A delayed multi-million pound bypass project partly paid for by EU funds has been hit by rising costs due to Brexit and the pandemic, councillors in Gwynedd have been told.