Any form of Brexit will be damaging for the Republic, the Governor of the Central Bank has said.