Responsibility for the Northern Ireland part of the Brexit deal lies "fairly and squarely with the UK government", a former top Stormont civil servant has said.