Company leaders said Brexit is one of their biggest concerns – with key issues being a lack of access to EU migrants.