Despite the promise leaving the EU would help the UK control its borders, most people surveyed said Brexit had hampered the ability to control immigration.