Voters invested hope in the idea of leaving the EU. But a few years of queues and chaos could further erode public trust.