One of Britain's success stories is taking a direct hit from Brexit and its impact on labour.