Britons are counting the cost of Brexit as the combination of the referendum, pandemic and energy crisis takes its toll.