Even among people who voted Leave in 2016, just 61 per cent still think the policy will eventually turn out well.