Even prominent Leave voters are no longer ignoring the evidence that Britain is now on the wrong side of the single market.