It's a Brexit myth that the public rejects freedom of movement; yet polling now suggests that Leave voters increasingly miss that very freedom.