Marks & Spencer chairman Archie Norman is just the latest business figure to speak out on the Tories' handling of Brexit.