Polling suggests the vast majority of people believe the split with the EU isn't going well - a fact being ignored by mainstream political parties.