As evidence mounts of the long-term harm being inflicted on the U.K. economy by Brexit, the government is coming under pressure to acknowledge the elephant in the room.