Davis famously said there would be no downsides to Brexit only considerable upsides