PM admits talks are not even taking place and plays down hopes from Brexiters that they could start ‘in the short to medium term’.