Industry leaders fear new entry restrictions and the UK’s tarnished image among some Europeans have caused a decline in EU visitors