The EU has insisted it was the UK government's choice to end visa-free touring for musicians on the continent, following an outcry from performers.