Simone James, who moved to Britain 20 years ago, said she was 'following instructions' and moving back to the European Union