An SNP MP has said there is “no way to polish that jobbie” at a rally in Edinburgh marking three years since the UK left the EU.