A Scottish seafood processing firm, which supplies fish to the Queen, says it is losing business because of labour shortages blamed on Brexit.