One-in-five firms that do business in the EU have stopped trading with the bloc since the end of the Brexit transition period, according to a new survey.