Two in five firms that trade with the EU expect to see a fall in business compared to before the coronavirus crisis, a new study suggests.