Businesses that make sporting goods, children’s toys, jewellery and medical goods have struggled the most with the border costs imposed by the UK’s decision to leave the EU.