It was “always inevitable” that Brexit would have an impact on UK trade with the rest of Europe, chancellor Rishi Sunak has admitted.