A Tory minister was left squirming over the extra costs being suffered by small businesses because of post-Brexit border checks.