A former Conservative minister touched on the personal impact of her opposition to Brexit, telling MPs: “I don’t care what that costs me.”