The UK will not be allowed to leave the EU without a deal at any point, Defence Minister Tobias Ellwood has suggested.