Ex-justice secretary calls for people to ‘vote for the centre-ground’ to avoid hard Brexit.