A former Tory Prime Minister is set to join an election rally aimed at preventing Boris Johnson from winning a Commons majority.