Former PM calls for ‘a little more charm, and a lot less cheap rhetoric’ and says public have been given unrealistic expectations.