The former prime minister said that migrants are integral to "the way we live" before the referendum.