Five years on from the Brexit referendum people are still more likely to define themselves by which side they backed in 2016 rather than their party political allegiances, according to a Yorkshire academic.