Mainstream UK parties should move on from immigration if they want to stop the Brexit architect from becoming prime minister.