Tories claim credit for fall in numbers as Labour continues push for cutting migration in wake of Starmer’s ‘island of strangers’ speech