Three million of them are unlikely to pitch up here, but government must plan for all eventualities – and support for its plan wouldn’t survive a mass influx.