Town divided over migrant influx