As with most important issues at the moment, the settlement of refugees in the UK is being overshadowed by Brexit.