The government has paid the owner of land being used as a Brexit lorry park in Ashford almost £6m in rent, it has emerged.