One port operator has had to demolish building work for new checks, while other crucial customs sites do not even have planning permission yet.