The Port of Dover has declared a "critical incident" due to five-hour queues leading to the ferry terminal and people are blaming Brexit.