Sir Roger Gale said one firm has had to trash £320,000 worth of produce "because there are no pickers and no drivers".