A UK farmer said he was worried about harvesting his crops because he does not know if can get enough workers.