The Government has abandoned a scheme to recruit British workers to help harvest fruit and vegetable crops, it is understood.