The number of adults participating in government-funded further education and skills training has dropped dramatically, according to a report by a parliamentary committee.