Organisations who help people with disabilities to work warned as far back as 2019 there was a "lack of detail" about what would replace EU funding.