The boss of Oxford Bus Company has said Brexit and Covid-19 are just some of reasons the business is struggling to hire drivers, as customers feel the impacts of delays.