$350 is pretty reasonable for a specialist on something like GPU optimization… For an application like machine learning, just 5–10 hours could save you a gigantic amount of money.

With that said, I would never hire this person in 1000 years, because of their attitude. There is no shortage of smart consultants out there, even for niches like bare metal GPU coding.