I find this analogy harder to understand. What am I hiring the mathematician to do in this example?

Research mathematics.

Do you get paid to do research or is there a deliverable at the end?

Yes, you get paid to do research and there are theorems delivered. Just like software projects, some never get delivered and you don't know when if they're not trivial.