> why would you want to let a LLM have any agentic interface to the real world though

The various arms race type dilemmas that actors face will create that outcome.

If you're a nation state not doing that, you'll lose to a nation state that does.

If you're a company not doing that, you'll lose to a company that does.

And if you were building "AI" hedge trimmers, why the hell would you think that an LLM was a sensible way to engineer them?

Thinks I need my hedge trimmers to do: trim hedges, avoid trimming things that are not hedges, manoeuvre within strict boundaries.

Things I don't need my hedge trimmers to be able to do: reply to me in iambic pentameter, turn articles into bullet points, pass a FizzBuzz test

Fantastic question, probably best-answered by these folks!

https://docs.innate.bot/docs.innate.bot

Usually, it's because people want to automate real-world tasks that they'd otherwise have to pay a person money to do, and they anticipate an LLM being capable of performing those tasks to an acceptable degree.