I've been using it that way for weeks, but it doesn't work as one would imagine it does. It's great for the higher level drudgery (typing in boilerplate of loops, imports/includes, data type definitions and so on), and for getting the basics of libraries you're unfamiliar with working. But it doesn't have any idea of what APIs actually do, so sometimes it'll make completely nonsensical calls that are (usually) grammatically correct, but just don't do what you want. So those you have to hunt down and correct manually. As a tool for someone who can't program, I don't see this as useful. Nor for someone just learning to program (although I can imagine how it would feel useful and productive). You actually have to know very well how things work to be able to spot the mistakes it makes. If you're a new programmer, you don't have the instinct yet for how APIs generally work to be able to sniff out what's going wrong in an AI generated program. I mean, of course with enough effort anyone can get it to work, what I mean is that I don't think it really enhances productivity in such cases.

Like, yesterday it switched two variables around in a loop, and that was somewhat obscured by the iterators in those loops being Series objects (numpy/pandas code) and needing some extra call on them (.any() or .bool() or something like that). It sounds obvious but it was fairly subtle, and it only came out after carefully reasoning through the whole function (20 or 30 lines or so). Still, it saved me a bunch of drudgery and reading of a 'getting started' guide - it was a net win.