It's actually not that different than talking with employees, however, the LLMs still have very significant shortfalls (which you know about after using them a lot.)

If a manager doesn't know anything about what their employees are working on, they are basically fucked. That much holds up with LLMs. The simple stuff mostly works, but the complex stuff isn't going to pan out for you, and it will take a while to figure out that's the direction you went in.