Given that the task has been under time pressure, I am not sure this study helps gauging the impact of LLMs in other contexts.
When my goal is to produce the result for a specific short term task - I maximize tool usage.
When my goal is to improve my personal skills - I use the LLM tooling differently optimizing for long(er) term learning.
You are reading on HN. You are probably more aware about the advantages and shortcomings of LLMs. You are not a casual user. And that's the problem with our echo chamber here.
Given that the task has been under time pressure, I am not sure this study helps gauging the impact of LLMs in other contexts.
When my goal is to produce the result for a specific short term task - I maximize tool usage.
When my goal is to improve my personal skills - I use the LLM tooling differently optimizing for long(er) term learning.