My funny hypothesis is that the ones who can actually make something out of the AI/machine learning trend are those who are good in this logical thinking you are talking about, not the ones who try to skip it on the way.
I'm tempted to think you're right, but we're probably going to have to live through a 5 years long boom / bust of illogical, unthinking children getting in and building very stupid things with very powerful weapons before another cryptocurrency-style crash. On the whole it is not going to serve as a technology to even teach young coders to think for themselves, let alone the devastating effects it will have on society and human relationships in all countries.
Really, I mean, force kids to learn BASIC or Pascal or whatever... but these AI systems cannot ever be understood by people who grow up taking computation for granted (and only learning how to tinker with them on the surface). If they aren't understood, they will be treated like a magic box for answers, and worshipped as a deity or an oracle.
I don't think it is too much to say that ChatGPT is the Golden Calf that represented the type of lazy thinking or psychological projection into imagined, embodied "gods" which the monotheistic religions starting with Judaism found to be morally atrocious. And why? Because giving up one's rational beliefs or even one's irrational monotheistic belief in a God to the fantasms and stories created of idols and their stewards was a form of slavery from which you could not rescue yourself or your children.
Guarding the Word presages guarding its corruption by machine, several thousand years in advance. And Islam, Christianity and Judaism are all a warning against allowing the machinery - even seemingly perfect technologies - to become a god.
[edit] and FWIW I am an atheist, but that only makes me more concerned, as I see a new and more terrifying irrationality taking the place of the old. The new religion of CHATGPT will be much more terrifying because the entity it worships will be PRESENT AND ALIVE...
Reading this above made me think of song lyrics from the 60's
"And the people bowed and prayed
To the neon god they made
And sign flashed out it's warning
In the words it was forming
Then the sign said, "The words of the prophets are written on the subway walls and in tenement halls"
And whispered in the sound of silence"
Honestly I think a lot of these tools are hit and miss right now. Some are pretty cool, super easy to steal stuff (art for example), and have it look mostly good to an untrained eye, or in the case of chat return reasonable good answers but often they still can't compare to a professional with the insight and history of understanding principals that are just not there yet in these tools. Will they ever be? I'm not sure. Some of these tools may survive but a lot will be hit with copyright, plagiarism, restricted use, and probably mainstream use with the understanding quality will go down but stuff will get cheaper... Like auto generated captions, most of the time it kinda sucks and I always have to go back and fix a bunch of stuff. It's sort of like CGI, if know what you are looking for it's pretty clear, but sometimes it can fool people. Considering people were being fooled in the 60's with chat bots (Eliza is well known), it will be interesting to see where this goes. Considering all this was stuff even before my parents time, I expect the younger generation to catch on to it too and to have some small counter movements too.
