I seem to remember that there was a suicidal teen that was getting instructions from Chatgpt on how to properly end themselves, ie. how not to alert the parents.