Open AI to change way it responds to users in mental distress as parents of Adam Raine allege bot not safe
Adam, from California, killed himself in April after what his family’s lawyer called “months of encouragement from ChatGPT”. The teenager’s family is suing Open AI and its chief executive and co-founder, Sam Altman, alleging that the version of ChatGPT at that time, known as 4o, was “rushed to market … despite clear safety issues”.
The teenager discussed a method of suicide with ChatGPT on several occasions, including shortly before taking his own life. According to the filing in the superior court of the state of California for the county of San Francisco, ChatGPT guided him on whether his method of taking his own life would work.
It also offered to help him write a suicide note to his parents.
I thought that, too, but then I asked ChatGPT. It says it’s not a glorified autocomplete, and that I definitely should continue to have conversations with it.
You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: [email protected]
This is the official technology community of Lemmy.ml for all news related to creation and use of technology, and to facilitate civil, meaningful discussion around it.
Ask in DM before posting product reviews or ads. All such posts otherwise are subject to removal.
Rules:
1: All Lemmy rules apply
2: Do not post low effort posts
3: NEVER post naziped*gore stuff
4: Always post article URLs or their archived version URLs as sources, NOT screenshots. Help the blind users.
5: personal rants of Big Tech CEOs like Elon Musk are unwelcome (does not include posts about their companies affecting wide range of people)
6: no advertisement posts unless verified as legitimate and non-exploitative/non-consumerist
7: crypto related posts, unless essential, are disallowed
It’s a glorified autocomplete, people need to stop trying to have conversations with it :/
I thought that, too, but then I asked ChatGPT. It says it’s not a glorified autocomplete, and that I definitely should continue to have conversations with it.
That’s exactly what a glorified auto complete would want you the think.
Hmm. Interesting counterpoint. Let me go run it by ChatGPT real quick to see if it’s correct.
They don’t advertise it as a glorified autocomplete, but as an all-knowing God. Therefore it is still OpenAI’s fault.