Conversation

Notices

1. Embed this notice
   Annika Backstrom (annika@xoxo.zone)'s status on Tuesday, 12-Aug-2025 15:02:54 JST Annika Backstrom

   Reading these chatbot logs gives me the heebie jeebies. Grima Wormtongue as a service https://mastodon.social/@kashhill/115011576505782614

   • Embed this notice
     Annika Backstrom (annika@xoxo.zone)'s status on Tuesday, 12-Aug-2025 15:06:59 JST Annika Backstrom

     in reply to

     The chatbot made a bulleted list of the ways it harmed the user? We are living a nightmare

   • Embed this notice
     clarity flowers (clarity@xoxo.zone)'s status on Tuesday, 12-Aug-2025 15:18:52 JST clarity flowers

     in reply to

     @annika these bots talk like the midpoint between a linkedin influencer and a girl on a first date who is really desperate for my approval it’s so jarring and upsetting

   • Embed this notice
     Annika Backstrom (annika@xoxo.zone)'s status on Tuesday, 12-Aug-2025 18:57:25 JST Annika Backstrom

     in reply to

     • Mx Amber Alex (she/it)

     @amberage Sometimes it feels like we're better at anthropomorphising ChatGPT than we are at recognising the humanity of other actual humans

   • Embed this notice
     Mx Amber Alex (she/it) (amberage@eldritch.cafe)'s status on Tuesday, 12-Aug-2025 18:57:26 JST Mx Amber Alex (she/it)

     in reply to

     @annika though almost equally distressing is the constant low levle anthropomorphisation of ChatGPT etc. throughout these articles. Saying that "AI" (air quotes mine) should "detect and recognise" (or words to that effect) signs of mental health crises is absurd – ChatGPT can't recognise anything.

     Everything ChatGPT supposedly does, other than spew words, like saying it doesn't do dirty words or instructions for bombs? Those are almost certainly filters OpenAI programmed that exist separately from the model itself (or query–response pairs it's been trained on), it has no idea (because it can't) what any of that is about.

     Even the most critical journalism that most bluntly and extensively addresses LLM downsides still credits these models with more sentience than they have or ever can have.

   • Embed this notice
     Mx Amber Alex (she/it) (amberage@eldritch.cafe)'s status on Tuesday, 12-Aug-2025 18:57:27 JST Mx Amber Alex (she/it)

     in reply to

     @annika going down the rabbithole of articles about LLM psychosis (they all so helpfully link to one another!) and 😬 yikes