Conversation

Notices

1. Embed this notice
   Mark Gritter (markgritter@mathstodon.xyz)'s status on Tuesday, 07-Jan-2025 10:53:42 JST Mark Gritter

   "Do not treat the generative AI as a rational being" Challenge

   Rating: impossible

   Asking a LLM bot to explain its reasoning, its creation, its training data, or even its prompt doesn't result in an output that means anything. LLMs do not have introspection. Getting the LLM to "admit" something embarrassing is not a win.

   • Embed this notice
     Paul Cantrell (inthehands@hachyderm.io)'s status on Tuesday, 07-Jan-2025 10:55:20 JST Paul Cantrell

     in reply to

     @markgritter
     No, really, look, I did it

   • Embed this notice
     Rich Felker (dalias@hachyderm.io)'s status on Tuesday, 07-Jan-2025 11:29:19 JST Rich Felker

     in reply to

     @markgritter You just wrote a prompt where the followup autocorrect text is admission-shaped.

   • Embed this notice
     Paul Cantrell (inthehands@hachyderm.io)'s status on Tuesday, 07-Jan-2025 14:05:15 JST Paul Cantrell

     in reply to

     @markgritter
     Yeah, it’s a sad fact of life that we don’t get to opt out of being human just because we know better.

   • Embed this notice
     Mark Gritter (markgritter@mathstodon.xyz)'s status on Tuesday, 07-Jan-2025 14:05:16 JST Mark Gritter

     in reply to

     • Paul Cantrell

     @inthehands OK, you are a person on the Internet (and also one I've met in real life) and I kind of want to argue with you whether or not you accomplished the challenge. :)

     But the tragedy here is that I have felt the same way about LLMs _even though_ I know that it is futile. Once you are chatting in a textbox some sort of magic takes over where we ascribe intentionality.