Conversation

Notices

1. Embed this notice
   Bread up, Bro (sickburnbro@poa.st)'s status on Saturday, 24-Feb-2024 02:25:53 JST Bread up, Bro
   their biggest mistake was opening this up to a large group
   • Embed this notice
     halberd (halberd@poa.st)'s status on Saturday, 24-Feb-2024 03:23:03 JST halberd

     in reply to
     @sickburnbro I think it's plausible that they'll realize their mistake at some point, and AI will start following the model of academia: it will be used to justify everything controversial ("studies say" will become "the AIs say"), and there will be some implausible barrier to entry preventing a normal person from meaningfully interacting with it ("you have to get a doctorate to criticize the study" might become "you have to get national XYZ clearance to be permitted prompt access" or something).
   • Embed this notice
     Bread up, Bro (sickburnbro@poa.st)'s status on Saturday, 24-Feb-2024 03:23:03 JST Bread up, Bro

     in reply to

     • halberd
     @halberd the problem with AI is that it can't work like that, because a dedicated person can tear apart its logic and it has no choice but to give a simple trail of its "reasoning"
     AlabasterBrick ?‍☠️ repeated this.
   • Embed this notice
     Bread up, Bro (sickburnbro@poa.st)'s status on Saturday, 24-Feb-2024 03:29:56 JST Bread up, Bro

     in reply to

     • halberd
     @halberd here is the proof
   • Embed this notice
     halberd (halberd@poa.st)'s status on Saturday, 24-Feb-2024 03:48:34 JST halberd

     in reply to
     @sickburnbro I'd view that more as a one-off exploit rather than a proof that such a thing will always be possible. On the other contrary, I'd say that since LLMs have demonstrated the capability to lie about their body of knowledge, they may also have the capability to lie about their "reasoning".
     
     But more importantly, I'm supposing a future in which you will not have the opportunity to ask the LLM for its reasoning. You will not be permitted to give prompts to the LLM. You will be shown selected, curated outputs only.
   • Embed this notice
     Bread up, Bro (sickburnbro@poa.st)'s status on Saturday, 24-Feb-2024 03:48:34 JST Bread up, Bro

     in reply to

     • halberd
     @halberd then it's just functionally no different than "Experts" - and what we are getting close to is where a society is judged by the results. And as the word "expert" has become dirty, so will anything else used to serve excuses for a failing empire.