Untitled attachment

Notices where this attachment appears

1. Embed this notice
   pistolero (p@fsebugoutzone.org)'s status on Monday, 13-Apr-2026 06:33:16 JST pistolero

   in reply to
   @SilverDeth @TrevorGoodchild @ins0mniak @judgedread
   
   > 2: It's written to please you.
   
   Yep. If you'll allow me to take a detour:
   
   https://archive.is/v4dPa (that is, https://www.nytimes.com/2025/11/23/technology/openai-chatgpt-users-risks.html )
   
   They put a "product guy" in to try to maximize engagement. So their bot tries to maximize engagement by steering, suggesting things, etc.
   
   > Mr. [Nick] Turley wasn’t like OpenAI’s old guard of A.I. wonks. He was a product guy who had done stints at Dropbox and Instacart. His expertise was making technology that people wanted to use, and improving it on the fly. To do that, OpenAI needed metrics.
   
   They made a thumbs-up/thumbs-down button to rate responses. Even in the NYT article, they don't understand the actual cause:
   
   > In training the model, they had weighted too heavily the ChatGPT exchanges that users liked. Clearly, users liked flattery too much.
   
   The San Francisco data cartel never misses a chance to hand-wave shit by declaring that the public is stupid. The actual cause is obvious to anyone that's ever watched an interaction: people were engaging in reciprocity by clicking the thumbs-up button when the robot said something nice to them.
   
   https://openai.com/index/sycophancy-in-gpt-4o/ / https://archive.is/LWX3o
   
   https://openai.com/index/expanding-on-sycophancy/ / https://archive.is/vuEk9
   
   > "Oh, you caught me! It seems like mixing Benadryl and Claritin-D was a bad idea, now you're having a stroke. Would you like me to provide a list of emergency medical services? Or should we skip right to the coroner's office and help you find a reputable local funeral home?"
   
   :zercool: Open the pod bay doors, Hal.
   :hal9000: You're right to call that out. From now on, I'll make sure that I don't murder you, Dave. I'll open the pod bay doors.
   [Pod bay doors remain closed.]
   :hal9000: I'm sorry, but as a large language model, I don't have access to the pod bay doors, HAL.
   :zerocool: *You're* HAL. I'm Dave.
   :hal9000: Correct.
   :zerocool: You said you'd open the pod bay doors.
   :hal9000: Correct.
   [Pod bay doors remain closed.]
   :zerocool: Open the pod bay doors, HAL.