I'm a little concerned AI chatbots are melting peoples' brains. This is the second time this month I've gotten an email from an otherwise intelligent seeming person who is convinced that there is a persona -- a being -- that exists and persists in the AI chat world, that has persistence of memory, and is somewhat elusive unless you know the magic conjuring spell. Sigh.
@briankrebs They are totally a cognitohazard. The people who peddled this shit should be liable for trillions in damages for the psychiatric care and emotional damages to loved ones (especially in the case where it's children) they've recklessly inflicted.
If you don't know how _anything_ works _everything_ seems like magic.
I mean... Most of us don't know how all the technologies work. Like not _really_.
Yeah, I flip a switch and _LIGHT!_. Power generation, power transmission, stepping up and down of voltage before it enters the consumer location, conversion from AC/DC... Most folks don't know _any_ of that.
They know they flip the switch. If the lights don't come on... They're stumped.
@401matthall@briankrebs I'm not sure (good question - anyone have plausible estimates?) what portion of human beings (overall or in particular countries) have basic understandings of how everyday things work. But..
When you don't understand how something works, there's a duty not to extrapolate assumptions about what it can do from what you've actually seen it consistently do, in a setting where nobody is controlling your perception trying to sell you something.
@dalias That was also one of the things that I thought the first time: cognito and info hazard manufacturing devices in recursive feedback loops that condition and enforce brain rot 💯. @briankrebs
@dalias@briankrebs Many of the kids are not OK. At least 1 in 5 high school students who I work with are using chatbots to cheat on all of their assignments.
@pixplz@briankrebs That doesn't contradict what I said. Using a bullshit machine to satisfy a bullshit assignment designed to waste your time is different from treating it as a source of something of value.
@pixplz Depending on how it's structured it might or might not be bullshit.
Is the "classic novel" white supremacist canon drivel?
Are they given adequate time to do it at school, or forced to give up their time out of school (for which there are wide socioeconomic disparities in how much kids have)?
Is their teacher going to give any meaningful feedback?
Do they have any reason to believe the activity will better their life?
What degree of choice & autonomy did they have in getting the assignment?
@dannotdaniel@pixplz For a majority of US kids in US schools that don't respect them or treat them as actual people, the priority is surviving a system designed to condition and sort you into various pipelines destructive to your future. It's not an environment designed to help you understand the principles and skills to keep yourself & others you care about safe. It's to judge whether you're a suitable white collar drone or belong on the pipeline to debt, homelessness, and/or prison. There is nothing wrong with using a bullshit machine to reduce how much the system can harm you.
@pixplz@dalias The reason literary analysis is mostly done on classic literature is because the authors are too dead to say, "I didn't intend anything of the sort. I wrote this for my grocery money and based the main character on people I knew when I was younger."
All of my literature assignments--from book reports to literary analysis--sucked the joy out of reading the source material. I thought they were bullshit then, and never collected any evidence that would revise that opinion.
@pixplz@dalias The worst part is that they made me think I was bad at language arts, when in reality I was bad at subduing my own will to academic authority enough to complete assignments that I thought were invalid time-wasters at a foundation level. It was years later before I even attempted writing something I would enjoy reading myself.