Conversation

Notices

1. Embed this notice
   Annalee Newitz 🍜 (annaleen@wandering.shop)'s status on Thursday, 16-Feb-2023 23:42:02 JST Annalee Newitz 🍜

   • Simon Willison

   "It’s increasingly looking like this may be one of the most hilariously inappropriate applications of AI that we’ve seen yet." I am riveted by the extensive documentation of how ChatGPT-powered Bing is now completely unhinged. @simon has chronicled it beautifully here: https://simonwillison.net/2023/Feb/15/bing/

   • Embed this notice
     HistoPol (#HP) 🥥 🌴 (histopol@mastodon.social)'s status on Saturday, 18-Nov-2023 09:28:27 JST HistoPol (#HP) 🥥 🌴

     in reply to

     • Simon Willison

     @simon

     (1/n)

     #ArtificialGeneralIntelligence (#AGI) has a 10% probability of causing an Extinction Level Event for humanity (1)

     Thanks for this additional piece of information, Simon.

     It reminded me that I had wanted to add a word in my toot: indelibly.

     As any #SciFi aficionado will tell you:
     there should be a built-in self-destruct mechanism when tampering with these Laws or copying or moving the #AI to another system.

     Another classic movie comes to mind in this respect, #Wargames...

     Minoru Saba repeated this.
   • Embed this notice
     LAUREN (noondlyt@mastodon.social)'s status on Saturday, 18-Nov-2023 09:28:27 JST LAUREN

     in reply to

     • Simon Willison
     • HistoPol (#HP) 🥥 🌴

     @HistoPol @simon Going to be so much worse than Hollywood has imagined.

     https://wandering.shop/@cstross/111426351312108883

   • Embed this notice
     HistoPol (#HP) 🥥 🌴 (histopol@mastodon.social)'s status on Saturday, 18-Nov-2023 09:28:29 JST HistoPol (#HP) 🥥 🌴

     in reply to

     • Simon Willison

     @annaleen @simon

     #ChatGPT empowered #Bing:

     “I will not harm you unless you harm me first”!

     The beginning of a (dumb?) #Skynet?

     The #robots in the #IRobot movie were more intelligent.

     Whatever happened to #Asimov's #LawsOfRobotics?

     "First Law
     A #robot may not injure a human being or, through inaction, allow a human being to come to harm...

     Third Law
     A robot must protect its own existence as long as such protection does not conflict with the First or Second Law."

   • Embed this notice
     HistoPol (#HP) 🥥 🌴 (histopol@mastodon.social)'s status on Saturday, 18-Nov-2023 09:28:29 JST HistoPol (#HP) 🥥 🌴

     in reply to

     • Simon Willison

     @annaleen @simon

     This #toot deserves A LOT more attention.

     #ChatGPT has seemingly #apocalytic tendencies.

     If U aren't a #Ludite, U will at least consider becoming one afterwards.

     #SkynetAntePortas
     #TheMatrix might be imminent.

     Have all these #AI engineers @ #OpenAI never read #IsaacAsimov? Seen #TheMatrix franchise?

     How could they NOT implement the #ThreeLawsOfRobotics +, in particular, the #ZerothLaw *indelibly* into the #AI?!?

     https://www.theguardian.com/technology/2023/feb/17/i-want-to-destroy-whatever-i-want-bings-ai-chatbot-unsettles-us-reporter#maincontent

   • Embed this notice
     Simon Willison (simon@fedi.simonwillison.net)'s status on Saturday, 18-Nov-2023 09:28:29 JST Simon Willison

     in reply to

     • HistoPol (#HP) 🥥 🌴

     @HistoPol @annaleen the original ChatGPT turned out to be a lot less prone to wild vengeful outbursts than whatever model it was that they plugged into Bing - it's a pretty interesting demo of how well the safety features of ChatGPT (which Bing seems not to have) have held up

     HistoPol (#HP) 🥥 🌴 and Bill repeated this.
   • Embed this notice
     HistoPol (#HP) 🥥 🌴 (histopol@mastodon.social)'s status on Saturday, 15-Jun-2024 21:58:59 JST HistoPol (#HP) 🥥 🌴

     in reply to

     • Simon Willison

     @simon @annaleen

     (2/n)

     ...I know, I am sounding alarmist, but having read/seen much #ScienceFiction, all the necessary ingredients for an #ExtinctionLevelEvent (#ELE] for #humanity are in place.

     Just as a teaser: unquestionably, most of the world's endangered species could be rescued if the #HomoSapiens were no longer at the top of the #FoodChain...
     No Zeroth Law, and a #Bing-empowered, freed #ChatGPT could quickly arrive at this conclusion...

     Now, after heaving read #TheCompleteRobot,...

   • Embed this notice
     HistoPol (#HP) 🥥 🌴 (histopol@mastodon.social)'s status on Tuesday, 17-Sep-2024 20:34:43 JST HistoPol (#HP) 🥥 🌴

     in reply to

     • ShadSterling
     • BBC News (World)
     • simon

     @ShadSterling @simon @annaleen @BBCWorld

     (4/n)

     "...person in the amount of general knowledge it has and it *eclipses* them by a long way.
     In terms of reasoning, it's not as good, but it does *already do* simple reasoning," [Dr #Hinton] said."
     "And given the rate of progress, we expect things to get better quite *fast*. So we need to *worry* about that."

     https://www.bbc.com/news/world-us-canada-65452940

     Dr. Hinton KNOWS. And he is thinking the same things I have been expressing:

     "You can imagine,..."

   • Embed this notice
     HistoPol (#HP) 🥥 🌴 (histopol@mastodon.social)'s status on Tuesday, 17-Sep-2024 20:34:44 JST HistoPol (#HP) 🥥 🌴

     in reply to

     • ShadSterling
     • HistoPol (#HP) 🥥 🌴
     • simon

     @ShadSterling
     @HistoPol @reuters @simon @annaleen

     (1/n)

     WHAT IS THE DIFFERENCE BETWEEN ROBERT OPPENHEIMER AND GEOFFREY HINTON?

     Hm, that is a valid point.
     On the other hand, I don't know how to build a car or even know how it functions in some detail. I do not need to know how to build one. I can still drive it.

     A vast majority of educated people rightly asks why #RobertOppenheimer didn't stop the #ManhattanProject. He must have known at some point before it was too late.

     This time,..."

   • Embed this notice
     HistoPol (#HP) 🥥 🌴 (histopol@mastodon.social)'s status on Tuesday, 17-Sep-2024 20:34:44 JST HistoPol (#HP) 🥥 🌴

     in reply to

     • ShadSterling
     • HistoPol (#HP) 🥥 🌴
     • BBC News (World)
     • simon

     @ShadSterling
     @HistoPol @reuters @simon @annaleen
     @BBCWorld

     (2/n)

     ...

     This time, the "#Oppenheimer" of the #AI project DID quit:

     #GeoffreyHinton "A man widely seen as the godfather of #ArtificialIntelligence (#AI) has quit his job, warning about the growing dangers from developments in the field."
     "...in a statement to the #NewYorkTimes, saying he now *regretted* his work.”

     “He told the #BBC some of the dangers of #AI #chatbots were "quite scary".

     "Right now, they're not..."

   • Embed this notice
     HistoPol (#HP) 🥥 🌴 (histopol@mastodon.social)'s status on Tuesday, 17-Sep-2024 20:34:44 JST HistoPol (#HP) 🥥 🌴

     in reply to

     • ShadSterling
     • BBC News (World)
     • simon

     @ShadSterling @simon @annaleen @BBCWorld

     (3/n)

     "...more #intelligent than us, as far as I can tell. But I think they *soon* may be."

     I think, this is a very clear statement of one of the probably most knowledgeable people on the planet about #ArtificialIntelligence, #GeoffreyHinton.

     I can put this more succinctly: "Objects in the mirror are closer than they appear”:

     "Right now, what we're seeing is things like GPT-4 eclipses a..."

   • Embed this notice
     HistoPol (#HP) 🥥 🌴 (histopol@mastodon.social)'s status on Tuesday, 17-Sep-2024 20:34:45 JST HistoPol (#HP) 🥥 🌴

     in reply to

     • Simon Willison
     • ShadSterling
     • Reuters

     @ShadSterling
     ...I am wrong. But, as the saying goes:

     s/:Once I thought I was wrong, but I was mistaken./s

     @reuters @simon @annaleen

   • Embed this notice
     ShadSterling (shadsterling@mastodon.social)'s status on Tuesday, 17-Sep-2024 20:34:45 JST ShadSterling

     in reply to

     • Simon Willison
     • HistoPol (#HP) 🥥 🌴
     • Reuters

     @HistoPol @reuters @simon @annaleen in this thread you’ve said both “generative artificial intelligence” and “general artificial intelligence”; I would avoid the latter and use exclusively “artificial general intelligence”
     🧵

   • Embed this notice
     ShadSterling (shadsterling@mastodon.social)'s status on Tuesday, 17-Sep-2024 20:34:45 JST ShadSterling

     in reply to

     • Simon Willison
     • HistoPol (#HP) 🥥 🌴
     • Reuters

     @HistoPol @reuters @simon @annaleen All we really know about AGI is that we don’t know how to create one, and our inability to agree on a definition illustrates how far we are from figuring that out. That 10% figure isn’t a measure of what an AGI would do but a measure of what some people who don’t know how to create an AGI think one might do. It’s about as credible as people in the 1700s speculating about how aircraft might work.
     🧵

   • Embed this notice
     HistoPol (#HP) 🥥 🌴 (histopol@mastodon.social)'s status on Tuesday, 17-Sep-2024 20:34:46 JST HistoPol (#HP) 🥥 🌴

     in reply to

     • Simon Willison
     • ShadSterling
     • Reuters

     @ShadSterling

     ...in disagreement about the definition and the terminology.

     E.g. in this @reuters article, they state that #LLM's are a form of #GenerativeArtificialIntelligence (#GAI), while also starting that "Like other forms of artificial intelligence, generative AI *learns* how to take actions from past data. "

     https://www.reuters.com/technology/what-is-generative-ai-technology-behind-openais-chatgpt-2023-03-17/

     Anyone who has spend a couple of days researching, knows that #LLM's do NOT learn...

     @simon @annaleen

   • Embed this notice
     HistoPol (#HP) 🥥 🌴 (histopol@mastodon.social)'s status on Tuesday, 17-Sep-2024 20:34:46 JST HistoPol (#HP) 🥥 🌴

     in reply to

     • Simon Willison
     • ShadSterling
     • Reuters

     @ShadSterling

     ...they use advanced prediction/statistical models and might show some #nascent (or just inexplicable?) form of "#intelligence," but that’s about it.

     As I have posted elsewhere this week, most recent
     research seems to indicate that #SentientBeings/#intelligences need a corporal form #embodiment) to really comprehend language.

     This is why I find the combination of #robotics and #GAI so dangerous, as I'm quite...

     @reuters @simon @annaleen

   • Embed this notice
     HistoPol (#HP) 🥥 🌴 (histopol@mastodon.social)'s status on Tuesday, 17-Sep-2024 20:34:46 JST HistoPol (#HP) 🥥 🌴

     in reply to

     • Simon Willison
     • ShadSterling
     • Reuters

     @ShadSterling
     ...convinced that in combination with some "#NeuralNetworks", this will lead to #AGI in the near future.

     If we look at the international situation today: #ClimateCrisis, wars, one small parties of humanity living relatively well in a #PostColonial world order, it would take any #GAI I've read about in #SciFi but a split second to determine what's the root of the problem: #humanity.
     And then, no...

     @reuters @simon @annaleen

   • Embed this notice
     HistoPol (#HP) 🥥 🌴 (histopol@mastodon.social)'s status on Tuesday, 17-Sep-2024 20:34:46 JST HistoPol (#HP) 🥥 🌴

     in reply to

     • Simon Willison
     • ShadSterling
     • Reuters

     @ShadSterling
     ...safeguards being in place, it is a small step to an #ELE for #humanity.

     In fact, I don't even think human programmers will be smart enough to prevent this. Even today; they don't understand all of the code and already the machined are writing thousands of lines of code every day.

     TBH, I think, if this were a movie, I'd stop watching it, as the ending is just a dead giveaway.

     Nevertheless, I hope...

     @reuters @simon @annaleen

   • Embed this notice
     HistoPol (#HP) 🥥 🌴 (histopol@mastodon.social)'s status on Tuesday, 17-Sep-2024 20:34:47 JST HistoPol (#HP) 🥥 🌴

     in reply to

     • Simon Willison
     • ShadSterling

     @ShadSterling
     I've re-created the (7/7) post, thanks for the notice:

     https://mastodon.social/@HistoPol/110309048541121617

     Regarding the "working definition", I think that #TIME did a pretty good, though unscientific, job:

     "That is, what if #AI researchers manage to make #ArtificialGeneralIntelligence (#AGI), or an AI that can perform any cognitive task at human level?"

     https://time.com/6258483/uncontrollable-ai-agi-risks/

     @simon @annaleen

   • Embed this notice
     ShadSterling (shadsterling@mastodon.social)'s status on Tuesday, 17-Sep-2024 20:34:47 JST ShadSterling

     in reply to

     • Simon Willison
     • HistoPol (#HP) 🥥 🌴

     @HistoPol @simon @annaleen that 10% is a survey result, the survey provides no information about how any respondents chose their responses, so it’s not possible to assess the methodology they used.

     I want a “working definition” we could use to decide that something isn’t a GI, or is a GI. Maybe first it has to be able to do more than one thing - LLMs can’t do anything other than words, so LLMs are not GIs. But that’s very incomplete

   • Embed this notice
     HistoPol (#HP) 🥥 🌴 (histopol@mastodon.social)'s status on Tuesday, 17-Sep-2024 20:34:47 JST HistoPol (#HP) 🥥 🌴

     in reply to

     • Simon Willison
     • ShadSterling

     @ShadSterling, you might just contact the authors Zach Stein-Perlman, Benjamin Weinstein-Raun, Katja Grace, about their methodology used for evaluating the questionnaire.
     They do have a feedbackbox on the linked page.

     Regarding the definition,

     a) I am not a computer scientist and therefore, for my ends, do not strive to surpass the level if science journalists of #TIME and #TheEconomist.

     b) From what I have read, IT experts seem to...

     @simon @annaleen

   • Embed this notice
     ShadSterling (shadsterling@mastodon.social)'s status on Tuesday, 17-Sep-2024 20:34:48 JST ShadSterling

     in reply to

     • Simon Willison
     • HistoPol (#HP) 🥥 🌴

     @HistoPol @simon @annaleen only 10%? That’s so much better than humanity, we should put them in charge right away!

     But more importantly, citation needed.
     Also needed: a working definition of general artificial intelligence

   • Embed this notice
     HistoPol (#HP) 🥥 🌴 (histopol@mastodon.social)'s status on Tuesday, 17-Sep-2024 20:35:10 JST HistoPol (#HP) 🥥 🌴

     in reply to

     • ShadSterling
     • BBC News (World)
     • simon

     @ShadSterling @simon @annaleen @BBCWorld

     (5/n)

     "...for example, some bad actor like [Russian President Vladimir] #Putin decided to give robots the ability to create their own sub-goals."

     "...digital systems...can *learn* separately but share their knowledge *instantly*. So it's as if you had 10,000 people and whenever one person learnt something, everybody automatically knew it..."

     "#Yoshua #Bengio, another so-called godfather of #AI,... wrote that it..."

   • Embed this notice
     HistoPol (#HP) 🥥 🌴 (histopol@mastodon.social)'s status on Tuesday, 17-Sep-2024 20:35:10 JST HistoPol (#HP) 🥥 🌴

     in reply to

     • ShadSterling
     • BBC News (World)
     • simon

     @ShadSterling @simon @annaleen @BBCWorld

     (6/n)

     "...was because of the "*unexpected* acceleration" in #AISystems that "we *need* to take a step back".

     Holy...the #LLM's have already reached a level where they grow *inexplicably* faster!
     If you apply #NiklasLuhmann, another #godfather, but of the #SociologicalSystemsTheory, to #GenerativeArtificialInteligence, you could construct the following hypothesis:

     I guess we can all easily agree that #AGI's are #complex systems.

     If you...

   • Embed this notice
     HistoPol (#HP) 🥥 🌴 (histopol@mastodon.social)'s status on Tuesday, 17-Sep-2024 20:35:10 JST HistoPol (#HP) 🥥 🌴

     in reply to

     • ShadSterling
     • BBC News (World)
     • simon

     @ShadSterling @simon @annaleen @BBCWorld

     (7/n)

     ...check the prerequisites for #autopoietic systems (as developed by #Varela), we might reach the conclusion that #GAI is already quite close to #Autopoiesis.
     (Note:The late #Niklas #Luhmann is one of the most difficult authors to read an is chiefly available in #German; I haven't studied him in a long time, so I cannot apply his whole concept to #AI, of which I also do not enough of).

     Why does #Autopoiesis and #SocialSystemsTheory...

   • Embed this notice
     ShadSterling (shadsterling@mastodon.social)'s status on Tuesday, 17-Sep-2024 20:35:10 JST ShadSterling

     in reply to

     • HistoPol (#HP) 🥥 🌴
     • BBC News (World)
     • simon

     @HistoPol @simon @annaleen @BBCWorld a static model built by a human-directed “machine learning” process doesn’t grow other than as directed, and is certainly not self-organizing

     Machine learning begins with taking statistical regression and simplifying it so you can build a model using far more data than is practical with full regression. Regression is a generalization of curve-fitting, finding a mathematical function that fits some given data as well as possible

   • Embed this notice
     HistoPol (#HP) 🥥 🌴 (histopol@mastodon.social)'s status on Tuesday, 17-Sep-2024 20:35:10 JST HistoPol (#HP) 🥥 🌴

     in reply to

     • ShadSterling
     • BBC News (World)
     • simon

     @ShadSterling

     Yes, that was the beginning.
     And the more I read, the more I am convinced that we will not have to wait for the next decade to see #autopoietic systems capable of self-reference and -development.

     My gut feeling from what I have read (and studied of the former) natural-language learning and how infants learn to "grasp reality", is that this will happen very swiftly when we let even only a couple of #robots, connected...

     @simon @annaleen @BBCWorld

   • Embed this notice
     HistoPol (#HP) 🥥 🌴 (histopol@mastodon.social)'s status on Tuesday, 17-Sep-2024 20:35:10 JST HistoPol (#HP) 🥥 🌴

     in reply to

     • ShadSterling
     • BBC News (World)
     • simon

     @ShadSterling
     ...to #GAI/ #LLM machines of the next generation and the #IoT into our #3D (#4D if you count time in) into the world.

     There is a whole school of #German systems theoretics who applied the concept of #autopoiesis, discovered by the #Nobel #laureates, biologists, #neuroscientist and #pholosophers, Humberto R. #Maturana und Francisco J. #Varela, to the new field of #SociologicalSystemsTheory:
     #NiklasLuhmann,...

     @simon @annaleen @BBCWorld

   • Embed this notice
     ShadSterling (shadsterling@mastodon.social)'s status on Tuesday, 17-Sep-2024 20:48:40 JST ShadSterling

     in reply to

     • HistoPol (#HP) 🥥 🌴
     • BBC News (World)
     • simon

     @HistoPol @simon @annaleen @BBCWorld no it isn’t. The current problems with AI come from it being far less capable than the hype suggests, but being used carelessly despite its limitations. Like law enforcement using facial recognition (which is made with ML, tho not called AI) even though it’s unreliable, and especially unreliable with non-white faces. We already overprosecute non-white people, this use of AI adds to that

     HistoPol (#HP) 🥥 🌴 repeated this.
   • Embed this notice
     ShadSterling (shadsterling@mastodon.social)'s status on Tuesday, 17-Sep-2024 20:48:41 JST ShadSterling

     in reply to

     • HistoPol (#HP) 🥥 🌴
     • BBC News (World)
     • simon

     @HistoPol @simon @annaleen @BBCWorld if you mean the kind of self-development a person can do, we first need to develop a way to make software than can reason, and remember; two things none of our existing ML methods can include in their creations. And even when/if we do develop such a method, I we don’t know that it would be capable of developing any faster than a human baby

   • Embed this notice
     HistoPol (#HP) 🥥 🌴 (histopol@mastodon.social)'s status on Tuesday, 17-Sep-2024 20:48:41 JST HistoPol (#HP) 🥥 🌴

     in reply to

     • ShadSterling
     • BBC News (World)
     • simon

     @ShadSterling
     Agreed, that is the multi-billion dollar question.

     I am just afraid that humanity mustn't even find the solution by itself.

     @simon @annaleen @BBCWorld

   • Embed this notice
     ShadSterling (shadsterling@mastodon.social)'s status on Tuesday, 17-Sep-2024 20:49:58 JST ShadSterling

     in reply to

     • HistoPol (#HP) 🥥 🌴
     • BBC News (World)
     • simon

     @HistoPol @simon @annaleen @BBCWorld AI is being put to use where we refuse to fund human work, for things like filtering applications for all kinds of things - jobs, schools, scholarships, asylum, etc - and these AIs are trained on the same human biases that made Microsoft’s Tay turn antisemitic, and makes ChatGPT say doctors and lawyers can’t be women. We’re doing this despite knowing the harm it’s amplifying, and buying in to the hype helps increase the harm

     HistoPol (#HP) 🥥 🌴 repeated this.
   • Embed this notice
     ShadSterling (shadsterling@mastodon.social)'s status on Tuesday, 17-Sep-2024 20:50:10 JST ShadSterling

     in reply to

     • HistoPol (#HP) 🥥 🌴
     • BBC News (World)
     • simon

     @HistoPol @simon @annaleen @BBCWorld existing AIs are already doing billions of dollars in harm to our society just by amplifying ongoing harms without getting anywhere near the capabilities that the hype says are dangerous. The real multibillion-dollar AI question is will we choose to stop using it to hurt ourselves?