Conversation

Notices

1. Embed this notice
   Psentee (psentee@stolat.town)'s status on Sunday, 23-Mar-2025 20:11:17 JST Psentee

   • myrmepropagandist
   • wroong

   @wroong @futurebird
   > approximate what an interaction with a human can be if human is a sum of all written language and knowledge

   Wouldn’t sum of all written knowledge include understanding integer numbers to the point of being able to multiply two digit integers?

   Written knowlegde is still more than pattern matching and autocomplete. It’s not even written knowledge, it’s only shape of the written knowledge.

   • Jacek Wesołowski and Silver Huskey repeated this.
   • Embed this notice
     myrmepropagandist (futurebird@sauropods.win)'s status on Sunday, 23-Mar-2025 20:11:16 JST myrmepropagandist

     in reply to

     • wroong

     @psentee @wroong

     The statistical patterns of which words and phrases tend to "go together" isn't the same thing as the meaning of those words.

     Because of this, LLMs struggle with things like "What is the sum of seven and 3?"

     To an LLM, "seven" is more statically clustered with "forty" than it is with 10.

     It's possible to brute force these errors to be less frequent, but there is nothing in the way these systems are structured that processes counting or numbers as well as, say, a crow might.

     Silver Huskey repeated this.
   • Embed this notice
     Kevin Riggle (kevinriggle@ioc.exchange)'s status on Monday, 24-Mar-2025 02:00:59 JST Kevin Riggle

     in reply to

     • myrmepropagandist
     • wroong

     @futurebird @psentee @wroong We’ve spent billions of dollars and finally made computers worse at math