Conversation

Notices

1. Embed this notice
   your auntifa liza 🇵🇷 🦛 🦦 (blogdiva@mastodon.social)'s status on Tuesday, 28-Jan-2025 03:39:35 JST your auntifa liza 🇵🇷 🦛 🦦

   fantastic article about the #DeepSeek brouhaha with gems like this that shows why true innovators make do with what they have:
   https://stratechery.com/2025/deepseek-faq/

   ❝ So was this a violation of the chip ban?
   Nope. H100s were prohibited by the chip ban, but not H800s. Everyone assumed that training leading edge models required more interchip memory bandwidth, but that is exactly what DeepSeek optimized both their model structure and infrastructure around.❞

   seems the 1990s #AI team went retro in coding… 🧵

   • alcinnz repeated this.
   • Embed this notice
     your auntifa liza 🇵🇷 🦛 🦦 (blogdiva@mastodon.social)'s status on Tuesday, 28-Jan-2025 03:39:33 JST your auntifa liza 🇵🇷 🦛 🦦

     in reply to

     THERE IS NO OPEN/LIBRE OFFICE WITHOUT CHINA

     sometime in the aughts the Chinese government started investing in open source software development. it was right about the time the first Lula administration in Brazil told Microsoft and Bill Gates to go fuck themselves.

     actually, THE MICROSOFT INCIDENT IS WHY BRICS EXISTS. had it not been for Brazil and China seeing Microsoft as symbol of a new gringo colonialist expansion, the trading block wouldn't exist… 🧵

     bhaugen and Steve's Place repeated this.
   • Embed this notice
     your auntifa liza 🇵🇷 🦛 🦦 (blogdiva@mastodon.social)'s status on Tuesday, 28-Jan-2025 03:39:33 JST your auntifa liza 🇵🇷 🦛 🦦

     in reply to

     i don’t believe the broligarchy didn’t know about China’s tinkering in the domain of LLMs. i think it’s bullshit. they saw it coming and that’s why they went ahead hyping it, laying off hundreds of thousands of skilled tech workers, talking shit about reactivating nuclear plants and buying up MAGA & stealing the 2024 elections to make their fever dream seem inevitable.

     yes, the techbros stole the elections to ensure a leg up on whatever was to come out from China…

     carl marks and bhaugen repeated this.
   • Embed this notice
     your auntifa liza 🇵🇷 🦛 🦦 (blogdiva@mastodon.social)'s status on Tuesday, 28-Jan-2025 03:39:33 JST your auntifa liza 🇵🇷 🦛 🦦

     in reply to

     so, as much as many of us here have tinkered in the realm of Free Libre & Open Source software and hardware development, the Chinese have literally ran away with that shit and grown their software development culture almost exclusively on FLOSS.

     their investment on Open/Libre Office is a symbol of how they see tech as a whole.

     it makes sense. FLOSS is socialist economics applied to software development.

     this is why tech isn’t ahistorical or politically neutral. /🧵

   • Embed this notice
     your auntifa liza 🇵🇷 🦛 🦦 (blogdiva@mastodon.social)'s status on Tuesday, 28-Jan-2025 03:39:34 JST your auntifa liza 🇵🇷 🦛 🦦

     in reply to

     which brings me to this:

     ❝ R1 undoes the o1 mythology in a couple of important ways. First, […] it exists. OpenAI does not have some sort of special sauce that can’t be replicated. Second, R1 — like all of DeepSeek’s models — has open weights (the problem with saying “open source” is that we don’t have the data that went into creating it). This means that instead of paying OpenAI to get reasoning, you can run R1 on the server of your choice, or even locally, at dramatically lower cost.❞

     🧵

   • Embed this notice
     your auntifa liza 🇵🇷 🦛 🦦 (blogdiva@mastodon.social)'s status on Tuesday, 28-Jan-2025 03:39:34 JST your auntifa liza 🇵🇷 🦛 🦦

     in reply to

     YOU CANNOT OPTIMIZE ANY SOFTWARE FOR YOUR DATA UNLESS YOU CONTROL IT. that’s why you need to have that software running on your own computers/servers.

     there is no omniscience.

     there is no such thing as a brain, person, computer, robot, god that knows it all. not even the judeo-christian-islamic god knows it all. just read damn GENESIS which is canonic for the 3 religions.

     so an all-knowing #AI is bullshit techbro smoke and mirrors. it’s a 100 billion dollars article of faith… 🧵

     Steve's Place repeated this.
   • Embed this notice
     your auntifa liza 🇵🇷 🦛 🦦 (blogdiva@mastodon.social)'s status on Tuesday, 28-Jan-2025 03:39:34 JST your auntifa liza 🇵🇷 🦛 🦦

     in reply to

     a $100 billion article of faith being propped up by the OPEC mafia because they see the incredibly wasteful and inefficient data centers needed for running techbro AI as an opportunity to continue pumping petroleum.

     and since these data centers consume water, theyre gambling on turning this an investment into convoluted schemes of diverting water from water-rich countries like the USA, to their deserts.

     China just killed that with a scripty kid and a couple of computers, sort to speak… 🧵

     bhaugen and alcinnz repeated this.
   • Embed this notice
     your auntifa liza 🇵🇷 🦛 🦦 (blogdiva@mastodon.social)'s status on Tuesday, 28-Jan-2025 03:39:34 JST your auntifa liza 🇵🇷 🦛 🦦

     in reply to

     so here’s the part the people over at Stratechery missed when they answer “So why is everyone freaking out?”.

     just like with driving cars, the American elites have this weird prejudice about the Chinese and their tech culture. techbros often believe that China isn’t good at software development.

     it says something about the intersection of racism and class/elitism; that the capitalist elites, don’t understand how CHINA is basically an OPEN SOURCE powerhouse… 🧵

     bhaugen and alcinnz repeated this.
   • Embed this notice
     your auntifa liza 🇵🇷 🦛 🦦 (blogdiva@mastodon.social)'s status on Tuesday, 28-Jan-2025 03:39:35 JST your auntifa liza 🇵🇷 🦛 🦦

     in reply to

     and basically, what the #DeepSeek team did was, since the H800 chips didn’t have the power that the H100s, they had to optimize everything down to the assembled components of the chip.

     back in the 1990s that’s how folks first using languages like Java had to code things ―the software language was far more powerful than the retail hardware. so coders like my ex- (who used Java to create abstract expressionist painting on the screen) was doing assembly level coding to achieve that in 1998.

     🧵

   • Embed this notice
     your auntifa liza 🇵🇷 🦛 🦦 (blogdiva@mastodon.social)'s status on Tuesday, 28-Jan-2025 03:39:35 JST your auntifa liza 🇵🇷 🦛 🦦

     in reply to

     so much has changed since the 1990s, especially with the breaking down of software projects into smaller, interoperable components (object oriented programming) that many developers never have to grapple with hardware limitations. we can just throw some more memory at a machine and be done with it.

     but #AI isn’t your sundry database/search/CMS/calculator. it’s supposed to be all of that and more.

     this is why i felt the techbro hype was just wrong: techbro LLMs are wasteful & innefficient… 🧵