GNU social JP
  • FAQ
  • Login
GNU social JPは日本のGNU socialサーバーです。
Usage/ToS/admin/test/Pleroma FE
  • Public

    • Public
    • Network
    • Groups
    • Featured
    • Popular
    • People

Embed Notice

HTML Code

Corresponding Notice

  1. Embed this notice
    snap (snappler@poa.st)'s status on Thursday, 30-Jan-2025 16:53:02 JSTsnapsnap
    in reply to
    • :ihavenomouth:
    • Chinese man ? #nobot
    • Rusty Crab
    • PopulistRight
    @IAMAL_PHARIUS @PopulistRight @RustyCrab @Inginsub tomshardware.com/tech-industry/artificial-intelligence/deepseeks-ai-breakthrough-bypasses-industry-standard-cuda-uses-assembly-like-ptx-programming-instead

    Here's the article about that. CUDA isn't really something you need to jailbreak past so much as it is a handy supplied library from Nvidia for interfacing with the hardware. PTX is basically just doing a lower level form of programming instead of using CUDA so they can write more efficient functions that are potentially more tailor to their workloads.

    This is sort of like writing your own lighting/ambient occlusion/whatever shader for a video game because the one that comes with the game engine doesn't necessarily work as efficiently as you want or lacks features you'd like to implement. Stuff like that. Nothing too spicy and I would hope the engineers at Meta and OAI and so on are doing similar things but given their card fleet size and likely hardware turnover, they may not. Stuff like that CAN be very fragile between GPU board revisions, driver updates, and different generations of cards so they can be a pain to keep working.
    In conversationabout 5 months ago from poa.stpermalink

    Attachments

    1. Domain not in remote thumbnail source whitelist: cdn.mos.cms.futurecdn.net
      DeepSeek's AI breakthrough bypasses industry-standard CUDA for some functions, uses Nvidia's assembly-like PTX programming instead
      Dramatic optimizations do not come easy.
  • Help
  • About
  • FAQ
  • TOS
  • Privacy
  • Source
  • Version
  • Contact

GNU social JP is a social network, courtesy of GNU social JP管理人. It runs on GNU social, version 2.0.2-dev, available under the GNU Affero General Public License.

Creative Commons Attribution 3.0 All GNU social JP content and data are available under the Creative Commons Attribution 3.0 license.