Embed Notice
HTML Code
Corresponding Notice
- Embed this notice@shippoaster @IAMAL_PHARIUS @Codeki @Inginsub @PopulistRight @RustyCrab I got called a shill like ten years ago by simply explaining that a lot of NVidia's domination wasn't superior hardware in itself, but developer support. They offered and still offer easy libraries to lazy/burdened AAA game development teams that let the implement useful, flashy features with minimal friction and they also have TONS of people available to answer developer questions. AMD/ATI did not. So AMD languished and fell behind because their lower sales meant no ability to create impactful libraries or technologies that were cross platform. FSR has been their most successful one to date and it's very shit and the new FSR4 is AMD only, killing any momentum there. That's on the game side, but consumer ubiquity is important for being the defacto for a lot of data center uses. It's why Ryzen has been slow to enter the datacenter.
On the other side, the research/AI side, we have the problem of all the people being college educated morons who work in Python and don't actually code in the way any programmer or engineer thinks about it. This has infected a lot of things, but it came baked in with the researchers. That helped CUDA become defacto and made sure that anything that wasn't as easy and reliable just fell by the wayside because who is ordering 500 AMD cards to try to run whatever their half-working, 5x slower brand of CUDA is this week?
So here we are. No one really discussing custom hardware beyond Nvidia's lazy slapped together rackmounts, which barely count. In some ways, I don't blame them. I'm not suggesting they're doing it out of wisdom, but the idea that transformers are the end of the road is pretty premature, so purpose building hardware to catch the wave before it crashes is a good way to go bankrupt. BitNet's ternary architecture could be very valuable if it ever gets proven out. Could lead to very fast, very small models with relatively cheap custom hardware (one day).