Wow the leaked AI doc where Google says "hey actually, the open source community is gonna completely beat both us and OpenAI at this machine learning model thing and we should stop pretending that's anything but true" is kinda just amazing https://www.semianalysis.com/p/google-we-have-no-moat-and-neither
@22@cwebber this is so bizarre; where it gives specifics it mostly talks about threats from Stanford's Alpaca, but as far as I can tell it's based on a leaked copy of Facebook's proprietary "Llama" and has fairly restrictive licensing terms
where's the open source alternative they're talking about? it feels like they're using "open source" to mean something completely different
is anyone even bothering to address the fatal flaw of attribution?
@cwebber “While our models still hold a slight edge in terms of quality, the gap is closing astonishingly quickly. Open-source models are faster, more customizable, more private, and pound-for-pound more capable. They are doing things with $100 and 13B params that we struggle with at $10M and 540B. And they are doing so in weeks, not months. This has profound implications for us”