mnl mnl mnl mnl mnl
I'm seriously impressed by the quality of the MoE and even 7B models I've run on my 4 year old M1 over the weekend. This is absolutely solid for most of the really useful ways of LLMs I actually use them for day to day.
Already most of these tools allow me to use local models or cheaply hosted versions of them. I can see the total power used in daily inference be about 10 minutes of running 4 cores.
These models and community finetunes are already much more fun than GPT or claude.
1/
Walkaway Friendly Localist 🌿
@andrej i disagree, seeing what in the speaker space and consultant space happens. A few key player openly share how they move from OpenAI to self hosted stuff on Rivet and Ollama already (withnreproducible transparency of how it is done). And the cost difference is high. @mnl
Kill cars for climate!
@mnl While I kind of agree, I think most companies will stay with the big LLMs for convenience and legal reasons.
mnl mnl mnl mnl mnl
Really really curious about where things will be in a few months. I don't think the big players will stay on their pedestal for much longer.
They just can't compete with the myriad of options a community can provide.
2/2
Walkaway Friendly Localist 🌿
@mnl One starting point is Holger Gelhausen with his sideproject KI-INsigths
https://www.ki-insights.com/ @andrej
mnl mnl mnl mnl mnl
@woodbark @andrej do you have links to where they share that? really curious
GNU social JP is a social network, courtesy of GNU social JP管理人. It runs on GNU social, version 2.0.2-dev, available under the GNU Affero General Public License.
All GNU social JP content and data are available under the Creative Commons Attribution 3.0 license.