@obrhoff This goes up all the way to institutional investors.
Just look at the tech sector: Even state pension funds / sovereign wealth funds invest overseas. One of the reasons they do invest in Europe is because of incentives or requirements they have to invest in local companies.
@ianthetechie@obrhoff@everydoor@zverik I believe the more interesting question is not technical but how can we build something that incentivizes the less nerdy folks to contribute to free and open geo data and/or the fediverse.
With nerdy apps such as StreetComplete or EveryDoor, or Mastodon or Pixelfed, we're still not getting the incentives working as e.g. Meta does: Most companies want an Instagram or Facebook account, simply because it's good for their business.
Not sure these small AI models are there yet in terms of quality / latency to run them offline. Especially when most folks don't have powerful GPUs in their dev laptops. Mac folks are probably best positioned here.
@obrhoff Ah that sucks. I can feel (!) it's getting worse, too, these days. But unless there are tents and needles on the streets and toilet paper getting thrown around, I would in no way compare it to SF / NY.
@obrhoff How is it comparable here in Berlin? Care to elaborate? Do you have numbers on this or is it just a feeling or perchance a hyperbolic mid-day rant? 🌝
@obrhoff Yeah the smaller distill models you can locally are great, too, it's just important to understand that you won't get the proper deepseek-r1 everyone is hyped about.
What models to pick for running locally depends on: What you can fit in memory, if you run on cpu or gpu, if you want to optimize for latency e.g. for interactive use cases, and what kind of quality output you're looking for.
Only the 671b / 404gb model is deepseek-r1 and most folks won't be able to run that locally.
All other variants are the qwen / llama distilled models. It's highly confusing that folks like ollama name them deepseek-r1. They're completely different models.
@obrhoff It's gonna be interesting what will happen to all these voluntary ESG initiatives and climate pledges at scale. Will they get cut similar to DEI initiatives and were they used for signalling only?
There's no accountability behind most of those voluntary climate pledges and in top they're in the way of pushing LLMs.
I expect lots of changes there with the new administration taking over and we're probably seeing just the beginning now.