Regarding AI *in* Firefox, this has brought us a built-in translator that does not outsource the work to the cloud. That's amazingly good work. I'd love to see the browser do more of that kind of thing. https://www.mozilla.org/en-US/firefox/features/translate/
@bert_hubert the general thrust of user controlled and open source "AI" is correct, but that doesnt mean such services should be crammed in a/the browser. For some time my thinking is that developing a proper decentralized algorithmic layer belongs to the #linux desktop where it can empower all user activities. Alas even basic search is not quite elevated to where it should be. Maybe now that the "AI cloud" brings a new iterations of every app, from spreadsheets to IDE's people will wake up.
@ptesarik@bert_hubert i'll use the cliche that we are not in Kansas anymore. There are several desktop knowledge management superapps that should have been on new path already: file managers, web browsers, editors/spreadsheets and IDE's. It makes no sense to squander resources going down silo approaches, not to mention that it prevents the serendipitous augmentation of other more specialized apps and use cases. Algorithms are here to stay, the only question is who will benefit.
@phiofx@bert_hubert I'm afraid people won't wake up. Developers of desktop environments might wake up, add something, and then applications will go out of their way to avoid the desktop service and instead use the one that's bundled with the application.
@bert_hubert you can get a surprising amount of mileage with local models with stuff like ggml, although it still consumes a consirable amount of hard drive space.
still, local AI is here now. now we just gotta get the people who train them to embrace sparsity so we can get building them cheaper too :ablobcatbongokeyboard: