{"generator":"GNU social 2.0.2-dev","title":"Conversation","totalItems":11,"items":[{"actor":{"id":"https:\/\/poa.st\/users\/striderpod","displayName":"<- ?? Striderpod ?? ->","status_net":{"avatarLinks":[{"url":"https:\/\/gnusocial.jp\/avatar\/7162-original-tmp20220825113654.webp","rel":"avatar","type":"image\/webp","width":441,"height":363},{"url":"https:\/\/gnusocial.jp\/avatar\/7162-96-20220825113654.webp","rel":"avatar","type":"image\/webp","width":96,"height":96},{"url":"https:\/\/gnusocial.jp\/avatar\/7162-48-20220825113654.webp","rel":"avatar","type":"image\/webp","width":48,"height":48},{"url":"https:\/\/gnusocial.jp\/avatar\/7162-24-20220825113654.webp","rel":"avatar","type":"image\/webp","width":24,"height":24}],"profile_info":{"local_id":"7162"}},"image":{"url":"https:\/\/gnusocial.jp\/avatar\/7162-96-20220825113654.webp","rel":"avatar","type":"image\/webp","width":96,"height":96},"objectType":"person","summary":"?? Terrible catholic. Worse poster. Frens only, pls. ??","url":"https:\/\/poa.st\/users\/striderpod","portablecontacts_net":{"preferredUsername":"striderpod","displayName":"<- ?? Striderpod ?? ->","note":"?? Terrible catholic. Worse poster. Frens only, pls. ??"}},"content":"So, how is it? What are your specs?","generator":{"id":"tag:gnusocial.jp,2026-07-06:notice-source:ActivityPub","objectType":"application","status_net":{"source_code":"ActivityPub"}},"id":"https:\/\/poa.st\/objects\/5982eb3f-67c7-456d-a953-c618c4963fc8","object":{"id":"https:\/\/poa.st\/objects\/5982eb3f-67c7-456d-a953-c618c4963fc8","objectType":"note","content":"So, how is it? What are your specs?","url":"https:\/\/poa.st\/objects\/5982eb3f-67c7-456d-a953-c618c4963fc8","status_net":{"notice_id":null},"inReplyTo":{"objectType":"note","id":"https:\/\/poa.st\/objects\/614dc81e-97db-47d0-bcaa-52dd8e482f3f","url":"https:\/\/poa.st\/objects\/614dc81e-97db-47d0-bcaa-52dd8e482f3f"}},"to":[{"objectType":"http:\/\/activitystrea.ms\/schema\/1.0\/person","id":"https:\/\/poa.st\/users\/WandererUber"},{"objectType":"http:\/\/activitystrea.ms\/schema\/1.0\/collection","id":"http:\/\/activityschema.org\/collection\/public"}],"status_net":{"conversation":"tag:gnusocial.jp,2026-06-12:objectType=thread:nonce=ceab044a0eae1e01","notice_info":{"local_id":"12739099","source":"ActivityPub"}},"published":"2026-06-12T01:38:07+00:00","provider":{"objectType":"service","displayName":"GNU social JP","url":"https:\/\/gnusocial.jp\/"},"verb":"post","url":"https:\/\/poa.st\/objects\/5982eb3f-67c7-456d-a953-c618c4963fc8"},{"actor":{"id":"https:\/\/poa.st\/users\/WandererUber","displayName":"Wanderer \u00fcber dem Nebelmeer","status_net":{"avatarLinks":[{"url":"https:\/\/gnusocial.jp\/avatar\/202805-original-tmp20231020151714.webp","rel":"avatar","type":"image\/webp","width":480,"height":272},{"url":"https:\/\/gnusocial.jp\/avatar\/202805-96-20231020151715.webp","rel":"avatar","type":"image\/webp","width":96,"height":96},{"url":"https:\/\/gnusocial.jp\/avatar\/202805-48-20231020151715.webp","rel":"avatar","type":"image\/webp","width":48,"height":48},{"url":"https:\/\/gnusocial.jp\/avatar\/202805-24-20231020151715.webp","rel":"avatar","type":"image\/webp","width":24,"height":24}],"profile_info":{"local_id":"202805"}},"image":{"url":"https:\/\/gnusocial.jp\/avatar\/202805-96-20231020151715.webp","rel":"avatar","type":"image\/webp","width":96,"height":96},"objectType":"person","summary":"I hate niggers","url":"https:\/\/poa.st\/users\/WandererUber","portablecontacts_net":{"preferredUsername":"WandererUber","displayName":"Wanderer \u00fcber dem Nebelmeer","note":"I hate niggers"}},"content":"Thank you, Pewdiepie. You are far too kind.","generator":{"id":"tag:gnusocial.jp,2026-07-06:notice-source:ActivityPub","objectType":"application","status_net":{"source_code":"ActivityPub"}},"id":"https:\/\/poa.st\/objects\/614dc81e-97db-47d0-bcaa-52dd8e482f3f","object":{"id":"https:\/\/poa.st\/objects\/614dc81e-97db-47d0-bcaa-52dd8e482f3f","objectType":"note","content":"Thank you, Pewdiepie. You are far too kind.","url":"https:\/\/poa.st\/objects\/614dc81e-97db-47d0-bcaa-52dd8e482f3f","status_net":{"notice_id":null}},"to":[{"objectType":"http:\/\/activitystrea.ms\/schema\/1.0\/collection","id":"http:\/\/activityschema.org\/collection\/public"}],"status_net":{"conversation":"tag:gnusocial.jp,2026-06-12:objectType=thread:nonce=ceab044a0eae1e01","notice_info":{"local_id":"12739098","source":"ActivityPub"}},"published":"2026-06-12T01:38:07+00:00","provider":{"objectType":"service","displayName":"GNU social JP","url":"https:\/\/gnusocial.jp\/"},"verb":"post","url":"https:\/\/poa.st\/objects\/614dc81e-97db-47d0-bcaa-52dd8e482f3f"},{"actor":{"id":"https:\/\/poa.st\/users\/WandererUber","displayName":"Wanderer \u00fcber dem Nebelmeer","status_net":{"avatarLinks":[{"url":"https:\/\/gnusocial.jp\/avatar\/202805-original-tmp20231020151714.webp","rel":"avatar","type":"image\/webp","width":480,"height":272},{"url":"https:\/\/gnusocial.jp\/avatar\/202805-96-20231020151715.webp","rel":"avatar","type":"image\/webp","width":96,"height":96},{"url":"https:\/\/gnusocial.jp\/avatar\/202805-48-20231020151715.webp","rel":"avatar","type":"image\/webp","width":48,"height":48},{"url":"https:\/\/gnusocial.jp\/avatar\/202805-24-20231020151715.webp","rel":"avatar","type":"image\/webp","width":24,"height":24}],"profile_info":{"local_id":"202805"}},"image":{"url":"https:\/\/gnusocial.jp\/avatar\/202805-96-20231020151715.webp","rel":"avatar","type":"image\/webp","width":96,"height":96},"objectType":"person","summary":"I hate niggers","url":"https:\/\/poa.st\/users\/WandererUber","portablecontacts_net":{"preferredUsername":"WandererUber","displayName":"Wanderer \u00fcber dem Nebelmeer","note":"I hate niggers"}},"content":"He doesn't need to because, unlike you, he didn't make the decision to roll the backend into this tool. Quite frankly, your decision to do this still seems absurd to me.
I have it running on my GPU right now.
>agentic hard with quants
could you quantify this?","generator":{"id":"tag:gnusocial.jp,2026-07-06:notice-source:ActivityPub","objectType":"application","status_net":{"source_code":"ActivityPub"}},"id":"https:\/\/poa.st\/objects\/1fa4dcc2-5afa-4657-9f4f-0fa9401f61cb","object":{"id":"https:\/\/poa.st\/objects\/1fa4dcc2-5afa-4657-9f4f-0fa9401f61cb","objectType":"note","content":"He doesn't need to because, unlike you, he didn't make the decision to roll the backend into this tool. Quite frankly, your decision to do this still seems absurd to me.
I have it running on my GPU right now.
>agentic hard with quants
could you quantify this?","url":"https:\/\/poa.st\/objects\/1fa4dcc2-5afa-4657-9f4f-0fa9401f61cb","status_net":{"notice_id":null},"inReplyTo":{"objectType":"note","id":"https:\/\/poster.place\/objects\/0c582be7-69fd-4630-855f-4f6f8bfcc322","url":"https:\/\/poster.place\/objects\/0c582be7-69fd-4630-855f-4f6f8bfcc322"}},"to":[{"objectType":"http:\/\/activitystrea.ms\/schema\/1.0\/person","id":"https:\/\/poa.st\/users\/striderpod"},{"objectType":"http:\/\/activitystrea.ms\/schema\/1.0\/person","id":"https:\/\/poster.place\/users\/verita84_64"},{"objectType":"http:\/\/activitystrea.ms\/schema\/1.0\/collection","id":"http:\/\/activityschema.org\/collection\/public"}],"status_net":{"conversation":"tag:gnusocial.jp,2026-06-12:objectType=thread:nonce=ceab044a0eae1e01","notice_info":{"local_id":"12739102","source":"ActivityPub"}},"published":"2026-06-12T01:38:06+00:00","provider":{"objectType":"service","displayName":"GNU social JP","url":"https:\/\/gnusocial.jp\/"},"verb":"post","url":"https:\/\/poa.st\/objects\/1fa4dcc2-5afa-4657-9f4f-0fa9401f61cb"},{"actor":{"id":"https:\/\/poster.place\/users\/verita84_64","displayName":"verita84","status_net":{"avatarLinks":[{"url":"https:\/\/gnusocial.jp\/theme\/gnusocialjp\/default-avatar-profile.png","rel":"avatar","type":"image\/png","width":96,"height":96},{"url":"https:\/\/gnusocial.jp\/theme\/gnusocialjp\/default-avatar-stream.png","rel":"avatar","type":"image\/png","width":48,"height":48},{"url":"https:\/\/gnusocial.jp\/theme\/gnusocialjp\/default-avatar-mini.png","rel":"avatar","type":"image\/png","width":24,"height":24}],"profile_info":{"local_id":"396742"}},"image":{"url":"https:\/\/gnusocial.jp\/theme\/gnusocialjp\/default-avatar-profile.png","rel":"avatar","type":"image\/png","width":96,"height":96},"objectType":"person","url":"https:\/\/poster.place\/users\/verita84_64","portablecontacts_net":{"preferredUsername":"verita84_64","displayName":"verita84"}},"content":"@WandererUber<\/a> @striderpod<\/a>
PewDiePie don't realize how hard agentic tooling is with quants. I am sure he don't have the GPU support either","generator":{"id":"tag:gnusocial.jp,2026-07-06:notice-source:ActivityPub","objectType":"application","status_net":{"source_code":"ActivityPub"}},"id":"https:\/\/poster.place\/objects\/0c582be7-69fd-4630-855f-4f6f8bfcc322","object":{"id":"https:\/\/poster.place\/objects\/0c582be7-69fd-4630-855f-4f6f8bfcc322","objectType":"note","content":"@WandererUber<\/a> @striderpod<\/a>
PewDiePie don't realize how hard agentic tooling is with quants. I am sure he don't have the GPU support either","url":"https:\/\/poster.place\/objects\/0c582be7-69fd-4630-855f-4f6f8bfcc322","status_net":{"notice_id":null},"inReplyTo":{"objectType":"note","id":"https:\/\/poa.st\/objects\/acd427a0-9d14-425b-88c2-d3c73b46c17b","url":"https:\/\/poa.st\/objects\/acd427a0-9d14-425b-88c2-d3c73b46c17b"}},"to":[{"objectType":"http:\/\/activitystrea.ms\/schema\/1.0\/person","id":"https:\/\/poa.st\/users\/striderpod"},{"objectType":"http:\/\/activitystrea.ms\/schema\/1.0\/person","id":"https:\/\/poa.st\/users\/WandererUber"},{"objectType":"http:\/\/activitystrea.ms\/schema\/1.0\/collection","id":"http:\/\/activityschema.org\/collection\/public"}],"status_net":{"conversation":"tag:gnusocial.jp,2026-06-12:objectType=thread:nonce=ceab044a0eae1e01","notice_info":{"local_id":"12739101","source":"ActivityPub"}},"published":"2026-06-12T01:38:06+00:00","provider":{"objectType":"service","displayName":"GNU social JP","url":"https:\/\/gnusocial.jp\/"},"verb":"post","url":"https:\/\/poster.place\/objects\/0c582be7-69fd-4630-855f-4f6f8bfcc322"},{"actor":{"id":"https:\/\/poa.st\/users\/WandererUber","displayName":"Wanderer \u00fcber dem Nebelmeer","status_net":{"avatarLinks":[{"url":"https:\/\/gnusocial.jp\/avatar\/202805-original-tmp20231020151714.webp","rel":"avatar","type":"image\/webp","width":480,"height":272},{"url":"https:\/\/gnusocial.jp\/avatar\/202805-96-20231020151715.webp","rel":"avatar","type":"image\/webp","width":96,"height":96},{"url":"https:\/\/gnusocial.jp\/avatar\/202805-48-20231020151715.webp","rel":"avatar","type":"image\/webp","width":48,"height":48},{"url":"https:\/\/gnusocial.jp\/avatar\/202805-24-20231020151715.webp","rel":"avatar","type":"image\/webp","width":24,"height":24}],"profile_info":{"local_id":"202805"}},"image":{"url":"https:\/\/gnusocial.jp\/avatar\/202805-96-20231020151715.webp","rel":"avatar","type":"image\/webp","width":96,"height":96},"objectType":"person","summary":"I hate niggers","url":"https:\/\/poa.st\/users\/WandererUber","portablecontacts_net":{"preferredUsername":"WandererUber","displayName":"Wanderer \u00fcber dem Nebelmeer","note":"I hate niggers"}},"content":"best-in-class. Not aware of anything better than prometheus.
I will also try @verita84_64<\/a> 's kit.
a bit buggy. I had to fix some annoyances. The biggest was that it would truncate messages and sometimes get context-size wrong. Deepseek V4 flash + opencode did it in minutes. If you need details later, just ask. I can make a patch file.
I'm running Qwen3.6-35B-A3B-Q6 on pic rel","generator":{"id":"tag:gnusocial.jp,2026-07-06:notice-source:ActivityPub","objectType":"application","status_net":{"source_code":"ActivityPub"}},"id":"https:\/\/poa.st\/objects\/acd427a0-9d14-425b-88c2-d3c73b46c17b","object":{"id":"https:\/\/poa.st\/objects\/acd427a0-9d14-425b-88c2-d3c73b46c17b","objectType":"note","content":"best-in-class. Not aware of anything better than prometheus.
I will also try @verita84_64<\/a> 's kit.
a bit buggy. I had to fix some annoyances. The biggest was that it would truncate messages and sometimes get context-size wrong. Deepseek V4 flash + opencode did it in minutes. If you need details later, just ask. I can make a patch file.
I'm running Qwen3.6-35B-A3B-Q6 on pic rel","url":"https:\/\/poa.st\/objects\/acd427a0-9d14-425b-88c2-d3c73b46c17b","status_net":{"notice_id":null},"inReplyTo":{"objectType":"note","id":"https:\/\/poa.st\/objects\/5982eb3f-67c7-456d-a953-c618c4963fc8","url":"https:\/\/poa.st\/objects\/5982eb3f-67c7-456d-a953-c618c4963fc8"}},"to":[{"objectType":"http:\/\/activitystrea.ms\/schema\/1.0\/person","id":"https:\/\/poa.st\/users\/striderpod"},{"objectType":"http:\/\/activitystrea.ms\/schema\/1.0\/person","id":"https:\/\/poster.place\/users\/verita84_64"},{"objectType":"http:\/\/activitystrea.ms\/schema\/1.0\/collection","id":"http:\/\/activityschema.org\/collection\/public"}],"status_net":{"conversation":"tag:gnusocial.jp,2026-06-12:objectType=thread:nonce=ceab044a0eae1e01","notice_info":{"local_id":"12739100","source":"ActivityPub"}},"published":"2026-06-12T01:38:06+00:00","provider":{"objectType":"service","displayName":"GNU social JP","url":"https:\/\/gnusocial.jp\/"},"verb":"post","url":"https:\/\/poa.st\/objects\/acd427a0-9d14-425b-88c2-d3c73b46c17b"},{"actor":{"id":"https:\/\/poa.st\/users\/WandererUber","displayName":"Wanderer \u00fcber dem Nebelmeer","status_net":{"avatarLinks":[{"url":"https:\/\/gnusocial.jp\/avatar\/202805-original-tmp20231020151714.webp","rel":"avatar","type":"image\/webp","width":480,"height":272},{"url":"https:\/\/gnusocial.jp\/avatar\/202805-96-20231020151715.webp","rel":"avatar","type":"image\/webp","width":96,"height":96},{"url":"https:\/\/gnusocial.jp\/avatar\/202805-48-20231020151715.webp","rel":"avatar","type":"image\/webp","width":48,"height":48},{"url":"https:\/\/gnusocial.jp\/avatar\/202805-24-20231020151715.webp","rel":"avatar","type":"image\/webp","width":24,"height":24}],"profile_info":{"local_id":"202805"}},"image":{"url":"https:\/\/gnusocial.jp\/avatar\/202805-96-20231020151715.webp","rel":"avatar","type":"image\/webp","width":96,"height":96},"objectType":"person","summary":"I hate niggers","url":"https:\/\/poa.st\/users\/WandererUber","portablecontacts_net":{"preferredUsername":"WandererUber","displayName":"Wanderer \u00fcber dem Nebelmeer","note":"I hate niggers"}},"content":"please don't vaguepost at me like this.
>It all started with getting the Intel Arc to work properly on Gentoo without Docker and with newer support for images.
I seriously doubt that you get significantly higher inference speeds than llamacpp or the forks that are out there, by rolling your own backend.
>You have to do some guidance on the backend to get models to code properly. Think of it as holding their hand. The lower the model is, say 9b, the more help it needs.
I don't appreciate being talked to this way. We're not on reddit and I'm not five years old. Besides that, Gemma4 E4B is decent at it. The benchmarks are out there, this is not some secret sauce.
>Also, since I made the backend, I can handle large source code files on small GPU's. Nobody does that
I can run 200k context with Q3.6-35B on beellama and use it in opencode\/pi no problem. Again, please quantify what you're saying.","generator":{"id":"tag:gnusocial.jp,2026-07-06:notice-source:ActivityPub","objectType":"application","status_net":{"source_code":"ActivityPub"}},"id":"https:\/\/poa.st\/objects\/4f02064c-e153-4214-893f-6d52dafbc905","object":{"id":"https:\/\/poa.st\/objects\/4f02064c-e153-4214-893f-6d52dafbc905","objectType":"note","content":"please don't vaguepost at me like this.
>It all started with getting the Intel Arc to work properly on Gentoo without Docker and with newer support for images.
I seriously doubt that you get significantly higher inference speeds than llamacpp or the forks that are out there, by rolling your own backend.
>You have to do some guidance on the backend to get models to code properly. Think of it as holding their hand. The lower the model is, say 9b, the more help it needs.
I don't appreciate being talked to this way. We're not on reddit and I'm not five years old. Besides that, Gemma4 E4B is decent at it. The benchmarks are out there, this is not some secret sauce.
>Also, since I made the backend, I can handle large source code files on small GPU's. Nobody does that
I can run 200k context with Q3.6-35B on beellama and use it in opencode\/pi no problem. Again, please quantify what you're saying.","url":"https:\/\/poa.st\/objects\/4f02064c-e153-4214-893f-6d52dafbc905","status_net":{"notice_id":null},"inReplyTo":{"objectType":"note","id":"https:\/\/poster.place\/objects\/24fdfad0-8cbc-454e-b7a1-c11659541686","url":"https:\/\/poster.place\/objects\/24fdfad0-8cbc-454e-b7a1-c11659541686"}},"to":[{"objectType":"http:\/\/activitystrea.ms\/schema\/1.0\/person","id":"https:\/\/poa.st\/users\/striderpod"},{"objectType":"http:\/\/activitystrea.ms\/schema\/1.0\/person","id":"https:\/\/poster.place\/users\/verita84_64"},{"objectType":"http:\/\/activitystrea.ms\/schema\/1.0\/collection","id":"http:\/\/activityschema.org\/collection\/public"}],"status_net":{"conversation":"tag:gnusocial.jp,2026-06-12:objectType=thread:nonce=ceab044a0eae1e01","notice_info":{"local_id":"12739104","source":"ActivityPub"}},"published":"2026-06-12T01:38:05+00:00","provider":{"objectType":"service","displayName":"GNU social JP","url":"https:\/\/gnusocial.jp\/"},"verb":"post","url":"https:\/\/poa.st\/objects\/4f02064c-e153-4214-893f-6d52dafbc905"},{"actor":{"id":"https:\/\/poster.place\/users\/verita84_64","displayName":"verita84","status_net":{"avatarLinks":[{"url":"https:\/\/gnusocial.jp\/theme\/gnusocialjp\/default-avatar-profile.png","rel":"avatar","type":"image\/png","width":96,"height":96},{"url":"https:\/\/gnusocial.jp\/theme\/gnusocialjp\/default-avatar-stream.png","rel":"avatar","type":"image\/png","width":48,"height":48},{"url":"https:\/\/gnusocial.jp\/theme\/gnusocialjp\/default-avatar-mini.png","rel":"avatar","type":"image\/png","width":24,"height":24}],"profile_info":{"local_id":"396742"}},"image":{"url":"https:\/\/gnusocial.jp\/theme\/gnusocialjp\/default-avatar-profile.png","rel":"avatar","type":"image\/png","width":96,"height":96},"objectType":"person","url":"https:\/\/poster.place\/users\/verita84_64","portablecontacts_net":{"preferredUsername":"verita84_64","displayName":"verita84"}},"content":"@WandererUber<\/a> @striderpod<\/a>
Absurd? It all started with getting the Intel Arc to work properly on Gentoo without Docker and with newer support for images. Everyone fell short of this.
You have to do some guidance on the backend to get models to code properly. Think of it as holding their hand. The lower the model is, say 9b, the more help it needs.
Also, since I made the backend, I can handle large source code files on small GPU's. Nobody does that","generator":{"id":"tag:gnusocial.jp,2026-07-06:notice-source:ActivityPub","objectType":"application","status_net":{"source_code":"ActivityPub"}},"id":"https:\/\/poster.place\/objects\/24fdfad0-8cbc-454e-b7a1-c11659541686","object":{"id":"https:\/\/poster.place\/objects\/24fdfad0-8cbc-454e-b7a1-c11659541686","objectType":"note","content":"@WandererUber<\/a> @striderpod<\/a>
Absurd? It all started with getting the Intel Arc to work properly on Gentoo without Docker and with newer support for images. Everyone fell short of this.
You have to do some guidance on the backend to get models to code properly. Think of it as holding their hand. The lower the model is, say 9b, the more help it needs.
Also, since I made the backend, I can handle large source code files on small GPU's. Nobody does that","url":"https:\/\/poster.place\/objects\/24fdfad0-8cbc-454e-b7a1-c11659541686","status_net":{"notice_id":null},"inReplyTo":{"objectType":"note","id":"https:\/\/poa.st\/objects\/1fa4dcc2-5afa-4657-9f4f-0fa9401f61cb","url":"https:\/\/poa.st\/objects\/1fa4dcc2-5afa-4657-9f4f-0fa9401f61cb"}},"to":[{"objectType":"http:\/\/activitystrea.ms\/schema\/1.0\/person","id":"https:\/\/poa.st\/users\/striderpod"},{"objectType":"http:\/\/activitystrea.ms\/schema\/1.0\/person","id":"https:\/\/poa.st\/users\/WandererUber"},{"objectType":"http:\/\/activitystrea.ms\/schema\/1.0\/collection","id":"http:\/\/activityschema.org\/collection\/public"}],"status_net":{"conversation":"tag:gnusocial.jp,2026-06-12:objectType=thread:nonce=ceab044a0eae1e01","notice_info":{"local_id":"12739103","source":"ActivityPub"}},"published":"2026-06-12T01:38:05+00:00","provider":{"objectType":"service","displayName":"GNU social JP","url":"https:\/\/gnusocial.jp\/"},"verb":"post","url":"https:\/\/poster.place\/objects\/24fdfad0-8cbc-454e-b7a1-c11659541686"},{"actor":{"id":"https:\/\/poa.st\/users\/WandererUber","displayName":"Wanderer \u00fcber dem Nebelmeer","status_net":{"avatarLinks":[{"url":"https:\/\/gnusocial.jp\/avatar\/202805-original-tmp20231020151714.webp","rel":"avatar","type":"image\/webp","width":480,"height":272},{"url":"https:\/\/gnusocial.jp\/avatar\/202805-96-20231020151715.webp","rel":"avatar","type":"image\/webp","width":96,"height":96},{"url":"https:\/\/gnusocial.jp\/avatar\/202805-48-20231020151715.webp","rel":"avatar","type":"image\/webp","width":48,"height":48},{"url":"https:\/\/gnusocial.jp\/avatar\/202805-24-20231020151715.webp","rel":"avatar","type":"image\/webp","width":24,"height":24}],"profile_info":{"local_id":"202805"}},"image":{"url":"https:\/\/gnusocial.jp\/avatar\/202805-96-20231020151715.webp","rel":"avatar","type":"image\/webp","width":96,"height":96},"objectType":"person","summary":"I hate niggers","url":"https:\/\/poa.st\/users\/WandererUber","portablecontacts_net":{"preferredUsername":"WandererUber","displayName":"Wanderer \u00fcber dem Nebelmeer","note":"I hate niggers"}},"content":"You're really doing your software a disservice by talking nonsense like this, I gotta be real here.
2. Please explain the technical details of what we talked about instead of copy-pasting LLM snippets at me. this is very disrespectful and you're wasting my time.
1. If you are using llamacpp anyways, why the fuck does your docker container ship with it. That's literally my only point dude. Pewdiepie does not have to care about getting GPU performance code right because he doesn't ship any. So I could only guess you were implying you're doing it differently. Now you're telling me you also don't even modify it. So I was right! it *IS* an absurd decision, making the user install llamacpp in the docker container even if he has inference up and running elsewhere. Nobody does it like this. Not anythingllm, not openwebui, not sillytavern, not prometheus, not even fucking oobabooga.
3. once again, how exactly did you \"design it\", if the inference is done by an external codebase anyways? Please quantify this.","generator":{"id":"tag:gnusocial.jp,2026-07-06:notice-source:ActivityPub","objectType":"application","status_net":{"source_code":"ActivityPub"}},"id":"https:\/\/poa.st\/objects\/a55cef37-d192-486b-bc68-7ca2738f2939","object":{"id":"https:\/\/poa.st\/objects\/a55cef37-d192-486b-bc68-7ca2738f2939","objectType":"note","content":"You're really doing your software a disservice by talking nonsense like this, I gotta be real here.
2. Please explain the technical details of what we talked about instead of copy-pasting LLM snippets at me. this is very disrespectful and you're wasting my time.
1. If you are using llamacpp anyways, why the fuck does your docker container ship with it. That's literally my only point dude. Pewdiepie does not have to care about getting GPU performance code right because he doesn't ship any. So I could only guess you were implying you're doing it differently. Now you're telling me you also don't even modify it. So I was right! it *IS* an absurd decision, making the user install llamacpp in the docker container even if he has inference up and running elsewhere. Nobody does it like this. Not anythingllm, not openwebui, not sillytavern, not prometheus, not even fucking oobabooga.
3. once again, how exactly did you \"design it\", if the inference is done by an external codebase anyways? Please quantify this.","url":"https:\/\/poa.st\/objects\/a55cef37-d192-486b-bc68-7ca2738f2939","status_net":{"notice_id":null},"inReplyTo":{"objectType":"note","id":"https:\/\/poster.place\/objects\/09845933-c3bc-42cc-bdb5-7a89319698cd","url":"https:\/\/poster.place\/objects\/09845933-c3bc-42cc-bdb5-7a89319698cd"}},"to":[{"objectType":"http:\/\/activitystrea.ms\/schema\/1.0\/person","id":"https:\/\/poa.st\/users\/striderpod"},{"objectType":"http:\/\/activitystrea.ms\/schema\/1.0\/person","id":"https:\/\/poster.place\/users\/verita84_64"},{"objectType":"http:\/\/activitystrea.ms\/schema\/1.0\/collection","id":"http:\/\/activityschema.org\/collection\/public"}],"status_net":{"conversation":"tag:gnusocial.jp,2026-06-12:objectType=thread:nonce=ceab044a0eae1e01","notice_info":{"local_id":"12739106","source":"ActivityPub"}},"published":"2026-06-12T01:38:04+00:00","provider":{"objectType":"service","displayName":"GNU social JP","url":"https:\/\/gnusocial.jp\/"},"verb":"post","url":"https:\/\/poa.st\/objects\/a55cef37-d192-486b-bc68-7ca2738f2939"},{"actor":{"id":"https:\/\/poster.place\/users\/verita84_64","displayName":"verita84","status_net":{"avatarLinks":[{"url":"https:\/\/gnusocial.jp\/theme\/gnusocialjp\/default-avatar-profile.png","rel":"avatar","type":"image\/png","width":96,"height":96},{"url":"https:\/\/gnusocial.jp\/theme\/gnusocialjp\/default-avatar-stream.png","rel":"avatar","type":"image\/png","width":48,"height":48},{"url":"https:\/\/gnusocial.jp\/theme\/gnusocialjp\/default-avatar-mini.png","rel":"avatar","type":"image\/png","width":24,"height":24}],"profile_info":{"local_id":"396742"}},"image":{"url":"https:\/\/gnusocial.jp\/theme\/gnusocialjp\/default-avatar-profile.png","rel":"avatar","type":"image\/png","width":96,"height":96},"objectType":"person","url":"https:\/\/poster.place\/users\/verita84_64","portablecontacts_net":{"preferredUsername":"verita84_64","displayName":"verita84"}},"content":"@WandererUber<\/a> @striderpod<\/a>
1. It's using llamacpp
2. That's literally what it's called, guidance because it sucks. I am quoting Claude
3. Again, like I said, I designed this so low-end GPU's have a shot. This is super important and should help larger GPU's too.","generator":{"id":"tag:gnusocial.jp,2026-07-06:notice-source:ActivityPub","objectType":"application","status_net":{"source_code":"ActivityPub"}},"id":"https:\/\/poster.place\/objects\/09845933-c3bc-42cc-bdb5-7a89319698cd","object":{"id":"https:\/\/poster.place\/objects\/09845933-c3bc-42cc-bdb5-7a89319698cd","objectType":"note","content":"@WandererUber<\/a> @striderpod<\/a>
1. It's using llamacpp
2. That's literally what it's called, guidance because it sucks. I am quoting Claude
3. Again, like I said, I designed this so low-end GPU's have a shot. This is super important and should help larger GPU's too.","url":"https:\/\/poster.place\/objects\/09845933-c3bc-42cc-bdb5-7a89319698cd","status_net":{"notice_id":null},"inReplyTo":{"objectType":"note","id":"https:\/\/poa.st\/objects\/4f02064c-e153-4214-893f-6d52dafbc905","url":"https:\/\/poa.st\/objects\/4f02064c-e153-4214-893f-6d52dafbc905"}},"to":[{"objectType":"http:\/\/activitystrea.ms\/schema\/1.0\/person","id":"https:\/\/poa.st\/users\/striderpod"},{"objectType":"http:\/\/activitystrea.ms\/schema\/1.0\/person","id":"https:\/\/poa.st\/users\/WandererUber"},{"objectType":"http:\/\/activitystrea.ms\/schema\/1.0\/collection","id":"http:\/\/activityschema.org\/collection\/public"}],"status_net":{"conversation":"tag:gnusocial.jp,2026-06-12:objectType=thread:nonce=ceab044a0eae1e01","notice_info":{"local_id":"12739105","source":"ActivityPub"}},"published":"2026-06-12T01:38:04+00:00","provider":{"objectType":"service","displayName":"GNU social JP","url":"https:\/\/gnusocial.jp\/"},"verb":"post","url":"https:\/\/poster.place\/objects\/09845933-c3bc-42cc-bdb5-7a89319698cd"},{"actor":{"id":"https:\/\/poa.st\/users\/WandererUber","displayName":"Wanderer \u00fcber dem Nebelmeer","status_net":{"avatarLinks":[{"url":"https:\/\/gnusocial.jp\/avatar\/202805-original-tmp20231020151714.webp","rel":"avatar","type":"image\/webp","width":480,"height":272},{"url":"https:\/\/gnusocial.jp\/avatar\/202805-96-20231020151715.webp","rel":"avatar","type":"image\/webp","width":96,"height":96},{"url":"https:\/\/gnusocial.jp\/avatar\/202805-48-20231020151715.webp","rel":"avatar","type":"image\/webp","width":48,"height":48},{"url":"https:\/\/gnusocial.jp\/avatar\/202805-24-20231020151715.webp","rel":"avatar","type":"image\/webp","width":24,"height":24}],"profile_info":{"local_id":"202805"}},"image":{"url":"https:\/\/gnusocial.jp\/avatar\/202805-96-20231020151715.webp","rel":"avatar","type":"image\/webp","width":96,"height":96},"objectType":"person","summary":"I hate niggers","url":"https:\/\/poa.st\/users\/WandererUber","portablecontacts_net":{"preferredUsername":"WandererUber","displayName":"Wanderer \u00fcber dem Nebelmeer","note":"I hate niggers"}},"content":">I am quoting Claude
>I never gave you LLM snippets.
I think I just about had enough of this nonsense convo.
>Go use PewDiePie's software lol.
I am using it right now. You know why? because (halfway down the page, mind you) your github readme tells me to install gigabytes of shit in docker and it's a bit of a hassle to do make space for this in my vm for unidentified benefit.","generator":{"id":"tag:gnusocial.jp,2026-07-06:notice-source:ActivityPub","objectType":"application","status_net":{"source_code":"ActivityPub"}},"id":"https:\/\/poa.st\/objects\/164fc684-e00c-41c3-a48c-49c8b4f191e8","object":{"id":"https:\/\/poa.st\/objects\/164fc684-e00c-41c3-a48c-49c8b4f191e8","objectType":"note","content":">I am quoting Claude
>I never gave you LLM snippets.
I think I just about had enough of this nonsense convo.
>Go use PewDiePie's software lol.
I am using it right now. You know why? because (halfway down the page, mind you) your github readme tells me to install gigabytes of shit in docker and it's a bit of a hassle to do make space for this in my vm for unidentified benefit.","url":"https:\/\/poa.st\/objects\/164fc684-e00c-41c3-a48c-49c8b4f191e8","status_net":{"notice_id":null},"inReplyTo":{"objectType":"note","id":"https:\/\/poster.place\/objects\/f834df0a-3f7c-4b12-bd20-7c2c690df7d2","url":"https:\/\/poster.place\/objects\/f834df0a-3f7c-4b12-bd20-7c2c690df7d2"}},"to":[{"objectType":"http:\/\/activitystrea.ms\/schema\/1.0\/person","id":"https:\/\/poa.st\/users\/striderpod"},{"objectType":"http:\/\/activitystrea.ms\/schema\/1.0\/person","id":"https:\/\/poster.place\/users\/verita84_64"},{"objectType":"http:\/\/activitystrea.ms\/schema\/1.0\/collection","id":"http:\/\/activityschema.org\/collection\/public"}],"status_net":{"conversation":"tag:gnusocial.jp,2026-06-12:objectType=thread:nonce=ceab044a0eae1e01","notice_info":{"local_id":"12739108","source":"ActivityPub"}},"published":"2026-06-12T01:38:03+00:00","provider":{"objectType":"service","displayName":"GNU social JP","url":"https:\/\/gnusocial.jp\/"},"verb":"post","url":"https:\/\/poa.st\/objects\/164fc684-e00c-41c3-a48c-49c8b4f191e8"},{"actor":{"id":"https:\/\/poster.place\/users\/verita84_64","displayName":"verita84","status_net":{"avatarLinks":[{"url":"https:\/\/gnusocial.jp\/theme\/gnusocialjp\/default-avatar-profile.png","rel":"avatar","type":"image\/png","width":96,"height":96},{"url":"https:\/\/gnusocial.jp\/theme\/gnusocialjp\/default-avatar-stream.png","rel":"avatar","type":"image\/png","width":48,"height":48},{"url":"https:\/\/gnusocial.jp\/theme\/gnusocialjp\/default-avatar-mini.png","rel":"avatar","type":"image\/png","width":24,"height":24}],"profile_info":{"local_id":"396742"}},"image":{"url":"https:\/\/gnusocial.jp\/theme\/gnusocialjp\/default-avatar-profile.png","rel":"avatar","type":"image\/png","width":96,"height":96},"objectType":"person","url":"https:\/\/poster.place\/users\/verita84_64","portablecontacts_net":{"preferredUsername":"verita84_64","displayName":"verita84"}},"content":"@WandererUber<\/a> @striderpod<\/a>
I never gave you LLM snippets.
Go use PewDiePie's software lol.","generator":{"id":"tag:gnusocial.jp,2026-07-06:notice-source:ActivityPub","objectType":"application","status_net":{"source_code":"ActivityPub"}},"id":"https:\/\/poster.place\/objects\/f834df0a-3f7c-4b12-bd20-7c2c690df7d2","object":{"id":"https:\/\/poster.place\/objects\/f834df0a-3f7c-4b12-bd20-7c2c690df7d2","objectType":"note","content":"@WandererUber<\/a> @striderpod<\/a>
I never gave you LLM snippets.
Go use PewDiePie's software lol.","url":"https:\/\/poster.place\/objects\/f834df0a-3f7c-4b12-bd20-7c2c690df7d2","status_net":{"notice_id":null},"inReplyTo":{"objectType":"note","id":"https:\/\/poa.st\/objects\/a55cef37-d192-486b-bc68-7ca2738f2939","url":"https:\/\/poa.st\/objects\/a55cef37-d192-486b-bc68-7ca2738f2939"}},"to":[{"objectType":"http:\/\/activitystrea.ms\/schema\/1.0\/person","id":"https:\/\/poa.st\/users\/striderpod"},{"objectType":"http:\/\/activitystrea.ms\/schema\/1.0\/person","id":"https:\/\/poa.st\/users\/WandererUber"},{"objectType":"http:\/\/activitystrea.ms\/schema\/1.0\/collection","id":"http:\/\/activityschema.org\/collection\/public"}],"status_net":{"conversation":"tag:gnusocial.jp,2026-06-12:objectType=thread:nonce=ceab044a0eae1e01","notice_info":{"local_id":"12739107","source":"ActivityPub"}},"published":"2026-06-12T01:38:03+00:00","provider":{"objectType":"service","displayName":"GNU social JP","url":"https:\/\/gnusocial.jp\/"},"verb":"post","url":"https:\/\/poster.place\/objects\/f834df0a-3f7c-4b12-bd20-7c2c690df7d2"}],"links":[{"url":"https:\/\/gnusocial.jp\/conversation\/6471211","rel":"alternate","type":"text\/html"}]}