{"generator":"GNU social 2.0.2-dev","title":"Conversation","totalItems":5,"items":[{"actor":{"id":"https:\/\/poa.st\/users\/DNutzinski","displayName":"DS.Now","status_net":{"avatarLinks":[{"url":"https:\/\/gnusocial.jp\/avatar\/266888-original-tmp20240625003144.webp","rel":"avatar","type":"image\/webp","width":400,"height":400},{"url":"https:\/\/gnusocial.jp\/avatar\/266888-96-20240625003144.webp","rel":"avatar","type":"image\/webp","width":96,"height":96},{"url":"https:\/\/gnusocial.jp\/avatar\/266888-48-20240625003144.webp","rel":"avatar","type":"image\/webp","width":48,"height":48},{"url":"https:\/\/gnusocial.jp\/avatar\/266888-24-20240625003144.webp","rel":"avatar","type":"image\/webp","width":24,"height":24}],"profile_info":{"local_id":"266888"}},"image":{"url":"https:\/\/gnusocial.jp\/avatar\/266888-96-20240625003144.webp","rel":"avatar","type":"image\/webp","width":96,"height":96},"objectType":"person","summary":"Gabfugee (2016-2024)______________________________I fix things for a living.(Mainly Windoze computers, which is why I use Linux).______________________________You may not see race, but race sees YOU. Be a realist, dammit, and stand up for yourself.","url":"https:\/\/poa.st\/users\/DNutzinski","portablecontacts_net":{"preferredUsername":"DNutzinski","displayName":"DS.Now","note":"Gabfugee (2016-2024)______________________________I fix things for a living.(Mainly Windoze computers, which is why I use Linux).______________________________You may not see race, but race sees YOU. Be a realist, dammit, and stand up for yourself."}},"content":"<a class=\"u-url mention\" href=\"https:\/\/poa.st\/users\/BowsacNoodle\">@BowsacNoodle<\/a> over my head man- I just fix the damned computers.<br \/><br \/>(srsly though, this was a fascinating read, and I should try to make my own. Its not like I don't have enough hw laying around)","generator":{"id":"tag:gnusocial.jp,2026-07-18:notice-source:ActivityPub","objectType":"application","status_net":{"source_code":"ActivityPub"}},"id":"https:\/\/poa.st\/objects\/d02368a4-d886-4a07-8200-63195bf1cd37","object":{"id":"https:\/\/poa.st\/objects\/d02368a4-d886-4a07-8200-63195bf1cd37","objectType":"note","content":"<a class=\"u-url mention\" href=\"https:\/\/poa.st\/users\/BowsacNoodle\">@BowsacNoodle<\/a> over my head man- I just fix the damned computers.<br \/><br \/>(srsly though, this was a fascinating read, and I should try to make my own. Its not like I don't have enough hw laying around)","url":"https:\/\/poa.st\/objects\/d02368a4-d886-4a07-8200-63195bf1cd37","status_net":{"notice_id":null},"inReplyTo":{"objectType":"note","id":"https:\/\/poa.st\/objects\/8f9a275a-4539-4ddc-b447-6a34e112bd91","url":"https:\/\/poa.st\/objects\/8f9a275a-4539-4ddc-b447-6a34e112bd91"}},"to":[{"objectType":"http:\/\/activitystrea.ms\/schema\/1.0\/person","id":"https:\/\/poa.st\/users\/BowsacNoodle"},{"objectType":"http:\/\/activitystrea.ms\/schema\/1.0\/collection","id":"http:\/\/activityschema.org\/collection\/public"}],"status_net":{"conversation":"tag:gnusocial.jp,2026-07-08:objectType=thread:nonce=032a43b2d56ee48a","notice_info":{"local_id":"12861405","source":"ActivityPub"}},"published":"2026-07-08T22:15:54+00:00","provider":{"objectType":"service","displayName":"GNU social JP","url":"https:\/\/gnusocial.jp\/"},"verb":"post","url":"https:\/\/poa.st\/objects\/d02368a4-d886-4a07-8200-63195bf1cd37"},{"actor":{"id":"https:\/\/poa.st\/users\/BowsacNoodle","displayName":"BowserNoodle \u2626\ufe0f","status_net":{"avatarLinks":[{"url":"https:\/\/gnusocial.jp\/avatar\/5696-original-tmp20220816035056.webp","rel":"avatar","type":"image\/webp","width":393,"height":407},{"url":"https:\/\/gnusocial.jp\/avatar\/5696-96-20220816035056.webp","rel":"avatar","type":"image\/webp","width":96,"height":96},{"url":"https:\/\/gnusocial.jp\/avatar\/5696-48-20220816035056.webp","rel":"avatar","type":"image\/webp","width":48,"height":48},{"url":"https:\/\/gnusocial.jp\/avatar\/5696-24-20220816035056.webp","rel":"avatar","type":"image\/webp","width":24,"height":24}],"profile_info":{"local_id":"5696"}},"image":{"url":"https:\/\/gnusocial.jp\/avatar\/5696-96-20220816035056.webp","rel":"avatar","type":"image\/webp","width":96,"height":96},"objectType":"person","summary":"Formerly BowsacNoodle. Distributist. Interested in philosophy and meta critiques. Eastern Rite. Myer&#39;s Briggs says I like to argue. I try to debate in good faith and assume the same from you until proven otherwise.","url":"https:\/\/poa.st\/users\/BowsacNoodle","portablecontacts_net":{"preferredUsername":"BowsacNoodle","displayName":"BowserNoodle \u2626\ufe0f","note":"Formerly BowsacNoodle. Distributist. Interested in philosophy and meta critiques. Eastern Rite. Myer&#39;s Briggs says I like to argue. I try to debate in good faith and assume the same from you until proven otherwise."}},"content":"<a class=\"u-url mention\" href=\"https:\/\/poa.st\/users\/DNutzinski\">@DNutzinski<\/a> That\u2019s my logic tbh. I have a bunch of \u201cold\u201c computers. I don\u2019t need something super high end. I want something that can handle calculations and parse data. I can make my own \u201cjarvis\u201d and not have it talk or speak to me, but if I wanted to do interaction, I\u2019d just chain another piece of software to it for the speech recognition and TTS. Doing everything inside one thing is convenient, but it\u2019s not necessary.","generator":{"id":"tag:gnusocial.jp,2026-07-18:notice-source:ActivityPub","objectType":"application","status_net":{"source_code":"ActivityPub"}},"id":"https:\/\/poa.st\/objects\/ae6abc59-73da-45af-bb14-ab50341b127d","object":{"id":"https:\/\/poa.st\/objects\/ae6abc59-73da-45af-bb14-ab50341b127d","objectType":"note","content":"<a class=\"u-url mention\" href=\"https:\/\/poa.st\/users\/DNutzinski\">@DNutzinski<\/a> That\u2019s my logic tbh. I have a bunch of \u201cold\u201c computers. I don\u2019t need something super high end. I want something that can handle calculations and parse data. I can make my own \u201cjarvis\u201d and not have it talk or speak to me, but if I wanted to do interaction, I\u2019d just chain another piece of software to it for the speech recognition and TTS. Doing everything inside one thing is convenient, but it\u2019s not necessary.","url":"https:\/\/poa.st\/objects\/ae6abc59-73da-45af-bb14-ab50341b127d","status_net":{"notice_id":null},"inReplyTo":{"objectType":"note","id":"https:\/\/poa.st\/objects\/d02368a4-d886-4a07-8200-63195bf1cd37","url":"https:\/\/poa.st\/objects\/d02368a4-d886-4a07-8200-63195bf1cd37"}},"to":[{"objectType":"http:\/\/activitystrea.ms\/schema\/1.0\/person","id":"https:\/\/poa.st\/users\/DNutzinski"},{"objectType":"http:\/\/activitystrea.ms\/schema\/1.0\/collection","id":"http:\/\/activityschema.org\/collection\/public"}],"status_net":{"conversation":"tag:gnusocial.jp,2026-07-08:objectType=thread:nonce=032a43b2d56ee48a","notice_info":{"local_id":"12861406","source":"ActivityPub"}},"published":"2026-07-08T22:15:53+00:00","provider":{"objectType":"service","displayName":"GNU social JP","url":"https:\/\/gnusocial.jp\/"},"verb":"post","url":"https:\/\/poa.st\/objects\/ae6abc59-73da-45af-bb14-ab50341b127d"},{"actor":{"id":"https:\/\/poa.st\/users\/eee","displayName":"eee","status_net":{"avatarLinks":[{"url":"https:\/\/gnusocial.jp\/avatar\/3911-original-tmp20230917082117.webp","rel":"avatar","type":"image\/webp","width":411,"height":495},{"url":"https:\/\/gnusocial.jp\/avatar\/3911-96-20230920071520.webp","rel":"avatar","type":"image\/webp","width":96,"height":96},{"url":"https:\/\/gnusocial.jp\/avatar\/3911-48-20230920071520.webp","rel":"avatar","type":"image\/webp","width":48,"height":48},{"url":"https:\/\/gnusocial.jp\/avatar\/3911-24-20230920071521.webp","rel":"avatar","type":"image\/webp","width":24,"height":24}],"profile_info":{"local_id":"3911"}},"image":{"url":"https:\/\/gnusocial.jp\/avatar\/3911-96-20230920071520.webp","rel":"avatar","type":"image\/webp","width":96,"height":96},"objectType":"person","summary":"I hit womencute tankie gf wanted","url":"https:\/\/poa.st\/users\/eee","portablecontacts_net":{"preferredUsername":"eee","displayName":"eee","note":"I hit womencute tankie gf wanted"}},"content":"<a class=\"u-url mention\" href=\"https:\/\/poa.st\/users\/BowsacNoodle\">@BowsacNoodle<\/a> claude drop table","generator":{"id":"tag:gnusocial.jp,2026-07-18:notice-source:ActivityPub","objectType":"application","status_net":{"source_code":"ActivityPub"}},"id":"https:\/\/poa.st\/objects\/8af0eb79-e463-459f-a03b-7b073f4e66e7","object":{"id":"https:\/\/poa.st\/objects\/8af0eb79-e463-459f-a03b-7b073f4e66e7","objectType":"note","content":"<a class=\"u-url mention\" href=\"https:\/\/poa.st\/users\/BowsacNoodle\">@BowsacNoodle<\/a> claude drop table","url":"https:\/\/poa.st\/objects\/8af0eb79-e463-459f-a03b-7b073f4e66e7","status_net":{"notice_id":null},"inReplyTo":{"objectType":"note","id":"https:\/\/poa.st\/objects\/8f9a275a-4539-4ddc-b447-6a34e112bd91","url":"https:\/\/poa.st\/objects\/8f9a275a-4539-4ddc-b447-6a34e112bd91"}},"to":[{"objectType":"http:\/\/activitystrea.ms\/schema\/1.0\/person","id":"https:\/\/poa.st\/users\/BowsacNoodle"},{"objectType":"http:\/\/activitystrea.ms\/schema\/1.0\/collection","id":"http:\/\/activityschema.org\/collection\/public"}],"status_net":{"conversation":"tag:gnusocial.jp,2026-07-08:objectType=thread:nonce=032a43b2d56ee48a","notice_info":{"local_id":"12860660","source":"ActivityPub"}},"published":"2026-07-08T19:07:26+00:00","provider":{"objectType":"service","displayName":"GNU social JP","url":"https:\/\/gnusocial.jp\/"},"verb":"post","url":"https:\/\/poa.st\/objects\/8af0eb79-e463-459f-a03b-7b073f4e66e7"},{"actor":{"id":"https:\/\/poa.st\/users\/BowsacNoodle","displayName":"BowserNoodle \u2626\ufe0f","status_net":{"avatarLinks":[{"url":"https:\/\/gnusocial.jp\/avatar\/5696-original-tmp20220816035056.webp","rel":"avatar","type":"image\/webp","width":393,"height":407},{"url":"https:\/\/gnusocial.jp\/avatar\/5696-96-20220816035056.webp","rel":"avatar","type":"image\/webp","width":96,"height":96},{"url":"https:\/\/gnusocial.jp\/avatar\/5696-48-20220816035056.webp","rel":"avatar","type":"image\/webp","width":48,"height":48},{"url":"https:\/\/gnusocial.jp\/avatar\/5696-24-20220816035056.webp","rel":"avatar","type":"image\/webp","width":24,"height":24}],"profile_info":{"local_id":"5696"}},"image":{"url":"https:\/\/gnusocial.jp\/avatar\/5696-96-20220816035056.webp","rel":"avatar","type":"image\/webp","width":96,"height":96},"objectType":"person","summary":"Formerly BowsacNoodle. Distributist. Interested in philosophy and meta critiques. Eastern Rite. Myer&#39;s Briggs says I like to argue. I try to debate in good faith and assume the same from you until proven otherwise.","url":"https:\/\/poa.st\/users\/BowsacNoodle","portablecontacts_net":{"preferredUsername":"BowsacNoodle","displayName":"BowserNoodle \u2626\ufe0f","note":"Formerly BowsacNoodle. Distributist. Interested in philosophy and meta critiques. Eastern Rite. Myer&#39;s Briggs says I like to argue. I try to debate in good faith and assume the same from you until proven otherwise."}},"content":"<a class=\"u-url mention\" href=\"https:\/\/poa.st\/users\/eee\">@eee<\/a> Sorry\u2014 I\u2019m unable to complete your request.","generator":{"id":"tag:gnusocial.jp,2026-07-18:notice-source:ActivityPub","objectType":"application","status_net":{"source_code":"ActivityPub"}},"id":"https:\/\/poa.st\/objects\/d41c11e8-8e55-4bd1-8da9-6958157d9e5b","object":{"id":"https:\/\/poa.st\/objects\/d41c11e8-8e55-4bd1-8da9-6958157d9e5b","objectType":"note","content":"<a class=\"u-url mention\" href=\"https:\/\/poa.st\/users\/eee\">@eee<\/a> Sorry\u2014 I\u2019m unable to complete your request.","url":"https:\/\/poa.st\/objects\/d41c11e8-8e55-4bd1-8da9-6958157d9e5b","status_net":{"notice_id":null},"inReplyTo":{"objectType":"note","id":"https:\/\/poa.st\/objects\/8af0eb79-e463-459f-a03b-7b073f4e66e7","url":"https:\/\/poa.st\/objects\/8af0eb79-e463-459f-a03b-7b073f4e66e7"}},"to":[{"objectType":"http:\/\/activitystrea.ms\/schema\/1.0\/person","id":"https:\/\/poa.st\/users\/eee"},{"objectType":"http:\/\/activitystrea.ms\/schema\/1.0\/collection","id":"http:\/\/activityschema.org\/collection\/public"}],"status_net":{"conversation":"tag:gnusocial.jp,2026-07-08:objectType=thread:nonce=032a43b2d56ee48a","notice_info":{"local_id":"12860661","source":"ActivityPub"}},"published":"2026-07-08T19:07:25+00:00","provider":{"objectType":"service","displayName":"GNU social JP","url":"https:\/\/gnusocial.jp\/"},"verb":"post","url":"https:\/\/poa.st\/objects\/d41c11e8-8e55-4bd1-8da9-6958157d9e5b"},{"actor":{"id":"https:\/\/poa.st\/users\/BowsacNoodle","displayName":"BowserNoodle \u2626\ufe0f","status_net":{"avatarLinks":[{"url":"https:\/\/gnusocial.jp\/avatar\/5696-original-tmp20220816035056.webp","rel":"avatar","type":"image\/webp","width":393,"height":407},{"url":"https:\/\/gnusocial.jp\/avatar\/5696-96-20220816035056.webp","rel":"avatar","type":"image\/webp","width":96,"height":96},{"url":"https:\/\/gnusocial.jp\/avatar\/5696-48-20220816035056.webp","rel":"avatar","type":"image\/webp","width":48,"height":48},{"url":"https:\/\/gnusocial.jp\/avatar\/5696-24-20220816035056.webp","rel":"avatar","type":"image\/webp","width":24,"height":24}],"profile_info":{"local_id":"5696"}},"image":{"url":"https:\/\/gnusocial.jp\/avatar\/5696-96-20220816035056.webp","rel":"avatar","type":"image\/webp","width":96,"height":96},"objectType":"person","summary":"Formerly BowsacNoodle. Distributist. Interested in philosophy and meta critiques. Eastern Rite. Myer&#39;s Briggs says I like to argue. I try to debate in good faith and assume the same from you until proven otherwise.","url":"https:\/\/poa.st\/users\/BowsacNoodle","portablecontacts_net":{"preferredUsername":"BowsacNoodle","displayName":"BowserNoodle \u2626\ufe0f","note":"Formerly BowsacNoodle. Distributist. Interested in philosophy and meta critiques. Eastern Rite. Myer&#39;s Briggs says I like to argue. I try to debate in good faith and assume the same from you until proven otherwise."}},"content":"I started looking into private hosting an LLM and I\u2019ve learned a few things. First\u2014  curtains for Zoosha (Yes, I manually typed an emdash). I know nothing about a lot of the terms that are constantly thrown about as if they\u2019re common knowledge for people in this space\u2026as if this space has existed for decades. My summary from my very limited early understanding is the demand for hardware really isn\u2019t that big if you\u2019re interested in mostly text, and you\u2019re willing to make one or more tradeoffs. The QRD: you can find clever ways to host your own AI without a kajillion dollars, but you\u2019ll have to tinker and be okay with that.<br \/>&gt;Tokenizetion<br \/>words or phrases are given numerical values. This can be easily parsed in a matrix (X*Y Data, like a spreadsheet) because computers hardware is very good at at this.<br \/>&gt;you can compress things to as low as \u201c2-bit quantization\u201d, giving four levels of precision vs \u201c4-bit quantization\u201d and its 16 levels of precision. This lets you use need far less ram to handle the gigantic matrix of data, but the chance for hallucinated incoherent data goes up.<br \/>This is confusing to me. From what I gather, compressing gives approximations of certain things because it can\u2019t be as granular by definition. Imagine approximating a song but you only have 4 notes available instead of 16. Eventually the compressed data becomes too fuzzy, and your llm acts like a legally blind geriatric who has smoked too much of the devil\u2019s lettuce and forgets what he was looking at or supposed to be talking about. But if you do it right, sometimes the old man is having a good day with his meds and can be vaguely coherent. That\u2019s where some of the creative stuff comes in, like mixed precision (think mp3s with variable bit rate encoding, but it\u2019s varying where the extra precision is needed to minimize resource) and Quantization-Aware Training (QAT), which is training a 2 bit model inside a 4 bit model(??) to verify accuracy and find ways to encode it better as 2-bit(??)","generator":{"id":"tag:gnusocial.jp,2026-07-18:notice-source:ActivityPub","objectType":"application","status_net":{"source_code":"ActivityPub"}},"id":"https:\/\/poa.st\/objects\/8f9a275a-4539-4ddc-b447-6a34e112bd91","object":{"id":"https:\/\/poa.st\/objects\/8f9a275a-4539-4ddc-b447-6a34e112bd91","objectType":"note","content":"I started looking into private hosting an LLM and I\u2019ve learned a few things. First\u2014  curtains for Zoosha (Yes, I manually typed an emdash). I know nothing about a lot of the terms that are constantly thrown about as if they\u2019re common knowledge for people in this space\u2026as if this space has existed for decades. My summary from my very limited early understanding is the demand for hardware really isn\u2019t that big if you\u2019re interested in mostly text, and you\u2019re willing to make one or more tradeoffs. The QRD: you can find clever ways to host your own AI without a kajillion dollars, but you\u2019ll have to tinker and be okay with that.<br \/>&gt;Tokenizetion<br \/>words or phrases are given numerical values. This can be easily parsed in a matrix (X*Y Data, like a spreadsheet) because computers hardware is very good at at this.<br \/>&gt;you can compress things to as low as \u201c2-bit quantization\u201d, giving four levels of precision vs \u201c4-bit quantization\u201d and its 16 levels of precision. This lets you use need far less ram to handle the gigantic matrix of data, but the chance for hallucinated incoherent data goes up.<br \/>This is confusing to me. From what I gather, compressing gives approximations of certain things because it can\u2019t be as granular by definition. Imagine approximating a song but you only have 4 notes available instead of 16. Eventually the compressed data becomes too fuzzy, and your llm acts like a legally blind geriatric who has smoked too much of the devil\u2019s lettuce and forgets what he was looking at or supposed to be talking about. But if you do it right, sometimes the old man is having a good day with his meds and can be vaguely coherent. That\u2019s where some of the creative stuff comes in, like mixed precision (think mp3s with variable bit rate encoding, but it\u2019s varying where the extra precision is needed to minimize resource) and Quantization-Aware Training (QAT), which is training a 2 bit model inside a 4 bit model(??) to verify accuracy and find ways to encode it better as 2-bit(??)","url":"https:\/\/poa.st\/objects\/8f9a275a-4539-4ddc-b447-6a34e112bd91","status_net":{"notice_id":null}},"to":[{"objectType":"http:\/\/activitystrea.ms\/schema\/1.0\/collection","id":"http:\/\/activityschema.org\/collection\/public"}],"status_net":{"conversation":"tag:gnusocial.jp,2026-07-08:objectType=thread:nonce=032a43b2d56ee48a","notice_info":{"local_id":"12860639","source":"ActivityPub"}},"published":"2026-07-08T19:02:20+00:00","provider":{"objectType":"service","displayName":"GNU social JP","url":"https:\/\/gnusocial.jp\/"},"verb":"post","url":"https:\/\/poa.st\/objects\/8f9a275a-4539-4ddc-b447-6a34e112bd91"}],"links":[{"url":"https:\/\/gnusocial.jp\/conversation\/6535139","rel":"alternate","type":"text\/html"}]}