Conversation

Notices

1. Embed this notice
   di0nysius the patomskyite (dsm@fsebugoutzone.org)'s status on Thursday, 17-Apr-2025 23:38:24 JST di0nysius the patomskyite
   Otherwise, eventually, the db will demand more hw. Either prune or grow, but inactivity will become 500s.
   • pistolero and nyanide :nyancat_rainbow::nyancat_body::nyancat_face: like this.
   • Embed this notice
      (mint@ryona.agency)'s status on Thursday, 17-Apr-2025 23:39:16 JST 

     in reply to
     @dsm It doesn't grow that much unless you either have hundreds of active users or try to federate the entirety of fediverse to home like pleb does.
     nyanide :nyancat_rainbow::nyancat_body::nyancat_face: likes this.
   • Embed this notice
     nyanide :nyancat_rainbow::nyancat_body::nyancat_face: (nyanide@lab.nyanide.com)'s status on Thursday, 17-Apr-2025 23:39:18 JST nyanide :nyancat_rainbow::nyancat_body::nyancat_face:

     in reply to
     @dsm This ones already asking for 40 sum' gigs. Would really like to repurpose scrap from the recycler so I can actually host this for a couple of years at my own place.
   • Embed this notice
      (mint@ryona.agency)'s status on Thursday, 17-Apr-2025 23:40:12 JST 

     in reply to

     • 
     @dsm Pruning activities that serve no purpose (e.g. likes that are getting recorded in object in addition to being sotred separately) does help, though.
   • Embed this notice
     di0nysius the patomskyite (dsm@fsebugoutzone.org)'s status on Thursday, 17-Apr-2025 23:43:27 JST di0nysius the patomskyite

     in reply to

     • 
     @mint vps db space is wildly limited for cheap single user builds, like 20gb after os. not that it should be default, but ot is at least a solution for those instances specifically.
      likes this.
   • Embed this notice
      (mint@ryona.agency)'s status on Thursday, 17-Apr-2025 23:44:31 JST 

     in reply to

     • Yukkuri
     @dsm Ah, right. @iamtakingiteasy was playing around with splitting DB into separate chanks that could be stored on different storage mediums, maybe one could try storing old posts on NFS or something, add that to a list of bad ideas.
     pistolero likes this.
   • Embed this notice
      (mint@ryona.agency)'s status on Thursday, 17-Apr-2025 23:46:14 JST 

     in reply to

     • 
     @dsm
     agency=# select data->>'type', count(data->>'type') as count from activities group by data->>'type' order by count desc;
     ?column? | count
     ------------+----------
     Create | 20877732
     Announce | 2837909
     Like | 1189087
     EmojiReact | 701261
     Update | 614204
     Undo | 114771
     Listen | 87105
     Follow | 10845
     Accept | 9278
     Delete | 4162
     Remove | 3038
     Add | 1439
     Block | 1126
     Reject | 866
     Flog | 135
     Move | 61
     (16 rows)
     Only three million creates more than last year. Also 87 thousand scrobbles, I wonder who's doing that still.
   • Embed this notice
     di0nysius the patomskyite (dsm@fsebugoutzone.org)'s status on Thursday, 17-Apr-2025 23:49:14 JST di0nysius the patomskyite

     in reply to

     • 
     • Yukkuri
     • pistolero
     @mint @iamtakingiteasy
     
     The use of vpn backhaul, using the vps for host only, was a good (perhaps better) solution. I think that's what @p is doing here now. Suddenly a few tb is affordable.
     , pistolero and pwm like this.
   • Embed this notice
      (mint@ryona.agency)'s status on Thursday, 17-Apr-2025 23:49:49 JST 

     in reply to

     • Yukkuri
     • pistolero
     @dsm @iamtakingiteasy @p Doing that right now on agency, together with some excessive caching rules.
     pistolero likes this.
   • Embed this notice
      (mint@ryona.agency)'s status on Thursday, 17-Apr-2025 23:50:37 JST 

     in reply to

     • 
     @dsm $ doas -u postgres psql -d agency -At -c "select data->>'actor' from activities where data->>'type
     ' = 'Listen' order by id asc;" | sort | uniq -c | sort -rn
     27336 https://bae.st/users/p
     21462 https://shitposter.world/users/p
     10292 https://shitposter.club/users/jeffcliff
     6697 https://iddqd.social/users/sundowner
     6580 https://thechimp.zone/users/thegreatape
     6247 https://iddqd.social/users/NEETzsche
     3686 https://asphodel.rip/users/Vaghrad
     2611 https://shitposter.club/users/p
     655 https://breastmilk.club/users/marine
     509 https://iddqd.social/users/ChristopherBRobin
     302 https://clubcyberia.co/users/Inginsub
     192 https://cawfee.club/users/cine
     174 https://bikeshed.party/users/feld
     104 https://friedcheese.us/users/feld
     89 https://clubcyberia.co/users/cassidyclown
     55 https://ryona.agency/users/mint
     31 https://clubcyberia.co/users/neko
     17 https://ryona.agency/users/lauralt
     15 https://bae.st/users/nosleep
     13 https://shitposter.club/users/Moon
     10 http://rawrxd4mden7rmbobaftao3qjyxbrvj4rrooehkqxlqcsdtnnn2hndid.onion/users/khayyam
     8 https://ryona.agency/users/FrailLeaf
     4 https://ryona.agency/users/cutemaxxer
     4 https://bae.st/users/Pawlicker
     3 https://shitposter.club/users/Bajax
     3 https://boymoder.biz/users/nukie
     2 https://social.singing.dog/users/Coyote
     2 https://cum.salon/users/chog9
     1 https://shitposter.world/users/sun
     1 https://ryona.agency/users/aosoth
     Checks out.
   • Embed this notice
     di0nysius the patomskyite (dsm@fsebugoutzone.org)'s status on Thursday, 17-Apr-2025 23:52:48 JST di0nysius the patomskyite

     in reply to

     • 
     • Yukkuri
     • pistolero
     @mint @iamtakingiteasy @p
     
     Thank goodness for ryona.agency. I really like your avi mods, makes TWKN much better.
      and pistolero like this.
   • Embed this notice
     Yukkuri (iamtakingiteasy@eientei.org)'s status on Friday, 18-Apr-2025 00:07:38 JST Yukkuri

     in reply to

     • 
     @mint @dsm https://eientei.org/objects/fafbe44b-51a9-469e-a9cc-95a4d877693c -- here is a writeup and here are pleroma patches and migrations: https://gitlab.eientei.org/eientei/pleroma/-/tree/upstream-flake
     
     Since it needs to migrate object ids to time-ordered snowflakes and rearrange some of the denormalized fields to properly partition the tables anyway, it also changes a bunch of queries to take advantage of new layout, as many joins became easier. Migration includes both up and down, so it is possible to rollback, but migration back from partitioned layout wasn't very well tested, especially after new objects were inserted. Eientei runs on this for a couple of months now, so it is more or less reasonable in terms of completeness. But to be something more than just 15% of overhead, it requires understanding of what you're doing. Then sure, moving all older rows to a partition on cheaper or even a networked storage is possible.
      likes this.
   • Embed this notice
     pistolero (p@fsebugoutzone.org)'s status on Friday, 18-Apr-2025 05:25:58 JST pistolero

     in reply to

     • 
     • Yukkuri
     @dsm @mint @iamtakingiteasy Yeah; it was initially my "what if the datacenter *does* kick us out" plan, but modified from "I guess ssh tunnel or reverse-proxy to a Tor address and run the shit out of my house" and luckily wireguard provides something a little more sane, although some of the outbound traffic still does go through Tor.
   • Embed this notice
     :blank: (i@declin.eu)'s status on Friday, 18-Apr-2025 14:23:43 JST :blank:

     in reply to

     • 
     • Yukkuri
     @mint @dsm have ranted and raved about this, crazy that @iamtakingiteasy went through with an implementation of it, going by month or even week would also help with the constant churn and vacoom that currently forces a repack for bloated instances
      likes this.