Um, so the Mitra media folder is already 139 Gb. Who is responsible for this? @griffith @bigtony @mischievoustomato @sneeden
Conversation
Notices
-
Embed this notice
FWC (fwc@0.5dollah.click)'s status on Friday, 03-Jan-2025 08:13:15 JST
FWC
-
Embed this notice
mischievoustomato@0.5dollah.click's status on Friday, 03-Jan-2025 08:13:14 JST
mischievoustomato
@fwc @bigtony @griffith @sneeden all of us essentially, but I don't remember mine being that big, let me check
-
Embed this notice
mischievoustomato@0.5dollah.click's status on Friday, 03-Jan-2025 08:14:26 JST
mischievoustomato
@fwc @bigtony @griffith @sneeden
> Filesystem Size Used Avail Use% Mounted on
/dev/sdb1 1.0T 270G 755G 27% /mnt/storage
oof yeah -
Embed this notice
mischievoustomato@0.5dollah.click's status on Friday, 03-Jan-2025 08:20:20 JST
mischievoustomato
-
Embed this notice
Griffith (griffith@0.5dollah.click)'s status on Friday, 03-Jan-2025 08:20:21 JST
Griffith
@mischievoustomato @fwc @bigtony @sneeden I’ve posted less on here than on our Pleroma instance, so it shouldn’t be that big.
-
Embed this notice
mischievoustomato@0.5dollah.click's status on Friday, 03-Jan-2025 08:20:39 JST
mischievoustomato
@fwc @bigtony @griffith @sneeden i just ran mitractl delete-orphaned-files and uh... it's stuck there
-
Embed this notice
mischievoustomato@0.5dollah.click's status on Friday, 03-Jan-2025 08:22:25 JST
mischievoustomato
@fwc @bigtony @griffith @sneeden i'm not sure. postgres is using 100% cpu, i assume it's reading shit, but at the same time my instance is in a non working state due to well, expired domain xDDD
-
Embed this notice
FWC (fwc@0.5dollah.click)'s status on Friday, 03-Jan-2025 08:22:26 JST
FWC
@mischievoustomato @bigtony @griffith @sneeden This has to be a bug of some kind, no?
-
Embed this notice
mischievoustomato@0.5dollah.click's status on Friday, 03-Jan-2025 08:22:55 JST
mischievoustomato
@fwc @bigtony @griffith @sneeden no, everything that comes in is stored there
-
Embed this notice
FWC (fwc@0.5dollah.click)'s status on Friday, 03-Jan-2025 08:22:56 JST
FWC
@bigtony @griffith @mischievoustomato @sneeden It says I have 139.5 k files in that directory. That's not possible if it were just uploaded files.
-
Embed this notice
mischievoustomato@0.5dollah.click's status on Friday, 03-Jan-2025 08:25:46 JST
mischievoustomato
@fwc @bigtony @griffith @sneeden yeah mitra doesn't have a thing like the pleroma thing where it doesnt download the thing but link the original server's thing
-
Embed this notice
FWC (fwc@0.5dollah.click)'s status on Friday, 03-Jan-2025 08:25:47 JST
FWC
@mischievoustomato @bigtony @griffith @sneeden Well, at least that explains it
-
Embed this notice
mischievoustomato@0.5dollah.click's status on Friday, 03-Jan-2025 08:25:55 JST
mischievoustomato
-
Embed this notice
mischievoustomato@0.5dollah.click's status on Friday, 03-Jan-2025 08:26:01 JST
mischievoustomato
-
Embed this notice
mischievoustomato@0.5dollah.click's status on Friday, 03-Jan-2025 08:26:48 JST
mischievoustomato
-
Embed this notice
Jelqer Skelter (sneeden@0.5dollah.click)'s status on Friday, 03-Jan-2025 08:26:49 JST
Jelqer Skelter
@mischievoustomato @fwc @bigtony @griffith media proxy?
-
Embed this notice
mischievoustomato@0.5dollah.click's status on Friday, 03-Jan-2025 08:27:52 JST
mischievoustomato
@fwc @bigtony @griffith @sneeden no i think it outright cant do that
-
Embed this notice
FWC (fwc@0.5dollah.click)'s status on Friday, 03-Jan-2025 08:27:53 JST
FWC
@mischievoustomato @bigtony @griffith @sneeden On by default, I guess?
-
Embed this notice
mischievoustomato@0.5dollah.click's status on Friday, 03-Jan-2025 08:37:01 JST
mischievoustomato
@adiz @fwc @bigtony @griffith @sneeden https://ti.parcero.casa/notes/a2jixxdohqm000qb
-
Embed this notice
👺防空識別區👹 (sojourn maxxing) (adiz@wl0.9ch.nl)'s status on Friday, 03-Jan-2025 08:37:03 JST
👺防空識別區👹 (sojourn maxxing)
@mischievoustomato @fwc @griffith @bigtony @sneeden uh oh big oofs ahead
In conversation permalink -
Embed this notice
silverpill (silverpill@mitra.social)'s status on Friday, 03-Jan-2025 22:54:26 JST
silverpill
@mischievoustomato @griffith @fwc @sneeden @bigtony
Yeah, it doesn't support this, but it will in the future.
Meanwhile you can adjust your data retention settings https://codeberg.org/silverpill/mitra/src/branch/main/docs/cache_management.md
By default Mitra stores posts for 50 days and empty profiles for 150 days.
I recommend changing it to 15 days for posts and 60 days for profiles (this will be a new default in mitra 4.0)In conversation permalink Attachments
-
Embed this notice
silverpill (silverpill@mitra.social)'s status on Sunday, 05-Jan-2025 03:58:43 JST
silverpill
@jae @griffith @fwc @mischievoustomato @sneeden @bigtony
When data retention parameters are changed, mitra starts removing unnecessary posts from the database and associated media from the filesystem. Media deletion happens in background tasks which block other background tasks, including incoming federation (not outgoing, which uses different thread).
If the number of deleted posts is huge, processing of media cleanup tasks may take a long time, leading to a noticeable delay in federation. But this doesn't lead to data loss.
In conversation permalink -
Embed this notice
𝔧𝔞𝔢 (jae@wizard.casa)'s status on Sunday, 05-Jan-2025 03:58:44 JST
𝔧𝔞𝔢
@fwc @silverpill @griffith @bigtony @mischievoustomato @sneeden
> Postgres will use 100% CPU to delete remote posts & media until it's done after a few hours.
i'm going to try it with an instance i'm synthetically filling up to see if i can offer some insight. my guess is that it's based on the amount of media objects/etc which determines how long it will exhaust the threads. there may be a way to optimize the query statement or general operation
In conversation permalink -
Embed this notice
𝔧𝔞𝔢 (jae@wizard.casa)'s status on Sunday, 05-Jan-2025 03:58:45 JST
𝔧𝔞𝔢
@mischievoustomato @fwc @griffith @bigtony @sneeden
> i'm not sure. postgres is using 100% cpu, i assume it's reading shit, but at the same time my instance is in a non working state due to well, expired domain xDDD
it's unlikely postgres is banging all the cores at 100% due to an expired domain. start dumping out some postgres logs to see what's happening. this should not be happening unless you're on some single core vps and you've got some other process hitting it hard.
In conversation permalink -
Embed this notice
FWC (fwc@0.5dollah.click)'s status on Sunday, 05-Jan-2025 03:58:45 JST
FWC
@jae @bigtony @griffith @mischievoustomato @sneeden
No, this is what happened because he changed (reduced) the remote post retention. Same thing happened to 0.5dollah.click yesterday after I changed ours. Postgres will use 100% CPU to delete remote posts & media until it's done after a few hours. Until that happens, there's no incoming federation. I let @silverpill know about it.
In conversation permalink -
Embed this notice
𝔧𝔞𝔢 (jae@wizard.casa)'s status on Monday, 06-Jan-2025 11:05:48 JST
𝔧𝔞𝔢
@fwc @silverpill @griffith @bigtony @mischievoustomato @sneeden agreed, a note would work.
In conversation permalink -
Embed this notice
silverpill (silverpill@mitra.social)'s status on Monday, 06-Jan-2025 11:05:48 JST
silverpill
@jae @griffith @fwc @mischievoustomato @sneeden @bigtony This shouldn't be very difficult to fix, I created a tracking issue https://codeberg.org/silverpill/mitra/issues/86
In conversation permalink Attachments
-
Embed this notice
FWC (fwc@0.5dollah.click)'s status on Monday, 06-Jan-2025 11:05:50 JST
FWC
@silverpill @bigtony @griffith @jae @mischievoustomato @sneeden
Yep, it's probably just something to note in the config.yaml or when the default changes in Mitra v4.0.0
In conversation permalink
-
Embed this notice