Conversation

Notices

1. Embed this notice
   Yeri (yeri@m.superuser.one)'s status on Sunday, 04-Dec-2022 03:21:39 JST Yeri

   Average #Cloudflare #R2 storage for past week for a single user #Mastodon instance is 52Gb. Peaking around 70Gb.

   Media cleanup job runs every 24hrs.

   #FediAdmin #MastoAdmin

   • Embed this notice
     pawlicker (pawlicker@pawlicker.ddns.net)'s status on Sunday, 04-Dec-2022 03:21:30 JST pawlicker

     in reply to

     • Ryle
     • Fez :mastodoncertified:
     @yeri @Ryle @Fez if you use pleroma you can disable caching entirely or just for domains that you don't want cached for obvious reasons like pawoo/baraag.
     
     Meanwhile I'm running this single user instance on an old sparc from 2006
   • Embed this notice
     Ryle (ryle@awoo.fyi)'s status on Sunday, 04-Dec-2022 03:21:33 JST Ryle

     in reply to

     • Fez :mastodoncertified:
     Our instance gets around this problem by not storing content from other servers on S3 (our content is still stored on S3). Instead the requests are proxied through our instance, but we have Cloudflare sitting in front of the proxy. On Cloudflare, we have rules to enforce strict caching policies implemented for any valid content served.
   • Embed this notice
     Yeri (yeri@m.superuser.one)'s status on Sunday, 04-Dec-2022 03:21:33 JST Yeri

     in reply to

     • Ryle
     • Fez :mastodoncertified:

     @Ryle @Fez using mastodon? How did you disable caching other server's content?

     And are you able to share your #cloudflare rules?

     Cc @kikobar

   • Embed this notice
     Yeri (yeri@m.superuser.one)'s status on Sunday, 04-Dec-2022 03:21:34 JST Yeri

     in reply to

     • Fez :mastodoncertified:

     @Fez there’s a few other threads we’ve been having about relay servers, storage, etc (maybe you can still find them in my timeline). But generally speaking, the less servers you connect to (i.e. don’t set up relay servers), the less data you’ll fetch/use/store.

     Also be sure to set up (via the CLI) the media prune command.

   • Embed this notice
     Fez :mastodoncertified: (fez@fora.social)'s status on Sunday, 04-Dec-2022 03:21:38 JST Fez :mastodoncertified:

     in reply to

     @yeri So my KVM VPS I’m using maxes out at 100gb. Hoping that’s enough for just a single user instance!

   • Embed this notice
     Ryle (ryle@awoo.fyi)'s status on Sunday, 04-Dec-2022 03:29:29 JST Ryle

     in reply to

     • pawlicker
     • Fez :mastodoncertified:

     “if you use pleroma you can disable caching entirely or just for domains that you don’t want cached for obvious reasons like pawoo/baraag.”

     You mean pull media directly from their domains?

     What I’m discussing with Pleroma derivative doesn’t do any caching of media on the server. The configuration I have just proxies the content when requested and Cloudflare does the caching.

     “Meanwhile I’m running this single user instance on an old sparc from 2006”

     That’s cool TBH. Considering those things can’t run Minecraft servers without hosing themselves quickly, I’m curious what the load of running that instance on such esoteric and old hardware?

   • Embed this notice
     pawlicker (pawlicker@pawlicker.ddns.net)'s status on Sunday, 04-Dec-2022 03:29:29 JST pawlicker

     in reply to

     • Ryle
     • Fez :mastodoncertified:
     @Ryle @Fez @yeri yep just directly from the domain. I know a few instances do this.
     
     Also, it uses 10-15% per CPU idling (it's dual CPU) and logging in takes like 15-20 seconds as the CPUs jump to 100%. The hardware is so old it wouldn't scale well for multi user instances, I'm sure a t4 or similar would be better.