Conversation

Notices

1. Embed this notice
   Rimu (rimu@mastodon.nzoss.nz)'s status on Thursday, 28-Dec-2023 06:35:21 JST Rimu

   Quite happy with the speed of the background task that ingests #ActivityPub data sent to #PieFed from other servers. Most Activitys are processed in around 0.1 seconds, average of 0.22 seconds, or ~5 per second. This is with just one worker process.

   If a 4 core VPS can handle 6(?) worker processes/threads it'll do 6 * 5 = 30 per sec.

   Based on the load of https://kglitch.social I expect at most 3 per second.

   That'll be fine for now.

   #fediverse

   • Embed this notice
     Rimu (rimu@mastodon.nzoss.nz)'s status on Thursday, 28-Dec-2023 16:13:48 JST Rimu

     in reply to

     Glad to report that I've figured out what was causing some activities to spike to up to 1.4 seconds and fixed it.

     When an Activity arrives if it's the first time one from that instance or that user has arrived, there are a few extra network requests PieFed needs to make to ensure the Activity data is fully fleshed out. Fortunately most of them can be deferred to future background tasks.