Notices by LIBRANET.de Announcements (libranet@mastodon.social)

Linux kernel update installed. Rebooting the server in 15 minutes...

libranet.de • venera.social

Server is up again. But I cannot connect via SSH or webbrowser. I have to check that later. Maybe I'm blocked by fail2ban. If this isn't the problem I have to access the server via rescue console.

Server is not reachable since 0:20 CET. :-( Cannot login via SSH because of a timeout error. Started a hardware shutdown now. When this is finished I can try to restart the server.

Drive has been replaced. Server is back online. Currently, the RAID1 recovery is running in the background. Good night! 😴

I have ordered the replacement of the dead nvme drive. Hetzner service will shut down the server as soon as someone has walked to the rack. 🙂

I have planned a database optimization on venera.social today. I'll start in half an hour at 10:45 CET / 9:45 UTC.

The node will be in maintenance mode while the optimization is running.

Expected downtime 2-3 hours.

After deleting a total of around 2000 accounts on libranet.de in the last few months, it is now time to optimize the database.

This will reduce storage space requirements by around 60% and improve performance.

The fastest way is to export the data completely, delete the database and import the data again.

I will start tomorrow around 11:00 CEST (09:00 UTC) and this will probably take 24 to 48 hours.

libranet.de

Sorry! I have accidentally invoked a shutdown of the database sever. 😭

Please take a coffee and relax.

Starting step 2: 22.04 LTS -> 24.04 LTS upgrade

Ubuntu 20.04 LTS End Of Life – Upgrade necessary for libranet.de and venera.social

The recommended distribution upgrade path is 20.04 LTS -> 22.04 LTS -> 24.04 LTS. Sigh. 🙂

I think I will do that tomorrow around 9:00 CEST / 7:00 UTC. This will take up to 2 hours if everything goes smoothly.

After upgrading the Linux distribution I need to upgrade/convert the database from postgresql 14 to postgresql 16.

I will stop the misskey service - do the database migration - restart the misskey service.

misskey.de

Linux distribution upgrade done. New version is Ubuntu 24.04.2 LTS. Rebooting now. Hope everything is working. :-)

Linux Distribution upgrade on misskey.de

I will stop the server, create a snapshot, restart the server and then perform the release upgrade.

This will take about an hour. There will be several short interruptions during this time.

misskey.de

The issue with the blurred or missing profile pictures has been fixed. 🎉 🚀 ✨

Maybe you need to force-refresh (SHIFT + Reload) the page to load all profile pictures successfully. Alternatively, you may clear your browser cache.

libranet.de · venera.social

In the next days I need to optimize the large database tables of libranet.de and venera.social. The database has grown to an extent where the server would run out of disk space in the next weeks.

This is a time-consuming and resource-intensive process that can block other database queries. That's why I will switch on maintenance mode beforehand.

I'll start with the large database tables of venera.social. When this is done I'll continue with libranet.de.

There's an update for MariaDB - the database server. I'll switch both Friendica nodes into maintenance mode at 12:00 CET (11:00 UTC) and install the update. Expected downtime: approx. 40-60 minutes.

There's an update for the MariaDB database system available. When I install the update the database system will be automatically restarted. This will take around 15-20 minutes.

I'll start the update in a couple of minutes.

libranet.de · venera.social

Linux kernel update installed. I'll reboot the server at 21:30 CEST / 19:30 UTC.

libranet.de · venera.social

Ok. I'll try to solve this. I need to drop old entries from the huge, local workerqueue of venera.social, put libranet.de into maintenance mode and then reenable venera.social. I'll see if the webserver survives the storm this way.

Hmm. venera.social is literally DDoS-ed by the Fediverse. Tons of requests to the local inbox. The webserver is constantly hitting the limit. 😭