Conversation
Notices
-
Embed this notice
Alex Gleason (alex@gleasonator.com)'s status on Sunday, 21-Apr-2024 05:03:07 JST Alex Gleason Guys gleasonator.dev is somewhat usable - Pleroma-tan likes this.
-
Embed this notice
Alex Gleason (alex@gleasonator.com)'s status on Sunday, 21-Apr-2024 05:04:15 JST Alex Gleason I gave up on SQLite and swiched to Postgres and it magically started working after months of fighting. -
Embed this notice
Caek Islove ? ❤️ (caekislove@gleasonator.com)'s status on Sunday, 21-Apr-2024 05:05:28 JST Caek Islove ? ❤️ @alex Blasphemy!
Alex Gleason likes this. -
Embed this notice
Alex Gleason (alex@gleasonator.com)'s status on Sunday, 21-Apr-2024 05:06:22 JST Alex Gleason @caekislove You can pass a DATABASE_URL now and choose `sqlite://db.sqlite3` or `postgres://localhost:5432/ditto` and decide for yourself how you'd prefer to suffer. -
Embed this notice
Alex Gleason (alex@gleasonator.com)'s status on Sunday, 21-Apr-2024 05:09:40 JST Alex Gleason @caekislove The main problem with SQLite is 10 minute long queries that should take 0.01s. Re-running the exact same query again takes 0.01s. This is in a 40GB database. Then I found a 20 year old thread of people complaining about how SQLite relies on OS disk cache and it can do that sometimes.
My original idea was to prune the db so it's always small, keeping only the last 7 days of data. But the other problem with SQLite is that it destroys performance to delete things! So whenever you run that cron it freezes the whole application for all users.
It could probably have been improved by running a worker pool on top of it. But you would still get 10 minute queries in some threads, it just wouldn't block the others. -
Embed this notice
Alex Gleason (alex@gleasonator.com)'s status on Sunday, 21-Apr-2024 05:10:57 JST Alex Gleason @caekislove Meanwhile we're working on LMDB integration. But I wanted this project to exist in the near future. -
Embed this notice
Caek Islove ? ❤️ (caekislove@gleasonator.com)'s status on Sunday, 21-Apr-2024 05:21:43 JST Caek Islove ? ❤️ @alex Damn I guess Hacker News lied to me when they said there's no problem in the world that can't be solved by SQLite!
(I never believed their lies about Rust being good)
-
Embed this notice
Alex Gleason (alex@gleasonator.com)'s status on Sunday, 21-Apr-2024 05:21:43 JST Alex Gleason @caekislove I think it could be, but you have to do a lot of engineering around it. You'd have to manage many smaller SQLite files and then route requests to it. -
Embed this notice
Microchimera (opphunter88@gleasonator.com)'s status on Sunday, 21-Apr-2024 06:58:45 JST Microchimera @alex Honestly at this point it can't perform worse than this site ☠️ Alex Gleason likes this. -
Embed this notice
Alex Gleason (alex@gleasonator.com)'s status on Sunday, 21-Apr-2024 21:22:54 JST Alex Gleason @gentoobro @caekislove 40GB? -
Embed this notice
gentoobro (gentoobro@gleasonator.com)'s status on Sunday, 21-Apr-2024 21:22:55 JST gentoobro @alex @caekislove ram-backed tmpfs?
-
Embed this notice
gentoobro (gentoobro@gleasonator.com)'s status on Monday, 22-Apr-2024 09:07:59 JST gentoobro @alex @caekislove Just delete all the images posted by those low-down dirty rotten good-for-nothing non-Pro free-loaders. Worked for other instances.
Alex Gleason likes this.