Notices by Marichkaposter (mposter@miniwa.moe)
-
Embed this notice
Marichkaposter (mposter@miniwa.moe)'s status on Monday, 11-Mar-2024 00:24:18 JST Marichkaposter
@Jain @ivesen In terms of distributing the storage utilization of volumes (so perhaps 25-100GB at a time) I think it should work pretty ok on current versions, if you still have your test setup. It won't distribute all reads/writes like that tho. -
Embed this notice
Marichkaposter (mposter@miniwa.moe)'s status on Monday, 11-Mar-2024 00:13:03 JST Marichkaposter
@Jain @ivesen The seaweedfs fsck isn't too hard to operate but we're not talking about a reliable thing like xfs. You probably can't use seaweedfs for entirely critical data and you *likely* want to replicate on a filesystem/block layer that has snapshots to have "backups" of volumes just in case, even if the volumes are replicated / and or erasure coded.
It should write pretty evenly across volume servers *over time* as they fill up but it is not doing it for all small bulks of files. Maybe it just writes it into *one* of your 25gb or w/e volumes and then replicates it to another drive as you asked. Amuch simple(r) scheme than having the rule engines+databases ceph runs but it makes actual hw usage overall a lot more modest and predictable. -
Embed this notice
Marichkaposter (mposter@miniwa.moe)'s status on Sunday, 10-Mar-2024 23:52:48 JST Marichkaposter
@ivesen @Jain Broadly, Nextcloud never really worked for me as either small OR large file store. And small files were really quite terrible.
In the end I went with samba (over wireguard) + seaweedfs for some other stuff for the pile of files. After Ceph was too bothersome. That Seaweedfs is not 100% solid and probably needs a backup... well, that was also very much the case for Nextcloud. But at least Seaweedfs generally runs pretty well.
Syncthing may also be an okay option depending on what you do. Even if you need to throw the additional storage at it at least it works pretty predictably up to a pretty large size (with some RAM). -
Embed this notice
Marichkaposter (mposter@miniwa.moe)'s status on Sunday, 10-Mar-2024 23:36:54 JST Marichkaposter
@ivesen @Jain I don't think you really can. SSD, more ram and more processing power may help a bit but ultimately it's probably not the kind of thing to put larger volumes of data (or anything like that) on.