@mian it defeats the simplicity somewhat yeah. i tried to look in to how zstd works and the codebase and spec seemed quite large. but facebook is also a bit bloaty so it might not have to be.

lz4, lizard and fastlz are mostly just the usual deduplication encoding so they aren't that complicated in theory. though lizard i think does add a basic entropy coder.

zpaq is cool but holy shit holy shit why is there a JIT in the decoder pipeline :blobcatsleepless2: