I wrote a tool that can walk through an ncdu binary export 4x slower than a non-parallel (cached) filesystem scan.
Conversation
Notices
-
Embed this notice
Ayo (ayo@lonely.town)'s status on Tuesday, 05-Nov-2024 18:52:23 JST Ayo - Haelwenn /элвэн/ :triskell: likes this.
-
Embed this notice
Ayo (ayo@lonely.town)'s status on Tuesday, 05-Nov-2024 18:52:51 JST Ayo @wolf480pl Partly. I get a 2x speedup by disabling line buffering on STDOUT and another 200ms by disabling the path string construction.
Ncdu can convert the entire file to JSON in ~500ms, so there's clearly other inefficiencies left.
Haelwenn /элвэн/ :triskell: likes this. -
Embed this notice
Wolf480pl (wolf480pl@mstdn.io)'s status on Tuesday, 05-Nov-2024 18:52:52 JST Wolf480pl @ayo that's... surprising
any idea what's going on?