Conversation

Notices

1. Embed this notice
   Ryan Castellucci :nonbinary_flag: (ryanc@infosec.exchange)'s status on Monday, 12-May-2025 20:35:19 JST Ryan Castellucci :nonbinary_flag:

   My command line data analysis tool is at a point where I'm ready to share it!

   freq is a tool I wrote in Rust, intended to replace pipelines of grep, sed, awk, sort, uniq -c, and sort -rn to look at distributions of values in datasets.

   I use it daily.

   https://rya.nc/gh/freq

   • Embed this notice
     Ryan Castellucci :nonbinary_flag: (ryanc@infosec.exchange)'s status on Monday, 12-May-2025 20:41:26 JST Ryan Castellucci :nonbinary_flag:

     in reply to

     This thing is awesome for ad-hoc log file analysis.

   • Embed this notice
     sid77 (sid77@infosec.exchange)'s status on Monday, 12-May-2025 20:53:45 JST sid77

     in reply to

     @ryanc Fancy!

   • Embed this notice
     Ryan Castellucci :nonbinary_flag: (ryanc@infosec.exchange)'s status on Monday, 12-May-2025 21:45:26 JST Ryan Castellucci :nonbinary_flag:

     in reply to

     Oh, and it can operate on compressed logs if you enable the feature flag(s) for that.

   • Embed this notice
     Ryan Castellucci :nonbinary_flag: (ryanc@infosec.exchange)'s status on Monday, 12-May-2025 22:06:24 JST Ryan Castellucci :nonbinary_flag:

     in reply to

     • Risotto Bias

     @risottobias I can add a few more examples, yeah

   • Embed this notice
     Risotto Bias (risottobias@toot.risottobias.org)'s status on Monday, 12-May-2025 22:06:26 JST Risotto Bias

     in reply to

     @ryanc are there other sample queries for inspiration?

   • Embed this notice
     Ryan Castellucci :nonbinary_flag: (ryanc@infosec.exchange)'s status on Monday, 12-May-2025 23:07:25 JST Ryan Castellucci :nonbinary_flag:

     in reply to

     I feel like the biggest gain here is that doing frequency analysis with sort/unique requires first sorting the input whereas freq does not.

   • Embed this notice
     Ryan Castellucci :nonbinary_flag: (ryanc@infosec.exchange)'s status on Monday, 12-May-2025 23:58:22 JST Ryan Castellucci :nonbinary_flag:

     in reply to

     • dakkar

     @dakkar oh, what am I using that requires that?

   • Embed this notice
     dakkar (dakkar@s.thenautilus.net)'s status on Monday, 12-May-2025 23:58:32 JST dakkar

     in reply to

     @ryanc@infosec.exchange possibly useful to add to the README: it needs rust ≥1.85

   • Embed this notice
     Ryan Castellucci :nonbinary_flag: (ryanc@infosec.exchange)'s status on Tuesday, 13-May-2025 00:21:24 JST Ryan Castellucci :nonbinary_flag:

     in reply to

     • dakkar

     @dakkar Ah. I'm fairly indifferent about fixing that.

   • Embed this notice
     dakkar (dakkar@s.thenautilus.net)'s status on Tuesday, 13-May-2025 00:21:26 JST dakkar

     in reply to

     @ryanc@infosec.exchange edition = "2024", apparently
     (I know almost nothing of Rust, I was just playing with writing an ebuild for your program)

   • Embed this notice
     Ryan Castellucci :nonbinary_flag: (ryanc@infosec.exchange)'s status on Tuesday, 13-May-2025 01:59:01 JST Ryan Castellucci :nonbinary_flag:

     in reply to

     • dakkar

     @dakkar it works if you change it to 2021

   • Embed this notice
     Adam Katz (adamhotep@infosec.exchange)'s status on Tuesday, 13-May-2025 03:15:54 JST Adam Katz

     in reply to

     @ryanc looks great! I have a similar tool (awk → sort → awk). I recommend adding a title row (with an option to suppress it for piping purposes, maybe even suppress it by default if stdout is closed).

   • Embed this notice
     Ryan Castellucci :nonbinary_flag: (ryanc@infosec.exchange)'s status on Tuesday, 13-May-2025 19:07:44 JST Ryan Castellucci :nonbinary_flag:

     in reply to

     • dakkar

     @dakkar Neat!

   • Embed this notice
     dakkar (dakkar@s.thenautilus.net)'s status on Tuesday, 13-May-2025 19:07:46 JST dakkar

     in reply to

     @ryanc@infosec.exchange https://www.thenautilus.net/cgit/gentoo-overlay/tree/app-text/freq/freq-0.7.0.ebuild this should be a not-terrible Gentoo package for your program