Conversation

Notices

1. Embed this notice
   Cory Doctorow (pluralistic@mamot.fr)'s status on Monday, 25-Sep-2023 10:17:30 JST Cory Doctorow

   Hey folks! I've got a folder of 100+ HTML files; I'd like to get a word-count of the rendered text (e.g. excluding tags). Is there an ubuntu utility I could use for this?

   ETA: I figured it out. I just did

   > cat * > merged.html

   then I opened the file in Firefox, copied the text, pasted it into Gedit, and used the Document Statistics tool.

   Dirty and ugly, but it got the job done.

   • clacke likes this.
   • Embed this notice
     Blair Fix (blair_fix@mastodon.online)'s status on Monday, 25-Sep-2023 10:17:31 JST Blair Fix

     in reply to

     @pluralistic

     You could use pandoc to convert all the html files to plain text:

     > for f in *.html; do pandoc "$f" -s -o "${f%.html}.txt"; done

     Then cat all the files and pipe them to wc to get a word count:

     > cat *.txt | wc

     clacke likes this.
   • Embed this notice
     Boyd Stephen Smith Jr. (boydstephensmithjr@hachyderm.io)'s status on Monday, 25-Sep-2023 10:17:33 JST Boyd Stephen Smith Jr.

     in reply to

     @pluralistic Relevant XKCD: https://xkcd.com/763/

     Your EDIT is several times more menacing than your question, to me. :)

     clacke likes this.
   • Embed this notice
     Mina (mina@swiss-talk.net)'s status on Monday, 25-Sep-2023 10:17:36 JST Mina

     in reply to

     • deadbeefmonster

     @deadbeefmonster

     wc -w

     @pluralistic

     clacke likes this.
   • Embed this notice
     deadbeefmonster (deadbeefmonster@infosec.exchange)'s status on Monday, 25-Sep-2023 10:17:43 JST deadbeefmonster

     in reply to

     @pluralistic you can use `lynx -dump file.html | wc -w`

     clacke likes this.
   • Embed this notice
     clacke (clacke@libranet.de)'s status on Monday, 25-Sep-2023 10:17:45 JST clacke

     in reply to

     • Blair Fix
     @blair_fix @pluralistic This is the canonical answer. (e|)l(ynx|inks) and w3m are cool but for another purpose, pandoc is the document-oriented one.