« javascript open tab browser link

word frequency count

cat {file} |tr [:upper:] [:lower:]\
| sed ’s/[^[:alpha:]][^[:alpha:]]*/\
/g’ | sort | uniq -c| sort -r |more

note that a new line is explicitly included in the sed via the line break. . .

thanks to Daniel Fackrell for the inspiration

This entry was posted on Sunday, 25 December 2011 at 6:33 am and is filed under linux. You can follow any responses to this entry through the RSS 2.0 feed. You can skip to the end and leave a response. Pinging is currently not allowed.

3 Responses to “word frequency count”

  1. äxl Says:
    11 February 2012 at 12:42 pm

    cat {file} | tr [:upper:] [:lower:]\ | sed s/[^[:alpha:]][^[:alpha:]]*/\ /g | sort | uniq -c | sort -r | more

    Gotten rid of the typographic apostrophes. Use typewriter apostrophes instead. The space before /g is important to separate words.
    But still it doesn't work correctly since it only counts unique lines not words ...

  2. äxl Says:
    11 February 2012 at 12:46 pm

    This seems to work:

    awk '{gsub(/[^[:alnum:]_[:blank:]]/, "", $0);for (i = 1; i

  3. äxl Says:
    11 February 2012 at 12:47 pm

    Here from pravin27:
    http://www.unix.com/shell-programming-scripting/156334-word-frequency-sort-printfriendly.html

Leave a Reply