Two command-line I use quite often for data analysis are jq and q:
- jq is a "Command-line JSON processor". Sometimes I get lengthy and ugly JSON responses from my curl commands. I'll pipe it into jq and strip out all the JSON parts I don't want, and it's pretty-printed too.
- q allows me to run SQL-like queries on CSV files. I can even do joins! Sure, it's only useful for people that know SQL queries, which isn't as many as I'd hope, but since I know how to do them, it comes in handy.
Authored Comments
Good list! Another terminal-based disk usage analyzer tool that's helped me a great deal is "dust".
Two command-line I use quite often for data analysis are jq and q:
- jq is a "Command-line JSON processor". Sometimes I get lengthy and ugly JSON responses from my curl commands. I'll pipe it into jq and strip out all the JSON parts I don't want, and it's pretty-printed too.
- q allows me to run SQL-like queries on CSV files. I can even do joins! Sure, it's only useful for people that know SQL queries, which isn't as many as I'd hope, but since I know how to do them, it comes in handy.