Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Yeah - just Extract it from your MySQL / Mongo / Postgres / logfiles / whatever system it's in right now, Transform it into a CSV or whatever the input needs to be and Load it into BigQuery. Once it's there, you can do whatever you need!


On a smaller scale, the "q" utility has been a boon for me in the handling of ad-hoc delimited data files.

http://harelba.github.io/q/

Really one of the best things I've discovered in the past 5 years. Saves so much work compared to doing stuff with sed, awk, and the like.


wow good find! I've been using my own script https://github.com/kahing/bin/blob/master/avg but q seems a lot more flexible and works with more than number types.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: