Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

They should ship parquet, supports predicate pushdown and is dramatically more compact, while you can't get row level data, it's great for analytical queries.


Totally agree! So much that I wrote a whole article about it a while back!

"Why parquet files are my preferred API for bulk open data" https://www.robinlinacre.com/parquet_api/


Parquet is a level better than csv but difficult to get customers to adopt and transmit in that format.


csvbase does ship parquet!

Just add ".parquet" - eg https://csvbase.com/meripaterson/stock-exchanges.parquet


Nice!


IMO this is the best simple option right now.

For sorted data you only need the relevant row groups which can be tunable to sensible sizes for your data and access pattern.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: