back

by dafelst·5y ago·view on hn ↗
I love seeing stuff like this, getting more understanding of the layers underlying high performance data analytics is super interesting to me.

This project seems very similar to Apache Arrow, if OP or anyone else is around to explain why one might be used over the other that would be great.

1 comments
> This project seems very similar to Apache Arrow, if OP or anyone else is around to explain why one might be used over the other that would be great.

Arrow is primarily a serialization format to transfer data between distributed systems. It uses zero copy and other techniques to quickly process, and store large data sets in memory.

Other libraries allow you to query Arrow data once processed.

This project is an in-memory columnar data store with querying and other capabilities.