back
user profile

skadamat

5,837karma·1,157submissions·August 2, 2011
about
Better data tools
recent activity (1,157 total)
comment
This is one of my favorite features of DuckDB and Parquet files! I combined these capabilities with mounting via NFS and documented in the last part of my post here: https://about.xethub.co…
2y ago·view thread
comment
Thanks for the kind words! We definitely got inspiration from Git LFS
2y ago·view thread
comment
We also have a writeup on the features and workflow if people want to dive deeper: https://about.xethub.com/blog/xetdata-scale-github-repos-100... …
2y ago·view thread
comment
Good question -- we've tested this a bit and it seems pretty clean. After removing the app, you can make these small changes we've documented in our uninstall path: https://xethub…
2y ago·view thread
comment
> You can't meaningfully version control the data; it's usually binary, and in an object store. The code already lives in a git repository. So what does that leave, the metadata around t…
2y ago·view thread
comment
I work at XetHub and we're taking a different approach here to managing ML experiments in git. Instead of trying to store data and ML models in one place (like S3) and code, models & document…
2y ago·view thread
comment
This is a super neat trick! At work, we're scaling git to terabyte scale and I'm constantly on the search for new ways we can showcase diffs for different file types: https://news…
2y ago·view thread
comment
Out of the box no, but you can solve the scaling git problem by improving the deduplication: https://xethub.com/assets/docs/faq/how-xet-deduplication-wor... We're …
2y ago·view thread
comment
WHY on earth would we let "AI systems" we don't understand control powerful things we care about. We should criticize the human, politician, or organization that enabled that
2y ago·view thread
comment
It's unfortunate that "AI" is still framed and discussed as some type of highly autonomous system that's separate from us. Bad acting humans with AI systems are the threat, not the…
2y ago·view thread
comment
My biggest challenge with GCP is that I'm still not convinced Google cares that much about this division. They acquired Looker, fired the customer service staff, and then set it out to crumble.…
2y ago·view thread