back
user profile
skadamat
5,837karma·1,157submissions·August 2, 2011
about
Better data tools
recent activity (1,157 total)
comment
This is one of my favorite features of DuckDB and Parquet files! I combined these capabilities with mounting via NFS and documented in the last part of my post here: https://about.xethub.co…
comment
Thanks for the kind words! We definitely got inspiration from Git LFS
comment
We also have a writeup on the features and workflow if people want to dive deeper: https://about.xethub.com/blog/xetdata-scale-github-repos-100... …
comment
Good question -- we've tested this a bit and it seems pretty clean. After removing the app, you can make these small changes we've documented in our uninstall path: https://xethub…
comment
> You can't meaningfully version control the data; it's usually binary, and in an object store. The code already lives in a git repository. So what does that leave, the metadata around t…
comment
I work at XetHub and we're taking a different approach here to managing ML experiments in git. Instead of trying to store data and ML models in one place (like S3) and code, models & document…
comment
This is a super neat trick! At work, we're scaling git to terabyte scale and I'm constantly on the search for new ways we can showcase diffs for different file types: https://news…
comment
Out of the box no, but you can solve the scaling git problem by improving the deduplication: https://xethub.com/assets/docs/faq/how-xet-deduplication-wor... We're …
comment
WHY on earth would we let "AI systems" we don't understand control powerful things we care about. We should criticize the human, politician, or organization that enabled that
comment
It's unfortunate that "AI" is still framed and discussed as some type of highly autonomous system that's separate from us. Bad acting humans with AI systems are the threat, not the…
comment
My biggest challenge with GCP is that I'm still not convinced Google cares that much about this division. They acquired Looker, fired the customer service staff, and then set it out to crumble.…