back

by pella·2y ago·view on hn ↗
Is this an M2 Ultra with 192 GB of unified memory, or the standard version with 64 GB of unified memory?
1 comments
4-bit quantized 180B will not fit in 64GB. You'll need need over 100 GB for that.