>when a 1t param model runs off a $200 SSD instead of a $50k rack of Nvidia chips.

I am 100% sure this won't happen in 10 years time. At least not on a $200 SSD. But I wouldn't be surprised if it ran on $1K to $2K HBF SSD. It will still be better than a $50K Rack.