I get your point, but hardware becomes obsolete. There will be a 'hardware overhang' (or more precisely stated, 'compute overhang') here. That is, unless we find a use for what will eventually be these older-gen GPUs. At least with traditional data centers, a lot of the hardware was storage, which the unfolding timeline of humanity was sure to fill up. Are we really going to do this much ongoing matmul on hardware that will eventually have outdated economics compared to next-gen GPUs? Go figure...
back
1 comments
I don’t think desktop gpus are going to move the needle for embodied AI robotics, at least not for on-board processing. The bottleneck currently is in making better models run on more resource-constrained devices, and there are different ways to approach this problem.