Would it be comparatively easy to make neuromorphic chips instead of traditional chips? I believe probabilistic algorithms like those employed by LLM's must be more tolerable to working with defects as well..?
back
1 comments
Yeah, so neuromorphic chips aren't particularly good at running (current) LLMs, in fact they would suck at it compared to GPUs. Neuromorphic chips are awesome for very niche, small kinds of neural networks used in robotics and edge devices.
However, I think you're right in the sense that neural networks can tolerate dead parameters pretty well, so maybe some kind of AI training or inference chip could be made with more fault-prone methods.
At the end of the day, chips are useless if nobody's willing to write software to run on them. Biologics would likely be good at making weird new kinds of chips, and they'd need a massive edge for anyone to care.