Can anybody point me to a better introduction into organoid intelligence? This all looks important and interesting, but this article seems to be all over the place. Turing test and CAPTCHA are not very convincing arguments brains beat AI. Brains store 2,500 (terabytes)? I'd like to see a source for that. Most brains I meet don't seem to know more about the world than a 7B LLM
back
3 comments
Most brains don't treat themselves to an abundance of training data, the ones who do seem pretty knowledgeable to me.
Witty comment aside, the human brain is pretty efficient in terms of energy use considering it's taking in a ton of data while it's conscious. Two each audio and video streams, olfactory, gustatory, touch, vestibular, and all the interoception. Inference and training in real time. All for the low price of 125 watts, a quarter that if you're just measuring the brain and not the whole body.
The paper was published last year. https://www.frontiersin.org/journals/science/articles/10.338...
I'm not convinced this field will outpace silicon or whatever succeeds it, considering how big the semiconductor industry is.
I have a suspicion that organoids will be to artificial intelligence what ornithopters are to flight. Technically possible, but reinventing it from scratch instead of following biology strictly will give us dramatic performance improvements.
All for the low price of 125 watts, but you need to sleep one fourth of the time, during which it doesn't do much, and on the other three thirds "Most brains don't treat themselves to an abundance of training data".
I'm not sure I'd call this machine efficient at using its computational power.
Also, that is the net energy expenditure of the body, but not the input required. We use a relatively antiquated form of the internal combustion engine to turn food into energy, which seems to be around 25% efficient, at best. It's also built on chains of other fairly inefficient biological entities, so it's hard to say what the overall efficiency is, but suffice to say that we're prevented from using the most efficient energy sources.
> during which it doesn't do much
I know this was in jest, but if sleep was not a critical biological process we would have evolved to not do it already
It's basically a cleaning cycle for the brain. If we don't sleep we die pretty soon. Meaning it's necessary daily scheduled maintenance downtime, which should count directly to efficiency calculations!
> Most brains I meet don't seem to know more about the world than a 7B LLM
I think this is pretty trivially untrue, it's just a very different sort of knowledge.
I’m not an LLM guy… how large on disk is a 7B LLM? (Minstrel is specific is needed, but a range would be great)
A completely unquantized fp16 model weight 7B LLM is about 15GB on a disk. You need closer to 24GB of memory for inference with a decently sized context.
Quantization is black magic of the software variety that seems to be able to significantly reduce that without a commensurate loss in quality, though the results are a little subjective. Some well reviewed quantizations of 7B models can get them below 9GB.