If they aren't invisible, my cat would have caught and killed dozens of them, and then I'd be smelling their rotting corpses around my house and slipping on their bodies.

Also presumably they'd end up in many pictures, which even if we somehow ignored them still in all photographs AI would still see, as would car lidar systems, etc.

(I guess the likelier theory is that a mushroom that causes hallucination is causing hallucination)