back

by signa11·8mo ago·view on hn ↗
this is just _excellent_

```

       I would conjecture that this is another manifestation of the
       NP-completeness wall that slammed symbolic AI, causing the
       first AI winter. It's always possible to turn an NP-complete
       algorithm into one that runs quickly, if you don't mind that it
       fails to generate any output if you hit a timeout. The
       transformer equivalent of this is generating plausible, wrong,
       hallucinated output in cases where it can't pattern match a
       good result based on its training. The problem, though, is that
       with traditional AI algorithms you typically know if you've hit
       a timeout, or if none of your knowledge rules match. With
       transformers, generating wrong output looks exactly like
       generating correct output, and there is no way to know which is
       which.
```