Well, bit more complicated than that, I've been eagerly helping in testing and keeping track of what they've done. Initially there were serious bugs, also about the templates, eventually they released RC1 which had some fixes towards the looping. Then a couple of days later, they released RC2 which supposedly fixed the issue, but ballooned the size so all of us who were running Laguna S 2.1 on a single Pro 6000, suddenly could no longer. So, unsure if RC2 actually fixes the issue, as we're a bunch who can no longer run it :)

Besides that, it was also discovered that their suggested inference parameters were wrong and led to worse behavior. Eventually someone discovered these works best (so if you have the issue with looping right now, try these, helps a lot for me but not 100% still) and was also what the evals used apparently: temperature: 1.0, top_p: 1.0, top_k:20

Now we're waiting for RC3 which Poolside said will come at one point, and hopefully also brings down the size again NVFP4 weights + full context can load properly again even on "smaller" hardware.