back

by tosh·12d ago·view on hn ↗
I agree in principle but in practice this is not easy

even with a robust, well thought through setup every model behaves in its own way, some adhere more to a system prompt, another model has more recent cut-off time and knows about new parts in the stdlib

some oversteer, some understeer …

if you want the best performance unfortunately there is not really a way other than to constantly adapt the harness/clutches/context to the model du jour

1 comments
I agree in any practice, it's not easy :)

In a non-deterministic world the compiler is no longer consistent anyways.