back

by numeri·2y ago·view on hn ↗
Yeah, this is correct and I'm not sure what paper GP was thinking of – Chinchilla is only about finding the point at which it would be more useful to scale the model rather than training longer.

Chinchilla optimal scaling is not useful if you want to use the model, just if you want to beat some other model on some metric for the minimal training costs.

1 comments
Well, my point is that "scale the model" is equivalent to upping inference costs.