back

by apitman·1d ago·view on hn ↗
Currently software is king when it comes to inference performance though.
1 comments
Having the entire model in the vram without having to transfer anything is even more king, though