▲ 2 pointsSAW-INT4: System-Aware 4-Bit KV-Cache Quantization for Real-World LLM Servingarxiv.orgby matt_d·3mo ago·0 comments·view on hn ↗