ExANS
Lossless KV cache compression for GPUs operating at 622 GB/s on H100.
Why it made the shelf
Seen on Hacker News. First seen 2 months ago. Best score 14.
Seen on
- First seen
- 2 months ago
- Best score
- 14 points
Public trail
Where it showed up
1 reference from 1 publisher.
- First trace
- Hacker News2 months ago
- 01Hacker NewsFirst trace
Lossless KV cache compression at 622 GB/s on H100