KV-psi
Trim an LLM KV cache using Linux Pressure Stall Information.
Why it made the shelf
KV-psi is an open source software tool designed to optimize LLM performance using Linux system metrics.
Seen on
- First seen
- 3 months ago
- Best score
- 8 points
Behind the tool
Who built it. How it grew.
People, backing, growth, and ownership. Every claim links to its source.
Official sitegithub.com
Source review current
Public trail
Where it showed up
1 reference from 1 publisher.
- First trace
- Hacker News3 months ago
- 01Hacker NewsFirst trace
KV-psi, using Linux PSI to to trim an LLM KV cache
