1Skipping 90% of KV dequant work speeds up LLM decode by 22% (opens in new tab)(github.com)1pidtom1mo ago0
