feat(kvcache): host-resident prefix tier for hybrid GDN models (snapshots + KV pages) - #525

Open

alvarorsouza-arch wants to merge 3 commits into

FlashML-org:mainfrom

alvarorsouza-arch:host-prefix-tier

Commits on Sep 17, 2026

feat(kvcache): host-RAM KV tier for sparse-attention models (--kv-host-pages)
alvarorsouza-arch
committed
849e072

Commits on Sep 19, 2026

fix(kvcache): fp8-aware write-through mirror + batch-safe selection cap
alvarorsouza-arch
committed
20f3b23
feat(kvcache): host-resident prefix tier for hybrid GDN models
alvarorsouza-arch
committed
5046e4a