Retrieval‑Augmented Memory Reduces Sliding‑Window Limitations in Video Models

VideoMLA’s low‑rank latent KV cache cuts KV‑cache demand by roughly 90 % and LongLive‑RAG’s retrieval‑augmented memory helps mitigate the temporal drift introduced by sliding‑window attention. The KV‑cache reduction comes from replacing per‑head keys and values with a shared low‑rank latent, shaving