https://openreview.net/forum?id=u7dlwgKstN&referrer=%5Bthe%20profile%20of%20Junyang%20Lin%5D(%2Fprofile%3Fid%3D~Junyang_Lin1)
CateKV: On Sequential Consistency for Long-Context LLM Inference Acceleration | OpenReview
Large language models (LLMs) have demonstrated strong capabilities in handling long-context tasks, but processing such long contexts remains challenging due to...
long contextllm inferencesequentialconsistency