https://openreview.net/forum?id=W9PYwtUbKh
Extending AutoCompressors via Surprisal-Based Dynamic Segmentation | OpenReview
The long-context bottleneck of transformer-based language models can be addressed via context compression frameworks such as AutoCompressors, which distill...
dynamic segmentationextendingviabasedopenreview