linear sequence - Robuta Search

https://huggingface.co/papers/2502.13685 Paper page - MoM: Linear Sequence Modeling with Mixture-of-Memories Join the discussion on this paper page linear sequence paper mom modeling mixture https://openreview.net/forum?id=AL1fq05o7H Mamba: Linear-Time Sequence Modeling with Selective State Spaces | OpenReview Foundation models, now powering most of the exciting applications in deep learning, are almost universally based on the Transformer architecture and its core... linear time mamba sequence modeling selective https://github.com/ksv-muralidhar/linear_sequence_predictor GitHub - ksv-muralidhar/linear_sequence_predictor: Python app that predicts the next number given a... Python app that predicts the next number given a sequence of numbers, by training a gradient descent regressor (built from scratch) on-the-fly. -... https://openreview.net/forum?id=y8Rm4VNRPH&referrer=%5Bthe%20profile%20of%20Yu%20Zhang%5D(%2Fprofile%3Fid%3D~Yu_Zhang36) Parallelizing Linear Transformers with the Delta Rule over Sequence Length | OpenReview Transformers with linear attention (i.e., linear transformers) and state-space models have recently been suggested as a viable linear-time alternative to... with the delta rule parallelizing linear transformers https://arxiv.org/abs/2312.00752 [2312.00752] Mamba: Linear-Time Sequence Modeling with Selective State Spaces Abstract page for arXiv paper 2312.00752: Mamba: Linear-Time Sequence Modeling with Selective State Spaces linear time 2312 00752 mamba https://elifesciences.org/articles/45909 Homology sensing via non-linear amplification of sequence-dependent pausing by RecQ helicase | eLife The rate of DNA unwinding by RecQ helicases is dramatically modulated by the DNA duplex stability in a geometry-dependent manner, providing an intrinsic... https://aclanthology.org/2023.blackboxnlp-1.2/ Emergent Linear Representations in World Models of Self-Supervised Sequence Models - ACL Anthology Neel Nanda, Andrew Lee, Martin Wattenberg. Proceedings of the 6th BlackboxNLP Workshop: Analyzing and Interpreting Neural Networks for NLP. 2023. linear representations world models https://arxiv.org/abs/2312.00752?ref=news.future-shock.ai [2312.00752] Mamba: Linear-Time Sequence Modeling with Selective State Spaces Abstract page for arXiv paper 2312.00752: Mamba: Linear-Time Sequence Modeling with Selective State Spaces linear time 2312 00752 mamba https://arxiv.org/abs/2404.02882 [2404.02882] Linear Attention Sequence Parallelism Abstract page for arXiv paper 2404.02882: Linear Attention Sequence Parallelism 2404 02882 linear attention sequence https://openreview.net/forum?id=qI2Vt9P9rl Uncovering the Computational Roles of Nonlinearity in Sequence Modeling Using Almost-Linear RNNs |... Sequence modeling tasks across domains such as natural language processing, time-series forecasting, speech recognition, and control require learning complex... https://openreview.net/forum?id=5t57omGVMw Learning to Relax: Setting Solver Parameters Across a Sequence of Linear System Instances |... https://openreview.net/forum?id=gG8sQUUtN7 LASP: Linear Attention Sequence Parallelism | OpenReview Sequence parallelism (SP) serves as a prevalent strategy to handle long sequences that exceed the memory limit of a single device. However, for linear sequence... lasp linear attention sequence parallelism