Robuta

https://cris.tau.ac.il/en/publications/learning-low-dimensional-state-spaces-with-overparameterized-recu/ LEARNING LOW DIMENSIONAL STATE SPACES WITH OVERPARAMETERIZED RECURRENT NEURAL NETS - Tel Aviv... https://openreview.net/forum?id=k9CF4h3muD Learning Low Dimensional State Spaces with Overparameterized Recurrent Neural Nets | OpenReview Linear RNNs optimized with gradient descent have implicit bias leading to solutions with low dimensional state spaces leading to non-trivial extrapolation. neural nets learning low dimensional state https://jmlr.org/papers/v26/24-1547.html Characterizing Dynamical Stability of Stochastic Gradient Descent in Overparameterized Learning stochastic gradient descent characterizing dynamical stability learning