Robuta

https://openreview.net/forum?id=svB4_0dObPj Variance Double-Down: The Small Batch Size Anomaly in Multistep Deep Reinforcement Learning |... We perform an exhaustive investigation into the interplay of batch size and update horizon and uncover a surprising phenomenon: when increasing the update... small batch size double down reinforcement learning variance anomaly