https://openreview.net/forum?id=ompl7supoX
Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations | OpenReview
Scale has become a crucial factor for obtaining strong machine learning models. As a result, understanding a model's scaling properties is key to designing new...
scaling lawscompute optimaltrainingbeyondfixed
https://openreview.net/forum?id=9GzyCtlngK
Compute-Optimal Scaling for Value-Based Deep RL | OpenReview
As models grow larger and training them becomes expensive, it becomes increasingly important to scale training recipes not just to larger models and more data,...
compute optimalvalue baseddeep rlscalingopenreview
https://howmanyparams.com/
Compute-Optimal LLMs
Chinchilla changed everything.
compute optimalllms
https://openreview.net/forum?id=MF7ljU8xcf
Compute-Optimal LLMs Provably Generalize Better with Scale | OpenReview
Why do larger language models generalize better? To explore this question, we develop generalization bounds on the pretraining objective of large language...
compute optimalbetter withllmsgeneralizescale
https://www.mathworks.com/help/robust/ref/dynamicsystem.h2syn.html
h2syn - Compute H2 optimal controller - MATLAB
This MATLAB function computes a stabilizing H2-optimal controller K for the plant P.
optimal controllercomputeh2matlab
https://openreview.net/forum?id=VNckp7JEHn
Inference Scaling Laws: An Empirical Analysis of Compute-Optimal Inference for LLM Problem-Solving...
While the scaling laws of large language models (LLMs) training have been extensively studied, optimal inference configurations of LLMs remain underexplored....