Robuta

What's happening with the latest releases of large language models? Is the industry hitting the edge of the scaling laws, and do the current benchmarks...

Jan 26, 2023 - I have collected a database of scaling laws for different tasks and architectures, and reviewed dozens of papers in the scaling law literature.

Nov 21, 2024 - Builders of large AI models have relied on the idea that bigger neural networks trained on more data and given more processing power would show...

Dec 23, 2024 - A brief history of LLM Scaling Laws from compute-optimal training and inference to scaling test-time compute and whether Scaling Laws are coming to an end.

Jun 21, 2024 - Observing what the rapid rise of conviction in AI disrupting robotics says about technological forecasting, company building, and investing in 2024.

Will AI scaling laws keep on scaling as models get bigger and bigger? History suggests it's not always so simple.

MIT and MIT-IBM Watson AI Lab researchers have developed a universal guide for estimating how large language models (LLMs) will perform based on smaller models...