https://themenonlab.blog/blog/guppylm-build-llm-from-scratch-5-minutes/
GuppyLM: Build a Working LLM From Scratch in 5 Minutes
GuppyLM is a 9M parameter language model trained from scratch on a free Colab GPU in 5 minutes. One notebook covers data generation, tokenizer training, model...
build afrom scratchworkingllmminutes