Robuta

https://rocm.docs.amd.com/projects/ai-developer-hub/en/latest/notebooks/pretrain/torchtitan_deepseek.html Pretraining with TorchTitan — Tutorials for AI developers 12.0 for ai pretraining torchtitan tutorials developers https://arxiv.org/abs/2508.06601 [2508.06601] Deep Ignorance: Filtering Pretraining Data Builds Tamper-Resistant Safeguards into... Abstract page for arXiv paper 2508.06601: Deep Ignorance: Filtering Pretraining Data Builds Tamper-Resistant Safeguards into Open-Weight LLMs deep ignorance filtering pretraining data https://dmol.pub/dl/pretraining.html 20. Pretraining — deep learning for molecules & materials deep learning pretraining molecules materials