Running on CPU Upgrade Featured 2.68k The Smol Training Playbook 📚 2.68k The secrets to building world-class LLMs
Running on Zero Featured 1.73k Dia 1.6B 👯 1.73k Generate realistic dialogue from a script, using Dia!
Running 3.6k The Ultra-Scale Playbook 🌌 3.6k The ultimate guide to training LLM on large GPU Clusters
Running 85 Scaling FineWeb to 1000+ languages: Step 1: finding signal in 100s of evaluation tasks 📝 85 Evaluate multilingual models using FineTasks
Running 131 TxT360: Trillion Extracted Text 📖 131 Explore and analyze the TxT360 dataset for LLM pre-training
Running on CPU Upgrade Featured 992 Model Memory Utility 🚀 992 Calculate vRAM needed for model training and inference
Running Featured 1.23k FineWeb: decanting the web for the finest text data at scale 🍷 1.23k Generate high-quality text data for LLMs using FineWeb