MiniMind: Train Your Own 64M-Parameter LLM From Scratch in PyTorch (GitHub)
AI-generated summary The GitHub project MiniMind teaches users how to train a 64M-parameter language model from scratch using plain PyTorch. The repository covers tokenization, pretraining, fine-tuning, and reinforcement learning while operating under the Apache 2.0 licence.