AnyLearn
All lessons

deepseek

5 lessons tagged deepseek: free, quiz-checked micro-lessons.

AI
advanced

RL in Reasoning Models: How o1, DeepSeek-R1, and Friends Think

A deep look at how reinforcement learning on chains-of-thought powers o1, DeepSeek-R1, Claude reasoning, and Gemini Thinking — covering GRPO, MCTS-style search, test-time compute scaling, and distillation into smaller models.

13 steps·~20 min
AI
advanced

RLVR and GRPO: Training LLMs with Verifiable Rewards

How Group Relative Policy Optimization turns unit tests and theorem provers into training signals — the technique behind DeepSeek-R1's leap in math and code reasoning without a reward model.

12 steps·~18 min
AI
intermediate

LLM Post-Training: SFT, RLHF, DPO, and Modern Alignment Recipes

A deep dive into how raw pretrained language models become helpful assistants — from supervised fine-tuning on curated demonstrations, through reward modeling and PPO-based RLHF, to modern direct alignment methods like DPO and the recipes used in Llama 3, Llama 4, and DeepSeek.

12 steps·~18 min
AI
intermediate

Modern LLM Architectures: From Decoder-Only to Mixture-of-Experts

A deep tour of the architectural choices powering today's large language models — decoder-only Transformers, encoder-decoder designs, grouped-query attention, RoPE positional embeddings, and mixture-of-experts routing — with concrete numbers and trade-offs.

12 steps·~18 min
AI
intermediate

The LLM Landscape in 2026: Who Makes What

A practitioner's map of the major frontier-model labs as of early 2026 — who they are, what they ship, which models are open vs closed, and how the field has split into general-purpose chat and reasoning families.

10 steps·~15 min

Related topics