Qwen3-4B learning-rate sweep

Qwen3-4B midtraining learning-rate sweep

English · change vs Qwen3-4B (points)

DNA · sequence recovery

80% DNA / 20% English unless noted, 50B training tokens. English: average of MMLU-Pro, HellaSwag, OpenBookQA.