Post-Training Recipes Converge on Multi-Teacher On-Policy Distillation
Frontier labs have shifted from single-stage RL pipelines to Multi-teacher On-Policy Distillation (MOPD), where N domain-specialist teachers feed into one student via on-policy distillation. DeepSeek V4, Nemotron 3 Ultra, and others scale this to 10+ teachers across reasoning, code, math, and agentic domains. The shift emerged because monolithic RL became expensive and conflict-prone; specialists are parallelizable and compositional.
If you're studying post-training or building open-model recipes, MOPD is now the canonical pattern. It changes how you think about scaling: instead of one big RL run, orchestrate multiple smaller runs and merge them.
Interconnects
Kimi K3 and GLM 5.2 Show Open Models Closing the Gap to Frontier
Kimi K3 (2.8T MoE, open weights pending) ranks #2 on Vals AI and #1 in code tasks, threatening the performance lead of Claude Fable and GPT 5.6. Chinese labs are demonstrating efficiency advantages through architecture innovations (delta attention, sparsity improvements) that yield 2.5× scaling efficiency gains. Xi Jinping committed China to open-source AI as national strategy, signaling risk tolerance on capability release.
The open-to-closed performance gap is now 3–5 months, not 6–9. If you're betting on closed models maintaining a moat, the evidence is shifting. Open models are viable for fine-tuning and domain specialization workflows.
Interconnects
Agentic RL Lifts Text-to-SQL from 73% to 74.3% Through Multi-Turn Tool Use
ReToolSQL combines supervised fine-tuning on verified reasoning traces with agentic reinforcement fine-tuning over multi-turn tool trajectories (SFT→RFT). On BIRD-SQL, Gemma 4 31B reached 74.32% execution accuracy single-pass, ranking first on the development leaderboard. The approach shows that tool-use trajectories unlock capabilities that single-turn training cannot, particularly for error recovery.
This pattern—SFT on verified traces, then RL over tool-use trajectories—is now the canonical approach for grounding LLMs in structured domains. Directly applicable if you're building reasoning-heavy applications.
arXiv cs.AI
Vector Index Retrieval Accelerates LLM Output Projection by 82%
Researchers replace dense vocabulary projection with HNSW-based vector indexing for top-k token selection, treated as maximum inner product search. On CPU inference with compact models (Gemma 3 270M, Qwen 3), end-to-end batch-size-one throughput improved up to 82% while preserving generation quality under evaluation.
If you're optimizing inference on resource-constrained hardware or building local tools, this shows approximate retrieval is practical for the output bottleneck—a major latency source in small-batch serving.
arXiv cs.CL
LLMs Encode Internal Signals for RAG Confidence—Use Hidden Activations to Route
Researchers show that models' middle-layer hidden activations encode whether retrieved evidence is sufficient, conflicting, or insufficient to answer a query. A lightweight linear classifier on these signals outperforms prompting-based baselines and specialized RAG models across 16 model architectures. The approach treats RAG triage as a decoding problem rather than a reasoning problem.
If you're building RAG systems, this shows the model's internal uncertainty is predictive and cheaper to decode than asking the model to explain its reasoning.
arXiv cs.CL
Knowledge Distillation to Small Models Exhibits Bimodal Collapse Below 5-Point Gains
On a healthcare API routing task, knowledge distillation variants show seed standard deviations up to 48.7 percentage points—swallowing all gains under five points. Three of seven KD variants exhibited bimodal collapse where 33–67% of seeds fell below 55% accuracy while others trained normally. Only progressive_kd and rank_kd avoided collapse, suggesting single-seed evaluation cannot detect central failure modes.
If you're distilling to compact models for production, this is a warning that reported gains need multiple seeds and statistical rigor. The variance is high enough to hide systematic failures.
arXiv cs.CL
Qwen 2.5-14B Answers 67% of 41 Years of Jeopardy! Clues—Beats Watson on Out-of-Distribution
A 9GB quantized open model evaluated on all 529,939 Jeopardy! clues from 1984–2025 achieves 67% accuracy (85% on factoid categories). On clues aired after its training cutoff, it holds 65% accuracy vs. Claude Opus 95%, while IBM's Watson scores zero by construction. The result demonstrates portability and longevity of general knowledge in modern LLMs vs. sealed, curated systems.
This is a concrete demonstration that small open models retain broad factual knowledge. Useful data point if you're evaluating whether fine-tuning a smaller open model beats paying for API access.
arXiv cs.AI