Dr. OPD: Learning What to Follow for Optimal On-Policy Distillation of Large Language Models
arXiv:2609.38025v1 Announce Type: cross Abstract: On-policy distillation (OPD) trains a student on its own generated responses using dense, token-level supervision from a stronger teacher. Vanilla OPD treats all teacher signals equally, assuming…
Read the full story at arXiv cs.AI ↗
ImpactNotable 31/100
Why it mattersRule-based estimate: event keywords (+4); trust 6/10.
RegionsGlobal
Published1 h ago (Wed, 30 Sep 2026 04:00:00 GMT)
RetrievedWed, 30 Sep 2026 04:00:56 GMT via rss
ClassifiedWed, 30 Sep 2026 04:01:19 GMT by heuristic
AuthorZhenyu Wang, Tianze Wang, Linjun Zhang, Yifan Hu