Higher-order pruning of experts in mixture-of-experts language models
arXiv:2609.18916v1 Announce Type: cross Abstract: Mixture-of-Experts (MoE) language models suffer from large parameter counts, which create a significant memory bottleneck. Expert pruning is the most direct approach for reducing this parameter…
Read the full story at arXiv cs.AI ↗
ImpactNotable 31/100
Why it mattersRule-based estimate: event keywords (+4); trust 6/10.
RegionsGlobal
Published3 d ago (Thu, 17 Sep 2026 04:00:00 GMT)
RetrievedThu, 17 Sep 2026 15:30:40 GMT via rss
ClassifiedThu, 17 Sep 2026 15:30:51 GMT by heuristic
AuthorAlex M. Tseng, Prannay Kaul, Luca Zancato, Wei Xia, Stefano Soatto