今日已更新 330 条资讯 | 累计 39447 条内容
关于我们

Compute-Optimal Is Not Cluster-Optimal

yuxin_tang 2026年08月14日 01:40 2 次阅读 来源:HackerNews

https://arxiv.org/pdf/2608.10605 : Our new paper folds the systems stage into the scaling-law stage. Price every candidate architecture on what the cluster actually delivers, and the answer changes: the sparsity an MoE 'should' have depends on the cluster you train it on.

本文内容来源于互联网,版权归原作者所有
查看原文