4. Scaling Law

介绍模型规模与性能的 Scaling Law 原理

• 参考资料

  • 帖子

    • Scaling Laws for LLMs: From GPT-3 to o3

  • 论文

    • Scaling Laws for Neural Language Models

    • Distillation Scaling Laws

    • Towards Greater Leverage: Scaling Laws for Efficient Mixture-of-Experts Language Models