7. Gemma

介绍 Gemma 系列模型的的架构与训练方法

• Gemma 主要技术：Sliding Window Attention、RMSNorm

• 参考资料

  • 论文

    • Gemma：Gemma: Open Models Based on Gemini Research and Technology

    • Gemma 2：Gemma 2: Improving Open Language Models at a Practical Size

    • Gemma 3：Gemma 3 Technical Report

    • Gemma 3n：Introducing Gemma 3n: The developer guide - Google Developers Blog