Muse Glimmer 30B Architecture Notes

Sebastian Raschka, PhD，Sebastian Raschka 的个人主页，AI 研究员与教育者，《Build a Large Language Model (From Scratch)》作者。关注

Short architecture note on Meta Muse Glimmer 30B, including gated local and global GQA, KV-cache efficiency, and release-time benchmark comparisons.

添加评论
点赞收藏
点踩分享查看原文
评论
?
参与讨论