Kimi K3 Architecture Notes

Sebastian Raschka, PhD，Sebastian Raschka 的个人主页，AI 研究员与教育者，《Build a Large Language Model (From Scratch)》作者。关注

Short architecture note on Kimi K3, including LatentMoE, Kimi Delta Attention, Attention Residuals, NoPE, multimodality, and inference-efficiency choices.

添加评论
点赞收藏
点踩分享查看原文
评论
?
参与讨论