DeepSeek V4 from the Inside
A technical reading of DeepSeek V4: Compressed Sparse Attention, Heavily Compressed Attention, manifold-constrained hyper-connections, Muon, and MXFP4, derived from the paper and the inference code.
点赞
收藏
点踩
分享评论
?
参与讨论
A technical reading of DeepSeek V4: Compressed Sparse Attention, Heavily Compressed Attention, manifold-constrained hyper-connections, Muon, and MXFP4, derived from the paper and the inference code.