Ideas on 4x RX7900xt + 1x RTX3060 (92GB VRAM) + 64GB Ram

localllama (Reddit)，r/LocalLLaMA，约 72.8 万成员的社区，专注于在本地硬件上运行大语言模型，涵盖模型选择、GPU 配置、量化技术、Ollama 与 llama.cpp 等工具，以及隐私优先的 AI 工作流。关注

preview.redd.it/c7m0ir9dt8vh1.png Hi there, I'm trying to build a server that can handle GLM 5.3 Flash q3xl/q4 & Qwen 3.8 next flash at the least 30tk/s on a budget. Also, since I'm in a third world country, there is no server grade hardware or professional cards anywhere. So, I'm planning to buy these, all used. 4x RX7900xt(20gb, 2x pcie3.0 x8/2x pci 3.0 x16)+1x RTX3060(12gb, pcie 3.0 x4)=92Gb of VRAM. And 64Gb of 3600mhz ram. What do you think about it? Do you have any other suggestions?

添加评论
点赞收藏
点踩分享查看原文
评论
?
参与讨论