Looking for advice for small office looking for local AI RAG

My company is looking for basically a local hardware back-end for an already set up Open WebUI Windows AD joined setup. We are already on the frontier models thru Open WebUI. ~10 users. Workload is a lot of contract and chat based email stuff, generate contracts, generate quotes. We want a local back end so we can get our RAG data set going that we have been preparing. Not a huge library but maybe ~500 pdfs ready to be converted to .md mostly standards related to the field we work in (civil). Budget ~$5-6k Are the GB10 Blackwell rigs still the best option now? Last we looked was about 6 months ago.

添加评论
点赞收藏
点踩分享查看原文
评论
?
参与讨论