问HN:有没有人拥有专用的本地AI服务器?

1作者: skwee3579 天前原帖
我在考虑尝试运行一些本地的人工智能模型,既用于自主编码,也想开发基于人工智能模型的产品。<p>目前我还没有考虑训练模型,而是更关注推理,同时尽量控制预算。我大约有2000到3000欧元可以用于购买家用服务器的硬件。我知道可以租用人工智能推理服务器,但根据我的研究,这类服务器的租金通常在每月200到300欧元左右,这意味着我的硬件大约在10个月内就能自我偿还。<p>然而,我对选择什么硬件感到有些困惑。我看到有人推荐使用Ryzen AI Pro+ 395的紧凑型PC,但也有人建议构建一台“常规”PC,配备Nvidia 3090或4090。<p>对于那些运行小型服务器(而不是10,000到15,000欧元的大型服务器)的人来说,你们的经验和建议是什么?
查看原文
I&#x27;m toying with the idea of trying to run some local AI models for both agentic coding, as well as trying to get into developing products on top of AI models.<p>I&#x27;m not, yet, looking into training models, but more about inference, while staying relatively on a budget. I have about €2-3k to spend on hardware, for a server I can run at home. I know that one can rent an AI inference server, but from my research, they tend to cost around €200-300&#x2F;mo, which means that my hardware will pay for itself in ~10 months.<p>However, I&#x27;m quiet confused with what hardware to chose. I saw recommendations for Ryzen AI Pro+ 395, in SFF PCs, but some people suggest instead to build a &quot;regular&quot; PC with Nvidia 3090 or 4090.<p>People who run small servers (as opposed to €10-15k beasts), what&#x27;s your experience and recommendations?