问HN:有没有人拥有专用的本地AI服务器?
我在考虑尝试运行一些本地的人工智能模型,既用于自主编码,也想开发基于人工智能模型的产品。<p>目前我还没有考虑训练模型,而是更关注推理,同时尽量控制预算。我大约有2000到3000欧元可以用于购买家用服务器的硬件。我知道可以租用人工智能推理服务器,但根据我的研究,这类服务器的租金通常在每月200到300欧元左右,这意味着我的硬件大约在10个月内就能自我偿还。<p>然而,我对选择什么硬件感到有些困惑。我看到有人推荐使用Ryzen AI Pro+ 395的紧凑型PC,但也有人建议构建一台“常规”PC,配备Nvidia 3090或4090。<p>对于那些运行小型服务器(而不是10,000到15,000欧元的大型服务器)的人来说,你们的经验和建议是什么?
查看原文
I'm toying with the idea of trying to run some local AI models for both agentic coding, as well as trying to get into developing products on top of AI models.<p>I'm not, yet, looking into training models, but more about inference, while staying relatively on a budget. I have about €2-3k to spend on hardware, for a server I can run at home. I know that one can rent an AI inference server, but from my research, they tend to cost around €200-300/mo, which means that my hardware will pay for itself in ~10 months.<p>However, I'm quiet confused with what hardware to chose. I saw recommendations for Ryzen AI Pro+ 395, in SFF PCs, but some people suggest instead to build a "regular" PC with Nvidia 3090 or 4090.<p>People who run small servers (as opposed to €10-15k beasts), what's your experience and recommendations?