问HN：本地LLM备份的设置？
作为未来访问变更的备份，我希望能够拥有最新的LLM权重和一台可以运行查询的机器。OpenAI发布权重的时机正好适合进行这项准备。我的问题是，您会购买什么样的硬件配置，要求合理可及（比如在5000美元以下，理想情况下远低于这个价格），并且能够很好地运行本地查询的模型。此外，如果有影响的话，这套设备是否适合用于存档，比如在出现重大进展使得今天的LLM变得过时之前，或者在需要时，因为没有好的、开放的权重可用。
查看原文
As a backup in case future access changes, I'd like to have sota LLM weights and a machine that can run queries with them in reserve. OpenAI releasing weights is as good a time as any to actually do it. My question is what hardware setup would you buy, that is reasonable accessible (say under 5k, ideally well under) and can do a good job running the models for local queries. And, if it matters, could be suitable for archiving, say until either there is a substantial advance rendering today's LLMs obsolete or until needed because good, open weights aren't available anymore.