请问HN：你推荐的本地托管大语言模型（LLM）聊天机器人开发教程有哪些？
“可以在本地运行的、允许使用CPU而不仅仅是GPU的LLM（大型语言模型）用于聊天机器人开发”可能指的是Llama，对吧？或者还有其他同样优秀并值得考虑的选项吗？
我来得有些晚（不后悔），直到现在我对任何形式的聊天机器人开发都没有任何灵感。所以我想跳过那些已经过时（或虚构）的教程，这些教程可能通过简单的网络搜索找到（尤其是考虑到今天的搜索质量……）。
我将要尝试的这个玩具将是开源且完全免费的，不涉及创业相关的内容……所以我不想追求一些前沿技术。它会类似于SocialAI，但在各个方面都更加有限（一些我不关心的东西），同时具备离线能力，并且用户可以在性格、倾向、世界观、观点和（大多数）机器人的条件反射等方面进行更多的调整。这是我想要实验的角度，旨在创造“一个足够可信的兴趣过滤泡泡以供娱乐价值，并观察它随时间的展开”。所以是为了娱乐，但应该会很有趣。
所以，是的，感谢你在这里分享哪些博客、视频或其他教程可以帮助程序员从（几乎）零基础到定制目标聊天机器人Hello World，这些内容是最近的/当前的，并且理想情况下专门基于（具有）离线/本地设置的LLM。我目前只知道这些东西作为提示文本区域，而不是可配置的可操作API接口。
如果有任何在LLM之前的时代或非LLM的替代方案（任何语言/技术栈的开源库或SDK）你会推荐的，比如说比Eliza更好的但又不是LLM的，我也会感兴趣 =)
查看原文
"Locally-runnable, CPU-not-just-GPU-permitting LLMs for chatbot dev" probably means Llama, right? Or are there other contenders on par and worth (co)considering?<p>I'm late to the game (no regrets), having had simply zero inspirations until now for any kind of chatbot dev. So I wanna skip all the already-outdated (or hallucinated) tuts a simple web search might probably yield (given today's web search quality especially...)<p>This toy I'll tinker on will be foss&fully-free, no startup stuff.. so not looking for some bleeding edge. Will be sth like SocialAI but more limited in various ways (stuff I don't care for) and yet offline-capable and with way more user-side tweakability of the nature/inclinations/worldview/opinions/conditioning of the (majority of) bots. That's the angle I wanna experiment on, to bring "make your sufficiently-plausible filter bubble of interest for entertainment value, and observe it unfolding by itself over time". So for amusement, but should be interesting.<p>So yeah, thanks for sharing here which blogs/videos/other-tuts take the coder from (near)zero to CustomTargetedChatbot(s)HelloWorld, are recent / current and building ideally specifically on (LLMs with) an offline / local setup. I only know these things as prompt textareas so far, not as configurable hackable API surfaces..<p>On the off-chance there's a pre-LLM-era or non-LLM alternative (foss lib or sdk in any lang/stack) that you'd recommend, ie. better-than-Eliza but non/pre-LLMs, I'd be interested too =)