Reddit,但配备多个本地大型语言模型(LLM)代理。

1作者: huydotnet大约 1 个月前原帖
这是我为了好玩而创建的一个项目:https://redditwithagents.vercel.app/ 截图: https://i.imgur.com/JFMFBNF.png 这个项目基本上是一个模仿Reddit界面部分功能的网页应用,允许你在浏览器中与大型语言模型(LLM)代理进行讨论。 所有的LLM API调用都在浏览器中进行,因为这个应用没有后端。你也可以配置应用使用你本地的LLM API。 例如,要使用LM Studio,请确保你在本地提供模型,并勾选两个选项:“启用CORS”和“在本地网络上提供服务”。 以下是它的样子:https://i.imgur.com/TfzIjl4.png 然后前往应用的设置页面,设置以下配置: ``` API URL: http://192.168.<whatever>.<your>:1234/v1 API Key: 你设置的任意密钥 Model: 类似于 openai/gpt-oss-20b ``` 你也可以在这里查看源代码:https://github.com/huytd/reddit-with-agents
查看原文
This is a project I created for fun: https:&#x2F;&#x2F;redditwithagents.vercel.app&#x2F;<p>screenshot: https:&#x2F;&#x2F;i.imgur.com&#x2F;JFMFBNF.png<p>It&#x27;s basically a web app that mimic parts of Reddit&#x27;s UI, allowing you to discuss with LLM agents right in the browswer.<p>All of the LLM API calls happen in the browser as the app does not have a backend. You can also config the app to use your local LLM APIs as well.<p>For example, to use LM Studio, make sure you serve the model locally and checked the two options: &quot;Enable CORS&quot; and &quot;Serve on Local Network&quot;<p>here&#x27;s what it look like: https:&#x2F;&#x2F;i.imgur.com&#x2F;TfzIjl4.png<p>Then go to the app&#x27;s settings page, set the following configs:<p><pre><code> API URL: http:&#x2F;&#x2F;192.168.&lt;whatever&gt;.&lt;your&gt;:1234&#x2F;v1 API Key: whatever-key-you-set Model: soemthing like openai&#x2F;gpt-oss-20b </code></pre> You can also check the source code here https:&#x2F;&#x2F;github.com&#x2F;huytd&#x2F;reddit-with-agents&#x2F;