展示HN：用于大型语言模型操作的彭博终端 – 免费且开源
彭博终端的存在是因为金融交易员需要一个地方来查看所有信息：价格、风险、路由、对手方健康状况。你不能在盲目中交易。
大型语言模型（LLM）工程师们正处于盲目交易的状态。
现在哪个服务提供商的状态不佳？当考虑到间接成本时，这个模型的实际费用是多少，而不仅仅是代币价格？如果流量在不同的服务提供商之间转移，成本和延迟会发生什么变化？你的技术栈是否过于集中在一个服务提供商上？
这些都是每个生产环境中的LLM系统所面临的操作问题。直到现在，没人为这些问题构建工具，因此大多数团队要么盲目操作，要么拼凑状态页面、电子表格和直觉。
我们构建了LLM运维工具包来解决这些问题：
1. 监控18个以上LLM提供商的在线状态，一目了然的实时状态
2. 包含间接成本的费用计算器，而不仅仅是原始代币定价
3. 路由模拟器，在转移流量之前模拟成本和延迟的影响
4. 模型多样性审计，提前发现集中风险，避免事件发生
免费、开源，无需注册。仪表板地址是 tools.lamatic.ai
路由模拟器是最具实验性的部分，尚不够完善。我们真心希望了解其他人如何看待服务提供商集中风险。
我们一直将其视为软件中的依赖风险，但这种框架在大规模应用时可能不再适用。
今天在Product Hunt上也有上线：producthunt.com/products/lamatic-ai
查看原文
Bloomberg Terminal exists because financial traders needed one place to see everything: prices, risk, routing, counterparty health. You can't trade blind.<p>LLM engineers are trading blind.<p>Which provider is degraded right now? What does this model actually cost when you factor in overhead, not just token price? If traffic shifts between providers, what happens to cost and latency? Is your stack dangerously concentrated on one provider?<p>These are operational questions every production LLM system has. Nobody's built the tooling for them until now, so most teams either fly blind or patch together status pages, spreadsheets, and gut feel.<p>We built the LLM Ops Toolkit to fix that:<p>1. Provider uptime monitor across 18+ LLM providers, live status in one view
2. Cost calculator that includes overhead, not just raw token pricing
3. Routing simulator to model cost and latency impact before you shift traffic
4. Model diversity audit to surface concentration risk before it becomes an incident<p>Free, open-source, no signup. Dashboard is at tools.lamatic.ai<p>The routing simulator is the most experimental piece and has the roughest edges. Genuinely curious how others think about provider concentration risk.<p>We've been treating it as dependency risk in software but that framing may not hold at scale.<p>Also live on Product Hunt today: producthunt.com/products/lamatic-ai