开源推理今年每周增长10%。
我们是一家小型推理服务提供商，刚刚在两周前公开上线，已经看到了疯狂的增长需求。
我联系了许多其他推理服务提供商，如Fireworks、togetherAI、simpliAI等，询问他们的增长情况以及他们对这一领域的看法和预测。
Fireworks的一位高层告诉我，自一月份以来，整个行业平均每周增长10%——这种爆炸性的增长感觉不真实。老实说，我预计今年晚些时候会出现价格挤压，没人能跟上这个速度。
我认为我们已经开始看到这一点，从GPU的价格来看——H100的按需价格从1.30上涨到大约1.90，H200节点全部售罄，等待名单超过3个月。我从我得到的报价来看，B300的等待名单几乎有一年的时间。市场真是疯狂。
查看原文
So we're a small inference provider, launched publicly two weeks ago and have seen a crazy demand of growth.<p>I reached out to a lot of other inference providers such as fireworks, togetherAI, simpliAI etc and started asking them their growth and what they are seeing in this space / what they predict we will see over this year.<p>I was told by a higher up at fireworks that on average since January the space as a whole has had 10% week over week growth -- this type of explosive growth feels unreal. I honestly expect a price squeeze later this year, no one can keep up.<p>I think we're starting to see this with GPU prices -- h100s have gone from 1.30 on demand to 1.90 about, h200 nodes are all sold out with 3+ month waitlists. B300s have near a year waitlist from the quotes I got. Insane market.