请问HN：是什么让保持大型语言模型在线如此困难？
感觉每隔几天就有一个大型AI服务出现故障、性能下降或变得缓慢。我并不是在抱怨，只是出于好奇。这些公司资金雄厚，人才济济。是什么原因导致运行这些模型的可靠性如此难以实现？是因为需求超出了预期，还是说提供AI服务与普通网页应用在本质上有根本的不同？
查看原文
It feels like every few days one of the big AI services is down, degraded, or just slow. I don't mean this as a complaint. I'm just genuinely curious. These are well-funded companies with smart people. What is it about running these models that makes reliability so elusive? Is it just demand nobody predicted, or is there something fundamentally different about serving AI vs. a normal web app?