阿姆达尔定律在大型语言模型生成代码中的应用
大型语言模型(LLMs)理论上可以生成数百万行正确的代码。然而,对于任何重要的代码,唯一能确认其正确性的方法是逐行审核,这比编写每一行代码更为困难,因为逐行审核可以帮助你建立一个概念层次和模型,从而更好地理解代码。因此,在编写任何重要内容时,LLMs的加速效果存在根本限制。
(主要的反对意见是,如果有人工工程师在你身边工作怎么办。但这只是一个干扰:有时你可以完全信任一位工程师,而对于LLMs来说,这一点完全不成立。)
查看原文
LLMs may theoretically be able to generate millions of correct lines of code.<p>But for any important code the only way to know that it's correct is to hand-audit every line, which is harder than writing every line because this allows you to build a conceptual hierarchy and model within which you can think about the code.<p>So there's a fundamental limit to the speedup from LLMs when writing anything you care about.<p>(The main objection will be what about when you have a human engineer working on your behalf. But this is a distraction: sometimes you can fully trust an engineer, which is not at all true for LLMs.)