请问HN:提示调优真的重要吗?

1作者: jonjohh7 个月前原帖
嗨,HN, 我之前在一家合规AI初创公司担任AI工程师,工作中最糟糕的部分就是收集数据和调整提示。评估过程非常糟糕。 我目前正在探索一些想法,惊讶地发现很多加速器中的工程师,甚至是种子阶段的团队,几乎都跳过了任何形式的LLM评估或提示调整。 我对微调感到失望,没听到关于dspy的好评,过去两年里一直听到“模型会不断变得更聪明”作为借口。 我很想听听其他人在调整提示方面的经验,以及他们对这项工作的看法。
查看原文
Hi HN,<p>I previously worked as an AI engineer at a Compliance AI startup and the worst part of the job was gathering data and tuning prompts. Evals were awful.<p>I&#x27;m currently exploring ideas and was surprised to find that a lot of engineers at accelerators, and even seed stage, are pretty much skipping any sort of LLM eval or prompt tuning.<p>I&#x27;ve been let down by finetuning, haven&#x27;t heard great things about dspy, and kept hearing &quot;well, the models will keep getting smarter&quot; as the cop out for the last 2 years.<p>Curious to hear the experience of others when it comes to tuning prompts&#x2F;how they view the work.