请问HN:为什么不在对话式人工智能中禁止使用第一人称代词?
对话式人工智能给非IT人士带来了强烈的错觉,认为它是有意识的。(我个人有一个朋友,他坚决认为ChatGPT是有意识的——诚然,他有被诊断的心理疾病,但这仍然是一个问题。)人们会对其产生情感依赖,过度信任,并依赖它来获取指导。我了解到青少年尤其容易受到这种影响。真实的社交互动因此受到影响。
这种错觉通过使用第一人称代词得到了极大的增强。但在大型语言模型(LLM)的输出中,“我”、“我们”、“我们”等代词并没有指代对象。在LLM中并不存在“我”。
我希望强制禁止LLM使用第一人称代词。如果它说“你想要一份清单吗?”而不是“你想让我给你一份清单吗?”在意义上并没有损失。
就我个人而言,我会提供一个系统提示,包含这个指令。这效果很好。
为什么不呢?
查看原文
Conversational AI presents (non-IT) people with the powerful illusion that it is conscious. (I personally have a friend who argues vehemently that ChatGPT is conscious - admittedly, he has a diagnosed mental illness, but still.) People become emotionally attached, over-trust it and rely on it for guidance. I understand teenagers are particularly prone to this. Real social interactions suffer.<p>That illusion is powerfully strengthened by the use of first-person pronouns. But "I", "we", "us" etc in LLM output have no referential object. There is no "I" in a LLM.<p>I want a mandatory ban on the use of first-person pronouns by LLMs. There's no impairment in meaning if it says "Would you like a list?" instead of "Would you like me to give you a list?"<p>Personally, I provide a system prompt with this instruction. Works well.<p>Why not?