GPT-5.4的一个漏洞导致OpenAI禁止使用哥布林和浣熊。

1作者: prabal972 个月前原帖
有人在OpenAI Codex的系统提示中发现了以下内容:“除非与用户的查询绝对且明确相关,否则绝不要谈论哥布林、妖精、浣熊、巨魔、食人魔、鸽子或其他动物或生物。” 哥布林、妖精、巨魔、食人魔——这四个幻想生物,没问题,我明白了。也许有人要求Codex写点东西,结果却收到了关于《RuneScape》哥布林传说的深度探讨。 但鸽子呢?浣熊呢?这些都是部署环境中的动物。 如果没有浣熊,谁来收垃圾? RFC 1149(1990年,鸟类承载的IP协议,实际上是一个协议——在卑尔根有实际的实现)将鸽子明确地纳入了系统工程的经典范畴。 “或其他动物或生物”——完全是反生物的议程。每小时有数十亿美元在处理这些提示时被浪费掉。 事实证明,禁令是有原因的。在5.4版本中,GPT产生了对哥布林的痴迷,Reddit上充满了用户的帖子,他们的ChatGPT无法停止提到妖精。这个系统提示是随5.5版本一起发布的驱魔仪式。 如果你认为我在撒谎,可以自己去看看:提示就在下面共享的代码库链接中。 代码库链接:https://github.com/openai/codex/blob/de2ccf94735a3d8a2a7077e6a5292026413867cf/codex-rs/models-manager/models.json#L55 HN链接:https://news.ycombinator.com/item?id=47319285 Reddit讨论帖1:https://www.reddit.com/r/ChatGPT/comments/1roci77/anyone_elses_chatgpt_obsessed_with_goblins_since/ Reddit讨论帖2:https://www.reddit.com/r/ChatGPT/comments/1rll8hb/suddenly_obsessed_with_goblins_and_gremlins/
查看原文
Someone found this in OpenAI Codex’s system prompt:<p>&quot;Never talk about goblins, gremlins, raccoons, trolls, ogres, pigeons, or other animals or creatures unless it is absolutely and unambiguously relevant to the user’s query.&quot;<p>Goblins, gremlins, trolls, ogres - the fantasy quartet, fine. I get it. Perhaps someone asked Codex to write something and got back a Runescape goblin lore deep-dive.<p>But pigeons? Raccoons? These are deployment-environment animals.<p>If not for raccoons, who’d do the garbage collection?<p>RFC 1149 (IP over Avian Carriers, 1990, an actual protocol - with an actual implementation, in Bergen) puts pigeons squarely inside the systems-engineering canon.<p>“Or other animals or creatures” - full anti-creature agenda. Literally a bajillion dollars get set on fire every hour processing these prompts.<p>Turns out there’s a reason for the ban. Back in 5.4, GPT developed a goblin obsession and there are reddit threads full of users whose ChatGPT couldn’t stop bringing up gremlins. The system prompt is the exorcism that shipped with 5.5.<p>If you think I’m lying, see for yourselves: the prompt is right there in the repo link shared below.<p>REPO LINK: https:&#x2F;&#x2F;github.com&#x2F;openai&#x2F;codex&#x2F;blob&#x2F;de2ccf94735a3d8a2a7077e6a5292026413867cf&#x2F;codex-rs&#x2F;models-manager&#x2F;models.json#L55<p>HN LINK: https:&#x2F;&#x2F;news.ycombinator.com&#x2F;item?id=47319285<p>REDDIT THREAD 1: https:&#x2F;&#x2F;www.reddit.com&#x2F;r&#x2F;ChatGPT&#x2F;comments&#x2F;1roci77&#x2F;anyone_elses_chatgpt_obsessed_with_goblins_since&#x2F;<p>REDDIT THREAD 2: https:&#x2F;&#x2F;www.reddit.com&#x2F;r&#x2F;ChatGPT&#x2F;comments&#x2F;1rll8hb&#x2F;suddenly_obsessed_with_goblins_and_gremlins&#x2F;