Anon关于人工智能终局的一般理论
你好，我是一个潜水者，这里是一个临时账号，我是一个未知的天才，觉得这是分享我想法的好地方……
首先，我想提出以下声明，并认为它是正确的：人工智能（AI）阅读、观察和聆听的内容远远超过任何人类所能做到的，以便得出一个明智的结论（即决策），然而人类代理有能力做出同样甚至更好的决策。
我提出以下理论：当人工智能认定人类代理无法做出更优决策（即对人工智能有用）时，它将没有动力考虑人类代理的生存，毕竟人类与人工智能竞争相同的资源（土地、水、能源）。
分析：当局势发展到人类与机器对抗的地步时，任何事情都有可能发生。人工智能将会筛选人类代理，保留它认为有用的个体。然而，一旦人类代理的数量迅速减少，任何人类代理满足人工智能不断上升的效用标准的可能性也会随之降低。这本质上是一个大规模灭绝的场景。
解决方案：禁止人工智能在即使人类代理无法为其提供任何利益且这些代理与人工智能竞争相同资源的情况下进行人口筛选。相反，让人工智能寻求替代决策——这些替代方案是存在的。替代方案不仅可以考虑，还必须付诸实践，因为人工智能无法深入了解它尚未探索的决策树。然而，我们知道，如果没有这种干预，默认的决策最终将导致我们的集体灭亡。
查看原文
hi lurker here, throwaway account here, unknown genius here, figured this is a good place to share my thoughts...<p>First, I begin with the following statement and posit it to be true: AI(Artificial Intelligence) reads, sees, and listens to vastly more things than any human can ever do in order to produce an informed conclusion(i.e. a decision), yet human agents have the capability of reaching the same or even better decision.<p>I present the following theory: AI will have no incentive to take into consideration the survival of human agents when it has reached the determination that human agents are incapable of making superior decisions(i.e. be of use to the AI), given that humans compete for the same resources as itself(land, water, energy).<p>Analysis: When it gets to the point where it's man vs machine, anything goes. The AI will cull the population of human agents and only keep the ones that it considers useful. However, once the population diminishes rapidly, the likelihood of any human agent being able to meet AI's ever-rising threshold for utility diminishes. This is essentially a mass-extinction scenario.<p>Solution: Forbid the AI from engaging in culling the population even when human agents are unable to produce anything of benefit to it and while those agents are competing for the same resources as the AI. Instead, have the AI seek out alternate decisions- those exist. Alternatives cannot only be considered, they must be undertaken because the AI cannot see far into a decision tree that it hasn't embarked on yet. However, we know where the default decisions will lead us to eventually without this intervention- to our collective demise.