问HN:有没有人解决过在100亿+节点下的P2P路由问题,而不出现DHT性能下降?

2作者: ikhrabry4 天前原帖
我们两位(物理学和数学博士以及哲学人类学家)多年来一直致力于开发一种数学上安全的秘密投票系统,以适应社会重大决策。在设计过程中,我们意识到这样的系统必须是一个满足六个绝对要求的点对点网络。我们尚未找到任何一个现有的协议或学术论文能够同时满足其中两个以上的要求: 第一:匿名用户认证,确保用户在网络中的唯一性(防止一个人创建多个账户),且不存储其个人数据,也不使用任何外部资源,如证书机构或可信第三方。 第二:提供这种匿名认证的网络必须能够覆盖地球上所有居民。目前,这一数字略超过80亿人,但每年增长超过1亿。此外,已故人员也必须被纳入系统,这意味着单调增长是无止境的。 第三:保证匿名性的网络不得有任何显著节点,即必须严格为点对点网络,由用户设备形成的节点构成。然而,每个用户可能拥有不止一个设备,设备可能会故障、丢失、过时,甚至仅仅是失去时尚。这立即改变了网络的规模——它必须处理数千亿个节点。 第四:必须为每个用户提供从任何设备访问其账户的能力,而不使用密码、令牌、种子短语或类似的东西。 第五:关键要求是进行搜索,使用户识别在1秒内完成(以便用户感知不到)。也就是说,任何设备必须在1秒内定位到任何其他设备或数据,而单个设备存储的路由信息量必须微乎其微,最好低于100 KB。 第六:为了保证在不可靠用户设备上的数据保存,首先,复制因子必须在~100或甚至~1000倍,其次,必须基于共识进行路由和数据的验证与恢复,而不依赖中央仲裁者或可信节点。同时,后台同步流量必须保持在每个设备几百字节/秒以下,以避免对移动数据计划造成过大压力。 我们向HN社区提出的问题是: 社区是否知道任何现有的P2P协议、DHT或学术提案,甚至尝试同时满足这些约束条件?我们研究了Kademlia、Chord、BATMAN、GNUnet、I2P等,发现它们似乎在可扩展性或流量效率上都存在问题。我们是否遗漏了什么基本的东西,还是这确实是一个盲点? (这个问题的提出是因为我们开发了一种候选架构,在我们看来,它解决了所有六个问题。简要描述可以在我们的GitHub上找到 [https://github.com/ikhrabry-spec/A-P2P-Network-Architecture-for-100B-Nodes]。我们已经提交了专利申请,并获得了一项专利。然而,我们对我们解决方案的新颖性和缺乏类似物表示怀疑——请指引我们可能遗漏的任何内容。)
查看原文
The two of us (PhD in Physics and Mathematics and Philosophical Anthropology) have spent many years working on a mathematically protected secret voting system suitable for making socially significant decisions. During the design process, we realized that such a system must be a peer-to-peer network satisfying six absolute requirements. We have not been able to find a single existing protocol or academic paper that simultaneously satisfies more than two of them: First: anonymous user authentication that guarantees the uniqueness of the user's representation in the network (preventing one person from creating multiple accounts) without storing their personal data and without using any external resources, such as certificate authorities or a trusted third party. Second: a network providing such anonymous authentication must be capable of covering all inhabitants of the Earth. Currently that is just over 8 billion people, but this number grows by more than 100 million every year. Moreover, the deceased must not be excluded from the system, which means monotonic growth is endless. Third: a network that guarantees anonymity must not have any distinguished nodes—that is, it must be strictly peer-to-peer, consisting of nodes formed by users' devices. However, each user may have not one but several devices, and devices can fail, get lost, become obsolete, or even simply go out of fashion. This immediately changes the scale of the network—it must handle hundreds of billions of nodes. Fourth: it is necessary to provide each user with access to their account from any device without using passwords, tokens, seed phrases, or anything similar. Fifth: the key requirement becomes performing a search that enables user recognition in less than 1 second (so that it is imperceptible to the user). That is, any device must locate any other device or data in less than 1 second, while the amount of routing information stored by a single device must be negligibly small, preferably under 100 KB. Sixth: to guarantee data preservation on unreliable user devices, first, the replication factor must be ~100 or even ~1000x, and second, there must be verification and recovery of routing and data based on consensus without a central arbiter or trusted nodes. At the same time, background synchronization traffic must remain below a few hundred bytes/sec per device to avoid overwhelming mobile data plans. Our question to HN: Is the community aware of any existing P2P protocol, DHT, or academic proposal that even attempts to simultaneously satisfy these constraints? We have studied Kademlia, Chord, BATMAN, GNUnet, I2P, etc., and all of them seem to fail at scalability or traffic efficiency. Are we missing something fundamental, or is this truly a blind spot? (This question is motivated by the fact that we have developed a candidate architecture that, in our opinion, solves all six problems. A brief description can be found on our GitHub [https://github.com/ikhrabry-spec/A-P2P-Network-Architecture-for-100B-Nodes]. Patent applications have been filed, and one patent has been granted. However, we doubt the novelty of our solutions and the absence of analogues—please point us to anything we may have missed.)