请问HN:潜在空间不仅仅是压缩吗?我们能探测它的内部规则吗?

1作者: WLHsu3 个月前原帖
我很好奇人们是否看到Anthropic的注入思维检测工作与像LeWM这样的潜在状态世界模型之间存在更深层的联系。<p>在一种情况下,模型似乎能够报告其内部扰动的部分。在另一种情况下,训练则明确地推动进入一个更结构化的潜在预测空间。<p>这些研究方向是否暗示潜在空间可能部分可探测并可解释为一个内部规则空间,而不仅仅是一个压缩的向量空间?有没有人尝试过将潜在状态探测、正则化世界模型和内省式检测结合起来?
查看原文
I’m curious whether people see a deeper connection between Anthropic’s injected-thought detection work and latent-state world models like LeWM.<p>In one case, the model seems able to report parts of its own internal perturbation. In the other, training is explicitly pushed into a more structured latent prediction space.<p>Do these lines of work suggest that latent space may be partially probeable and interpretable as an internal rule space, rather than just a compressed vector space? Has anyone experimented with combining latent-state probing, regularized world models, and introspection-style detection?