Launch HN: Parsewise(YC P25)– 通过API在文档之间进行推理
大家好,我们是Parsewise的创始人Greg和Max。
Parsewise将一堆非结构化数据转化为符合模式的数据,同时保留跨文档解析值的来源信息。想象一下,把一堆文件交给Claude,并请求输出CSV或JSON格式。如果你尝试过这个,你会知道系统的限制(文件数量、输入类型、成本、延迟),同时也面临着无法快速验证结果的人为挑战。我们解决了这两个问题。
我们帮助技术团队简化非结构化数据的ETL流程,并邀请业务专家参与定义和即时验证。
这里有一段视频,展示了一些使用案例:<a href="https://www.youtube.com/watch?v=dbRllnnh47w" rel="nofollow">https://www.youtube.com/watch?v=dbRllnnh47w</a>
以下是使用Parsewise的用户的描述:
“我需要从保险政策PDF、转录的电话记录、电子邮件等中提取信息。我并不是在寻找一种仅仅逐点、逐页提取数据并放入结构化定义模式的工具,而是希望有一种更具智能的方式,能够理解信息可能分散在多个文档中,并能够推理出应该提取哪些内容。”
我们基于十年的复杂数据转化和数据分析/综合经验(以及痛苦)创办了这家公司。Greg曾在Palantir构建经典的ETL并实施AI工作流,而Max则在贝恩公司进行金融领域的高度复杂数据分析,这与我们的许多客户相似。
Parsewise的工作方式是接收一堆数据(想象一下数百或数千个PDF、Excel等),并输出符合模式的数据,其中每个值都可以追溯到多个文档中的字级引用。我们为API客户提供在其应用程序中展示数据来源的方法,或者他们可以使用我们的平台进行内部操作。
在数据处理的核心,我们有自我改进的代理定义。它们定义了可接受的数据来源、解析或组合值的逻辑,以及向最终用户突出不确定性的规则。
我们的底层技术是模型和云无关的,可以在私有网络中部署。我们在视觉推理方面使用Gemini模型取得了最佳效果,在我们找到的最强基础推理基准(Databricks OfficeQA)上实现了SOTA(超越Claude Fable)[将包含我们博客文章的链接]。
值得注意的是,我们更关注“人机协作”而非模型协作,专注于我们在采用过程中看到的实际摩擦,主要围绕可验证性。这意味着优化信任结果所需的时间和点击次数。
我们使用vLLMs进行解析,然后使用小型模型进行高效的大规模全面搜索。与RAG不同,我们不进行抽样;相反,我们会全面找到与特定查询相关的所有值。我们使用更大的模型进行决策,处理解析和向用户标记不一致性。
这种全面性和明确的值来源是我们平台的独特之处,超越了许多现有提供商所覆盖的数据解析第一步。
我们非常欢迎构建者和探索者在复杂文档挑战中尝试Parsewise。我们有很多想法可以扩展产品并改进,但也希望能得到社区的反馈和建议!
查看原文
Hi all, it’s Greg and Max, founders of Parsewise here<p>Parsewise transforms a bucket of unstructured data into schema compliant data retaining lineage for values resolved across documents.
Imagine giving Claude a bunch of files and asking for a CSV or JSON output. If you have tried this, you know both the system limitations (number of files, type of inputs, cost, latency) but also the human-facing challenge of having no way to validate the results quickly. We solve both.
We help tech teams simplify their unstructured data ETL, and loop in business experts for the definitions and for instant validation.<p>Here is a video with a few use cases: <a href="https://www.youtube.com/watch?v=dbRllnnh47w" rel="nofollow">https://www.youtube.com/watch?v=dbRllnnh47w</a><p>Parsewise in the words of someone coming to us:
”I need to extract information from insurance policy PDFs, phone calls that have been transcribed, emails, etc. I am NOT looking for something that would just extract data point by data point, page by page into a structured well-defined schema but more something more agentic that can understand that information might be across documents and that it should reason over what to extract.”<p>We started the company based on a decade of experience (and pain) in complex data transformation and data analysis / synthesis. Greg was building both classical ETL and implemented AI workflows at Palantir. At Bain, Max did highly complex data analysis in the financial sector, similar to many of our customers.<p>Parsewise works by taking in a bucket of data (think hundreds or thousands of pdfs, excels etc.), and outputting schema compliant data where every single value is traceable down to word level citations across multiple documents in the bucket. We provide API customers with ways to show the lineage in their own applications, or they can use our platform for internal operations.
At the core of the data processing we have self-improving agent definitions. They define the acceptable sources, the logic for resolving or combining values, and the rule for highlighting uncertainty to the end user.<p>The underlying tech is model and cloud agnostic and can be deployed in private networks. We have seen the best results with Gemini models for visual reasoning, achieving SOTA (beating Claude Fable) on the strongest grounded reasoning benchmark we have found (Databricks OfficeQA) [will include link to our blog post].
Notably, we focused more on the “human harness” rather than the model harness, leaning into the actual friction we saw in uptake, which is around verifiability. That means optimizing the time and clicks required to trust the outcomes.
We use vLLMs for parsing, and then we use small models for efficient large scale exhaustive search. Unlike RAG, we do not sample; instead, we exhaustively find all relevant values for a given query. We use larger models for decision making around resolutions and flagging inconsistencies to users.<p>This exhaustiveness and explicit value sourcing is unique to our platform, and it goes beyond the first step of data parsing that many existing providers cover.<p>We would love to welcome builders and tinkerers to try Parsewise on your complex document challenges. We have a ton of ideas on how we can expand the product and make it better, but would appreciate feedback and ideas from the community!