海象:一种基于基本原理构建的高性能存储引擎
嗨,最近我一直在开发一个名为 Walrus 的高性能存储引擎,使用 Rust 编写。
简单介绍一下,Walrus 是一个基于基本原理构建的嵌入式进程内存储引擎,可以作为构建各种应用的基础组件,开箱即用,包括时间序列事件日志、数据库 WAL、消息队列、迷你 Kafka、键值存储、任务队列等等。
最近的版本在特定工作负载下超越了单节点的 Apache Kafka 和 RocksDB(基准测试在代码库中)。
代码库链接:https://github.com/nubskr/walrus
如果你对 Walrus 的内部结构感兴趣,这两篇发布文章将为你提供所需的所有信息:
1. v0.1.0 发布文章:https://nubskr.com/2025/10/06/walrus(最初它只是一个预写日志)
2. v0.2.0 发布文章:https://nubskr.com/2025/10/20/walrus_v0.2.0
我期待听到社区的反馈,同时 Walrus 的“分布式”版本正在开发中。
(由于某种原因,我无法在顶部发布链接)
查看原文
Hi, Recently I've been working on a high performance storage engine in Rust called Walrus<p>A little bit of intro, Walrus is an embedded in-process storage engine built from first principles and can be used as a building block to build these things right out of the box like Timeseries Event Logs, Database WAL, Message Queue, mini Kafka, key value stores, task queues, and much more..<p>the recent release outperforms single node apache kafka and rocksdb at the workloads of their choice (benchmarks in the repo)<p>repo: https://github.com/nubskr/walrus<p>If you're interested in learning about walrus's internals, these two release posts will give you all you need:<p>1. v0.1.0 release post:https://nubskr.com/2025/10/06/walrus (it was just supposed to be a write ahead log in the beginning..)
2. v0.2.0 release post: https://nubskr.com/2025/10/20/walrus_v0.2.0<p>I'm looking forward to hearing feedback from the community and the works of a 'distributed' version of walrus are in progress.<p>(it wouldn't let me post the links at the top for some reason)