请问HN:你如何设计一个高效的事务性/持久性任务系统?

1作者: stevefan199916 天前原帖
作为一个想要设计类似于 EC2 的云资源调度系统的人,我总是想深入了解它们是如何工作的。我知道我需要一个任务队列,但应该选择哪个呢?Kafka?NATS(JetStream)?RabbitMQ?还是他们真的只是用一些不公开的黑科技设计了自己的持久耐用任务队列? 到今天我仍然不知道。此外,我还希望将其作为某种 Kubernetes 操作器来运行。
查看原文
As someone who wants to design a cloud resource scheduling system similar to EC2, I always wonder how they works in depth. I know I&#x27;m going to need a task queue, but which? Kafka? NATS (JetStream)? RabbitMQ? Or if they really just design your own persistent durable task queue with some black magic which is not open sourced.<p>I still don&#x27;t know to this day. Plus I have a focus on running that as some kind of Kubernetes operator as well.