-
Notifications
You must be signed in to change notification settings - Fork 221
Streaming Platforms Comparision
KamiWan edited this page Apr 30, 2024
·
1 revision
Feature | AutoMQ | Apache Kafka | Confluent | Apache Pulsar | Redpanda | Warpstream |
---|---|---|---|---|---|---|
Apache Kafka Compatibility[1] | Native Kafka | Native Kafka | Native Kafka | Non-Kafka | Kafka Protocol | Kafka Protocol |
Source Code Availability | Yes | Yes | No | Yes | Yes | No |
Stateless Broker | Yes | No | No | Yes | No | Yes |
P99 Latency | Single-digit ms latency |
> 400ms | ||||
Continuous Self-Balancing | Yes | No | Yes | Yes | Yes | Yes |
Scale in/out | In seconds | In hours/days | In hours | In hours (scale-in); In seconds (scale-out) |
In hours/In seconds (Enterprise Only) | In seconds |
Spot Instance Support | Yes | No | No | No | No | Yes |
Partition Reassignment | In seconds | In hours/days | In hours | In seconds | In hours/In seconds (Enterprise Only) | In seconds |
Component | Broker | Broker Zookeeper (Non-KRaft) |
Broker Zookeeper Bookkeeper Proxy(Optional) |
Broker | Agent MetadataServer |
|
Durability | Guaranteed by S3/EBS[2] | Guaranteed by ISR | Guaranteed by Bookkeeper | Guaranteed by Raft | Guaranteed by S3 | |
Inter-AZ Networking Fees | No | Yes | No |
[1] Apache Kafka Compatibility's definition is coming from this blog.
[2] EBS Durability: On Azure, GCP, and Alibaba Cloud, Regional EBS replicas span multiple AZs. On AWS, ensure durability by double writing to EBS and S3 Express One Zone in different AZs.