Setup a Kafka Cluster
About Kafka
Apache Kafka is an open-source stream-processing software platform developed by LinkedIn and donated to the Apache Software Foundation, written in Scala and Java
Kafka® is used for building real-time data pipelines and streaming apps. It is horizontally scalable, fault-tolerant, wicked fast, and runs in production in thousands of companies.
- PUBLISH & SUBSCRIBE
- PROCESS
- STORE
Why Apache Kafka
A Distributed Streaming Platform
- Log-structured persistence - Kafka utilizes a segmented, append-only log, largely limiting itself to sequential I/O for both reads and writes, which is fast across a wide variety of storage media.
- Record batching - Sequential I/O is blazingly fast on most media types, comparable to the peak performance of network I/O.
- Batch compression - The impact of batching is particularly obvious when compression is enabled, as compression becomes generally more effective as the data size increases.
- Zero-copy - One of the typical sources of inefficiencies is copying byte data between buffers.
Book an Appointment!
Book a 30 min consulting on Apache Kafka with WeCanDoNow team
Where is Apache Kafka Useful?
- Messaging
- Website Activity Tracking
- Log Aggregation
- Stream Processing
- Event Sourcing
- Commit Log
Key Features
- Scalability
- High-Volume
- Fault Tolerance
- Reliability
- Durability
- Performance
- Zero Downtime
- Replication