Apache Kafka

<p>Apache Kafka is a <a href="/facts/Distributed_computing/o5nyhqTF">distributed</a> <a href="/facts/Event_store/EjpH3R6z">event store</a> and <a href="/facts/Stream_processing/vXe6gkTT">stream-processing</a> platform. It is an <a href="/facts/Open-source_software/HzTaB8E9">open-source</a> system developed by the <a href="/facts/Apache_Software_Foundation/Xl9Tt9lE">Apache Software Foundation</a> written in <a href="/facts/Java_/9ScgFyAL">Java</a> and <a href="/facts/Scala_/ebL8o6AK">Scala</a>. The project aims to provide a unified, high-throughput, low-latency platform for handling real-time data feeds. Kafka can connect to external systems (for data import/export) via Kafka Connect, and provides the Kafka Streams <a href="/facts/Library_(computing)/xRzL3P7q">libraries</a> for stream processing applications. Kafka uses a binary <a href="/facts/Transmission_Control_Protocol/WW4sPrt9">TCP</a>-based protocol that is optimized for efficiency and relies on a "message set" abstraction that naturally groups messages together to reduce the overhead of the network roundtrip. This "leads to larger network packets, larger sequential disk operations, contiguous memory blocks [...] which allows Kafka to turn a bursty stream of random message writes into linear writes."
</p>

Apache Kafka open-in-new

Apache Kafka