ALL


  Install and setup Kafka on Windows

Kafka has become a very popular distributed message delivery service which decouples different services while making message delivery between service easy, fast and reliable. In this post, we will walk through how to install and set up Kafka on Windows.Pre-requisiteJavaApache ZooKeeperInstallationGo to Kafka's download link and download the latest stable release, we downloaded 2.2.0 as of this writing. After downloading, copy the installation file to some folder and unzip it. Since Kafka uses ZooKeeper, so you also need to install ZooKeeper, The download link is at http://zookeeper.a...

8,927 2       KAFKA STREAM USER GUIDE


  How Kafka achieves high throughput low latency

Kafka is a message streaming system with high throughput and low latency. It is widely adopted in lots of big companies. A well configured Kafka cluster can achieve super high throughput with millions of concurrent writes. How Kafka can achieve this? This post will try to explain some technologies used by Kafka.Page cache + Disk sequential writeEvery time when Kafka receives a record, it will write it to disk file eventually. But if it writes to disk every time it receives a record, it would not have very good performance. In fact, Kafka has a fantastic design here which is it utilizes the pag...

8,968 0       BIG DATA KAFKA