Kafka

Error converting content: marked is not a function

- Why does Kafka need ZooKeeper?
- One of the biggest design goals of Kafka are cluster deployments. That is the problem they are solving, and it would be silly to make a zk-less version for a standalone server. I have the feeling that kafka is not the tool for your job, but that you would be better of just using a vanilla file.
- from [confluent](https://www.confluent.io/blog/removing-zookeeper-dependency-in-kafka/): Currently, Apache Kafka® uses Apache ZooKeeper™ to store its metadata. Data such as the location of partitions and the configuration of topics are stored outside of Kafka itself, in a separate ZooKeeper cluster. In 2019, we outlined a plan to break this dependency and bring metadata management into Kafka itself.
- ZooKeeper is still required for running Kafka, but in the near future ZooKeeper will be replaced with a Self-Managed Metadata Quorum. Whatever this means.
- So why not have an easy version? Without distributed systems overhead? The complexity here makes the case for hosted pub/sub #sigh. Kinesis from amazon then gets leverage.
-
-
-
-
-
	-