Browsed by
Category: Kafka

How to adjust Replication Factor from internal topic in ka

How to adjust Replication Factor from internal topic in ka

The Kafka replication factor is a crucial mechanism that ensures the consistency and availability of data. I’ve previously covered this topic in a post, which you can read here. the internal topic __consumer_offsets plays a pivotal role in Kafka. It handles the consumers group offset, storing the last message consumed by specific consumer, along with information about broker connection. In the event of a broker failure, it facilitates rebalancing within the consumer group.. It is very important to have this…

Read More Read More

Understanding Kafka Partitions

Understanding Kafka Partitions

Kafka Partitions are one of the core mechanisms for ordering produced events in your application. It is the way that Kafka distribute events thought the nodes and keeping the same events from the same entity together to guarantee the ordination of the facts for the consumers. Partitions In Kafka, event messages are essentially logs files containing all the events, separated and organized into partitions. Imagine partitions as office drawers with dividers, organizing papers related to different companies. For example, papers…

Read More Read More

Understanding Kafka Replication Factory and Partitions

Understanding Kafka Replication Factory and Partitions

Comments 0 Comment

Kafka is a distributed event store and event streaming platform, so it is developed to be fault-tolerant in a distributed server running in many nodes. The concept of Kafka Replication Factory is some of the main configurations to achieve this. Let’s say that we have a Kafka instance running in a 3 nodes server, as the image below. It is even more common, depending on your application, to run in more nodes, but lets keep it simple with just three…

Read More Read More