Browsed by
Tag: Infrastructure

How to adjust Replication Factor from internal topic in ka

How to adjust Replication Factor from internal topic in ka

The Kafka replication factor is a crucial mechanism that ensures the consistency and availability of data. I’ve previously covered this topic in a post, which you can read here. the internal topic __consumer_offsets plays a pivotal role in Kafka. It handles the consumers group offset, storing the last message consumed by specific consumer, along with information about broker connection. In the event of a broker failure, it facilitates rebalancing within the consumer group.. It is very important to have this…

Read More Read More

Understanding Kafka Replication Factory and Partitions

Understanding Kafka Replication Factory and Partitions

Kafka is a distributed event store and event streaming platform, so it is developed to be fault-tolerant in a distributed server running in many nodes. The concept of Kafka Replication Factory is some of the main configurations to achieve this. Let’s say that we have a Kafka instance running in a 3 nodes server, as the image below. It is even more common, depending on your application, to run in more nodes, but lets keep it simple with just three…

Read More Read More