Discussion:
min.insync.replica for __consumer_offsets topic
Fang Wong
2016-12-13 04:46:02 UTC
Permalink
Hi,

In our application, we set topic.replication.factor to 3 in the client side
and min.insync.replicas = 2 in the kafka server side (server.properties).

Does min.insync.replicas = 2 apply to kafka internal topic
__consumer_offsets (we are using kafka version 0.9.0.1 and have
offsets.storage = kafka)?

How to get the replication factor and min insync replica for topic
__consumer_offsets?

Another side question, we have a test code to create test topic without
setting topic.replication.factor to 3, we always see replication factor is
1, and ISR is 1 for this test topic, why the server.properties
min.insync.replicas = 2 not apply to the test topic?

Thanks,
Fang
Manikumar
2016-12-13 06:04:31 UTC
Permalink
There is no "topic.replication.factor" client/server config property.
Yes, min.insync.replicas config property is applicable to internal topics
also. We can override with topic level configs
You can use kafka-topics command to describe the __consumer_offsets topic.

You can use kafka-topics.sh to create the topic or
change "default.replication.factor" config property in server side.
"min.insync.replicas" is only applicable while producing data.
Post by Fang Wong
Hi,
In our application, we set topic.replication.factor to 3 in the client side
and min.insync.replicas = 2 in the kafka server side (server.properties).
Does min.insync.replicas = 2 apply to kafka internal topic
__consumer_offsets (we are using kafka version 0.9.0.1 and have
offsets.storage = kafka)?
How to get the replication factor and min insync replica for topic
__consumer_offsets?
Another side question, we have a test code to create test topic without
setting topic.replication.factor to 3, we always see replication factor is
1, and ISR is 1 for this test topic, why the server.properties
min.insync.replicas = 2 not apply to the test topic?
Thanks,
Fang
Loading...