kafka扩容副本数

1.新建topic

kafka-topics.sh --create --zookeeper `ka zk` --replication-factor 1 --partitions 3 --topic testpartition

2.从1副本增加到3副本

cat replica-extends.json
{
 "version":1,
 "partitions":[{"topic":"testpartition","partition":0,"replicas":[1,2,3]},{"topic":"testpartition","partition":1,"replicas":[1,2,3]},{"topic":"testpartition","partition":2,"replicas":[1,2,3]}]
}

3.执行扩容副本

kafka-reassign-partitions.sh --zookeeper `ka zk` --reassignment-json-file replica-extends.json  --execute
输入出:

Current partition replica assignment

{"version":1,"partitions":[{"topic":"testpartition","partition":2,"replicas":[1],"log_dirs":["any"]},{"topic":"testpartition","partition":1,"replicas":[3],"log_dirs":["any"]},{"topic":"testpartition","partition":0,"replicas":[2],"log_dirs":["any"]}]}

Save this to use as the --reassignment-json-file option during rollback
Successfully started reassignment of partitions.

过程检查

kafka-reassign-partitions.sh --zookeeper `ka zk` --reassignment-json-file replica-extends.json  --verify
输出
Status of partition reassignment: 
Reassignment of partition testpartition-0 completed successfully
Reassignment of partition testpartition-1 completed successfully
Reassignment of partition testpartition-2 completed successfully

4.扩容后检查

kafka-topics.sh --describe --zookeeper `ka zk` --topic testpartition
Topic:testpartition     PartitionCount:3        ReplicationFactor:3     Configs:
        Topic: testpartition    Partition: 0    Leader: 2       Replicas: 1,2,3 Isr: 2,3,1
        Topic: testpartition    Partition: 1    Leader: 3       Replicas: 1,2,3 Isr: 3,2,1
        Topic: testpartition    Partition: 2    Leader: 1       Replicas: 1,2,3 Isr: 1,2,3