kafka runtime_error ai_generated true

再均衡进行中异常：消费者组正在再均衡，因此另一个再均衡已在进行中

org.apache.kafka.common.errors.RebalanceInProgressException: The group is rebalancing, so a rebalance is already in progress

ID: kafka/consumer-group-rebalance-timeout

其他格式: JSON · Markdown 中文 · English
82%修复率
88%置信度
1证据数
2024-01-10首次发现

版本兼容性

版本状态引入弃用备注
Kafka 3.6.0 active — — —
Kafka 3.7.0 active — — —

根因分析

消费者组再均衡在另一个再均衡仍在进行时被触发，通常由消费者加入缓慢或网络延迟引起。

English

Consumer group rebalance triggered while another rebalance is still in progress, typically due to slow consumer join times or network delays.

generic

官方文档

https://kafka.apache.org/documentation/#consumer_rebalance

解决方案

  1. Set `rebalance.timeout.ms=120000` in consumer config to allow more time for rebalance completion, and ensure `max.poll.records=500` to reduce processing load per poll.
  2. Use static group membership by setting `group.instance.id` to a unique value per consumer to reduce rebalance frequency.
  3. Example fix in Java consumer: `props.put(ConsumerConfig.REBALANCE_TIMEOUT_MS_CONFIG, 120000); props.put(ConsumerConfig.MAX_POLL_RECORDS_CONFIG, 500);`

无效尝试

常见但无效的做法:

  1. 70% 失败

    It only postpones the error; the rebalance will still fail if consumers are slow.

  2. 85% 失败

    It exacerbates the problem by making consumers appear dead prematurely.