Commit cannot be completed since the group has already rebalanced and assigned the partitions to another member

0 votes
Hello

We designed a notification application which send emails to users. We used KAFKA for building this applications. Due to below issue users are receiving 100s of emails, As it was retrying 100s of emails are sent. we reduced our max.poll.records from 100 to 50 then to 30. yet its not fixed. And also we have  not configured max.poll.interval.ms, we are using the default one. i am a beginner in KAFKA having hard time resolving this issue.

error trace org.apache.kafka.clients.consumer.CommitFailedException: Commit cannot be completed since the group has already rebalanced and assigned the partitions to another member. This means that the time between subsequent calls to poll() was longer than the configured max.poll.interval.ms, which typically implies that the poll loop is spending too much time message processing. You can address this either by increasing max.poll.interval.ms or by reducing the maximum size of batches returned in poll() with max.poll.records.
Feb 10, 2023 in Apache Kafka by noushin

edited 1 hour ago 5 views

No answer to this question. Be the first to respond.

Your answer

Your name to display (optional):
Privacy: Your email address will only be used for sending these notifications.
webinar REGISTER FOR FREE WEBINAR X
REGISTER NOW
webinar_success Thank you for registering Join Edureka Meetup community for 100+ Free Webinars each month JOIN MEETUP GROUP