Is there any change in consumer offsets if a new partition s is added to a Kafka topic

0 votes
Jul 9, 2018 in Apache Kafka by coldcode
• 2,090 points

edited Jul 9, 2018 by coldcode 2,392 views

1 answer to this question.

0 votes

Yes, it stays the same.

An offset is maintained for each partition separately, so your new partition's offset will start from 0 and won't affect other offsets.

For each topic, the Kafka cluster maintains a partitioned log that looks like this:

image

Hope this works for you!

Get your Kafka certification today to become certified professional

Thank You

answered Jul 9, 2018 by nitinrawat895
• 11,380 points

Related Questions In Apache Kafka

0 votes
1 answer

I tried to do configration for retation log in kafkA ,BUT kafka broker shuts Down.Is there any solution for that??

Hi@Parth, There are mainly two types of retention ...READ MORE

answered Feb 18, 2020 in Apache Kafka by MD
• 95,460 points
933 views
0 votes
1 answer

How to create a Kafka topic in a broker?

Hi@akhtar, To create a Kafka topic, you need ...READ MORE

answered Dec 7, 2020 in Apache Kafka by MD
• 95,460 points
1,610 views
0 votes
1 answer

How to start a consumer in Kafka cluster?

Hi@akhtar, In Kafka, each topic is divided into a ...READ MORE

answered Dec 7, 2020 in Apache Kafka by MD
• 95,460 points
776 views
+2 votes
9 answers

Writing the Kafka consumer output to a file

System.out.println(String.valueOf(output.offset()) + ": " + new String(bytes, ...READ MORE

answered Dec 7, 2018 in Apache Kafka by Harsh
38,563 views
0 votes
1 answer

How to commit message offsets in Kafka for reliable data pipeline?

You can use auto.commit.enable to allow Kafka ...READ MORE

answered Jul 10, 2018 in Apache Kafka by Shubham
• 13,490 points
3,577 views
0 votes
1 answer

Explain to me the functionality of Kafka in a Big-Data Cluster

Let me explain to you about Apache ...READ MORE

answered Apr 30, 2019 in Apache Kafka by ravikiran
• 4,620 points
1,111 views
0 votes
1 answer

How to check pending messages in KAFKA topic?

kafka-run-class.bat kafka.tools.ConsumerOffsetChecker --broker-info --group test-consumer-group --topic test ...READ MORE

answered May 29, 2020 in Apache Kafka by chandra
11,046 views
+1 vote
1 answer

Kafka consumer not able to start reading messages from the last uncommitted offsets

Hi@prasant, I am not sure it will work ...READ MORE

answered Feb 18, 2020 in Apache Kafka by MD
• 95,460 points
9,685 views
0 votes
1 answer

How to delete a topic in Kafka 0.8.1.1?

Deleting topic isn't always working in 0.8.1.1 Deletion ...READ MORE

answered Sep 4, 2018 in Apache Kafka by nitinrawat895
• 11,380 points
1,815 views
0 votes
1 answer

What is the optimum number of producers to create in Kafka?

In general, a single producer for all ...READ MORE

answered Jul 10, 2018 in Apache Kafka by nitinrawat895
• 11,380 points
8,450 views
webinar REGISTER FOR FREE WEBINAR X
REGISTER NOW
webinar_success Thank you for registering Join Edureka Meetup community for 100+ Free Webinars each month JOIN MEETUP GROUP