How to write output from Kafka to S3 using a Confluent S3 connector

0 votes

I have my kafka project in my local system. I want to connect kafka with S3. So that I can transfer data from the terminal into S3.

How can I do that?

Thank You

Apr 3, 2020 in Apache Kafka by akhtar
 • 38,260 points • 1,838 views

1 answer to this question.

0 votes

Hi@akhtar,

To do this task you have to install the connector using Confluent Hub. Navigate to your Confluent Platform installation directory and run the following command to install the latest (latest) connector version. The connector must be installed on every machine where Connect will run.

confluent-hub install confluentinc/kafka-connect-s3:latest

Hope this works for you!

Get your Kafka certification today to become certified professional

Thank You

answered Apr 3, 2020 by MD
 • 95,460 points

Related Questions In Apache Kafka

0 votes
1 answer

How to write Kafka connector to integrate with Facebook API?

If you know the limit of API ...READ MORE

answered Apr 29, 2019 in Apache Kafka by Kumar
 • 2,781 views
+2 votes
9 answers

Writing the Kafka consumer output to a file

System.out.println(String.valueOf(output.offset()) + ": " + new String(bytes, ...READ MORE

answered Dec 7, 2018 in Apache Kafka by Harsh
 • 38,557 views
0 votes
1 answer

How to reset the offset of messages consumed from Kafka?

The reset option only prints the result ...READ MORE

answered Jul 10, 2018 in Apache Kafka by Shubham
 • 13,490 points • 14,018 views
0 votes
2 answers

How to installed confluent kafka in our system?

Easy Approach is work with Docker. ConfluentInc ...READ MORE

answered Jun 18, 2020 in Apache Kafka by PAWAN
 • 380 points • 3,090 views
0 votes
1 answer

How to purge Kafka Topic?

For your case what you can do ...READ MORE

answered Sep 4, 2018 in Apache Kafka by nitinrawat895
 • 11,380 points • 2,724 views
0 votes
1 answer

How to delete a topic in Kafka 0.8.1.1?

Deleting topic isn't always working in 0.8.1.1 Deletion ...READ MORE

answered Sep 4, 2018 in Apache Kafka by nitinrawat895
 • 11,380 points • 1,813 views
0 votes
1 answer

Kafka Elements

The most important elements of Kafka: Topic – ...READ MORE

answered Sep 19, 2018 in Apache Kafka by kurt_cobain
 • 9,350 points • 2,136 views
0 votes
1 answer

Kafka vs Flume

Even though both are used for real-time ...READ MORE

answered Sep 24, 2018 in Big Data Hadoop by Data_Nerd
 • 2,390 points • 886 views
+1 vote
14 answers

How can I delete all the messages from a Kafka topic?

To delete all the messages from a Kafka topic.  There are many approach ...READ MORE

answered Jun 19, 2020 in Apache Kafka by PAWAN
 • 380 points • 229,413 views
0 votes
1 answer

[Mac] Writing the Kafka consumer output to a CSV file

Hi@ I don't know it will work or ...READ MORE

answered Feb 18, 2020 in Apache Kafka by MD
 • 95,460 points • 4,098 views
webinar REGISTER FOR FREE WEBINAR X
REGISTER NOW
webinar_success Thank you for registering Join Edureka Meetup community for 100+ Free Webinars each month JOIN MEETUP GROUP
"PMP®","PMI®", "PMI-ACP®" and "PMBOK®" are registered marks of the Project Management Institute, Inc. MongoDB®, Mongo and the leaf logo are the registered trademarks of MongoDB, Inc.