kafka consumer in R

Question

I am trying to hack together a kafka consumer in Python or R. Using the kafka console consumer I can grep for a string and retrieve the relevant data but I am at a loss when it comes to parsing it suitably in R.

There are kafka clients available in other languages but one in R would be helpful from a data analytics point of view.

Can anyone help me with the resources that will lead me to the right path?

Answer 1

As there is a C++ API for Kafka, you could use Rcpp to bring it to R. Also, there is a library that allows you to connect to kafka - rkafka.