Hello everyone,

Guys I'm trying to consume a kafka topic within my job pipeline, the main
idea is firs read the payload from the kafka topic using KafkaIO, this read
will return a PCollection<KafkaRecord<Long,String>> then I want to turn
this into a PCollection<KV<String,String>> where later I might be able to
read the V and turn it into a PCollection<String>.

I have designed a first sample code : https://pastebin.com/UdT4D7VW and at
the line 18 I added a print hoping visualize the value payload in order to
create later my final PCollection<String>, however when I run the pipeline
it doesnt print anything so I dont know if is really even consuming my
topic.

Question:
* How should I debug this to know where I'm? I'm using IntelliJ , Java 8
and maven 3
* Am I right on my assumptions to read
the PCollection<KafkaRecord<Long,String>> into PCollection<String> ?
* There is any other better way?

thanks so much
AU

Reply via email to