Hi,

I am very very new to Go and Apache Beam too! This is my situation:
 - I have a kafka running
 - I want to write an etl pipeline that consuming data from the kafka in Go

Because there is no Kafka support in the Go SDK, only Java SDK. I had been
looking for a way to create an unbounded collection in Go then do some
coding to consume the kafka, but no result! *beam.Create()* only supports
to create a finite data source.

Could you please guide me or give me some ideas to make progress? Either
creating an unbounded collection or a straight way to create an etl
pipeline consuming kafka.

And the last question: Could I write that pipeline in Java and invoke that
pipeline from Go? :D

Thanks and regards,

Duc Tran

Reply via email to