Kafka Connect Distributed Mode Doubt

2021-03-22 Thread Himanshu Shukla
Hi All, I am having these below understanding regarding Kafka connect. 1. Kafka Connect Standalone has the provision of either running the job from the command line or we can use the REST interface also to add/update/delete a connector job. 2. Standalone mode won't be running like a clustered

Re: Kafka connect replication using MirrorMaker 2.0

2021-03-22 Thread Ning Zhang
Hi Daniel, it is probably hard to figure out how to sync topics across two kafka connect cluster. In general, if implementing a solution requires strong technical pre-requisite (e.g. kafka connect will be aware of each other offset), It may be better to go with simpler solution first, for

Kafka-BigQuery connector issue

2021-03-22 Thread Mich Talebzadeh
Hi, Has anyone managed to connect and deliver Json data to BigQuery table on Google Cloud from on-premise source. We are trying to use wepay Google BigQuery Sink Connector to send both the schema and payload in Kafka message but

Re: Processor API in 2.7

2021-03-22 Thread John Roesler
Hi Ross, Thanks for the feedback! For some "context," the change you mention was: https://cwiki.apache.org/confluence/display/KAFKA/KIP-478+-+Strongly+typed+Processor+API In addition to the spec on that page, there are links to the discussion and voting mailing list threads. The primary

Need help in setting up the IDE

2021-03-22 Thread Aviral Srivastava
Hey everyone! I need help in setting up my IDE with Kafka. I have loaded and successfully build the Gradle project in IDEA. I looked around and found a blog post