Poll Interval for Kafka Connect Source

Hi, Is there a configuration to set poll Interval for a SourceTask using the Connect API? The JDBC Connector uses a custom property - poll.interval.ms but is there an internal property which can be used by different connectors? Thanks, Shiti

Possible bug in Kafka Connect - Schema modified internally

Hi, When defining a Kafka pipeline I realized that the Schema of SinkRecord was not the same as its SourceRecord. I used the following code snippet. for(Field x :record.valueSchema().fields()){ outputStream.println(x.name()); } Is this the correct way to get the schema or am

Kafka Connect - SinkRecord schema

Hi, I was trying to define the following Kafka Connect pipeline : JDBC Source -> Console Sink using bulk mode I realized the schema resulting from SinkRecord.valueSchema was incorrect. I modified FileStreamSinkTask's put method to, public void put(Collection sinkRecords) { for (SinkRecord r

Re: Kafka Connect usage

ed to start Kafka server and Zookeeper before running Kafka Connect. > > Thanks, > Liquan > > On Tue, Jan 12, 2016 at 10:22 AM, Shiti Saxena > wrote: > > > Hi Alex, > > > > I am using the default files. > > > > Do we need to start Kafka server

Re: Kafka Connect usage

files you're passing to connect-standalone.sh. Can you share > these three files? > > Thanks, > > Alex > > On Mon, Jan 11, 2016 at 10:14 PM, Shiti Saxena > wrote: > > > Hi, > > > > I tried executing the following, > > > > bin

Kafka Connect usage

Hi, I tried executing the following, bin/connect-standalone.sh config/connect-standalone.properties config/connect-file-source.properties config/connect-console-sink.properties I created a file text.txt in kafka directory but get the error, ERROR Failed to flush WorkerSourceTask{id=local-file-s

Kafka Connect Embedded API

Hi, I wanted to use Kafka Connect in an application and wanted to if the Embedded API discussed in KIP-26 available in 0.9.0.0 or is there an alternative? Thanks, Shiti

Programmable API for Kafka Connect ?

Does Kafka Connect have an API which can be used by applications to start Kafka Connect, add/remove Connectors? I also do not want to use the REST API and do not want to start the REST server.

Programmable API for Kafka Connect ?

Hi, Does Kafka Connect have an API which can be used by applications to start Kafka Connect, add/remove Connectors? I also do not want to use the REST API and do not want to start the REST server. Thanks, Shiti