Re: Modify kafka-connect api context path

2021-05-28 Thread Fernando Moraes
No, is not what I looking for. When kafka connect starts, he will be available at http://localhost:8083/connectors I need to put a additional path to the host, something like: http://localhost:8083/my-service/connectors Em qua., 26 de mai. de 2021 às 17:57, Ran Lupovich escreveu: >

Re: Reading offset from one consumer group to use for another consumer group.

2021-05-28 Thread Ran Lupovich
One more thought that you could think about, have two consumer groups 1 that starts every hour for you "db consumer" and 2 for near real time , the 2ed should run all the time and populate your "memory db" like Redis and the TTL could be arranged from Redis mechainsem בתאריך יום ו׳, 28 במאי 2021,

Re: Reading offset from one consumer group to use for another consumer group.

2021-05-28 Thread Ran Lupovich
So I think, You should write to your db the partition and the offset, while initing the real time consumer you'd read from database where to set the consumer starting point, kind-of the "exactly once" programming approach, בתאריך יום ו׳, 28 במאי 2021, 21:38, מאת Ronald Fenner ‏<

Re: Reading offset from one consumer group to use for another consumer group.

2021-05-28 Thread Ronald Fenner
That might work if my consumers were in the same process but the db consumer is a python job running under Airflow and the realtime consumer wold be running as a backend service on another server. Also how would I seed the realtime consumer at startup if the consumer isn't running which would

Re: Issue using Https with elasticsearch source connector

2021-05-28 Thread Ran Lupovich
trustStore [image: Copy to clipboard] JAVA_OPTS=$JAVA_OPTS -Djavax.net.ssl.trustStore=/path/to/truststore.jks -Djavax.net.ssl.trustStoreType=jks -Djavax.net.ssl.trustStorePassword=changeit keyStore [image: Copy to clipboard] JAVA_OPTS=$JAVA_OPTS -Djavax.net.ssl.keyStore=/path/to/keystore.jks

Re: Issue using Https with elasticsearch source connector

2021-05-28 Thread sunil chaudhari
Yeah. I am trying to add truststore in java keystore Lets see On Fri, 28 May 2021 at 5:40 PM, Ran Lupovich wrote: > Anyways you need to remmber it is a java application and you can pass many > variables that not formally supported by the application as jvm input > setting or in the connector

Re: Issue using Https with elasticsearch source connector

2021-05-28 Thread Ran Lupovich
Anyways you need to remmber it is a java application and you can pass many variables that not formally supported by the application as jvm input setting or in the connector OPTS, does not have experience with this specfic source connector did something similar as work arounf for the mongodb sink

Re: Issue using Https with elasticsearch source connector

2021-05-28 Thread sunil chaudhari
Hello Ran, Whatever link you have provided is the supported SINK connector. It has all settings for SSL. The connector I am talking about is the Souce connector and its not supported by Confluent. If you see the documentation you will find that there is no setting for SSL certs.