Re: getting an error when configuring state backend to hdfs

2018-12-23 Thread Yun Tang
Hi Avi For application running in your IDE, please set the checkpoint path schema as "file://", you could refer to source code of ITcases using rocksDBStateBackend. For application running in your cluster, please choose Flink with Hadoop to download, or choose Flink without hadoop and export

Re: Flink 1.7 doesn't work with Kafka Table Source Descriptors

2018-12-23 Thread dhanuka ranasinghe
Hi Cheng, Thanks for your prompt reply. I was able to figured out the problem. What I got wrong was not properly configuring org.apache.flink.streaming.connectors.kafka.Kafka010TableSourceSinkFactory as as TableSourceFactory in META-INF/services. Cheers, Dhanuka On Mon, Dec 24, 2018 at 10:15 AM

Re: Flink 1.7 doesn't work with Kafka Table Source Descriptors

2018-12-23 Thread Hequn Cheng
Hi Dhanuka, >From the exceptions, it seems you have changed the Kafka version to 'universal'. You can solve your problem in any of the following ways: - Change Kafka version to 0.11. You only have a jar of 0.11 version in your lib folder. - Add flink-connector-kafka_2.11-1.7.0.jar to your lib

Re: [ANNOUNCE] Apache Flink 1.6.3 released

2018-12-23 Thread vino yang
Thanks for being the release manager Gordon. And glad to see Flink 1.6.3 released. Best, Vino Tzu-Li (Gordon) Tai 于2018年12月23日周日 下午9:35写道: > Hi, > > The Apache Flink community is very happy to announce the release of > Apache Flink 1.6.3, which is the third bugfix release for the Apache >

Running Flink on Yarn

2018-12-23 Thread Anil
I have a setup for Flink(1.4.2) with YARN. I'm using Flink Yarn Client for deploying my jobs to Yarn Cluster. In the current setup parallelism was directly mapped to the number of cores, with each parallel instance of the job running in one container. So for a parallelism of 9, there are 10

[ANNOUNCE] Apache Flink 1.6.3 released

2018-12-23 Thread Tzu-Li (Gordon) Tai
Hi, The Apache Flink community is very happy to announce the release of  Apache Flink 1.6.3, which is the third bugfix release for the Apache  Flink 1.6 series.  Apache Flink® is an open-source stream processing framework for  distributed, high-performing, always-available, and accurate data 

Re: Flink 1.7 doesn't work with Kafka Table Source Descriptors

2018-12-23 Thread dhanuka ranasinghe
Hi Cheng, I have removed 1.6.1 jars and then I got below error Starting execution of program The program finished with the following exception: org.apache.flink.client.program.ProgramInvocationException: The main method caused an

Connecting to kafka with tls

2018-12-23 Thread Avi Levi
Hi, Can anyone give me an example for how to use kafka client with tls support ? I must use tls to connect to our kafka Thanks in advance Avi