回复: Flink sql case when problem

2021-06-18 Thread Jacky Yin
Hello Jing, Regarding the convention(from 'IN' to 'OR') threshold, could you please kindly explain it with more details? Is it the count of the items of the 'IN' clause? BR, Jacky 发件人: JING ZHANG 发送时间: 2021年6月18日 15:19 收件人: Leonard Xu 抄送: 纳兰清风 ; User-Flink

回复: Elasticsearch sink connector timeout

2021-06-06 Thread Jacky Yin
In flink-es connector 6.*, you can set the socket timeout by implementing a customized RestClientFactory。 Here is the code snippet. @Override public void configureRestClientBuilder(RestClientBuilder restClientBuilder) { restClientBuilder

回复: ES sink never receive error code

2021-05-24 Thread Jacky Yin
If you are using es connector 6.*, actually there is a deadlock bug if the backoff is enabled. The 'retry' and 'flush' share one thread pool which has only one thread. Sometimes the one holding the thread tries to get the semaphore which is hold by the one who tries to get the thread. Therefore

Dynamic index(by day) to sink to elastic search

2019-04-09 Thread Jacky Yin
Hello There, We are using flink sql to build a stream pipeline which reads data from kafka, aggregates the data and finally sinks to elastic search. For the table sink to elastic search, we expect to create index by day (e.g. index1-2019-04-08, index1-2019-04-09…). Is this function supported?

Re: How to run a job with job cluster mode on top of mesos?

2019-04-02 Thread Jacky Yin
Yes, it worked for me. However, just like what you said, it is not that straightforward, so I would like to learn from ` StandaloneJobClusterEntrypoint ` and try to enhance the ` MesosJobClusterEntrypoint`.  Jacky Yin 发件人: Till Rohrmann 日期: 2019年4月2日 星期二 下午10:50 收件人: Jacky Yin 殷传旺 抄送: "

Re: How to run a job with job cluster mode on top of mesos?

2019-04-02 Thread Jacky Yin
Hello Till, I submitted a PR(#8084) for this issue. Could you help review it? Many thanks! Jacky Yin 发件人: Till Rohrmann 日期: 2019年3月29日 星期五 下午11:06 收件人: Jacky Yin 殷传旺 抄送: "user@flink.apache.org" 主题: Re: How to run a job with job cluster mode on top of mesos? Thanks a lot Jacky. Ch

Re: How to run a job with job cluster mode on top of mesos?

2019-03-29 Thread Jacky Yin
Hello Till, Thanks very much for the clear steps. And I noticed that you have already created a jira ticket for this issue and I would like to contribute it. (I have already assigned it to me).  Jacky Yin 发件人: Till Rohrmann 日期: 2019年3月26日 星期二 下午6:31 收件人: Jacky Yin 殷传旺 抄送: "

How to run a job with job cluster mode on top of mesos?

2019-03-22 Thread Jacky Yin
with the mode of job cluster on top of mesos. However I cannot find any help or example for this shell. Any help will be greatly appreciated. Thanks! Jacky Yin 发件人: Jacky Yin 殷传旺 日期: 2019年3月21日 星期四 下午2:31 收件人: "user@flink.apache.org" 主题: Documentation of mesos-appmaster-job.sh Hello All,

Documentation of mesos-appmaster-job.sh

2019-03-21 Thread Jacky Yin
Hello All, I cannot find any documentation or help about how to use $flin_home/bin/mesos-appmaster-job.sh. Anybody help? Thanks! Jacky Yin