Re: [DISCUSS] flink connector for sink to apache/incubator-druid

2019-11-04 Thread Qi Luo
Hi Xiao Dao, Is it possible to ingest into Druid with exactly-once guarantee? Thanks, Qi On Mon, Nov 4, 2019 at 4:18 PM xiao dao wrote: > Dear Flink Community! > I would like to open the discussion of contributiong incubator-druid Flink > connector to Flink. > > ## A brief introduction to

Re: [DISCUSS] FLIP-70 - Support Computed Column for Flink SQL

2019-09-17 Thread Qi Luo
Fantastic! We're also very interested in this feature. +Boxiu On Tue, Sep 17, 2019 at 11:31 AM Danny Chan wrote: > In umbrella task FLINK-10232 we have introduced CREATE TABLE grammar in > our new module flink-sql-parser. And we proposed to use computed column to > describe the time attribute

Re: [DISCUSS] Support JSON functions in Flink SQL

2019-09-04 Thread Qi Luo
We also see strong demands from our SQL users for JSON/Date related functions. Also +Anyang Hu On Wed, Sep 4, 2019 at 9:51 PM Jark Wu wrote: > Hi Forward, > > Thanks for bringing this discussion and preparing the nice design. > I think it's nice to have the JSON functions in the next release.

Re: Flink SQL - Support Computed Columns in DDL?

2019-09-03 Thread Qi Luo
wrote: > > > Yeah, we are planning to implement this feature in release-1.10, wait for > > our good news ! > > > > Best, > > Danny Chan > > 在 2019年9月3日 +0800 PM6:19,Qi Luo ,写道: > > > Hi folks, > > > > > > Computed columns in Flink S

Flink SQL - Support Computed Columns in DDL?

2019-09-03 Thread Qi Luo
Hi folks, Computed columns in Flink SQL DDL is currently disabled in both old planner and Blink planner (throws "Computed columns for DDL is not supported yet!" exception in SqlToOperationConverter). I searched through the JIRA but found no relevant issues. Do we have any plans to support this

Re: [ANNOUNCE] Apache Flink 1.9.0 released

2019-08-23 Thread qi luo
Congratulations and thanks for the hard work! Qi > On Aug 22, 2019, at 8:03 PM, Tzu-Li (Gordon) Tai wrote: > > The Apache Flink community is very happy to announce the release of Apache > Flink 1.9.0, which is the latest major release. > > Apache Flink® is an open-source stream processing

Re: [DISCUSS][CODE STYLE] Usage of Java Optional

2019-08-01 Thread qi luo
Agree that using Optional will improve code robustness. However we’re hesitating to use Optional in data intensive operations. For example, SingleInputGate is already creating Optional for every BufferOrEvent in getNextBufferOrEvent(). How much performance gain would we get if it’s replaced by

Re: [ANNOUNCE] Flink 1.9 release branch has been created

2019-07-12 Thread qi luo
Great work! > On Jul 12, 2019, at 2:58 PM, Hequn Cheng wrote: > > Hi Kurt, > > Great work and thanks for the update. > > FYI, I find a bug[1] on Table API accidentally. The PR has already been > opened. I think it would be good if the fix can be included in the 1.9. > > Best, > Hequn > >

Re: [ANNOUNCE] Feature freeze for Apache Flink 1.9.0 release

2019-07-11 Thread qi luo
No worries. Glad to know the progress :-) > On Jul 12, 2019, at 11:53 AM, Kurt Young wrote: > > Hi qi, > > We are about to cut branch, the announce mail will be sent after that. > Sorry for the slight delay. > > Best, > Kurt > > > On Fri, Jul 12, 2019 at

Re: [ANNOUNCE] Feature freeze for Apache Flink 1.9.0 release

2019-07-11 Thread qi luo
Do we have a new timeline for 1.9 branch cut? Thanks, Qi > On Jul 12, 2019, at 11:42 AM, qi luo wrote: > > Any news on this? > > Thanks, > Qi > >> On Jul 11, 2019, at 11:13 PM, Stephan Ewen wrote: >> >> Number (6) is not a feature but a bug fix, so no

Re: [ANNOUNCE] Feature freeze for Apache Flink 1.9.0 release

2019-07-11 Thread qi luo
Any news on this? Thanks, Qi > On Jul 11, 2019, at 11:13 PM, Stephan Ewen wrote: > > Number (6) is not a feature but a bug fix, so no need to block on that... > > On Thu, Jul 11, 2019 at 4:27 PM Kurt Young wrote: > >> Hi Chesnay, >> >> Here is the JIRA list I have collected, all of them

Re: [DISCUSS] Proposal of external shuffle service

2019-01-29 Thread qi luo
Very clear. Thanks! > On Jan 28, 2019, at 10:29 PM, zhijiang wrote: > > Hi Qi, > > Thanks for the concerns of this proposal. In Blink we implemented the > YarnShuffleService which is mainly used for batch jobs in production and some > benchmark before. This YarnShuffleService is not within

Re: [DISCUSS] Proposal of external shuffle service

2019-01-28 Thread qi luo
Hi Zhijiang, I see there’s a YarnShuffleService in newly released Blink branch. Is there any relationship between that YarnShuffleService and your external shuffle service? Regards, Qi > On Jan 28, 2019, at 8:07 PM, zhijiang > wrote: > > Hi till, > > Very glad to receive your feedbacks

Re: [DISCUSS] Bot for stale PRs on GitHub

2019-01-11 Thread qi luo
+1 for the stable bot, as it will help bring valuable PR out to be reviewed. > On Jan 11, 2019, at 6:26 PM, Driesprong, Fokko wrote: > > +1 I'm in favor of the Stale bot. > > We use the Stalebot at Apache Airflow as well, and it really helps smoothen > the reviewing process. Keep in mind that

Re: [DISCUSS] Creating last bug fix release for 1.5 branch

2018-12-08 Thread qi luo
Hi Till, Does Flink has an agreement on how long will a major version be supported? Some companies may need a long time to upgrade Flink major versions in production. If Flink terminates support for a major version too quickly, it may be a concern for companies. Best, Qi > On Dec 8, 2018, at

Apply for flink contributor permission

2018-11-27 Thread qi luo
Hi Flink team, Could you pls give me the contributor permission, as I’m working on JIRA issue [1]. My Jira ID is *Qi* (luoqi...@gmail.com ) [1] https://issues.apache.org/jira/browse/FLINK-10941 Thanks, Qi