Re: Flink Query Optimizer

2018-07-15 Thread vino yang
Hi Albert, If you want to provide more feature about the query optimizer for Flink. I suggest you based on Apache Calcite, if Calcite's optimizer can not match your requirement. You can talk with Calcite community or just customize Calcite if you do not want to wait. Our inner Calcite version

Re: Flink Query Optimizer

2018-07-15 Thread Hequn Cheng
Hi Albert, Apache Flink leverages Apache Calcite to optimize and translate queries. The optimization currently performed include projection and filter push-down, subquery decorrelation, and other kinds of query rewriting. Flink does not yet optimize the order of joins[1]. I agree with you it is

Flink Query Optimizer

2018-07-14 Thread Albert Jonathan
Hello, I am just wondering, does Flink use Apache Calcite's query optimizer to generate an optimal logical plan for stream queries, or does it have its own independent query optimizer? >From what I observed so far, the Flink's query optimizer only groups operator together without changing the