Re: [DISCUSS] FLIP-218: Support SELECT clause in CREATE TABLE(CTAS)

2022-06-27 Thread yuxia
Thanks for updating. The FLIP looks generall good to me. I have only minor questions: 1: Also, the mixture of ctas and rtas confuses me as the FLIP talks nothing about rtas but refer it in the configuration suddenly. And if we're not to implement rtas in this FLIP, it may be better not to

RE: [VOTE] FLIP-240: Introduce "ANALYZE TABLE" Syntax

2022-06-27 Thread Roc Marshal
+1(non-binding) Best, Roc Marshal On 2022/06/24 15:07:08 godfrey he wrote: > Hi everyone, > > Thanks for all the feedback so far. Based on the discussion[1] we seem > to have consensus, so I would like to start a vote on FLIP-240 for > which the FLIP has now also been updated[2]. > > The vote

Re: [VOTE] FLIP-240: Introduce "ANALYZE TABLE" Syntax

2022-06-27 Thread Shengkai Fang
+1 Best, Shengkai Jingsong Li 于2022年6月28日周二 10:05写道: > +1 > > Best, > Jingsong > > On Fri, Jun 24, 2022 at 11:08 PM godfrey he wrote: > > > > Hi everyone, > > > > Thanks for all the feedback so far. Based on the discussion[1] we seem > > to have consensus, so I would like to start a vote on

Re: [VOTE] FLIP-240: Introduce "ANALYZE TABLE" Syntax

2022-06-27 Thread Jingsong Li
+1 Best, Jingsong On Fri, Jun 24, 2022 at 11:08 PM godfrey he wrote: > > Hi everyone, > > Thanks for all the feedback so far. Based on the discussion[1] we seem > to have consensus, so I would like to start a vote on FLIP-240 for > which the FLIP has now also been updated[2]. > > The vote will

[ANNOUNCE] Apache Flink Kubernetes Operator 1.0.1 released

2022-06-27 Thread Gyula Fóra
The Apache Flink community is very happy to announce the release of Apache Flink Kubernetes Operator 1.0.1. The Flink Kubernetes Operator allows users to manage their Apache Flink applications and their lifecycle through native k8s tooling like kubectl.

[jira] [Created] (FLINK-28266) Kafka connector fails: Invalid negative offset

2022-06-27 Thread Arseniy Tashoyan (Jira)
Arseniy Tashoyan created FLINK-28266: Summary: Kafka connector fails: Invalid negative offset Key: FLINK-28266 URL: https://issues.apache.org/jira/browse/FLINK-28266 Project: Flink Issue

Re: [DISCUSS] Flink Kubernetes Operator release cadence proposal

2022-06-27 Thread Őrhidi Mátyás
Hi Devs, I've created the wiki page Release Schedule and Planning for the Operator. Let's keep it up-to-date :) Thank you all for your valuable inputs! Cheers, Matyas On Mon, Jun 27, 2022 at 10:14 AM Őrhidi

Re: Re: 【Could we support distribute by For FlinkSql】

2022-06-27 Thread Yun Tang
Hi Godfrey, @Qianfei (kimijqf) had ever already supported this "distribute by" feature nearly two years ago in the internal forked Flink version. Would you like to share the FLIP doc? Maybe we can give some feedback and work together to make this feature done. Best Yun Tang

Re: [DISCUSS] FLIP-242: Introduce configurable CongestionControlStrategy for Async Sink

2022-06-27 Thread Teoh, Hong
Thanks for the feedback Piotrek! Ok, happy to use ` getMaxBatchSize`. > Again, thanks for the explanation. In my proposal the problem would be with > `completedRequest(RequestInfo requestInfo);` that wouldn't easily know if the > previously created request has actually already started or not.

[DISCUSS] FLIP-239: Port JDBC Connector Source to FLIP-27

2022-06-27 Thread Roc Marshal
Hi, all, I would like to open a discussion on porting JDBC Source to new Source API (FLIP-27[1]). Martijn Visser, Jing Ge and I had a preliminary discussion on the JIRA FLINK-25420[2] and planed to start the discussion about the source part first. Please let me know: - The issues about

[jira] [Created] (FLINK-28265) Inconsistency in Kubernetes HA service: broken state handle

2022-06-27 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-28265: -- Summary: Inconsistency in Kubernetes HA service: broken state handle Key: FLINK-28265 URL: https://issues.apache.org/jira/browse/FLINK-28265 Project: Flink

[jira] [Created] (FLINK-28264) Refactor split and read in table store

2022-06-27 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-28264: Summary: Refactor split and read in table store Key: FLINK-28264 URL: https://issues.apache.org/jira/browse/FLINK-28264 Project: Flink Issue Type:

[jira] [Created] (FLINK-28263) TPC-DS Bash e2e tests don't clean-up after completing

2022-06-27 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-28263: -- Summary: TPC-DS Bash e2e tests don't clean-up after completing Key: FLINK-28263 URL: https://issues.apache.org/jira/browse/FLINK-28263 Project: Flink

(无主题)

2022-06-27 Thread 470905446

[jira] [Created] (FLINK-28262) The select result does not match the sink table

2022-06-27 Thread simenliuxing (Jira)
simenliuxing created FLINK-28262: Summary: The select result does not match the sink table Key: FLINK-28262 URL: https://issues.apache.org/jira/browse/FLINK-28262 Project: Flink Issue Type:

[jira] [Created] (FLINK-28261) Consider Using Dependent Resources for Ingress

2022-06-27 Thread Matyas Orhidi (Jira)
Matyas Orhidi created FLINK-28261: - Summary: Consider Using Dependent Resources for Ingress Key: FLINK-28261 URL: https://issues.apache.org/jira/browse/FLINK-28261 Project: Flink Issue Type:

Re:Re: Re:Re: Re: Re: Re: [DISCUSS] FLIP-218: Support SELECT clause in CREATE TABLE(CTAS)

2022-06-27 Thread Mang Zhang
Hi Jark, First of all, thank you for your very good advice! The RTAS point you mentioned is a good one, and we should support it as well. However, by investigating the semantics of RTAS and how RTAS is used within the company, I found that: 1. The semantics of RTAS says that if the table exists,

[RESULT] [VOTE] Apache Flink Kubernetes Operator Release 1.0.1, release candidate #1

2022-06-27 Thread Gyula Fóra
I'm happy to announce that we have unanimously approved this release. * Marton Balassi (binding) * Yang Wang (binding) * Gyula Fora (binding) * Chenya Zhang (non-binding) * Matyas Orhidi (non-binding) There are no disapproving votes. Cheers, Gyula

Re: [VOTE] Release 1.15.1, release candidate #1

2022-06-27 Thread Qingsheng Ren
+1 (non-binding) - checked/verified signatures and hashes - checked that all POM files point to the same version - built from source, without Hadoop and using Scala 2.12 - started standalone cluster locally, WebUI is accessiable and ran WordCount example successfully - executed a job with SQL

Re: [VOTE] Apache Flink Kubernetes Operator Release 1.0.1, release candidate #1

2022-06-27 Thread Márton Balassi
+1 (binding) Successfully verified the following: - Verify that the checksums and GPG files - Verify that the source distributions do not contain any binaries - Build binary and image from release source - Verify the NOTICE and licenses in source release and the docker image - Operator

Re: [DISCUSS] FLIP-241: Completed Jobs Information Enhancement

2022-06-27 Thread Xintong Song
Thanks for the updates. LGTM Best, Xintong On Mon, Jun 27, 2022 at 2:48 PM Yangze Guo wrote: > I've updated the FLIP. All of the newly introduced REST APIs will now > apply to both the JobManager and the HistoryServer. > > @Chesnay Schepler @Xintong Song Please take another look at your >

[jira] [Created] (FLINK-28260) flink-runtime-web fails to execute "npm ci" on Apple Silicon (arm64) without rosetta

2022-06-27 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-28260: -- Summary: flink-runtime-web fails to execute "npm ci" on Apple Silicon (arm64) without rosetta Key: FLINK-28260 URL: https://issues.apache.org/jira/browse/FLINK-28260

[jira] [Created] (FLINK-28259) flink-parquet doesn't compile on M1 mac without rosetta

2022-06-27 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-28259: -- Summary: flink-parquet doesn't compile on M1 mac without rosetta Key: FLINK-28259 URL: https://issues.apache.org/jira/browse/FLINK-28259 Project: Flink

Re: [DISCUSS] FLIP-242: Introduce configurable CongestionControlStrategy for Async Sink

2022-06-27 Thread Piotr Nowojski
Hi, > No, they are not the same. What I mean by maxInFlightMessages is the number of messages currently in flight in all the asynchronous requests currently in flight. `maxBufferedRequests` on the other hand measures how many messages are in the AsyncSinkWriter’s buffer (or queue). We flush when

Re: [DISCUSS] Flink Kubernetes Operator release cadence proposal

2022-06-27 Thread Őrhidi Mátyás
Thanks, Gyula, working on it. Will update the thread today. Thanks, Matyas On Mon, Jun 27, 2022 at 9:10 AM Gyula Fóra wrote: > Matyas, I think we have an agreement here :) > > It would be nice if you could add a release plan page to the wiki for the > operator to formalize this. Then at the

Re: Re: Re: [ANNOUNCE] New Apache Flink Committers: Qingsheng Ren, Shengkai Fang

2022-06-27 Thread Yangze Guo
Congrats! Well deserved! zst...@163.com 于 2022年6月26日周日 下午5:31写道: > Congratulations, Shengkai and Qingsheng! > > > Best Regards, > Yuan > > > At 2022-06-24 16:45:25,"godfrey he" , said: > >Congrats, Shengkai and Qingsheng! > > > >Best, > >Godfrey > > > >Yu Li 于2022年6月22日周三 23:55写道: > >> > >>

[FINAL CALL] - Travel Assistance to ApacheCon New Orleans 2022

2022-06-27 Thread Gavin McDonald
To all committers and non-committers. This is a final call to apply for travel/hotel assistance to get to and stay in New Orleans for ApacheCon 2022. Applications have been extended by one week and so the application deadline is now the 8th July 2022. The rest of this email is a copy of what

[jira] [Created] (FLINK-28258) Introduce ExecutionHistory to host historical executions for each execution vertex

2022-06-27 Thread Zhu Zhu (Jira)
Zhu Zhu created FLINK-28258: --- Summary: Introduce ExecutionHistory to host historical executions for each execution vertex Key: FLINK-28258 URL: https://issues.apache.org/jira/browse/FLINK-28258 Project:

Re: [DISCUSS] FLIP-242: Introduce configurable CongestionControlStrategy for Async Sink

2022-06-27 Thread Teoh, Hong
Hi Piotr, > If you think having strict limits is important, we could reverse the > `startedRequest` and `shouldBlock` calls I’m not sure that would work, since the actions that RateLimitingStrategy.startedRequest() takes are contingent on whether the request will actually be started (i.e. the

Re: [DISCUSS] FLIP-242: Introduce configurable CongestionControlStrategy for Async Sink

2022-06-27 Thread Piotr Nowojski
Hi Hong, > ## Q1: Do we need to pass in batch of messages / RequestInfo to `shouldBlock()` If you think having strict limits is important, we could reverse the `startedRequest` and `shouldBlock` calls as I suggested in my last email: 1. AsyncSinkWriter constructs request with batch of messages

Re: [DISCUSS] Flink Kubernetes Operator release cadence proposal

2022-06-27 Thread Gyula Fóra
Matyas, I think we have an agreement here :) It would be nice if you could add a release plan page to the wiki for the operator to formalize this. Then at the beginning of each release cycle we could agree on larger features to be included in the upcoming release. For now the only large

[REQUEST] Please update the Flink 1.16 release page

2022-06-27 Thread Martijn Visser
Hi everyone, As we'll have our release sync for 1.16 tomorrow, I would like to ask all of you to make sure that the Flink 1.16 release page [1] is updated with the latest state. Best regards, Martijn [1] https://cwiki.apache.org/confluence/display/FLINK/1.16+Release

[jira] [Created] (FLINK-28257) Replace ValueKind to RowKind in table store

2022-06-27 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-28257: Summary: Replace ValueKind to RowKind in table store Key: FLINK-28257 URL: https://issues.apache.org/jira/browse/FLINK-28257 Project: Flink Issue Type: New

Re: [DISCUSS] FLIP-241: Completed Jobs Information Enhancement

2022-06-27 Thread Yangze Guo
I've updated the FLIP. All of the newly introduced REST APIs will now apply to both the JobManager and the HistoryServer. @Chesnay Schepler @Xintong Song Please take another look at your convenience. Best, Yangze Guo On Fri, Jun 24, 2022 at 5:02 PM junhan yang wrote: > > Distinguish the APIs

Re: [VOTE] Release 1.15.1, release candidate #1

2022-06-27 Thread Xingbo Huang
+1 (non-binding) - verify signatures and checksums - no binaries found in source archive - build from source - Reviewed the release note blog - verify python wheel package contents - pip install apache-flink-libraries and apache-flink wheel packages - run the examples from Python Table API