[jira] [Created] (FLINK-33720) Building Flink took suspiciously long in e2e1 stage with Hadoop 3.1.3 enabled

2023-11-30 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-33720: - Summary: Building Flink took suspiciously long in e2e1 stage with Hadoop 3.1.3 enabled Key: FLINK-33720 URL: https://issues.apache.org/jira/browse/FLINK-33720

[jira] [Created] (FLINK-33719) Cleanup the usage of deprecated StreamTableEnvironment#toRetractStream

2023-11-30 Thread Jane Chan (Jira)
Jane Chan created FLINK-33719: - Summary: Cleanup the usage of deprecated StreamTableEnvironment#toRetractStream Key: FLINK-33719 URL: https://issues.apache.org/jira/browse/FLINK-33719 Project: Flink

[jira] [Created] (FLINK-33718) Cleanup the usage of deprecated StreamTableEnvironment#toAppendStream

2023-11-30 Thread Jane Chan (Jira)
Jane Chan created FLINK-33718: - Summary: Cleanup the usage of deprecated StreamTableEnvironment#toAppendStream Key: FLINK-33718 URL: https://issues.apache.org/jira/browse/FLINK-33718 Project: Flink

[jira] [Created] (FLINK-33717) Cleanup the usage of deprecated StreamTableEnvironment#fromDataStream(DataStream, Expression...)

2023-11-30 Thread Jane Chan (Jira)
Jane Chan created FLINK-33717: - Summary: Cleanup the usage of deprecated StreamTableEnvironment#fromDataStream(DataStream, Expression...) Key: FLINK-33717 URL: https://issues.apache.org/jira/browse/FLINK-33717

[jira] [Created] (FLINK-33716) Cleanup the usage of deprecated StreamTableEnvironment#createTemporaryView(String, DataStream, Expression...)

2023-11-30 Thread Jane Chan (Jira)
Jane Chan created FLINK-33716: - Summary: Cleanup the usage of deprecated StreamTableEnvironment#createTemporaryView(String, DataStream, Expression...) Key: FLINK-33716 URL:

[jira] [Created] (FLINK-33715) Enhance history server to archive multiple histories per jobid

2023-11-30 Thread dongwoo.kim (Jira)
dongwoo.kim created FLINK-33715: --- Summary: Enhance history server to archive multiple histories per jobid Key: FLINK-33715 URL: https://issues.apache.org/jira/browse/FLINK-33715 Project: Flink

[DISCUSS] FLIP-380: Support Full Partition Processing On Non-keyed DataStream

2023-11-30 Thread Wencong Liu
Hi devs, I'm excited to propose a new FLIP[1] aimed at enhancing the DataStream API to support full window processing on non-keyed streams. This feature addresses the current limitation where non-keyed DataStreams cannot accumulate records per subtask for collective processing at the end of

[jira] [Created] (FLINK-33714) Update documentation about the usage of RuntimeContext#getExecutionConfig

2023-11-30 Thread Junrui Li (Jira)
Junrui Li created FLINK-33714: - Summary: Update documentation about the usage of RuntimeContext#getExecutionConfig Key: FLINK-33714 URL: https://issues.apache.org/jira/browse/FLINK-33714 Project: Flink

[jira] [Created] (FLINK-33713) Deprecate RuntimeContext#getExecutionConfig

2023-11-30 Thread Junrui Li (Jira)
Junrui Li created FLINK-33713: - Summary: Deprecate RuntimeContext#getExecutionConfig Key: FLINK-33713 URL: https://issues.apache.org/jira/browse/FLINK-33713 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-33712) FLIP-391: Deprecate RuntimeContext#getExecutionConfig

2023-11-30 Thread Junrui Li (Jira)
Junrui Li created FLINK-33712: - Summary: FLIP-391: Deprecate RuntimeContext#getExecutionConfig Key: FLINK-33712 URL: https://issues.apache.org/jira/browse/FLINK-33712 Project: Flink Issue Type:

[RESULT][VOTE] FLIP-391: Deprecate RuntimeContext#getExecutionConfig

2023-11-30 Thread Junrui Lee
The voting time of FLIP-391: Deprecate RuntimeContext#getExecutionConfig[1] has passed. I'm closing the vote now. There were 5 +1 votes, 4 of which are binding: Rui Fan (binding) Weijie Guo (binding) Jing Ge (binding) Zhu Zhu (binding) Zhanghao Chen (non-binding) There were no -1 votes. Thus

Re: [DISCUSS] FLIP-395: Migration to GitHub Actions

2023-11-30 Thread Yangze Guo
Thanks for the efforts, @Matthias. +1 to start a trial on Github Actions and migrate the CI if we can prove its computation capacity and stability. I share the same concern with Xintong that we do not explicitly claim the effect of this trial on the contribution procedure. I think you can

Re: [VOTE] FLIP-364: Improve the restart-strategy

2023-11-30 Thread Zhu Zhu
+1 (binding) Thanks, Zhu Zhanghao Chen 于2023年11月30日周四 23:31写道: > +1 (non-binding) > > Best, > Zhanghao Chen > > From: Rui Fan <1996fan...@gmail.com> > Sent: Monday, November 13, 2023 11:01 > To: dev > Subject: [VOTE] FLIP-364: Improve the restart-strategy > >

Re: [DISCUSS] Contribute Flink Doris Connector to the Flink community

2023-11-30 Thread wudi
Thank you everyone. But I encountered a problem when creating FLIP. There is no permission to create files in the Flink Improvement Proposals [1] space. I may need PMC to help me add permissions: My Jira account is Di Wu The email is d...@apache.org Thanks [1]

[jira] [Created] (FLINK-33711) Fix numbers of field of the taxi event / Fix broken link

2023-11-30 Thread Leona Yoda (Jira)
Leona Yoda created FLINK-33711: -- Summary: Fix numbers of field of the taxi event / Fix broken link Key: FLINK-33711 URL: https://issues.apache.org/jira/browse/FLINK-33711 Project: Flink Issue

Doc about cleaning savePoints and checkPoints

2023-11-30 Thread Rodrigo Meneses
Hi Flink Community, I'm searching for docs about how the cleaning of checkpoints and savepoints actually work. I'm interested particularly in the cases when the user has `NATIVE` format (incremental savepoint). Somehow, when using NATIVE format, the number of savepoints kept are not matching the

[jira] [Created] (FLINK-33710) Autoscaler redeploys pipeline for a NOOP parallelism change

2023-11-30 Thread Maximilian Michels (Jira)
Maximilian Michels created FLINK-33710: -- Summary: Autoscaler redeploys pipeline for a NOOP parallelism change Key: FLINK-33710 URL: https://issues.apache.org/jira/browse/FLINK-33710 Project:

Re: [RESULT][VOTE] Apache Flink Kafka Connectors v3.0.2, RC #1

2023-11-30 Thread Tzu-Li (Gordon) Tai
I'm happy to announce that we have unanimously approved this release. There are 6 approving votes, 3 of which are binding: * Gordon Tai (binding) * Rui Fan * Jing Ge * Leonard Xu (binding) * Martijn Visser (binding) * Sergey Nuyanzin There are no disapproving votes. Thanks everyone! I'll now

Re: [DISCUSS] Release flink-connector-parent v1.01

2023-11-30 Thread Etienne Chauchot
Thanks Sergey for your vote. Indeed I have listed only the PRs merged since last release but there are these 2 open PRs that could be worth reviewing/merging before release. https://github.com/apache/flink-connector-shared-utils/pull/25

Re: [VOTE] FLIP-364: Improve the restart-strategy

2023-11-30 Thread Zhanghao Chen
+1 (non-binding) Best, Zhanghao Chen From: Rui Fan <1996fan...@gmail.com> Sent: Monday, November 13, 2023 11:01 To: dev Subject: [VOTE] FLIP-364: Improve the restart-strategy Hi everyone, Thank you to everyone for the feedback on FLIP-364: Improve the

Re: [VOTE] Release flink-shaded 18.0, release candidate #1

2023-11-30 Thread Jing Ge
+1(not binding) - validate checksum - validate hash - checked the release notes - verified that no binaries exist in the source archive - build the source with Maven 3.8.6 and jdk11 - checked repo - checked tag - verified web PR Best regards, Jing On Thu, Nov 30, 2023 at 11:39 AM Sergey

Re: [ANNOUNCE] Apache Flink 1.16.3 released

2023-11-30 Thread Maximilian Michels
Thank you Rui for driving this! On Thu, Nov 30, 2023 at 3:01 AM Rui Fan <1996fan...@gmail.com> wrote: > > The Apache Flink community is very happy to announce the release of > Apache Flink 1.16.3, which is the > third bugfix release for the Apache Flink 1.16 series. > > > > Apache Flink® is an

Re: [VOTE] FLIP-364: Improve the restart-strategy

2023-11-30 Thread Maximilian Michels
+1 (binding) -Max On Thu, Nov 30, 2023 at 9:15 AM Rui Fan <1996fan...@gmail.com> wrote: > > +1(binding) > > Best, > Rui > > On Mon, Nov 13, 2023 at 11:01 AM Rui Fan <1996fan...@gmail.com> wrote: > > > Hi everyone, > > > > Thank you to everyone for the feedback on FLIP-364: Improve the > >

[jira] [Created] (FLINK-33709) Report CheckpointStats as Spans

2023-11-30 Thread Piotr Nowojski (Jira)
Piotr Nowojski created FLINK-33709: -- Summary: Report CheckpointStats as Spans Key: FLINK-33709 URL: https://issues.apache.org/jira/browse/FLINK-33709 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-33708) Add Span and TraceReporter concepts

2023-11-30 Thread Piotr Nowojski (Jira)
Piotr Nowojski created FLINK-33708: -- Summary: Add Span and TraceReporter concepts Key: FLINK-33708 URL: https://issues.apache.org/jira/browse/FLINK-33708 Project: Flink Issue Type: Sub-task

Re: [DISCUSS] Resolve diamond inheritance of Sink.createWriter

2023-11-30 Thread Becket Qin
Hi folks, Sorry for replying late on the thread. For this particular FLIP, I see two solutions: Option 1: 1. On top of the the current status, rename *org.apache.flink.api.connector.sink2.InitContext *to *CommonInitContext (*should probably be package private*)*. 2. Change the name

[ANNOUNCE] Apache flink-connector-aws 4.2.0 released

2023-11-30 Thread Danny Cranmer
The Apache Flink community is very happy to announce the release of Apache flink-connector-aws 4.2.0. This release supports Flink 1.17 and 1.18. Apache Flink® is an open-source stream processing framework for distributed, high-performing, always-available, and accurate data streaming

Re: [DISCUSS] FLIP-389: Annotate SingleThreadFetcherManager and FutureCompletingBlockingQueue as PublicEvolving

2023-11-30 Thread Hongshun Wang
Hi all, Any additional questions or concern regarding this FLIP-389[1].? Looking forward to hearing from you. Thanks, Hongshun Wang [1] https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=278465498 On Wed, Nov 22, 2023 at 3:44 PM Hongshun Wang wrote: > Hi Becket, > > Thanks a

Re: [ANNOUNCE] Experimental Java 21 support now available on master

2023-11-30 Thread Yun Tang
Hi Sergey, I checked the CI [1] which was executed with Java21, and noticed that the StatefulJobSnapshotMigrationITCase-related tests have passed, which proves what I guessed before, most checkpoints/savepoints should be restored successfully. I think we shall introduce such snapshot migration

[jira] [Created] (FLINK-33707) Verify the snapshot migration on Java17

2023-11-30 Thread Yun Tang (Jira)
Yun Tang created FLINK-33707: Summary: Verify the snapshot migration on Java17 Key: FLINK-33707 URL: https://issues.apache.org/jira/browse/FLINK-33707 Project: Flink Issue Type: Improvement

Re: Python connector question

2023-11-30 Thread Dian Fu
Hi Peter, Thanks a lot for taking care of this. Appreciate it! Re flink-sql-client-1.18.0.jar: The original motivation of including it in the PyFlink package is that we want to make sure that Python users get most things they need after piping install PyFlink. So most artifacts of a normal Flink

[jira] [Created] (FLINK-33706) Build_wheels_on_macos fails on AZP

2023-11-30 Thread Sergey Nuyanzin (Jira)
Sergey Nuyanzin created FLINK-33706: --- Summary: Build_wheels_on_macos fails on AZP Key: FLINK-33706 URL: https://issues.apache.org/jira/browse/FLINK-33706 Project: Flink Issue Type: Bug

Re: [VOTE] Apache Flink Kafka Connectors v3.0.2, RC #1

2023-11-30 Thread Sergey Nuyanzin
+1(non-binding) - Downloaded all the resources - Verified signatures - Validated hashsums - Built from source code - Checked Github release tag - Reviewed the web PR On Mon, Nov 27, 2023 at 9:05 AM Martijn Visser wrote: > +1 (binding) > > - Validated hashes > - Verified signature > - Verified

Re: [VOTE] Release flink-shaded 18.0, release candidate #1

2023-11-30 Thread Sergey Nuyanzin
+1 (non-binding) - Downloaded all the resources - Validated checksum hash - Build the source with Maven and jdk8 - Build Flink master with new flink-shaded and check that all the tests are passing one minor thing that I noticed during releasing: for ci it uses maven 3.8.6 at the same time for

Re: [DISCUSS] Release flink-connector-parent v1.01

2023-11-30 Thread Sergey Nuyanzin
thanks for volunteering Etienne +1 for releasing however there is one more PR to enable custom jvm flags for connectors in similar way it is done in Flink main repo for modules It will simplify a bit support for java 17 could we have this as well in the coming release? On Wed, Nov 29, 2023 at

[jira] [Created] (FLINK-33705) Upgrade flink-shaded to 18.0

2023-11-30 Thread Sergey Nuyanzin (Jira)
Sergey Nuyanzin created FLINK-33705: --- Summary: Upgrade flink-shaded to 18.0 Key: FLINK-33705 URL: https://issues.apache.org/jira/browse/FLINK-33705 Project: Flink Issue Type: Technical

[jira] [Created] (FLINK-33704) Update GCS filesystems to latest available versions

2023-11-30 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-33704: -- Summary: Update GCS filesystems to latest available versions Key: FLINK-33704 URL: https://issues.apache.org/jira/browse/FLINK-33704 Project: Flink

[jira] [Created] (FLINK-33703) Use maven 3.8.6 for releasing of flink-shaded

2023-11-30 Thread Sergey Nuyanzin (Jira)
Sergey Nuyanzin created FLINK-33703: --- Summary: Use maven 3.8.6 for releasing of flink-shaded Key: FLINK-33703 URL: https://issues.apache.org/jira/browse/FLINK-33703 Project: Flink Issue

Re: [DISCUSS] FLIP-383: Support Job Recovery for Batch Jobs

2023-11-30 Thread Lijie Wang
Hi Guowei, Thanks for your feedback. >> As far as I know, there are multiple job managers on standby in some scenarios. In this case, is your design still effective? I think it's still effective. There will only be one leader. After becoming the leader, the startup process of JobMaster is the

Re: [VOTE] FLIP-379: Dynamic source parallelism inference for batch jobs

2023-11-30 Thread Leonard Xu
+1(binding) Btw, @Etienne, IIRC, your vote should be a binding one. Best, Leonard > 2023年11月30日 下午5:03,Etienne Chauchot 写道: > > +1 (non-biding) > > Etienne > > Le 30/11/2023 à 09:13, Rui Fan a écrit : >> +1(binding) >> >> Best, >> Rui >> >> On Thu, Nov 30, 2023 at 3:56 PM Lijie Wang

[RESULT][VOTE] Release flink-connector-aws, v4.2.0 release candidate #1

2023-11-30 Thread Danny Cranmer
I'm happy to announce that we have unanimously approved this release. There are 7 approving votes, 3 of which are binding: * Mystic Lama * Danny Cranmer (binding) * Jiabao Sun * Martijn Visser (binding) * Ahmed Hamdy * Leonard Xu (binding) * Samrat Deb There are no disapproving votes. Thanks

Re: [VOTE] Release flink-connector-aws, v4.2.0 release candidate #1

2023-11-30 Thread Danny Cranmer
Thanks everyone for the support. This vote is now closed, I will announce the results in a separate email. Danny. On Thu, Nov 30, 2023 at 5:20 AM Samrat Deb wrote: > Hi danny , > > +1 (non binding) > > Release notes look good > - Signatures and checksums verified > - pom versions checked > -

Re: [VOTE] FLIP-379: Dynamic source parallelism inference for batch jobs

2023-11-30 Thread Etienne Chauchot
+1 (non-biding) Etienne Le 30/11/2023 à 09:13, Rui Fan a écrit : +1(binding) Best, Rui On Thu, Nov 30, 2023 at 3:56 PM Lijie Wang wrote: +1 (binding) Best, Lijie Zhu Zhu 于2023年11月30日周四 13:13写道: +1 Thanks, Zhu Xia Sun 于2023年11月30日周四 11:41写道: Hi everyone, I'd like to start a vote

[jira] [Created] (FLINK-33702) Add IncrementalDelayRetryStrategy in AsyncRetryStrategies

2023-11-30 Thread xiangyu feng (Jira)
xiangyu feng created FLINK-33702: Summary: Add IncrementalDelayRetryStrategy in AsyncRetryStrategies Key: FLINK-33702 URL: https://issues.apache.org/jira/browse/FLINK-33702 Project: Flink

[jira] [Created] (FLINK-33701) restart.time-tracking doc is wrong

2023-11-30 Thread Rui Fan (Jira)
Rui Fan created FLINK-33701: --- Summary: restart.time-tracking doc is wrong Key: FLINK-33701 URL: https://issues.apache.org/jira/browse/FLINK-33701 Project: Flink Issue Type: Technical Debt

Re: [VOTE] FLIP-364: Improve the restart-strategy

2023-11-30 Thread Rui Fan
+1(binding) Best, Rui On Mon, Nov 13, 2023 at 11:01 AM Rui Fan <1996fan...@gmail.com> wrote: > Hi everyone, > > Thank you to everyone for the feedback on FLIP-364: Improve the > restart-strategy[1] > which has been discussed in this thread [2]. > > I would like to start a vote for it. The vote

Re: [VOTE] FLIP-379: Dynamic source parallelism inference for batch jobs

2023-11-30 Thread Rui Fan
+1(binding) Best, Rui On Thu, Nov 30, 2023 at 3:56 PM Lijie Wang wrote: > +1 (binding) > > Best, > Lijie > > Zhu Zhu 于2023年11月30日周四 13:13写道: > > > +1 > > > > Thanks, > > Zhu > > > > Xia Sun 于2023年11月30日周四 11:41写道: > > > > > Hi everyone, > > > > > > I'd like to start a vote on FLIP-379: