[jira] [Created] (FLINK-31482) support count jobmanager-failed failover times

Fei Feng created FLINK-31482: Summary: support count jobmanager-failed failover times Key: FLINK-31482 URL: https://issues.apache.org/jira/browse/FLINK-31482 Project: Flink Issue Type:

[jira] [Created] (FLINK-31481) Add filter support for ShowDatabases

Ran Tao created FLINK-31481: --- Summary: Add filter support for ShowDatabases Key: FLINK-31481 URL: https://issues.apache.org/jira/browse/FLINK-31481 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-31480) Fix Typo in YarnClusterDescriptor

Shilun Fan created FLINK-31480: -- Summary: Fix Typo in YarnClusterDescriptor Key: FLINK-31480 URL: https://issues.apache.org/jira/browse/FLINK-31480 Project: Flink Issue Type: Bug

Re: [DISCUSS] FLIP-301: Hybrid Shuffle supports Remote Storage

Hi, Yun Thanks for your suggestions. > I think you could describe it explicitly in the original FLIP's goals or design principles. I have updated the FLIP and given a more detailed description of the tier decoupling design. Best, Yuxin Yun Tang 于2023年3月15日周三 20:46写道： > Hi Yuxin, > > Thanks

Re: [VOTE] FLIP-300: Add targetColumns to DynamicTableSink#Context to solve the null overwrite problem of partial-insert

+1 (non-binding) Best, Jane On Thu, Mar 16, 2023 at 7:48 AM Benchao Li wrote: > +1 (binding) > > Dong Lin 于2023年3月15日周三 23:24写道： > > > +1 (binding) > > > > On Mon, Mar 13, 2023 at 8:18 PM Lincoln Lee > > wrote: > > > > > Dear Flink developers, > > > > > > Thanks for all your feedback for

[jira] [Created] (FLINK-31479) Close blocking iterators in tests

Guojun Li created FLINK-31479: - Summary: Close blocking iterators in tests Key: FLINK-31479 URL: https://issues.apache.org/jira/browse/FLINK-31479 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-31478) TypeError: a bytes-like object is required, not 'JavaList' is thrown when ds.execute_and_collect() is called on a KeyedStream

Dian Fu created FLINK-31478: --- Summary: TypeError: a bytes-like object is required, not 'JavaList' is thrown when ds.execute_and_collect() is called on a KeyedStream Key: FLINK-31478 URL:

Re: [VOTE] FLIP-293: Introduce Flink Jdbc Driver For Sql Gateway

Hang Ruan ruanhang1...@gmail.com 通过 “flink.apache.org” 3月15日周三 17:09 (17小时前) 发送至 dev 英语 中文 翻译邮件 +1 (non-binding) Samrat Deb 于2023年3月15日周三 23:29写道： > +1 ( non binding) > > Bests, > Samrat > > On Wed, 15 Mar 2023 at 8:54 PM, Dong Lin

Re: [Discussion] - Release major Flink version to support JDK 17 (LTS)

Thanks for your start this discuss I have been tracking this problem for a long time, until I saw a conversation in ISSUSE a few days ago and learned that the Kryo version problem will affect the JDK17 compilation of snapshots [1] FLINK-24998 , As @cherry said it ruined our whole effort towards

[jira] [Created] (FLINK-31477) NestedLoopJoinTest.testLeftOuterJoinWithFilter failed on azure

Leonard Xu created FLINK-31477: -- Summary: NestedLoopJoinTest.testLeftOuterJoinWithFilter failed on azure Key: FLINK-31477 URL: https://issues.apache.org/jira/browse/FLINK-31477 Project: Flink

Re: [VOTE] FLIP-300: Add targetColumns to DynamicTableSink#Context to solve the null overwrite problem of partial-insert

+1 (binding) Dong Lin 于2023年3月15日周三 23:24写道： > +1 (binding) > > On Mon, Mar 13, 2023 at 8:18 PM Lincoln Lee > wrote: > > > Dear Flink developers, > > > > Thanks for all your feedback for FLIP-300: Add targetColumns to > > DynamicTableSink#Context to solve the null overwrite problem of > >

[Discussion] - Release major Flink version to support JDK 17 (LTS)

Hey dev community, I'm writing this email to kick off a discussion following this epic: FLINK-15736. We are moving towards JDK 17 (LTS) , the only blocker now is Flink which currently remains on JDK 11 (LTS). Flink does not support JDK 17 yet,

[ANNOUNCE] Apache Flink 1.15.4 released

The Apache Flink community is very happy to announce the release of Apache Flink 1.15.4, which is the fourth bugfix release for the Apache Flink 1.15 series. Apache Flink® is an open-source stream processing framework for distributed, high-performing, always-available, and accurate data streaming

[jira] [Created] (FLINK-31476) AdaptiveScheduler should take lower bound parallelism settings into account

David Morávek created FLINK-31476: - Summary: AdaptiveScheduler should take lower bound parallelism settings into account Key: FLINK-31476 URL: https://issues.apache.org/jira/browse/FLINK-31476

Re: [VOTE] Release flink-connector-parent 1.0.0, release candidate #1

Title correction: the version is 1.0.0. On 15/03/2023 16:40, Chesnay Schepler wrote: Hi everyone, Please review and vote on the release candidate, as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release (please provide specific comments) This is the first release of the

[VOTE] Release flink-connector-parent10.0, release candidate #1

Hi everyone, Please review and vote on the release candidate, as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release (please provide specific comments) This is the first release of the flink-connector-parent pom by the Flink project. This subsumes the previous release that I

Re: [VOTE] FLIP-293: Introduce Flink Jdbc Driver For Sql Gateway

+1 ( non binding) Bests, Samrat On Wed, 15 Mar 2023 at 8:54 PM, Dong Lin wrote: > +1 (binding) > > On Mon, Mar 13, 2023 at 1:47 PM Shammon FY wrote: > > > Hi Devs, > > > > I'd like to start the vote on FLIP-293: Introduce Flink Jdbc Driver For > Sql > > Gateway [1]. > > > > The FLIP was

Re: [VOTE] FLIP-300: Add targetColumns to DynamicTableSink#Context to solve the null overwrite problem of partial-insert

+1 (binding) On Mon, Mar 13, 2023 at 8:18 PM Lincoln Lee wrote: > Dear Flink developers, > > Thanks for all your feedback for FLIP-300: Add targetColumns to > DynamicTableSink#Context to solve the null overwrite problem of > partial-insert[1] on the discussion thread[2]. > > I'd like to start a

Re: [VOTE] FLIP-293: Introduce Flink Jdbc Driver For Sql Gateway

+1 (binding) On Mon, Mar 13, 2023 at 1:47 PM Shammon FY wrote: > Hi Devs, > > I'd like to start the vote on FLIP-293: Introduce Flink Jdbc Driver For Sql > Gateway [1]. > > The FLIP was discussed in thread [2], and it aims to introduce Flink Jdbc > Driver module in Flink. > > The vote will last

[jira] [Created] (FLINK-31475) Allow project to be user-defined in release scripts

Chesnay Schepler created FLINK-31475: Summary: Allow project to be user-defined in release scripts Key: FLINK-31475 URL: https://issues.apache.org/jira/browse/FLINK-31475 Project: Flink

[jira] [Created] (FLINK-31474) [Flink] Add failure information for out-of-order checkpoints

Ming Li created FLINK-31474: --- Summary: [Flink] Add failure information for out-of-order checkpoints Key: FLINK-31474 URL: https://issues.apache.org/jira/browse/FLINK-31474 Project: Flink Issue

[jira] [Created] (FLINK-31473) Add new show operations docs

Ran Tao created FLINK-31473: --- Summary: Add new show operations docs Key: FLINK-31473 URL: https://issues.apache.org/jira/browse/FLINK-31473 Project: Flink Issue Type: Sub-task

Re: [DISCUSS] FLIP-301: Hybrid Shuffle supports Remote Storage

Hi Yuxin, Thanks for your explanations. I think the kernel idea is that you prefer the simple and decoupling design for the 1st version of hybrid shuffle with remote storage. If following this idea, perhaps I could accept your current explanations and I think you could describe it explicitly

[jira] [Created] (FLINK-31472) AsyncSinkWriterThrottlingTest failed with Illegal mailbox thread

Ran Tao created FLINK-31472: --- Summary: AsyncSinkWriterThrottlingTest failed with Illegal mailbox thread Key: FLINK-31472 URL: https://issues.apache.org/jira/browse/FLINK-31472 Project: Flink

[DISCUSSI] Improve Multi-Query optimization in Flink

Hi devs, I want to discuss about a new way to optimize the multi-sink query in Flink. Currently, Flink use the RelNodeBlock mechanism to do optimization for the mutl-sink query. It has following steps: 1. Multi-sink query will be parsed and validated to multi RelNode tree 2. Merge the

[jira] [Created] (FLINK-31470) Introduce integration tests for Externalized Declarative Resource Management

David Morávek created FLINK-31470: - Summary: Introduce integration tests for Externalized Declarative Resource Management Key: FLINK-31470 URL: https://issues.apache.org/jira/browse/FLINK-31470

[jira] [Created] (FLINK-31471) Allow changing per-vertex desired parallelism through WEB UI

David Morávek created FLINK-31471: - Summary: Allow changing per-vertex desired parallelism through WEB UI Key: FLINK-31471 URL: https://issues.apache.org/jira/browse/FLINK-31471 Project: Flink

[jira] [Created] (FLINK-31469) Allow setting JobResourceRequirements through REST API

David Morávek created FLINK-31469: - Summary: Allow setting JobResourceRequirements through REST API Key: FLINK-31469 URL: https://issues.apache.org/jira/browse/FLINK-31469 Project: Flink

[jira] [Created] (FLINK-31468) Allow setting JobResourceRequirements through DispatcherGateway

David Morávek created FLINK-31468: - Summary: Allow setting JobResourceRequirements through DispatcherGateway Key: FLINK-31468 URL: https://issues.apache.org/jira/browse/FLINK-31468 Project: Flink

[jira] [Created] (FLINK-31467) Support time travel for Spark 3.3

yuzelin created FLINK-31467: --- Summary: Support time travel for Spark 3.3 Key: FLINK-31467 URL: https://issues.apache.org/jira/browse/FLINK-31467 Project: Flink Issue Type: New Feature

Re: [DISCUSS] Enabling dynamic partition discovery by default in Kafka source

Thanks Hongshun for picking up the ticket and analyzing the detail deeply. As you have discussed with Qingsheng offline, I think we can update the content to FLIP-288[1] and then start the FLIP discussion. Best, Leonard [1]

[jira] [Created] (FLINK-31466) Backport "FilterJoinRule misses opportunity to push filter to semijoin input" to FlinkFilterJoinRule

Sergey Nuyanzin created FLINK-31466: --- Summary: Backport "FilterJoinRule misses opportunity to push filter to semijoin input" to FlinkFilterJoinRule Key: FLINK-31466 URL:

[jira] [Created] (FLINK-31465) [Flink] Fix shortcode errors in docs

Ming Li created FLINK-31465: --- Summary: [Flink] Fix shortcode errors in docs Key: FLINK-31465 URL: https://issues.apache.org/jira/browse/FLINK-31465 Project: Flink Issue Type: Improvement

Re: [VOTE] FLIP-296: Extend watermark-related features for SQL

+1 (binding) Thanks Kui for driving this work. Best Yun Tang From: Kui Yuan Sent: Wednesday, March 15, 2023 16:45 To: dev@flink.apache.org Subject: [VOTE] FLIP-296: Extend watermark-related features for SQL Hi all, I want to start the vote of FLIP-296:

Re: [DISCUSS] Enabling dynamic partition discovery by default in Kafka source

Hi Hongshun Agree with @Etienne. And can you describe this process and the problems in a figure? Thanks Best, Shammon FY On Wed, Mar 15, 2023 at 5:15 PM Etienne Chauchot wrote: > Hi, > > Why not track this in a FLIP and a ticket and link this discussion thread. > > My 2 cents > > Etienne > >

Re: [DISCUSS] Enabling dynamic partition discovery by default in Kafka source

Thanks for your advise! I will do this later. Best, Hongshun On Wed, Mar 15, 2023 at 5:15 PM Etienne Chauchot wrote: > Hi, > > Why not track this in a FLIP and a ticket and link this discussion thread. > > My 2 cents > > Etienne > > Le 15/03/2023 à 10:01, Hongshun Wang a écrit : > > Hi

[jira] [Created] (FLINK-31464) Move SqlNode convert logic out from SqlToOperationConverter

luoyuxia created FLINK-31464: Summary: Move SqlNode convert logic out from SqlToOperationConverter Key: FLINK-31464 URL: https://issues.apache.org/jira/browse/FLINK-31464 Project: Flink Issue

Re: [DISCUSS] Enabling dynamic partition discovery by default in Kafka source

Hi, Why not track this in a FLIP and a ticket and link this discussion thread. My 2 cents Etienne Le 15/03/2023 à 10:01, Hongshun Wang a écrit : Hi devs, I’d like to join this discussion. CC:Qingsheng As discussed above, new partitions after the first discovery should be consumed from

Re: [VOTE] FLIP-293: Introduce Flink Jdbc Driver For Sql Gateway

+1 (non-binding) Best, Hang Leonard Xu 于2023年3月15日周三 15:53写道： > Thanks shammon for driving this FLIP. > > +1 (binding) > > Best, > Leonard > > On Wed, Mar 15, 2023 at 1:36 PM weijie guo > wrote: > > > +1 (binding) > > > > Best regards, > > > > Weijie > > > > > > Jacky Lau 于2023年3月15日周三

RE: [DISCUSS] Enabling dynamic partition discovery by default in Kafka source

Hi devs, I’d like to join this discussion. CC:Qingsheng As discussed above, new partitions after the first discovery should be consumed from EARLIEST offset. However, when KafkaSourceEnumerator restarts after a job failure, it cannot distinguish between unassigned partitions as first-discovered

[jira] [Created] (FLINK-31463) When I use apache flink1.12.2 version, the following akka error often occurs.

Zhuang Liu created FLINK-31463: --- Summary: When I use apache flink1.12.2 version, the following akka error often occurs. Key: FLINK-31463 URL: https://issues.apache.org/jira/browse/FLINK-31463 Project:

[VOTE] FLIP-296: Extend watermark-related features for SQL

Hi all, I want to start the vote of FLIP-296: Extend watermark-related features for SQL [1].The FLIP was discussed in this thread [2]. The goal of the FLIP is to extend those watermark-related features already implemented on the datastream api for SQL users. The vote will last for at least 72

[jira] [Created] (FLINK-31462) [Flink] Supports full calculation from the specified snapshot

Ming Li created FLINK-31462: --- Summary: [Flink] Supports full calculation from the specified snapshot Key: FLINK-31462 URL: https://issues.apache.org/jira/browse/FLINK-31462 Project: Flink Issue

Re: [VOTE] FLIP-293: Introduce Flink Jdbc Driver For Sql Gateway

Thanks shammon for driving this FLIP. +1 (binding) Best, Leonard On Wed, Mar 15, 2023 at 1:36 PM weijie guo wrote: > +1 (binding) > > Best regards, > > Weijie > > > Jacky Lau 于2023年3月15日周三 13:30写道： > > > +1 (non-binding) > > it will make integrate with other tools convenient, like

Re: [VOTE] Release 1.17.0, release candidate #2

Thanks Qingsheng for driving this. +1 (non-binding) - built from source code - run some batch jobs, query results are expected, the default batch scheduler is AdaptiveBatchScheduler, WebUI looks good, no suspicious output/log. - start a Flink yarn session cluster, run the 10TB tpc-ds, all job