退订

2021-03-02 Thread 吴新乐

Re: [VOTE] FLIP-162: Consistent Flink SQL time function behavior

2021-03-02 Thread Timo Walther
+1 (binding) Regards, Timo On 03.03.21 04:14, Jark Wu wrote: +1 (binding) Best, Jark On Tue, 2 Mar 2021 at 10:42, Leonard Xu wrote: Hi all, I would like to start the vote for FLIP-162 [1], which has been discussed and reached a consensus in the discussion thread [2]. Please vote +1 to

[jira] [Created] (FLINK-21578) Closeable Sink Committer/GlobalCommitter were created to function in onestep during job graph composition

2021-03-02 Thread Kezhu Wang (Jira)
Kezhu Wang created FLINK-21578: -- Summary: Closeable Sink Committer/GlobalCommitter were created to function in onestep during job graph composition Key: FLINK-21578 URL:

[jira] [Created] (FLINK-21577) SimpleType.simpleTypeFrom(...) complains with "Collection is empty"

2021-03-02 Thread Tzu-Li (Gordon) Tai (Jira)
Tzu-Li (Gordon) Tai created FLINK-21577: --- Summary: SimpleType.simpleTypeFrom(...) complains with "Collection is empty" Key: FLINK-21577 URL: https://issues.apache.org/jira/browse/FLINK-21577

[jira] [Created] (FLINK-21576) Remove ExecutionVertex#getPreferredLocations

2021-03-02 Thread Zhu Zhu (Jira)
Zhu Zhu created FLINK-21576: --- Summary: Remove ExecutionVertex#getPreferredLocations Key: FLINK-21576 URL: https://issues.apache.org/jira/browse/FLINK-21576 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-21575) Replace InputFormat with BulkFormat in HivePartition Reader

2021-03-02 Thread Leonard Xu (Jira)
Leonard Xu created FLINK-21575: -- Summary: Replace InputFormat with BulkFormat in HivePartition Reader Key: FLINK-21575 URL: https://issues.apache.org/jira/browse/FLINK-21575 Project: Flink

[jira] [Created] (FLINK-21574) WindowDistinctAggregateITCase.testCumulateWindow_GroupingSets unstable

2021-03-02 Thread Guowei Ma (Jira)
Guowei Ma created FLINK-21574: - Summary: WindowDistinctAggregateITCase.testCumulateWindow_GroupingSets unstable Key: FLINK-21574 URL: https://issues.apache.org/jira/browse/FLINK-21574 Project: Flink

[jira] [Created] (FLINK-21573) Support expression reuse in codegen

2021-03-02 Thread Benchao Li (Jira)
Benchao Li created FLINK-21573: -- Summary: Support expression reuse in codegen Key: FLINK-21573 URL: https://issues.apache.org/jira/browse/FLINK-21573 Project: Flink Issue Type: Improvement

Re: [VOTE] FLIP-162: Consistent Flink SQL time function behavior

2021-03-02 Thread Jark Wu
+1 (binding) Best, Jark On Tue, 2 Mar 2021 at 10:42, Leonard Xu wrote: > Hi all, > > I would like to start the vote for FLIP-162 [1], which has been discussed > and > reached a consensus in the discussion thread [2]. > > Please vote +1 to approve the FLIP, or -1 with a comment. > > The vote

[jira] [Created] (FLINK-21572) USE DATABASE & USE CATALOG fails with quoted identifiers containing characters to be escaped in Flink SQL client.

2021-03-02 Thread Xiaoguang Sun (Jira)
Xiaoguang Sun created FLINK-21572: - Summary: USE DATABASE & USE CATALOG fails with quoted identifiers containing characters to be escaped in Flink SQL client. Key: FLINK-21572 URL:

Re: [VOTE] FLIP-163: SQL Client Improvements

2021-03-02 Thread Jark Wu
+1 to the updated FLIP. Best, Jark On Wed, 3 Mar 2021 at 10:30, Leonard Xu wrote: > +1 (non-binding) > > The updated FLIP looks well. > > Best, > Leonard > > > > 在 2021年3月2日,22:27,Shengkai Fang 写道: > > > > already updated the FLIP[2]. It seems the vote has lasted for a long > time. > >

Re: [VOTE] FLIP-163: SQL Client Improvements

2021-03-02 Thread Leonard Xu
+1 (non-binding) The updated FLIP looks well. Best, Leonard > 在 2021年3月2日,22:27,Shengkai Fang 写道: > > already updated the FLIP[2]. It seems the vote has lasted for a long time.

[jira] [Created] (FLINK-21571) Japicmp reference version does not exist

2021-03-02 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-21571: Summary: Japicmp reference version does not exist Key: FLINK-21571 URL: https://issues.apache.org/jira/browse/FLINK-21571 Project: Flink Issue Type:

Re: [DISCUSS] FLIP-165: Operator's Flame Graphs

2021-03-02 Thread Seth Wiesman
Cool feature +1 There is a subsection called monitoring in the operations section of the docs. It would fit nicely there. Seth On Tue, Mar 2, 2021 at 4:23 PM Alexander Fedulov wrote: > Hi Piotr, > > Thanks for the comments - all valid points. > We should definitely document how the Flame

Re: [DISCUSS] FLIP-165: Operator's Flame Graphs

2021-03-02 Thread Alexander Fedulov
Hi Piotr, Thanks for the comments - all valid points. We should definitely document how the Flame Graphs are constructed - I will work on the docs. Do you have a proposition about the part of which page/section they should become? I would like to also mention here that I plan to work on further

Re: [RESULT] [VOTE] Release 1.12.2, release candidate #2

2021-03-02 Thread Henry Saputra
Apparently I suck at math, yes it should be 4 binding Votes. Thanks, Dawid - Henry On Tue, Mar 2, 2021 at 12:59 PM Roman Khachatryan wrote: > Yes, you are right. > > There are 7 approving votes, 4 of which are binding: > * Kurt Young > * Piotr Nowojski > * Yu Li > * Zhu Zhu > > There are no

[jira] [Created] (FLINK-21570) Add Job ID to RuntimeContext

2021-03-02 Thread Roman Khachatryan (Jira)
Roman Khachatryan created FLINK-21570: - Summary: Add Job ID to RuntimeContext Key: FLINK-21570 URL: https://issues.apache.org/jira/browse/FLINK-21570 Project: Flink Issue Type:

Re: [RESULT] [VOTE] Release 1.12.2, release candidate #2

2021-03-02 Thread Roman Khachatryan
Yes, you are right. There are 7 approving votes, 4 of which are binding: * Kurt Young * Piotr Nowojski * Yu Li * Zhu Zhu There are no disapproving votes. Thanks everyone! Regards, Roman On Tue, Mar 2, 2021 at 9:29 PM Dawid Wysakowicz wrote: > Yes, Henry is right. Binding votes on Apache

Re: [RESULT] [VOTE] Release 1.12.2, release candidate #2

2021-03-02 Thread Dawid Wysakowicz
Yes, Henry is right. Binding votes on Apache releases must come from PMC members. Out of the votes 4 are binding: * Kurt Young * Piotr Nowojski * Yu Li * Zhu Zhu Best, Dawid On 02/03/2021 21:17, Henry Saputra wrote: > Roman, binding Votes only come from Apache Flink PMC members. > > From the

Re: [RESULT] [VOTE] Release 1.12.2, release candidate #2

2021-03-02 Thread Henry Saputra
Roman, binding Votes only come from Apache Flink PMC members. >From the list you had seems like only 3 binding Votes, right? On Tue, Mar 2, 2021, 7:08 AM Roman Khachatryan wrote: > I'm happy to announce that we have unanimously approved this release. > > There are 7 approving votes, 5 of

Re: [DISCUSS] FLIP-166: Flink/Pinot Connector

2021-03-02 Thread Henry Saputra
I think this is good contribution to Apache Bahir: https://github.com/apache/bahir-flink as proper place to additional Flink connectors. - Henry On Tue, Mar 2, 2021, 11:35 AM Yupeng Fu wrote: > Hi all, > > I'd like to propose a Flink/Pinot connector to solve the problems of > streaming/batch

Re: [DISCUSS] Splitting User support mailing list

2021-03-02 Thread Henry Saputra
-1 for splitting user list to areas in Flink. As Robert and others have chimed in, we could have separate user list for sub projects in Flink, like statefun - Henry On Tue, Mar 2, 2021, 11:27 AM Roman Khachatryan wrote: > Thanks Robert, > > That's a good idea, let's revisit it later. > >

[DISCUSS] FLIP-166: Flink/Pinot Connector

2021-03-02 Thread Yupeng Fu
Hi all, I'd like to propose a Flink/Pinot connector to solve the problems of streaming/batch unification for the real-time analytical infrastructure on top of Flink and Pinot. Apache Pinot is a real-time distributed OLAP datastore with an inbuilt lambda

Re: [DISCUSS] Splitting User support mailing list

2021-03-02 Thread Roman Khachatryan
Thanks Robert, That's a good idea, let's revisit it later. Regards, Roman On Tue, Mar 2, 2021 at 3:40 PM Robert Metzger wrote: > Thanks a lot for bringing up this idea Roman! > > After reading the initial proposal, I quite liked the idea, because it > makes our life easier: We can only

[jira] [Created] (FLINK-21569) Flink SQL with CSV file input job hangs

2021-03-02 Thread Nico Kruber (Jira)
Nico Kruber created FLINK-21569: --- Summary: Flink SQL with CSV file input job hangs Key: FLINK-21569 URL: https://issues.apache.org/jira/browse/FLINK-21569 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-21568) Navigating in SQL client can lead to SqlExecutionException

2021-03-02 Thread Nico Kruber (Jira)
Nico Kruber created FLINK-21568: --- Summary: Navigating in SQL client can lead to SqlExecutionException Key: FLINK-21568 URL: https://issues.apache.org/jira/browse/FLINK-21568 Project: Flink

[jira] [Created] (FLINK-21567) CSV Format exception while parsing: ArrayIndexOutOfBoundsException: 4000

2021-03-02 Thread Nico Kruber (Jira)
Nico Kruber created FLINK-21567: --- Summary: CSV Format exception while parsing: ArrayIndexOutOfBoundsException: 4000 Key: FLINK-21567 URL: https://issues.apache.org/jira/browse/FLINK-21567 Project:

Re: Re: Re: [DISCUSS] FLIP-147: Support Checkpoints After Tasks Finished

2021-03-02 Thread Piotr Nowojski
Hi, Thanks for reminding me. I think FLIP-147 will have to deal in one way or another with the (re?)emitting MAX_WATERMARK. There is a pre-existing issue that watermarks are not checkpointed/stored on state, and there was/is now clear answer how we should handle this as far as I remember. One

[jira] [Created] (FLINK-21566) Improve error message for "Unsupported casting"

2021-03-02 Thread Nico Kruber (Jira)
Nico Kruber created FLINK-21566: --- Summary: Improve error message for "Unsupported casting" Key: FLINK-21566 URL: https://issues.apache.org/jira/browse/FLINK-21566 Project: Flink Issue Type:

[jira] [Created] (FLINK-21565) Support more integer types in TIMESTAMPADD

2021-03-02 Thread Nico Kruber (Jira)
Nico Kruber created FLINK-21565: --- Summary: Support more integer types in TIMESTAMPADD Key: FLINK-21565 URL: https://issues.apache.org/jira/browse/FLINK-21565 Project: Flink Issue Type:

[jira] [Created] (FLINK-21564) CommonTestUtils.waitUntilCondition could fail with condition meets before

2021-03-02 Thread Kezhu Wang (Jira)
Kezhu Wang created FLINK-21564: -- Summary: CommonTestUtils.waitUntilCondition could fail with condition meets before Key: FLINK-21564 URL: https://issues.apache.org/jira/browse/FLINK-21564 Project: Flink

[jira] [Created] (FLINK-21563) Support using computed columns when defining (new) computed columns

2021-03-02 Thread Nico Kruber (Jira)
Nico Kruber created FLINK-21563: --- Summary: Support using computed columns when defining (new) computed columns Key: FLINK-21563 URL: https://issues.apache.org/jira/browse/FLINK-21563 Project: Flink

[jira] [Created] (FLINK-21562) Add more informative message on CSV parsing errors

2021-03-02 Thread Nico Kruber (Jira)
Nico Kruber created FLINK-21562: --- Summary: Add more informative message on CSV parsing errors Key: FLINK-21562 URL: https://issues.apache.org/jira/browse/FLINK-21562 Project: Flink Issue Type:

[jira] [Created] (FLINK-21561) Introduce cache for binaries downloaded by bash tests

2021-03-02 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-21561: -- Summary: Introduce cache for binaries downloaded by bash tests Key: FLINK-21561 URL: https://issues.apache.org/jira/browse/FLINK-21561 Project: Flink

[RESULT] [VOTE] Release 1.12.2, release candidate #2

2021-03-02 Thread Roman Khachatryan
I'm happy to announce that we have unanimously approved this release. There are 7 approving votes, 5 of which are binding: * Kurt Young * Piotr Nowojski * Roman Khachatryan * Yu Li * Zhu Zhu There are no disapproving votes. Thanks everyone! Regards, Roman

Re: [VOTE] Release 1.12.2, release candidate #2

2021-03-02 Thread Roman Khachatryan
Thank you all for helping to verify and test the RC! The vote has lasted for more than 72 hours and has enough approvals. I will finalize the vote result soon in a separate email. Regards, Roman On Tue, Mar 2, 2021 at 10:33 AM Zhu Zhu wrote: > +1 (binding) > - checked signatures and

[jira] [Created] (FLINK-21560) AkkaRpcServiceTest.testScheduleRunnable fails with "call was not properly delayed"

2021-03-02 Thread Dawid Wysakowicz (Jira)
Dawid Wysakowicz created FLINK-21560: Summary: AkkaRpcServiceTest.testScheduleRunnable fails with "call was not properly delayed" Key: FLINK-21560 URL: https://issues.apache.org/jira/browse/FLINK-21560

Re: [DISCUSS] Apache Flink Jira Process

2021-03-02 Thread Robert Metzger
Thanks a lot for the proposal! +1 for doing it! On Tue, Mar 2, 2021 at 12:27 PM Khachatryan Roman < khachatryan.ro...@gmail.com> wrote: > Hi Konstantin, > > I think we should try it out. > Even if tickets don't work well it can be a good step towards managing > technical debt in some other way,

Re: [DISCUSS] Splitting User support mailing list

2021-03-02 Thread Robert Metzger
Thanks a lot for bringing up this idea Roman! After reading the initial proposal, I quite liked the idea, because it makes our life easier: We can only monitor lists relevant for the topics we are working on (I have to admit that I usually skip all questions that seem to be related to SQL or

[ANNOUCE][DISCUSS] Roadmap Update for Website

2021-03-02 Thread Stephan Ewen
Hi all! The roadmap on the Flink website is quite outdated: https://flink.apache.org/roadmap.html I drafted an update to the roadmap that reflects the currently ongoing bigger threads. Not every detail is mentioned there, because this roadmap should give users a high-level view where the project

Re: [VOTE] FLIP-163: SQL Client Improvements

2021-03-02 Thread Shengkai Fang
Hi, everyone. We have resolved the divergence in the discussion[1] recently and I have already updated the FLIP[2]. It seems the vote has lasted for a long time. If no one has other objections, I will close the vote until March. 4 2021 10:00 AM UTC+8. Best, Shengkai [1]

[jira] [Created] (FLINK-21559) Python DataStreamTests::test_process_function failed on AZP

2021-03-02 Thread Till Rohrmann (Jira)
Till Rohrmann created FLINK-21559: - Summary: Python DataStreamTests::test_process_function failed on AZP Key: FLINK-21559 URL: https://issues.apache.org/jira/browse/FLINK-21559 Project: Flink

Re: [DISCUSS] FLIP-165: Operator's Flame Graphs

2021-03-02 Thread Piotr Nowojski
Nice feature +1 from my side for it. In the PR I think we are missing documentation. I think it's especially important to mention the limitations of this approach for performance analysis. If we make it easy for the user to get such kind of data, it's important they do not proverbially shoot

Re: [DISCUSS] FLIP-165: Operator's Flame Graphs

2021-03-02 Thread Till Rohrmann
Ah ok. Thanks for the clarification Alex. Cheers, Till On Tue, Mar 2, 2021 at 2:02 PM Alexander Fedulov wrote: > It is passed back as part of the response to the asynchronous callback > within the coordinator and is used to decide if all outstanding requests to > the parallel instances of a

Re: [DISCUSS]FLIP-163: SQL Client Improvements

2021-03-02 Thread Timo Walther
+1 for option 2 Regards, Timo On 02.03.21 03:50, Jark Wu wrote: I prefer option#2 and I think this can make everyone happy. Best, Jark On Mon, 1 Mar 2021 at 18:22, Shengkai Fang wrote: Hi, everyone. After the long discussion, I am fine with both choices. But I prefer the second option

Re: [DISCUSS] FLIP-165: Operator's Flame Graphs

2021-03-02 Thread Alexander Fedulov
It is passed back as part of the response to the asynchronous callback within the coordinator and is used to decide if all outstanding requests to the parallel instances of a particular operator returned successfully. If so, the request is considered successful, sub-results are combined and the

[jira] [Created] (FLINK-21558) DeclarativeSlotManager starts logging "Could not fulfill resource requirements of job xxx"

2021-03-02 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-21558: -- Summary: DeclarativeSlotManager starts logging "Could not fulfill resource requirements of job xxx" Key: FLINK-21558 URL: https://issues.apache.org/jira/browse/FLINK-21558

Re: [DISCUSS] FLIP-165: Operator's Flame Graphs

2021-03-02 Thread Till Rohrmann
Why does the caller of TaskExecutorGateway.requestThreadInfoSamples need to specify the request id? Is it because the caller can send a second request with the same id? Or can the caller query the result of a previous request by specifying the requestId? If the TaskExecutor does not need to know

Re: [DISCUSS] Apache Flink Jira Process

2021-03-02 Thread Khachatryan Roman
Hi Konstantin, I think we should try it out. Even if tickets don't work well it can be a good step towards managing technical debt in some other way, like wiki. Thanks! Regards, Roman On Tue, Mar 2, 2021 at 9:32 AM Dawid Wysakowicz wrote: > I'd be fine with dropping the "Trivial" priority

[jira] [Created] (FLINK-21556) StreamingKafkaITCase hangs on azure

2021-03-02 Thread Dawid Wysakowicz (Jira)
Dawid Wysakowicz created FLINK-21556: Summary: StreamingKafkaITCase hangs on azure Key: FLINK-21556 URL: https://issues.apache.org/jira/browse/FLINK-21556 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-21557) An error was reported when temp join hive.

2021-03-02 Thread HideOnBush (Jira)
HideOnBush created FLINK-21557: -- Summary: An error was reported when temp join hive. Key: FLINK-21557 URL: https://issues.apache.org/jira/browse/FLINK-21557 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-21555) HA does not work when using mesos scheduler

2021-03-02 Thread Qinghui Xu (Jira)
Qinghui Xu created FLINK-21555: -- Summary: HA does not work when using mesos scheduler Key: FLINK-21555 URL: https://issues.apache.org/jira/browse/FLINK-21555 Project: Flink Issue Type: Bug

Re: [VOTE] Release 1.12.2, release candidate #2

2021-03-02 Thread Zhu Zhu
+1 (binding) - checked signatures and checksums - built from source - ran medium scale streaming and batch jobs (parallelism=1000) on a YARN cluster. checked output and logs. - the web PR looks good Thanks, Zhu Roman Khachatryan 于2021年3月2日周二 下午4:20写道: > Hi everyone, > > +1 (binding) > >

Re: [DISCUSS] FLIP-165: Operator's Flame Graphs

2021-03-02 Thread Alexander Fedulov
Hi Till, Thanks for your comments. * What is the requestId used for in the RPC call? It is the handle that is used as the key in the ThreadInfoRequestCoordinator's pending responses Map. I believe it was called sampleId in the StackTraceSampleCoordinator, but I decided to rename it because

Re: [DISCUSS] Apache Flink Jira Process

2021-03-02 Thread Dawid Wysakowicz
I'd be fine with dropping the "Trivial" priority in favour of "starter" label. Best, Dawid On 01/03/2021 11:53, Konstantin Knauf wrote: > Hi Dawid, > > Thanks for the feedback. Do you think we should simply get rid of the > "Trivial" priority then and use the "starter" label more aggressively?

[jira] [Created] (FLINK-21554) Remove the magical classpath setting stuff in docker-entrypoint.sh

2021-03-02 Thread Yang Wang (Jira)
Yang Wang created FLINK-21554: - Summary: Remove the magical classpath setting stuff in docker-entrypoint.sh Key: FLINK-21554 URL: https://issues.apache.org/jira/browse/FLINK-21554 Project: Flink

Re: [DISCUSS] Apache Flink Jira Process

2021-03-02 Thread Konstantin Knauf
Hi Roman, thanks for your feedback. For the Technical Debt tickets the same rules as for all other tickets would apply: * Major+ indicates an active discussion or contribution. * Minor is for everything else. So, other issue types, too, do not imply an intention to work on it in the near

Re: [VOTE] Release 1.12.2, release candidate #2

2021-03-02 Thread Roman Khachatryan
Hi everyone, +1 (binding) I've verified the checksums and the source distribution with maven verify. Regards, Roman On Tue, Mar 2, 2021 at 7:29 AM Kurt Young wrote: > +1 (binding) > > - We mainly checked the patch of FLINK-20663 [1] and confirmed there is no > OutOfManagedMemory error

Re: [DISCUSS] FLIP-165: Operator's Flame Graphs

2021-03-02 Thread Till Rohrmann
Thanks for starting this discussion Alex. I really like this feature because it gives better insights into what a Flink job is doing. Quick question on the TaskExecutorGateway extension: * What is the requestId used for in the RPC call? * Would it make sense to group numSubSamples,