Re: [DISCUSS] Exact feature freeze date

2020-05-15 Thread Congxian Qiu
+1 for Monday morning in Europe. Best, Congxian Danny Chan 于2020年5月16日周六 上午10:40写道: > +1 for Monday morning in Europe. > > Best, > Danny Chan > 在 2020年5月15日 +0800 PM10:51,Zhijiang .invalid>,写道: > > +1 for Monday morning in Europe. > > > > Best, > > Zhijiang > > > > > >

[jira] [Created] (FLINK-17749) Remove fromTableSource method from TableEnvironment

2020-05-15 Thread Kurt Young (Jira)
Kurt Young created FLINK-17749: -- Summary: Remove fromTableSource method from TableEnvironment Key: FLINK-17749 URL: https://issues.apache.org/jira/browse/FLINK-17749 Project: Flink Issue Type:

[jira] [Created] (FLINK-17748) Remove registration of TableSource/TableSink in Table Env

2020-05-15 Thread Kurt Young (Jira)
Kurt Young created FLINK-17748: -- Summary: Remove registration of TableSource/TableSink in Table Env Key: FLINK-17748 URL: https://issues.apache.org/jira/browse/FLINK-17748 Project: Flink Issue

[jira] [Created] (FLINK-17747) PackagedProgram' extractedTempLibraries and jarfiles may be duplicate

2020-05-15 Thread lisen (Jira)
lisen created FLINK-17747: - Summary: PackagedProgram' extractedTempLibraries and jarfiles may be duplicate Key: FLINK-17747 URL: https://issues.apache.org/jira/browse/FLINK-17747 Project: Flink

[jira] [Created] (FLINK-17746) PackagedProgram' extractedTempLibraries and jarfiles may be duplicate

2020-05-15 Thread lisen (Jira)
lisen created FLINK-17746: - Summary: PackagedProgram' extractedTempLibraries and jarfiles may be duplicate Key: FLINK-17746 URL: https://issues.apache.org/jira/browse/FLINK-17746 Project: Flink

[jira] [Created] (FLINK-17745) PackagedProgram' extractedTempLibraries and jarfiles may be duplicate

2020-05-15 Thread lisen (Jira)
lisen created FLINK-17745: - Summary: PackagedProgram' extractedTempLibraries and jarfiles may be duplicate Key: FLINK-17745 URL: https://issues.apache.org/jira/browse/FLINK-17745 Project: Flink

Re: [DISCUSS] Exact feature freeze date

2020-05-15 Thread Danny Chan
+1 for Monday morning in Europe. Best, Danny Chan 在 2020年5月15日 +0800 PM10:51,Zhijiang ,写道: > +1 for Monday morning in Europe. > > Best, > Zhijiang > > > -- > From:Yun Tang > Send Time:2020年5月15日(星期五) 21:58 > To:dev > Subject:Re:

[jira] [Created] (FLINK-17744) StreamContextEnvironment#execute cannot be call JobListener#onJobExecuted

2020-05-15 Thread lisen (Jira)
lisen created FLINK-17744: - Summary: StreamContextEnvironment#execute cannot be call JobListener#onJobExecuted Key: FLINK-17744 URL: https://issues.apache.org/jira/browse/FLINK-17744 Project: Flink

[jira] [Created] (FLINK-17743) Python e2e failed by Cannot run program "venv.zip/.conda/bin/python"

2020-05-15 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-17743: Summary: Python e2e failed by Cannot run program "venv.zip/.conda/bin/python" Key: FLINK-17743 URL: https://issues.apache.org/jira/browse/FLINK-17743 Project: Flink

[jira] [Created] (FLINK-17742) Blob file not removed after task was cancelled in standalone mode

2020-05-15 Thread lisen (Jira)
lisen created FLINK-17742: - Summary: Blob file not removed after task was cancelled in standalone mode Key: FLINK-17742 URL: https://issues.apache.org/jira/browse/FLINK-17742 Project: Flink Issue

[jira] [Created] (FLINK-17741) Create integration or e2e test for out of order (savepoint) barriers

2020-05-15 Thread Roman Khachatryan (Jira)
Roman Khachatryan created FLINK-17741: - Summary: Create integration or e2e test for out of order (savepoint) barriers Key: FLINK-17741 URL: https://issues.apache.org/jira/browse/FLINK-17741

[jira] [Created] (FLINK-17740) Remove flink-container/kubernetes

2020-05-15 Thread Andrey Zagrebin (Jira)
Andrey Zagrebin created FLINK-17740: --- Summary: Remove flink-container/kubernetes Key: FLINK-17740 URL: https://issues.apache.org/jira/browse/FLINK-17740 Project: Flink Issue Type: Sub-task

Re: [VOTE] Guarantee that @PublicEvolving classes are API and binary compatible across bug fix releases (x.y.u and x.y.v)

2020-05-15 Thread Yangze Guo
+1 Best, Yangze Guo On Sat, May 16, 2020 at 12:26 AM Yuan Mei wrote: > > +1 > > On Sat, May 16, 2020 at 12:21 AM Ufuk Celebi wrote: > > > +1 > > > > – Ufuk > > > > > > On Fri, May 15, 2020 at 4:54 PM Zhijiang > .invalid> > > wrote: > > > > > Sounds good, +1. > > > > > > Best, > > > Zhijiang >

Re: [VOTE] Guarantee that @PublicEvolving classes are API and binary compatible across bug fix releases (x.y.u and x.y.v)

2020-05-15 Thread Yuan Mei
+1 On Sat, May 16, 2020 at 12:21 AM Ufuk Celebi wrote: > +1 > > – Ufuk > > > On Fri, May 15, 2020 at 4:54 PM Zhijiang .invalid> > wrote: > > > Sounds good, +1. > > > > Best, > > Zhijiang > > > > > > -- > > From:Thomas Weise > >

Re: [VOTE] Guarantee that @PublicEvolving classes are API and binary compatible across bug fix releases (x.y.u and x.y.v)

2020-05-15 Thread Ufuk Celebi
+1 – Ufuk On Fri, May 15, 2020 at 4:54 PM Zhijiang wrote: > Sounds good, +1. > > Best, > Zhijiang > > > -- > From:Thomas Weise > Send Time:2020年5月15日(星期五) 21:33 > To:dev > Subject:Re: [VOTE] Guarantee that @PublicEvolving

[jira] [Created] (FLINK-17739) ResultPartitionTest.testInitializeMoreStateThanBuffer is unstable

2020-05-15 Thread Piotr Nowojski (Jira)
Piotr Nowojski created FLINK-17739: -- Summary: ResultPartitionTest.testInitializeMoreStateThanBuffer is unstable Key: FLINK-17739 URL: https://issues.apache.org/jira/browse/FLINK-17739 Project: Flink

[jira] [Created] (FLINK-17738) Remove legacy scheduler option

2020-05-15 Thread Till Rohrmann (Jira)
Till Rohrmann created FLINK-17738: - Summary: Remove legacy scheduler option Key: FLINK-17738 URL: https://issues.apache.org/jira/browse/FLINK-17738 Project: Flink Issue Type: Task

Re: [VOTE] Guarantee that @PublicEvolving classes are API and binary compatible across bug fix releases (x.y.u and x.y.v)

2020-05-15 Thread Zhijiang
Sounds good, +1. Best, Zhijiang -- From:Thomas Weise Send Time:2020年5月15日(星期五) 21:33 To:dev Subject:Re: [VOTE] Guarantee that @PublicEvolving classes are API and binary compatible across bug fix releases (x.y.u and x.y.v) +1

Re: [DISCUSS] Exact feature freeze date

2020-05-15 Thread Zhijiang
+1 for Monday morning in Europe. Best, Zhijiang -- From:Yun Tang Send Time:2020年5月15日(星期五) 21:58 To:dev Subject:Re: [DISCUSS] Exact feature freeze date +1 for Monday morning in Europe. Best Yun Tang

[jira] [Created] (FLINK-17737) KeyedStateCheckpointingITCase fails in UC mode

2020-05-15 Thread Roman Khachatryan (Jira)
Roman Khachatryan created FLINK-17737: - Summary: KeyedStateCheckpointingITCase fails in UC mode Key: FLINK-17737 URL: https://issues.apache.org/jira/browse/FLINK-17737 Project: Flink

Re: [DISCUSS] Exact feature freeze date

2020-05-15 Thread Yun Tang
+1 for Monday morning in Europe. Best Yun Tang From: Jingsong Li Sent: Friday, May 15, 2020 21:17 To: dev Subject: Re: [DISCUSS] Exact feature freeze date +1 for Monday morning. Best, Jingsong Lee On Fri, May 15, 2020 at 8:45 PM Till Rohrmann wrote: > +1

Re: [VOTE] Guarantee that @PublicEvolving classes are API and binary compatible across bug fix releases (x.y.u and x.y.v)

2020-05-15 Thread Jingsong Li
+1 (non-binding) Best, Jingsong Lee On Fri, May 15, 2020 at 9:26 PM Thomas Weise wrote: > +1 > > > On Fri, May 15, 2020 at 6:15 AM Till Rohrmann > wrote: > > > Dear community, > > > > with reference to the dev ML thread about guaranteeing API and binary > > compatibility for @PublicEvolving

Re: [VOTE] Guarantee that @PublicEvolving classes are API and binary compatible across bug fix releases (x.y.u and x.y.v)

2020-05-15 Thread Thomas Weise
+1 On Fri, May 15, 2020 at 6:15 AM Till Rohrmann wrote: > Dear community, > > with reference to the dev ML thread about guaranteeing API and binary > compatibility for @PublicEvolving classes across bug fix releases [1] I > would like to start a vote about it. > > The proposal is that the

Re: [DISCUSS] Exact feature freeze date

2020-05-15 Thread Jingsong Li
+1 for Monday morning. Best, Jingsong Lee On Fri, May 15, 2020 at 8:45 PM Till Rohrmann wrote: > +1 from my side extend the feature freeze until Monday morning. > > Cheers, > Till > > On Fri, May 15, 2020 at 2:04 PM Robert Metzger > wrote: > > > I'm okay, but I would suggest to agree on a

Re: [DISCUSS] Stability guarantees for @PublicEvolving classes

2020-05-15 Thread Till Rohrmann
The vote thread can be found here https://lists.apache.org/thread.html/rc58099fb0e31d0eac951a7bbf7f8bda8b7b65c9ed0c04622f5333745%40%3Cdev.flink.apache.org%3E . Cheers, Till On Fri, May 15, 2020 at 3:03 PM Till Rohrmann wrote: > I completely agree that there are many other aspect of our

[jira] [Created] (FLINK-17736) Add flink CEP examples

2020-05-15 Thread dengziming (Jira)
dengziming created FLINK-17736: -- Summary: Add flink CEP examples Key: FLINK-17736 URL: https://issues.apache.org/jira/browse/FLINK-17736 Project: Flink Issue Type: Improvement

[VOTE] Guarantee that @PublicEvolving classes are API and binary compatible across bug fix releases (x.y.u and x.y.v)

2020-05-15 Thread Till Rohrmann
Dear community, with reference to the dev ML thread about guaranteeing API and binary compatibility for @PublicEvolving classes across bug fix releases [1] I would like to start a vote about it. The proposal is that the Flink community starts to guarantee that @PublicEvolving classes will be API

Re: [DISCUSS] increase "state.backend.fs.memory-threshold" from 1K to 100K

2020-05-15 Thread Yun Tang
Please correct me if I am wrong, "put the increased value into the default configuration" means we will update that in default flink-conf.yaml but still leave the default value of `state.backend.fs.memory-threshold`as previously? It seems I did not get the point why existing setups with existing

Re: [DISCUSS] Stability guarantees for @PublicEvolving classes

2020-05-15 Thread Till Rohrmann
I completely agree that there are many other aspect of our guarantees and processes around the @Public and @PublicEvolving classes which need to be discussed and properly defined. For the sake of keeping this discussion thread narrowly scoped, I would suggest to start a separate discussion about

[jira] [Created] (FLINK-17735) Add specialized collecting iterator to Blink planner

2020-05-15 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-17735: --- Summary: Add specialized collecting iterator to Blink planner Key: FLINK-17735 URL: https://issues.apache.org/jira/browse/FLINK-17735 Project: Flink Issue

Re: Interested in applying as a technical writer

2020-05-15 Thread Marta Paes Moreira
Hi, Deepak. Thanks for the introduction — it's cool to see that you're interested in contributing to Flink as part of GSoD! We're looking forward to receiving your application! Let us know if you have any questions, in the meantime. Marta On Thu, May 14, 2020 at 11:35 PM Deepak Vohra wrote:

[jira] [Created] (FLINK-17734) Add specialized collecting sink function

2020-05-15 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-17734: --- Summary: Add specialized collecting sink function Key: FLINK-17734 URL: https://issues.apache.org/jira/browse/FLINK-17734 Project: Flink Issue Type: New

[jira] [Created] (FLINK-17733) Add documentation for real-time hive

2020-05-15 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-17733: Summary: Add documentation for real-time hive Key: FLINK-17733 URL: https://issues.apache.org/jira/browse/FLINK-17733 Project: Flink Issue Type: Sub-task

Re: [DISCUSS] Exact feature freeze date

2020-05-15 Thread Till Rohrmann
+1 from my side extend the feature freeze until Monday morning. Cheers, Till On Fri, May 15, 2020 at 2:04 PM Robert Metzger wrote: > I'm okay, but I would suggest to agree on a time of day. What about Monday > morning in Europe? > > On Fri, May 15, 2020 at 1:43 PM Piotr Nowojski > wrote: > >

[jira] [Created] (FLINK-17732) RescalingITCase.testSavepointRescalingOutPartitionedOperatorStateList

2020-05-15 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-17732: -- Summary: RescalingITCase.testSavepointRescalingOutPartitionedOperatorStateList Key: FLINK-17732 URL: https://issues.apache.org/jira/browse/FLINK-17732 Project:

[jira] [Created] (FLINK-17731) Artifact X already exists for build Y

2020-05-15 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-17731: -- Summary: Artifact X already exists for build Y Key: FLINK-17731 URL: https://issues.apache.org/jira/browse/FLINK-17731 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-17730) HadoopS3RecoverableWriterITCase.testRecoverAfterMultiplePersistsStateWithMultiPart times out

2020-05-15 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-17730: -- Summary: HadoopS3RecoverableWriterITCase.testRecoverAfterMultiplePersistsStateWithMultiPart times out Key: FLINK-17730 URL: https://issues.apache.org/jira/browse/FLINK-17730

Re: [DISCUSS] Exact feature freeze date

2020-05-15 Thread Robert Metzger
I'm okay, but I would suggest to agree on a time of day. What about Monday morning in Europe? On Fri, May 15, 2020 at 1:43 PM Piotr Nowojski wrote: > Hi, > > Couple of contributors asked for extending cutting the release branch > until Monday, what do you think about such extension? > > (+1

[jira] [Created] (FLINK-17729) Make mandatory to have lib/, plugin/ and dist in yarn.provided.lib.dirs

2020-05-15 Thread Kostas Kloudas (Jira)
Kostas Kloudas created FLINK-17729: -- Summary: Make mandatory to have lib/, plugin/ and dist in yarn.provided.lib.dirs Key: FLINK-17729 URL: https://issues.apache.org/jira/browse/FLINK-17729 Project:

Re: [ANNOUNCE] Apache Flink 1.10.1 released

2020-05-15 Thread Benchao Li
Thanks Yu for the great work, and everyone else who made this possible. Dian Fu 于2020年5月15日周五 下午6:55写道: > Thanks Yu for managing this release and everyone else who made this > release possible. Good work! > > Regards, > Dian > > 在 2020年5月15日,下午6:26,Till Rohrmann 写道: > > Thanks Yu for being our

[jira] [Created] (FLINK-17728) use sql parser to parse a statement in sql client

2020-05-15 Thread godfrey he (Jira)
godfrey he created FLINK-17728: -- Summary: use sql parser to parse a statement in sql client Key: FLINK-17728 URL: https://issues.apache.org/jira/browse/FLINK-17728 Project: Flink Issue Type:

Re: [DISCUSS] Exact feature freeze date

2020-05-15 Thread Piotr Nowojski
Hi, Couple of contributors asked for extending cutting the release branch until Monday, what do you think about such extension? (+1 from my side) Piotrek > On 25 Apr 2020, at 21:24, Yu Li wrote: > > +1 for extending the feature freeze to May 15th. > > Best Regards, > Yu > > > On Fri, 24

[jira] [Created] (FLINK-17727) Can't subsume checkpoint with no channel state in UC mode

2020-05-15 Thread Roman Khachatryan (Jira)
Roman Khachatryan created FLINK-17727: - Summary: Can't subsume checkpoint with no channel state in UC mode Key: FLINK-17727 URL: https://issues.apache.org/jira/browse/FLINK-17727 Project: Flink

Re: [ANNOUNCE] Apache Flink 1.10.1 released

2020-05-15 Thread Dian Fu
Thanks Yu for managing this release and everyone else who made this release possible. Good work! Regards, Dian > 在 2020年5月15日,下午6:26,Till Rohrmann 写道: > > Thanks Yu for being our release manager and everyone else who made the > release possible! > > Cheers, > Till > > On Fri, May 15, 2020

[jira] [Created] (FLINK-17726) Scheduler should take care of tasks directly canceled by TaskManager

2020-05-15 Thread Zhu Zhu (Jira)
Zhu Zhu created FLINK-17726: --- Summary: Scheduler should take care of tasks directly canceled by TaskManager Key: FLINK-17726 URL: https://issues.apache.org/jira/browse/FLINK-17726 Project: Flink

Re: [DISCUSS] Rework History Server into Global Dashboard

2020-05-15 Thread Till Rohrmann
This sounds like a good plan to me Gyula. And there is always the Flink packages option available if we want to make it available earlier. Cheers, Till On Fri, May 15, 2020 at 10:12 AM Gyula Fóra wrote: > Hi Till! > > I agree to some extent that managing multiple clusters is not Flink's >

Re: [ANNOUNCE] Apache Flink 1.10.1 released

2020-05-15 Thread Till Rohrmann
Thanks Yu for being our release manager and everyone else who made the release possible! Cheers, Till On Fri, May 15, 2020 at 9:15 AM Congxian Qiu wrote: > Thanks a lot for the release and your great job, Yu! > Also thanks to everyone who made this release possible! > > Best, > Congxian > > >

[jira] [Created] (FLINK-17725) FileUploadHandlerTest.testUploadCleanupOnFailure fails with "SocketTimeout timeout"

2020-05-15 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-17725: -- Summary: FileUploadHandlerTest.testUploadCleanupOnFailure fails with "SocketTimeout timeout" Key: FLINK-17725 URL: https://issues.apache.org/jira/browse/FLINK-17725

[jira] [Created] (FLINK-17724) PyFlink end-to-end test fails with Cannot run program "venv.zip/.conda/bin/python": error=2, No such file or directory

2020-05-15 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-17724: -- Summary: PyFlink end-to-end test fails with Cannot run program "venv.zip/.conda/bin/python": error=2, No such file or directory Key: FLINK-17724 URL:

[jira] [Created] (FLINK-17723) Written design for flink threading model and guarantees made to the various structual components

2020-05-15 Thread John Lonergan (Jira)
John Lonergan created FLINK-17723: - Summary: Written design for flink threading model and guarantees made to the various structual components Key: FLINK-17723 URL:

Re: [DISCUSS] increase "state.backend.fs.memory-threshold" from 1K to 100K

2020-05-15 Thread Stephan Ewen
I see, thanks for all the input. I agree with Yun Tang that the use of UnionState is problematic and can cause issues in conjunction with this. However, most of the large-scale users I know that also struggle with UnionState have also increased this threshold, because with this low threshold,

Re: [DISCUSS] Rework History Server into Global Dashboard

2020-05-15 Thread Gyula Fóra
Hi Till! I agree to some extent that managing multiple clusters is not Flink's primary responsibility. However many (if not most) production users use Flink in per-job-cluster mode which gives superior configurability and resource isolation than standalone/session modes. But still the best job

[jira] [Created] (FLINK-17722) "Failed to find the file" in "build_wheels" stage

2020-05-15 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-17722: -- Summary: "Failed to find the file" in "build_wheels" stage Key: FLINK-17722 URL: https://issues.apache.org/jira/browse/FLINK-17722 Project: Flink Issue

[jira] [Created] (FLINK-17721) AbstractHadoopFileSystemITTest .cleanupDirectoryWithRetry fails with AssertionError

2020-05-15 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-17721: -- Summary: AbstractHadoopFileSystemITTest .cleanupDirectoryWithRetry fails with AssertionError Key: FLINK-17721 URL: https://issues.apache.org/jira/browse/FLINK-17721

[jira] [Created] (FLINK-17720) StreamSqlTests.test_execute_sql: "AssertionError: True is not false"

2020-05-15 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-17720: -- Summary: StreamSqlTests.test_execute_sql: "AssertionError: True is not false" Key: FLINK-17720 URL: https://issues.apache.org/jira/browse/FLINK-17720 Project:

[jira] [Created] (FLINK-17719) Provide ChannelStateReader#hasStates for hints of reading channel states

2020-05-15 Thread Zhijiang (Jira)
Zhijiang created FLINK-17719: Summary: Provide ChannelStateReader#hasStates for hints of reading channel states Key: FLINK-17719 URL: https://issues.apache.org/jira/browse/FLINK-17719 Project: Flink

Re: [ANNOUNCE] Apache Flink 1.10.1 released

2020-05-15 Thread Congxian Qiu
Thanks a lot for the release and your great job, Yu! Also thanks to everyone who made this release possible! Best, Congxian Yu Li 于2020年5月14日周四 上午1:59写道: > The Apache Flink community is very happy to announce the release of Apache > Flink 1.10.1, which is the first bugfix release for the

[jira] [Created] (FLINK-17718) Integrate avro to file system connector

2020-05-15 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-17718: Summary: Integrate avro to file system connector Key: FLINK-17718 URL: https://issues.apache.org/jira/browse/FLINK-17718 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-17717) Throws for DDL create system temporary function with composite table path

2020-05-15 Thread Danny Chen (Jira)
Danny Chen created FLINK-17717: -- Summary: Throws for DDL create system temporary function with composite table path Key: FLINK-17717 URL: https://issues.apache.org/jira/browse/FLINK-17717 Project: Flink

[jira] [Created] (FLINK-17716) Remove deprecated RowData.get and similar methods

2020-05-15 Thread Timo Walther (Jira)
Timo Walther created FLINK-17716: Summary: Remove deprecated RowData.get and similar methods Key: FLINK-17716 URL: https://issues.apache.org/jira/browse/FLINK-17716 Project: Flink Issue