[jira] [Created] (FLINK-21920) Optimize DefaultScheduler#allocateSlots

2021-03-22 Thread Zhilong Hong (Jira)
Zhilong Hong created FLINK-21920: Summary: Optimize DefaultScheduler#allocateSlots Key: FLINK-21920 URL: https://issues.apache.org/jira/browse/FLINK-21920 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-21919) JsonPlanTestBase should extends AbstractTestBase

2021-03-22 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-21919: Summary: JsonPlanTestBase should extends AbstractTestBase Key: FLINK-21919 URL: https://issues.apache.org/jira/browse/FLINK-21919 Project: Flink Issue Type:

[jira] [Created] (FLINK-21918) Add execution.runtime-mode setter in StreamExecutionEnvironment

2021-03-22 Thread Dian Fu (Jira)
Dian Fu created FLINK-21918: --- Summary: Add execution.runtime-mode setter in StreamExecutionEnvironment Key: FLINK-21918 URL: https://issues.apache.org/jira/browse/FLINK-21918 Project: Flink Issue

[jira] [Created] (FLINK-21917) Add back missing zh docs

2021-03-22 Thread Leonard Xu (Jira)
Leonard Xu created FLINK-21917: -- Summary: Add back missing zh docs Key: FLINK-21917 URL: https://issues.apache.org/jira/browse/FLINK-21917 Project: Flink Issue Type: Bug Components:

Re: [DISCUSS] Split PyFlink packages into two packages: apache-flink and apache-flink-libraries

2021-03-22 Thread Xingbo Huang
Thanks for the feedback everyone. I will proceed if there is no objection. Best, Xingbo Till Rohrmann 于2021年3月22日周一 下午5:30写道: > If there is no other way, then I would say let's go with splitting the > modules. This is already better than keeping the Flink binaries bundled > with every

[jira] [Created] (FLINK-21916) Allows multiple kinds of ManagedMemoryUseCase for the same operator

2021-03-22 Thread Dian Fu (Jira)
Dian Fu created FLINK-21916: --- Summary: Allows multiple kinds of ManagedMemoryUseCase for the same operator Key: FLINK-21916 URL: https://issues.apache.org/jira/browse/FLINK-21916 Project: Flink

[jira] [Created] (FLINK-21915) Optimize Execution#finishPartitionsAndUpdateConsumers

2021-03-22 Thread Zhilong Hong (Jira)
Zhilong Hong created FLINK-21915: Summary: Optimize Execution#finishPartitionsAndUpdateConsumers Key: FLINK-21915 URL: https://issues.apache.org/jira/browse/FLINK-21915 Project: Flink Issue

Re: [VOTE] Move Flink ML pipeline API and library code to a separate repository named flink-ml

2021-03-22 Thread Dian Fu
+1 Regards, Dian On Fri, Mar 19, 2021 at 6:39 PM Till Rohrmann wrote: > +1 > > Cheers, > Till > > On Fri, Mar 19, 2021 at 9:02 AM Becket Qin wrote: > > > +1. Thanks for driving the effort, Dong. > > > > Jiangjie (Becket) Qin > > > > On Fri, Mar 19, 2021 at 10:07 AM Dong Lin wrote: > > > > >

[jira] [Created] (FLINK-21914) Trying to access closed classloader

2021-03-22 Thread Spongebob (Jira)
Spongebob created FLINK-21914: - Summary: Trying to access closed classloader Key: FLINK-21914 URL: https://issues.apache.org/jira/browse/FLINK-21914 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-21913) Update DynamicTableFactory.Context to use ResolvedCatalogTable

2021-03-22 Thread Timo Walther (Jira)
Timo Walther created FLINK-21913: Summary: Update DynamicTableFactory.Context to use ResolvedCatalogTable Key: FLINK-21913 URL: https://issues.apache.org/jira/browse/FLINK-21913 Project: Flink

[jira] [Created] (FLINK-21912) Introduce Schema and ResolvedSchema in Python API

2021-03-22 Thread Timo Walther (Jira)
Timo Walther created FLINK-21912: Summary: Introduce Schema and ResolvedSchema in Python API Key: FLINK-21912 URL: https://issues.apache.org/jira/browse/FLINK-21912 Project: Flink Issue

[jira] [Created] (FLINK-21911) Support arithmetic MIN/MAX in SQL

2021-03-22 Thread Timo Walther (Jira)
Timo Walther created FLINK-21911: Summary: Support arithmetic MIN/MAX in SQL Key: FLINK-21911 URL: https://issues.apache.org/jira/browse/FLINK-21911 Project: Flink Issue Type: Sub-task

Re: [DISCUSS] Split PyFlink packages into two packages: apache-flink and apache-flink-libraries

2021-03-22 Thread Till Rohrmann
If there is no other way, then I would say let's go with splitting the modules. This is already better than keeping the Flink binaries bundled with every Python/platform package. Cheers, Till On Mon, Mar 22, 2021 at 8:28 AM Xingbo Huang wrote: > When we **pip install** a wheel package, it just

Re: Re: Re: [DISCUSSION] Introduce a separated memory pool for the TM merge shuffle

2021-03-22 Thread Stephan Ewen
Hi Yingjie! Thanks for doing those experiments, the results look good. Let's go ahead with 32M then. Regarding the key, I am not strongly opinionated there. There are arguments for both keys, (1) making the key part of the network pool config as you did here or (2) making it part of the TM

Re: Re: Re: [DISCUSSION] Introduce a separated memory pool for the TM merge shuffle

2021-03-22 Thread Till Rohrmann
Thanks for the update Yingjie. Then let's go with 32 MB I would say. Concerning the name of the configuration option I see Xintong's point. If the batch shuffle is subtracted from `taskmanager.memory.framework.off-heap.size` because it is part of the off-heap pool, then something like

[jira] [Created] (FLINK-21910) Wrong Checks whether the service has been started.

2021-03-22 Thread pengkangjing (Jira)
pengkangjing created FLINK-21910: Summary: Wrong Checks whether the service has been started. Key: FLINK-21910 URL: https://issues.apache.org/jira/browse/FLINK-21910 Project: Flink Issue

Re: [DISCUSS] Split PyFlink packages into two packages: apache-flink and apache-flink-libraries

2021-03-22 Thread Xingbo Huang
When we **pip install** a wheel package, it just unpacks the wheel package and installs its dependencies[1]. There is no way to download things from an external website during installation. It works differently from the source package where we could download something in the setup.py. This is