[jira] [Created] (FLINK-13337) Do not need to backup and restore streamEnv config in BatchExecutor
XuPingyong created FLINK-13337: -- Summary: Do not need to backup and restore streamEnv config in BatchExecutor Key: FLINK-13337 URL: https://issues.apache.org/jira/browse/FLINK-13337 Project: Flink Issue Type: Task Components: Table SQL / Planner Affects Versions: 1.9.0, 1.10.0 Reporter: XuPingyong Fix For: 1.9.0, 1.10.0 -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Created] (FLINK-13329) Set env config for sql jobs
XuPingyong created FLINK-13329: -- Summary: Set env config for sql jobs Key: FLINK-13329 URL: https://issues.apache.org/jira/browse/FLINK-13329 Project: Flink Issue Type: Task Components: Table SQL / API Affects Versions: 1.9.0, 1.10.0 Reporter: XuPingyong Fix For: 1.9.0, 1.10.0 Now we execute streaming job through TableEnvironment, but StreamExecutionEnvironment can not be touched by users, so we can not set checkpoint and other env configs when we execute sql jobs. -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Closed] (FLINK-13122) Set managed memory to operator resourceSpec in blink table planner
[ https://issues.apache.org/jira/browse/FLINK-13122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XuPingyong closed FLINK-13122. -- Resolution: Won't Fix > Set managed memory to operator resourceSpec in blink table planner > -- > > Key: FLINK-13122 > URL: https://issues.apache.org/jira/browse/FLINK-13122 > Project: Flink > Issue Type: Task > Components: Table SQL / Planner >Affects Versions: 1.9.0 >Reporter: XuPingyong >Priority: Major > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (FLINK-13119) Add blink table config to documentation
[ https://issues.apache.org/jira/browse/FLINK-13119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XuPingyong updated FLINK-13119: --- Component/s: Documentation > Add blink table config to documentation > --- > > Key: FLINK-13119 > URL: https://issues.apache.org/jira/browse/FLINK-13119 > Project: Flink > Issue Type: Task > Components: Documentation >Reporter: XuPingyong >Priority: Major > Labels: pull-request-available > Time Spent: 10m > Remaining Estimate: 0h > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (FLINK-13122) Set managed memory to operator resourceSpec in blink table planner
XuPingyong created FLINK-13122: -- Summary: Set managed memory to operator resourceSpec in blink table planner Key: FLINK-13122 URL: https://issues.apache.org/jira/browse/FLINK-13122 Project: Flink Issue Type: Task Components: Table SQL / Planner Affects Versions: 1.9.0 Reporter: XuPingyong -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (FLINK-13121) Set batch/streaming properties to StreamGraph in blink table env
XuPingyong created FLINK-13121: -- Summary: Set batch/streaming properties to StreamGraph in blink table env Key: FLINK-13121 URL: https://issues.apache.org/jira/browse/FLINK-13121 Project: Flink Issue Type: Task Components: Table SQL / Planner Affects Versions: 1.9.0 Reporter: XuPingyong Fix For: 1.9.0 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (FLINK-13121) Set batch/streaming properties to StreamGraph in blink table planner
[ https://issues.apache.org/jira/browse/FLINK-13121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XuPingyong updated FLINK-13121: --- Summary: Set batch/streaming properties to StreamGraph in blink table planner (was: Set batch/streaming properties to StreamGraph in blink table env) > Set batch/streaming properties to StreamGraph in blink table planner > > > Key: FLINK-13121 > URL: https://issues.apache.org/jira/browse/FLINK-13121 > Project: Flink > Issue Type: Task > Components: Table SQL / Planner >Affects Versions: 1.9.0 >Reporter: XuPingyong >Priority: Major > Fix For: 1.9.0 > > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (FLINK-13119) Add blink table config to documentation
XuPingyong created FLINK-13119: -- Summary: Add blink table config to documentation Key: FLINK-13119 URL: https://issues.apache.org/jira/browse/FLINK-13119 Project: Flink Issue Type: Task Reporter: XuPingyong -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (FLINK-13040) improve blink configOptions
[ https://issues.apache.org/jira/browse/FLINK-13040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XuPingyong updated FLINK-13040: --- Description: _1. improve planner and runtime config of blink_ was: _1. promote planner and runtime config of blink_ > improve blink configOptions > --- > > Key: FLINK-13040 > URL: https://issues.apache.org/jira/browse/FLINK-13040 > Project: Flink > Issue Type: Task > Components: Table SQL / API >Affects Versions: 1.9.0 >Reporter: XuPingyong >Priority: Major > Labels: pull-request-available > Fix For: 1.9.0 > > Time Spent: 0.5h > Remaining Estimate: 0h > > _1. improve planner and runtime config of blink_ > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (FLINK-13040) improve blink configOptions
[ https://issues.apache.org/jira/browse/FLINK-13040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XuPingyong updated FLINK-13040: --- Summary: improve blink configOptions (was: promote blink configOptions) > improve blink configOptions > --- > > Key: FLINK-13040 > URL: https://issues.apache.org/jira/browse/FLINK-13040 > Project: Flink > Issue Type: Task > Components: Table SQL / API >Affects Versions: 1.9.0 >Reporter: XuPingyong >Priority: Major > Labels: pull-request-available > Fix For: 1.9.0 > > Time Spent: 0.5h > Remaining Estimate: 0h > > _1. promote planner and runtime config of blink_ > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (FLINK-13040) promote blink configOptions
[ https://issues.apache.org/jira/browse/FLINK-13040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XuPingyong updated FLINK-13040: --- Component/s: (was: Documentation) Table SQL / API > promote blink configOptions > --- > > Key: FLINK-13040 > URL: https://issues.apache.org/jira/browse/FLINK-13040 > Project: Flink > Issue Type: Task > Components: Table SQL / API >Affects Versions: 1.9.0 >Reporter: XuPingyong >Priority: Major > Labels: pull-request-available > Fix For: 1.9.0 > > Time Spent: 20m > Remaining Estimate: 0h > > _1. promote planner and runtime config of blink_ > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (FLINK-13040) promote blink configOptions and add these config descriptions to
[ https://issues.apache.org/jira/browse/FLINK-13040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XuPingyong updated FLINK-13040: --- Summary: promote blink configOptions and add these config descriptions to (was: promote blink configOptions and add these config descriptions to document) > promote blink configOptions and add these config descriptions to > - > > Key: FLINK-13040 > URL: https://issues.apache.org/jira/browse/FLINK-13040 > Project: Flink > Issue Type: Task > Components: Documentation >Affects Versions: 1.9.0 >Reporter: XuPingyong >Priority: Major > Labels: pull-request-available > Fix For: 1.9.0 > > Time Spent: 20m > Remaining Estimate: 0h > > _1. promote planner and runtime config of blink_ > _2. add anotations to indicate the config works for batch, streaming sql or > both._ > _3. add these configs to document_ -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (FLINK-13040) promote blink configOptions
[ https://issues.apache.org/jira/browse/FLINK-13040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XuPingyong updated FLINK-13040: --- Summary: promote blink configOptions (was: promote blink configOptions and add these config descriptions to ) > promote blink configOptions > --- > > Key: FLINK-13040 > URL: https://issues.apache.org/jira/browse/FLINK-13040 > Project: Flink > Issue Type: Task > Components: Documentation >Affects Versions: 1.9.0 >Reporter: XuPingyong >Priority: Major > Labels: pull-request-available > Fix For: 1.9.0 > > Time Spent: 20m > Remaining Estimate: 0h > > _1. promote planner and runtime config of blink_ > _2. add anotations to indicate the config works for batch, streaming sql or > both._ > _3. add these configs to document_ -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (FLINK-13040) promote blink configOptions
[ https://issues.apache.org/jira/browse/FLINK-13040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XuPingyong updated FLINK-13040: --- Description: _1. promote planner and runtime config of blink_ was: _1. promote planner and runtime config of blink_ _2. add anotations to indicate the config works for batch, streaming sql or both._ _3. add these configs to document_ > promote blink configOptions > --- > > Key: FLINK-13040 > URL: https://issues.apache.org/jira/browse/FLINK-13040 > Project: Flink > Issue Type: Task > Components: Documentation >Affects Versions: 1.9.0 >Reporter: XuPingyong >Priority: Major > Labels: pull-request-available > Fix For: 1.9.0 > > Time Spent: 20m > Remaining Estimate: 0h > > _1. promote planner and runtime config of blink_ > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (FLINK-13040) promote blink configOptions and add these config descriptions to document
[ https://issues.apache.org/jira/browse/FLINK-13040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XuPingyong updated FLINK-13040: --- Description: _1. promote planner and runtime config of blink_ _2. add anotations to indicate the config works for batch, streaming sql or both._ _3. add these configs to document_ > promote blink configOptions and add these config descriptions to document > - > > Key: FLINK-13040 > URL: https://issues.apache.org/jira/browse/FLINK-13040 > Project: Flink > Issue Type: Task > Components: Documentation >Affects Versions: 1.9.0 >Reporter: XuPingyong >Priority: Major > Fix For: 1.9.0 > > > _1. promote planner and runtime config of blink_ > _2. add anotations to indicate the config works for batch, streaming sql or > both._ > _3. add these configs to document_ -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (FLINK-13040) promote blink configOptions and add these config descriptions to document
XuPingyong created FLINK-13040: -- Summary: promote blink configOptions and add these config descriptions to document Key: FLINK-13040 URL: https://issues.apache.org/jira/browse/FLINK-13040 Project: Flink Issue Type: Task Components: Documentation Affects Versions: 1.9.0 Reporter: XuPingyong Fix For: 1.9.0 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (FLINK-12824) set parallelism for stream SQL
XuPingyong created FLINK-12824: -- Summary: set parallelism for stream SQL Key: FLINK-12824 URL: https://issues.apache.org/jira/browse/FLINK-12824 Project: Flink Issue Type: Task Components: Table SQL / Planner Affects Versions: 1.9.0 Reporter: XuPingyong Parallelism setting has been developped for batch SQL, the calculation method can also apply to stream SQL. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (FLINK-12816) set maxParallelism to 1 when DataStreamSource is not isParallel
XuPingyong created FLINK-12816: -- Summary: set maxParallelism to 1 when DataStreamSource is not isParallel Key: FLINK-12816 URL: https://issues.apache.org/jira/browse/FLINK-12816 Project: Flink Issue Type: Task Components: API / DataStream Affects Versions: 1.8.0 Reporter: XuPingyong Fix For: 1.9.0 Now when DataStreamSource is not parallel, only parallelism is set to 1, maxParallelism should be also set to 1. As when SingleOutputStreamOperator is not parallel, it set not only parallelism but also maxParallelism to 1 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (FLINK-12801) Set parallelism for batch SQL
XuPingyong created FLINK-12801: -- Summary: Set parallelism for batch SQL Key: FLINK-12801 URL: https://issues.apache.org/jira/browse/FLINK-12801 Project: Flink Issue Type: Task Components: Table SQL / Planner Reporter: XuPingyong DataStream user can set parallelism by SingleOutputStreamOperator#setParallelism and DataStreamSink#setParallelism. But SQL users cannot set parallelism to operators while compiled jobGraphs from SQL are usally complex. Now we first set parallelism for batch SQL by config. We introduce two resourceSetting mode: InferMode.NONE: User can set parallelism to source, sink and other nodes separately. InferMode.ONLY_SOURCE： Relative to InferMode.NONE, source paralelism can be inferred by source row count. We also introduce ShuffleStage to make adjacent operatos parallelism same that there is no data shuffle between them. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
