[jira] [Updated] (FLINK-14676) Introduce parallelism inference for source
[ https://issues.apache.org/jira/browse/FLINK-14676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee updated FLINK-14676: - Parent: (was: FLINK-14133) Issue Type: Improvement (was: Sub-task) > Introduce parallelism inference for source > -- > > Key: FLINK-14676 > URL: https://issues.apache.org/jira/browse/FLINK-14676 > Project: Flink > Issue Type: Improvement > Components: Table SQL / Planner >Reporter: Jingsong Lee >Assignee: Jingsong Lee >Priority: Major > Labels: pull-request-available > Time Spent: 10m > Remaining Estimate: 0h > > FLINK-12801 has introduce parallelism setting for table, but because > TableSource generate DataStream, maybe DataStream is not a real source, that > will lead to some shuffle errors. So FLINK-13494 remove these implementations. > In this ticket, I would like to introduce parallelism inference only for > InputFormatTableSource, the RowCount of InputFormatTableSource is more > accurate than downstream stages. It is worth to automatically generate its > parallelism. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (FLINK-14676) Introduce parallelism inference for source
[ https://issues.apache.org/jira/browse/FLINK-14676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee updated FLINK-14676: - Parent: FLINK-14799 Issue Type: Sub-task (was: New Feature) > Introduce parallelism inference for source > -- > > Key: FLINK-14676 > URL: https://issues.apache.org/jira/browse/FLINK-14676 > Project: Flink > Issue Type: Sub-task > Components: Table SQL / Planner >Reporter: Jingsong Lee >Assignee: Jingsong Lee >Priority: Major > Labels: pull-request-available > Time Spent: 10m > Remaining Estimate: 0h > > FLINK-12801 has introduce parallelism setting for table, but because > TableSource generate DataStream, maybe DataStream is not a real source, that > will lead to some shuffle errors. So FLINK-13494 remove these implementations. > In this ticket, I would like to introduce parallelism inference only for > InputFormatTableSource, the RowCount of InputFormatTableSource is more > accurate than downstream stages. It is worth to automatically generate its > parallelism. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (FLINK-14676) Introduce parallelism inference for source
[ https://issues.apache.org/jira/browse/FLINK-14676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee updated FLINK-14676: - Issue Type: New Feature (was: Improvement) > Introduce parallelism inference for source > -- > > Key: FLINK-14676 > URL: https://issues.apache.org/jira/browse/FLINK-14676 > Project: Flink > Issue Type: New Feature > Components: Table SQL / Planner >Reporter: Jingsong Lee >Assignee: Jingsong Lee >Priority: Major > Labels: pull-request-available > Time Spent: 10m > Remaining Estimate: 0h > > FLINK-12801 has introduce parallelism setting for table, but because > TableSource generate DataStream, maybe DataStream is not a real source, that > will lead to some shuffle errors. So FLINK-13494 remove these implementations. > In this ticket, I would like to introduce parallelism inference only for > InputFormatTableSource, the RowCount of InputFormatTableSource is more > accurate than downstream stages. It is worth to automatically generate its > parallelism. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (FLINK-14676) Introduce parallelism inference for source
[ https://issues.apache.org/jira/browse/FLINK-14676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee updated FLINK-14676: - Summary: Introduce parallelism inference for source (was: Introduce parallelism inference for InputFormatTableSource) > Introduce parallelism inference for source > -- > > Key: FLINK-14676 > URL: https://issues.apache.org/jira/browse/FLINK-14676 > Project: Flink > Issue Type: Sub-task > Components: Table SQL / Planner >Reporter: Jingsong Lee >Assignee: Jingsong Lee >Priority: Major > Labels: pull-request-available > Time Spent: 10m > Remaining Estimate: 0h > > FLINK-12801 has introduce parallelism setting for table, but because > TableSource generate DataStream, maybe DataStream is not a real source, that > will lead to some shuffle errors. So FLINK-13494 remove these implementations. > In this ticket, I would like to introduce parallelism inference only for > InputFormatTableSource, the RowCount of InputFormatTableSource is more > accurate than downstream stages. It is worth to automatically generate its > parallelism. -- This message was sent by Atlassian Jira (v8.3.4#803005)
