[
https://issues.apache.org/jira/browse/FLINK-21069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jark Wu updated FLINK-21069:
----------------------------
Description:
I tried the following test, and the printed node parallelism in json plan is
not 5.
{code:scala}
@Test
def testExplainAndExecuteSingleSink(): Unit = {
val env = TableEnvironmentImpl.create(settings)
val conf = new Configuration();
conf.setInteger("parallelism.default", 5)
conf.setInteger("taskmanager.numberOfTaskSlots", 1)
env.getConfig.addConfiguration(conf)
TestTableSourceSinks.createCsvTemporarySinkTable(
env, new TableSchema(Array("first"), Array(STRING)), "MySink1")
TestTableSourceSinks.createPersonCsvTemporaryTable(env, "MyTable")
println(env.explainSql("insert into MySink1 select first from MyTable",
ExplainDetail.JSON_EXECUTION_PLAN))
}
{code}
I think the bug is because TableEnvironemnt#explain will not invoke
{{PlannerBase#translate(modifyOperations: util.List[ModifyOperation])}} where
we configure the configuration into underlying {{StreamExecutionEnvironment}}.
was:
I tried the following test, and the printed node parallelism in json plan is
not 5.
{code:scala}
@Test
def testExplainAndExecuteSingleSink(): Unit = {
val env = TableEnvironmentImpl.create(settings)
val conf = new Configuration();
conf.setInteger("parallelism.default", 5)
conf.setInteger("taskmanager.numberOfTaskSlots", 1)
env.getConfig.addConfiguration(conf)
TestTableSourceSinks.createCsvTemporarySinkTable(
env, new TableSchema(Array("first"), Array(STRING)), "MySink1")
TestTableSourceSinks.createPersonCsvTemporaryTable(env, "MyTable")
println(tEnv.explainSql("insert into MySink1 select first from MyTable",
ExplainDetail.JSON_EXECUTION_PLAN))
}
{code}
I think the bug is because TableEnvironemnt#explain will not invoke
{{PlannerBase#translate(modifyOperations: util.List[ModifyOperation])}} where
we configure the configuration into underlying {{StreamExecutionEnvironment}}.
> Configuration "parallelism.default" doesn't take effect for
> TableEnvironment#explainSql
> ---------------------------------------------------------------------------------------
>
> Key: FLINK-21069
> URL: https://issues.apache.org/jira/browse/FLINK-21069
> Project: Flink
> Issue Type: Bug
> Components: Table SQL / API
> Reporter: Jark Wu
> Priority: Major
> Labels: starter
> Fix For: 1.13.0
>
>
> I tried the following test, and the printed node parallelism in json plan is
> not 5.
> {code:scala}
> @Test
> def testExplainAndExecuteSingleSink(): Unit = {
> val env = TableEnvironmentImpl.create(settings)
> val conf = new Configuration();
> conf.setInteger("parallelism.default", 5)
> conf.setInteger("taskmanager.numberOfTaskSlots", 1)
> env.getConfig.addConfiguration(conf)
> TestTableSourceSinks.createCsvTemporarySinkTable(
> env, new TableSchema(Array("first"), Array(STRING)), "MySink1")
> TestTableSourceSinks.createPersonCsvTemporaryTable(env, "MyTable")
> println(env.explainSql("insert into MySink1 select first from MyTable",
> ExplainDetail.JSON_EXECUTION_PLAN))
> }
> {code}
> I think the bug is because TableEnvironemnt#explain will not invoke
> {{PlannerBase#translate(modifyOperations: util.List[ModifyOperation])}} where
> we configure the configuration into underlying {{StreamExecutionEnvironment}}.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
