[
https://issues.apache.org/jira/browse/FLINK-34535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17822399#comment-17822399
]
yuanfenghu commented on FLINK-34535:
------------------------------------
[~lincoln.86xy]
Thank you for your comment,
> Regarding to the motivation 'combine it with the parameter
> `pipeline.jobvertex-parallelism-overrides` to set up my task parallelism',
> could you explain more about it?
`pipeline.jobvertex-parallelism-overrides` Parameters can modify the
parallelism of each flink task before flink runs the task. He needs to specify
the parallelism value of vertex in jobgraph, like this:
{code:java}
//代码占位符
pipeline.jobvertex-parallelism-overrides =
0a448493b4782967b150582570326227:4,bc764cd8ddf7a0cff126f51c16239658:3 {code}
This way when flink runs, the parallelism of the corresponding vertexid:
0a448493b4782967b150582570326227 and bc764cd8ddf7a0cff126f51c16239658 will be
set to 4,3.
So my motivation is that I want to set the parallelism of each of my tasks in
the task generated by flinksql, but in flinksql parallelism is set globally, so
I need to get each of my jobVertexId before the task is run. But the existing
explain does not return this information, so I want to return this information
in the explain
> (Also adding new mode to current `ExplainDetail` is a public api change,
>there should be a
>[FLIP|https://cwiki.apache.org/confluence/display/FLINK/Flink+Improvement+Proposals?src=contextnavpagetreemode]
> discussion)
I noticed ExplainDetail have a @PublicEvolving, But in fact, my function is
relatively simple, and it should be to build a separate FLIP? Maybe if we could
put this information in What about JSON_EXECUTION_PLAN?
> COMPILE PLAN
COMPILE PLAN It seems to be a reasonable way also,Can you help me @ some
friends who are more familiar with this area (flinksql)?
Discuss their views on this issue
> Support JobPlanInfo for the explain result
> ------------------------------------------
>
> Key: FLINK-34535
> URL: https://issues.apache.org/jira/browse/FLINK-34535
> Project: Flink
> Issue Type: Improvement
> Components: Table SQL / Planner
> Reporter: yuanfenghu
> Priority: Major
> Labels: pull-request-available
>
> In the Flink Sql Explain syntax, we can set ExplainDetails to plan
> JSON_EXECUTION_PLAN, but we cannot plan JobPlanInfo. If we can explain this
> part of the information, referring to JobPlanInfo, I can combine it with the
> parameter `pipeline.jobvertex-parallelism-overrides` to set up my task
> parallelism
--
This message was sent by Atlassian Jira
(v8.20.10#820010)