[
https://issues.apache.org/jira/browse/TEZ-4320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiaomin Zhang updated TEZ-4320:
-------------------------------
Description:
We found TEZ progress stays at 0% (from ResourceManager WebUI or REST) for most
of times. While for some simple queries, it can be correctly updated.
After some debugging, it seems due to the fix of TEZ-3982 :
{noformat}
+ float dagProgress = progress / getTotalVertices();
+ if (dagProgress >= 0.0f && progress <= 1.0f) {
+ return dagProgress;
+ } else {
+ return 0.0f;
{noformat}
So the dagProgress will be only updated if progress is less than 1.0, but it's
not true for most cases.
was:
We found TEZ progress stays at 0% (from ResourceManager WebUI or REST) for most
of times. While for some simple queries, it can be correctly updated.
After some debugging, it seems due to the fix of TEZ-3982 :
{noformat}
+ float dagProgress = progress / getTotalVertices();
+ if (dagProgress >= 0.0f && progress <= 1.0f) {
+ return dagProgress;{noformat}
> DAGAppMaster progress not updated correctly
> -------------------------------------------
>
> Key: TEZ-4320
> URL: https://issues.apache.org/jira/browse/TEZ-4320
> Project: Apache Tez
> Issue Type: Bug
> Reporter: Xiaomin Zhang
> Priority: Major
>
> We found TEZ progress stays at 0% (from ResourceManager WebUI or REST) for
> most of times. While for some simple queries, it can be correctly updated.
> After some debugging, it seems due to the fix of TEZ-3982 :
>
> {noformat}
> + float dagProgress = progress / getTotalVertices();
> + if (dagProgress >= 0.0f && progress <= 1.0f) {
> + return dagProgress;
> + } else {
> + return 0.0f;
> {noformat}
> So the dagProgress will be only updated if progress is less than 1.0, but
> it's not true for most cases.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
