[
https://issues.apache.org/jira/browse/TEZ-2370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14557913#comment-14557913
]
Jeff Zhang commented on TEZ-2370:
---------------------------------
[~harisekhon] start from 0.6.0, tez provides ui for job debugging.
http://tez.apache.org/tez-ui.html
> Add stages information to RM UI for debugging / visibility on job progress
> --------------------------------------------------------------------------
>
> Key: TEZ-2370
> URL: https://issues.apache.org/jira/browse/TEZ-2370
> Project: Apache Tez
> Issue Type: Improvement
> Components: UI
> Affects Versions: 0.5.2
> Environment: HDP 2.2.0
> Reporter: Hari Sekhon
> Priority: Minor
>
> Something that has been bugging me since last year is the difficulty of
> debugging Tez jobs compared to MapReduce jobs.
> This is because Resource Manager / Application Master does not display the
> job stats and stages that we are used to seeing in MapReduce eg. Map and
> Reduce task counts and progress. I appreciate that Tez is a more flexible
> framework with a DAG but it would be nice if it could surface the information
> on the different stages, number of tasks running, completed, failed, killed,
> successful etc, similar to how Spark does, and the stage breakdown would be
> useful in understanding what the job is doing at different times, what stage
> is getting stuck/failing etc.
> At the moment the only thing available is to trawl the logs or hope to have a
> console output where some of that information is available, both of which are
> non-ideal when debugging other's people's jobs after the fact.
> Hari Sekhon
> http://www.linkedin.com/in/harisekhon
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
