[jira] [Updated] (HIVE-7236) Tez progress monitor should indicate running/failed tasks
[
https://issues.apache.org/jira/browse/HIVE-7236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Lefty Leverenz updated HIVE-7236:
-
Labels: TODOC14 (was: )
Tez progress monitor should indicate running/failed tasks
-
Key: HIVE-7236
URL: https://issues.apache.org/jira/browse/HIVE-7236
Project: Hive
Issue Type: Bug
Components: Tez
Affects Versions: 0.14.0
Reporter: Gopal V
Assignee: Gopal V
Priority: Minor
Labels: TODOC14
Fix For: 0.14.0
Attachments: HIVE-7236.1.patch
Currently, the only logging in TezJobMonitor is for completed tasks.
This makes it hard to locate task stalls and task failures. Failure scenarios
are harder to debug, in particular when analyzing query runs on a cluster
with bad nodes.
Change the job monitor to log running failed tasks as follows.
{code}
Map 1: 0(+157,-1)/1755 Reducer 2: 0/1
Map 1: 0(+168,-1)/1755 Reducer 2: 0/1
Map 1: 0(+189,-1)/1755 Reducer 2: 0/1
Map 1: 0(+189,-1)/1755 Reducer 2: 0/1
{code}
That is 189 tasks running, 1 failure and 0 complete.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (HIVE-7236) Tez progress monitor should indicate running/failed tasks
[
https://issues.apache.org/jira/browse/HIVE-7236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gunther Hagleitner updated HIVE-7236:
-
Resolution: Fixed
Status: Resolved (was: Patch Available)
Committed to trunk. Thanks [~gopalv]!
Tez progress monitor should indicate running/failed tasks
-
Key: HIVE-7236
URL: https://issues.apache.org/jira/browse/HIVE-7236
Project: Hive
Issue Type: Bug
Components: Tez
Affects Versions: 0.14.0
Reporter: Gopal V
Assignee: Gopal V
Priority: Minor
Attachments: HIVE-7236.1.patch
Currently, the only logging in TezJobMonitor is for completed tasks.
This makes it hard to locate task stalls and task failures. Failure scenarios
are harder to debug, in particular when analyzing query runs on a cluster
with bad nodes.
Change the job monitor to log running failed tasks as follows.
{code}
Map 1: 0(+157,-1)/1755 Reducer 2: 0/1
Map 1: 0(+168,-1)/1755 Reducer 2: 0/1
Map 1: 0(+189,-1)/1755 Reducer 2: 0/1
Map 1: 0(+189,-1)/1755 Reducer 2: 0/1
{code}
That is 189 tasks running, 1 failure and 0 complete.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Updated] (HIVE-7236) Tez progress monitor should indicate running/failed tasks
[
https://issues.apache.org/jira/browse/HIVE-7236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gunther Hagleitner updated HIVE-7236:
-
Fix Version/s: 0.14.0
Tez progress monitor should indicate running/failed tasks
-
Key: HIVE-7236
URL: https://issues.apache.org/jira/browse/HIVE-7236
Project: Hive
Issue Type: Bug
Components: Tez
Affects Versions: 0.14.0
Reporter: Gopal V
Assignee: Gopal V
Priority: Minor
Fix For: 0.14.0
Attachments: HIVE-7236.1.patch
Currently, the only logging in TezJobMonitor is for completed tasks.
This makes it hard to locate task stalls and task failures. Failure scenarios
are harder to debug, in particular when analyzing query runs on a cluster
with bad nodes.
Change the job monitor to log running failed tasks as follows.
{code}
Map 1: 0(+157,-1)/1755 Reducer 2: 0/1
Map 1: 0(+168,-1)/1755 Reducer 2: 0/1
Map 1: 0(+189,-1)/1755 Reducer 2: 0/1
Map 1: 0(+189,-1)/1755 Reducer 2: 0/1
{code}
That is 189 tasks running, 1 failure and 0 complete.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Updated] (HIVE-7236) Tez progress monitor should indicate running/failed tasks
[
https://issues.apache.org/jira/browse/HIVE-7236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gopal V updated HIVE-7236:
--
Release Note: Log Tez running/failed tasks in TezJobMonitor
Status: Patch Available (was: In Progress)
Tez progress monitor should indicate running/failed tasks
-
Key: HIVE-7236
URL: https://issues.apache.org/jira/browse/HIVE-7236
Project: Hive
Issue Type: Bug
Components: Tez
Affects Versions: 0.14.0
Reporter: Gopal V
Assignee: Gopal V
Priority: Minor
Attachments: HIVE-7236.1.patch
Currently, the only logging in TezJobMonitor is for completed tasks.
This makes it hard to locate task stalls and task failures. Failure scenarios
are harder to debug, in particular when analyzing query runs on a cluster
with bad nodes.
Change the job monitor to log running failed tasks as follows.
{code}
Map 1: 0(+157,-1)/1755 Reducer 2: 0/1
Map 1: 0(+168,-1)/1755 Reducer 2: 0/1
Map 1: 0(+189,-1)/1755 Reducer 2: 0/1
Map 1: 0(+189,-1)/1755 Reducer 2: 0/1
{code}
That is 189 tasks running, 1 failure and 0 complete.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Updated] (HIVE-7236) Tez progress monitor should indicate running/failed tasks
[
https://issues.apache.org/jira/browse/HIVE-7236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gopal V updated HIVE-7236:
--
Attachment: HIVE-7236.1.patch
Tez progress monitor should indicate running/failed tasks
-
Key: HIVE-7236
URL: https://issues.apache.org/jira/browse/HIVE-7236
Project: Hive
Issue Type: Bug
Components: Tez
Affects Versions: 0.14.0
Reporter: Gopal V
Assignee: Gopal V
Priority: Minor
Attachments: HIVE-7236.1.patch
Currently, the only logging in TezJobMonitor is for completed tasks.
This makes it hard to locate task stalls and task failures. Failure scenarios
are harder to debug, in particular when analyzing query runs on a cluster
with bad nodes.
Change the job monitor to log running failed tasks as follows.
{code}
Map 1: 0(+157,-1)/1755 Reducer 2: 0/1
Map 1: 0(+168,-1)/1755 Reducer 2: 0/1
Map 1: 0(+189,-1)/1755 Reducer 2: 0/1
Map 1: 0(+189,-1)/1755 Reducer 2: 0/1
{code}
That is 189 tasks running, 1 failure and 0 complete.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
