[
https://issues.apache.org/jira/browse/TEZ-3941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jonathan Eagles updated TEZ-3941:
---------------------------------
Description:
Found this in 20% of the AM stack traces taken.
{noformat}
"Dispatcher thread {Speculator}" #39 prio=5 os_prio=0 tid=0x00002ba1883d1800
nid=0x1b3e4 runnable [0x00002ba1a3f03000]
java.lang.Thread.State: RUNNABLE
at
org.apache.tez.dag.app.dag.impl.TaskImpl.getAttempts(TaskImpl.java:410)
at
org.apache.tez.dag.app.dag.speculation.legacy.LegacySpeculator.speculationValue(LegacySpeculator.java:223)
at
org.apache.tez.dag.app.dag.speculation.legacy.LegacySpeculator.maybeScheduleASpeculation(LegacySpeculator.java:361)
at
org.apache.tez.dag.app.dag.speculation.legacy.LegacySpeculator.maybeSpeculate(LegacySpeculator.java:135)
at
org.apache.tez.dag.app.dag.speculation.legacy.LegacySpeculator.notifyAttemptStatusUpdate(LegacySpeculator.java:159)
at
org.apache.tez.dag.app.dag.speculation.legacy.LegacySpeculator.handle(LegacySpeculator.java:196)
at
org.apache.tez.dag.app.dag.impl.VertexImpl.handleSpeculatorEvent(VertexImpl.java:4228)
at
org.apache.tez.dag.app.DAGAppMaster$SpeculatorEventHandler.handle(DAGAppMaster.java:2324)
at
org.apache.tez.dag.app.DAGAppMaster$SpeculatorEventHandler.handle(DAGAppMaster.java:2316)
at
org.apache.tez.common.AsyncDispatcher.dispatch(AsyncDispatcher.java:180)
at org.apache.tez.common.AsyncDispatcher$1.run(AsyncDispatcher.java:115)
at java.lang.Thread.run(Thread.java:745)
{noformat}
> Reduce CPU needed for LegacySpeculator#speculationValue
> -------------------------------------------------------
>
> Key: TEZ-3941
> URL: https://issues.apache.org/jira/browse/TEZ-3941
> Project: Apache Tez
> Issue Type: Bug
> Reporter: Jonathan Eagles
> Priority: Major
>
> Found this in 20% of the AM stack traces taken.
> {noformat}
> "Dispatcher thread {Speculator}" #39 prio=5 os_prio=0 tid=0x00002ba1883d1800
> nid=0x1b3e4 runnable [0x00002ba1a3f03000]
> java.lang.Thread.State: RUNNABLE
> at
> org.apache.tez.dag.app.dag.impl.TaskImpl.getAttempts(TaskImpl.java:410)
> at
> org.apache.tez.dag.app.dag.speculation.legacy.LegacySpeculator.speculationValue(LegacySpeculator.java:223)
> at
> org.apache.tez.dag.app.dag.speculation.legacy.LegacySpeculator.maybeScheduleASpeculation(LegacySpeculator.java:361)
> at
> org.apache.tez.dag.app.dag.speculation.legacy.LegacySpeculator.maybeSpeculate(LegacySpeculator.java:135)
> at
> org.apache.tez.dag.app.dag.speculation.legacy.LegacySpeculator.notifyAttemptStatusUpdate(LegacySpeculator.java:159)
> at
> org.apache.tez.dag.app.dag.speculation.legacy.LegacySpeculator.handle(LegacySpeculator.java:196)
> at
> org.apache.tez.dag.app.dag.impl.VertexImpl.handleSpeculatorEvent(VertexImpl.java:4228)
> at
> org.apache.tez.dag.app.DAGAppMaster$SpeculatorEventHandler.handle(DAGAppMaster.java:2324)
> at
> org.apache.tez.dag.app.DAGAppMaster$SpeculatorEventHandler.handle(DAGAppMaster.java:2316)
> at
> org.apache.tez.common.AsyncDispatcher.dispatch(AsyncDispatcher.java:180)
> at
> org.apache.tez.common.AsyncDispatcher$1.run(AsyncDispatcher.java:115)
> at java.lang.Thread.run(Thread.java:745)
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
