[
https://issues.apache.org/jira/browse/TEZ-2269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14407412#comment-14407412
]
Siddharth Seth commented on TEZ-2269:
-------------------------------------
Wonder if this is just contention trying to acquire the writeLock in a loop -
that shouldn't cause the hangs though.
This patch itself mostly looks good - will need to handle negative values for
timeoutMillis.
We're probably better off moving this check away from the main DAG lock - which
has far too much unnecessary contention at the moment. Will upload a patch
which does this.
> DAGAppMaster becomes unresponsive
> ---------------------------------
>
> Key: TEZ-2269
> URL: https://issues.apache.org/jira/browse/TEZ-2269
> Project: Apache Tez
> Issue Type: Bug
> Affects Versions: 0.7.0
> Reporter: Rajesh Balamohan
> Attachments: TEZ-2269.test.patch,
> app_master_application_1428021179455_0001_jstack.txt, client_jstack.txt
>
>
> Scenario:
> - Run TPCH query20 @ 1 TB scale
> - Tez master branch, Hive trunk
> - auto-reduce parallelism is not an issue (happens with/without auto-reduce
> parallelism)
> 1 or 2 times in 10 runs, DAGAppMaster would freeze unexpectedly. There is no
> pattern observed on which vertex it happens. But when this happens, only
> option is to kill the application. I will attach the jstack soon, but that
> doesn't seem to reveal much.
> Need to debug more; Creating this JIRA for tracking purposes.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
