[
https://issues.apache.org/jira/browse/TEZ-1087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13983529#comment-13983529
]
Bikas Saha commented on TEZ-1087:
---------------------------------
This logs needed are the ones for the failed task so that we can see that we
indeed are hitting the condition fixed by the patch.
Never mind. I will commit this patch and we can open a new issue if we see this
happen again after this patch goes in.
For the patch itself, I think we are better off just continuing after checking
for completed inputs instead of re-ordering the way its done in that patch.
Unless you see differently, I will make that change.
> ShuffleManager fails with IllegalStateException
> -----------------------------------------------
>
> Key: TEZ-1087
> URL: https://issues.apache.org/jira/browse/TEZ-1087
> Project: Apache Tez
> Issue Type: Bug
> Reporter: Cheolsoo Park
> Attachments: TEZ-1087-1.patch, am.log.tar.gz
>
>
> While running a Pig-on-Tez job, I ran into this error-
> {code}
> at java.util.ArrayList$Itr.remove(ArrayList.java:844)
> at
> org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager.constructFetcherForHost(ShuffleManager.java:314)
> at
> org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager.access$1200(ShuffleManager.java:80)
> at
> org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager$RunShuffleCallable.call(ShuffleManager.java:260)
> at
> org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager$RunShuffleCallable.call(ShuffleManager.java:213)
> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:744)
> {code}
--
This message was sent by Atlassian JIRA
(v6.2#6252)
