[jira] [Commented] (YARN-1575) Public localizer crashes with "Localized unkown resource"

[Jason Lowe (JIRA)]

    [ 
https://issues.apache.org/jira/browse/YARN-1575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13865949#comment-13865949
 ] 

Jason Lowe commented on YARN-1575:
----------------------------------

This ultimately will bring down the NM later with this error:

{noformat}
2014-01-08 14:13:20,051 [AsyncDispatcher event handler] FATAL 
org.apache.hadoop.yarn.event.AsyncDispatcher: Error in dispatcher thread
java.util.concurrent.RejectedExecutionException: Task 
java.util.concurrent.ExecutorCompletionService$QueueingFuture@27d65d rejected 
from java.util.concurrent.ThreadPoolExecutor@16a9bc1[Terminated, pool size = 0, 
active threads = 0, queued tasks = 0, completed tasks = 34924]
        at 
java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2048)
        at 
java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:821)
        at 
java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1372)
        at 
java.util.concurrent.ExecutorCompletionService.submit(ExecutorCompletionService.java:181)
        at 
org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$PublicLocalizer.addResource(ResourceLocalizationService.java:616)
        at 
org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker.handle(ResourceLocalizationService.java:520)
        at 
org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker.handle(ResourceLocalizationService.java:462)
        at 
org.apache.hadoop.yarn.event.AsyncDispatcher.dispatch(AsyncDispatcher.java:130)
        at 
org.apache.hadoop.yarn.event.AsyncDispatcher$1.run(AsyncDispatcher.java:77)
        at java.lang.Thread.run(Thread.java:722)
2014-01-08 14:13:20,051 [AsyncDispatcher event handler] INFO 
org.apache.hadoop.yarn.event.AsyncDispatcher: Exiting, bbye..
{noformat}

> Public localizer crashes with "Localized unkown resource"
> ---------------------------------------------------------
>
>                 Key: YARN-1575
>                 URL: https://issues.apache.org/jira/browse/YARN-1575
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: nodemanager
>    Affects Versions: 0.23.10, 2.2.0
>            Reporter: Jason Lowe
>            Priority: Critical
>
> The public localizer can crash with the error:
> {noformat}
> 2014-01-08 14:11:43,212 [Thread-467] ERROR 
> org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService:
>  Localized unkonwn resource to java.util.concurrent.FutureTask@852e26
> 2014-01-08 14:11:43,212 [Thread-467] INFO 
> org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService:
>  Public cache exiting
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)