[
https://issues.apache.org/jira/browse/YARN-8672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16659209#comment-16659209
]
Chandni Singh commented on YARN-8672:
-------------------------------------
The {{DeletionService}} is deleting the tokens file. Ran the test with debug
logging which made this clear:
{code}
2018-10-22 10:35:29,605 DEBUG [LocalizerRunner for container_0_0000_01_000000]
nodemanager.DeletionService (DeletionService.java:delete(91)) - Scheduling
DeletionTask (delay 0) : FileDeletionTask : id : -1 user : null subDir :
/Users/cnisingh/workspace/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerManager-localDir/nmPrivate/container_0_0000_01_000000.tokens
baseDir : null
2018-10-22 10:35:29,605 DEBUG [DeletionService #0] task.DeletionTask
(FileDeletionTask.java:run(100)) - Running DeletionTask : FileDeletionTask :
id : -1 user : null subDir :
/Users/cnisingh/workspace/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerManager-localDir/nmPrivate/container_0_0000_01_000000.tokens
baseDir : null
2018-10-22 10:35:29,605 DEBUG [DeletionService #0] task.DeletionTask
(FileDeletionTask.java:run(106)) - NM deleting absolute path :
/Users/cnisingh/workspace/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerManager-localDir/nmPrivate/container_0_0000_01_000000.tokens
2018-10-22 10:35:29,612 INFO [LocalizerRunner for container_0_0000_01_000000]
localizer.ResourceLocalizationService
(ResourceLocalizationService.java:run(1265)) - Localizer failed for
container_0_0000_01_000000
ExitCodeException exitCode=1: chmod:
/Users/cnisingh/workspace/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/target/TestContainerManager-localDir/nmPrivate/container_0_0000_01_000000.tokens:
No such file or directory
{code}
> TestContainerManager#testLocalingResourceWhileContainerRunning occasionally
> times out
> -------------------------------------------------------------------------------------
>
> Key: YARN-8672
> URL: https://issues.apache.org/jira/browse/YARN-8672
> Project: Hadoop YARN
> Issue Type: Bug
> Components: nodemanager
> Affects Versions: 3.2.0
> Reporter: Jason Lowe
> Assignee: Chandni Singh
> Priority: Major
>
> Precommit builds have been failing in
> TestContainerManager#testLocalingResourceWhileContainerRunning. I have been
> able to reproduce the problem without any patch applied if I run the test
> enough times. It looks like something is removing container tokens from the
> nmPrivate area just as a new localizer starts.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
