[jira] [Updated] (YARN-3602) TestResourceLocalizationService.testPublicResourceInitializesLocalDir fails Intermittently due to IOException from cleanup

2016-04-22 Thread Vinod Kumar Vavilapalli (JIRA) 

 [ 
https://issues.apache.org/jira/browse/YARN-3602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Vinod Kumar Vavilapalli updated YARN-3602:
--
Issue Type: Test  (was: Bug)

> TestResourceLocalizationService.testPublicResourceInitializesLocalDir fails 
> Intermittently due to IOException from cleanup
> --
>
> Key: YARN-3602
> URL: https://issues.apache.org/jira/browse/YARN-3602
> Project: Hadoop YARN
>  Issue Type: Test
>  Components: test
>Reporter: zhihai xu
>Assignee: zhihai xu
>Priority: Minor
>  Labels: BB2015-05-RFC
> Fix For: 2.8.0, 2.7.3
>
> Attachments: YARN-3602.000.patch
>
>
> ResourceLocalizationService.testPublicResourceInitializesLocalDir fails 
> Intermittently due to IOException from cleanup. The stack trace is the 
> following from test report at
> https://builds.apache.org/job/PreCommit-YARN-Build/7729/testReport/org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer/TestResourceLocalizationService/testPublicResourceInitializesLocalDir/
> {code}
> Error Message
> Unable to delete directory 
> target/org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.TestResourceLocalizationService/2/filecache.
> Stacktrace
> java.io.IOException: Unable to delete directory 
> target/org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.TestResourceLocalizationService/2/filecache.
>   at org.apache.commons.io.FileUtils.deleteDirectory(FileUtils.java:1541)
>   at org.apache.commons.io.FileUtils.forceDelete(FileUtils.java:2270)
>   at org.apache.commons.io.FileUtils.cleanDirectory(FileUtils.java:1653)
>   at org.apache.commons.io.FileUtils.deleteDirectory(FileUtils.java:1535)
>   at org.apache.commons.io.FileUtils.forceDelete(FileUtils.java:2270)
>   at org.apache.commons.io.FileUtils.cleanDirectory(FileUtils.java:1653)
>   at org.apache.commons.io.FileUtils.deleteDirectory(FileUtils.java:1535)
>   at 
> org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.TestResourceLocalizationService.cleanup(TestResourceLocalizationService.java:187)
> {code}
> It looks like we can safely ignore the IOException in cleanup which is called 
> after test.
> The IOException may be due to the test machine environment because 
> TestResourceLocalizationService/2/filecache is created by 
> ResourceLocalizationService#initializeLocalDir.
> testPublicResourceInitializesLocalDir created 0/filecache, 1/filecache, 
> 2/filecache and 3/filecache
> {code}
> for (int i = 0; i < 4; ++i) {
>   localDirs.add(lfs.makeQualified(new Path(basedir, i + "")));
>   sDirs[i] = localDirs.get(i).toString();
> }
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (YARN-3602) TestResourceLocalizationService.testPublicResourceInitializesLocalDir fails Intermittently due to IOException from cleanup

2016-02-09 Thread Jason Lowe (JIRA) 

 [ 
https://issues.apache.org/jira/browse/YARN-3602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jason Lowe updated YARN-3602:
-
Fix Version/s: 2.7.3

I committed this to branch-2.7.

> TestResourceLocalizationService.testPublicResourceInitializesLocalDir fails 
> Intermittently due to IOException from cleanup
> --
>
> Key: YARN-3602
> URL: https://issues.apache.org/jira/browse/YARN-3602
> Project: Hadoop YARN
>  Issue Type: Bug
>  Components: test
>Reporter: zhihai xu
>Assignee: zhihai xu
>Priority: Minor
>  Labels: BB2015-05-RFC
> Fix For: 2.8.0, 2.7.3
>
> Attachments: YARN-3602.000.patch
>
>
> ResourceLocalizationService.testPublicResourceInitializesLocalDir fails 
> Intermittently due to IOException from cleanup. The stack trace is the 
> following from test report at
> https://builds.apache.org/job/PreCommit-YARN-Build/7729/testReport/org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer/TestResourceLocalizationService/testPublicResourceInitializesLocalDir/
> {code}
> Error Message
> Unable to delete directory 
> target/org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.TestResourceLocalizationService/2/filecache.
> Stacktrace
> java.io.IOException: Unable to delete directory 
> target/org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.TestResourceLocalizationService/2/filecache.
>   at org.apache.commons.io.FileUtils.deleteDirectory(FileUtils.java:1541)
>   at org.apache.commons.io.FileUtils.forceDelete(FileUtils.java:2270)
>   at org.apache.commons.io.FileUtils.cleanDirectory(FileUtils.java:1653)
>   at org.apache.commons.io.FileUtils.deleteDirectory(FileUtils.java:1535)
>   at org.apache.commons.io.FileUtils.forceDelete(FileUtils.java:2270)
>   at org.apache.commons.io.FileUtils.cleanDirectory(FileUtils.java:1653)
>   at org.apache.commons.io.FileUtils.deleteDirectory(FileUtils.java:1535)
>   at 
> org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.TestResourceLocalizationService.cleanup(TestResourceLocalizationService.java:187)
> {code}
> It looks like we can safely ignore the IOException in cleanup which is called 
> after test.
> The IOException may be due to the test machine environment because 
> TestResourceLocalizationService/2/filecache is created by 
> ResourceLocalizationService#initializeLocalDir.
> testPublicResourceInitializesLocalDir created 0/filecache, 1/filecache, 
> 2/filecache and 3/filecache
> {code}
> for (int i = 0; i < 4; ++i) {
>   localDirs.add(lfs.makeQualified(new Path(basedir, i + "")));
>   sDirs[i] = localDirs.get(i).toString();
> }
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (YARN-3602) TestResourceLocalizationService.testPublicResourceInitializesLocalDir fails Intermittently due to IOException from cleanup

2015-05-08 Thread Ray Chiang (JIRA) 

 [ 
https://issues.apache.org/jira/browse/YARN-3602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ray Chiang updated YARN-3602:
-
Labels: BB2015-05-RFC  (was: )

> TestResourceLocalizationService.testPublicResourceInitializesLocalDir fails 
> Intermittently due to IOException from cleanup
> --
>
> Key: YARN-3602
> URL: https://issues.apache.org/jira/browse/YARN-3602
> Project: Hadoop YARN
>  Issue Type: Bug
>  Components: test
>Reporter: zhihai xu
>Assignee: zhihai xu
>Priority: Minor
>  Labels: BB2015-05-RFC
> Attachments: YARN-3602.000.patch
>
>
> ResourceLocalizationService.testPublicResourceInitializesLocalDir fails 
> Intermittently due to IOException from cleanup. The stack trace is the 
> following from test report at
> https://builds.apache.org/job/PreCommit-YARN-Build/7729/testReport/org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer/TestResourceLocalizationService/testPublicResourceInitializesLocalDir/
> {code}
> Error Message
> Unable to delete directory 
> target/org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.TestResourceLocalizationService/2/filecache.
> Stacktrace
> java.io.IOException: Unable to delete directory 
> target/org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.TestResourceLocalizationService/2/filecache.
>   at org.apache.commons.io.FileUtils.deleteDirectory(FileUtils.java:1541)
>   at org.apache.commons.io.FileUtils.forceDelete(FileUtils.java:2270)
>   at org.apache.commons.io.FileUtils.cleanDirectory(FileUtils.java:1653)
>   at org.apache.commons.io.FileUtils.deleteDirectory(FileUtils.java:1535)
>   at org.apache.commons.io.FileUtils.forceDelete(FileUtils.java:2270)
>   at org.apache.commons.io.FileUtils.cleanDirectory(FileUtils.java:1653)
>   at org.apache.commons.io.FileUtils.deleteDirectory(FileUtils.java:1535)
>   at 
> org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.TestResourceLocalizationService.cleanup(TestResourceLocalizationService.java:187)
> {code}
> It looks like we can safely ignore the IOException in cleanup which is called 
> after test.
> The IOException may be due to the test machine environment because 
> TestResourceLocalizationService/2/filecache is created by 
> ResourceLocalizationService#initializeLocalDir.
> testPublicResourceInitializesLocalDir created 0/filecache, 1/filecache, 
> 2/filecache and 3/filecache
> {code}
> for (int i = 0; i < 4; ++i) {
>   localDirs.add(lfs.makeQualified(new Path(basedir, i + "")));
>   sDirs[i] = localDirs.get(i).toString();
> }
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (YARN-3602) TestResourceLocalizationService.testPublicResourceInitializesLocalDir fails Intermittently due to IOException from cleanup

2015-05-08 Thread Ray Chiang (JIRA) 

 [ 
https://issues.apache.org/jira/browse/YARN-3602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ray Chiang updated YARN-3602:
-
Labels:   (was: BB2015-05-TBR)

> TestResourceLocalizationService.testPublicResourceInitializesLocalDir fails 
> Intermittently due to IOException from cleanup
> --
>
> Key: YARN-3602
> URL: https://issues.apache.org/jira/browse/YARN-3602
> Project: Hadoop YARN
>  Issue Type: Bug
>  Components: test
>Reporter: zhihai xu
>Assignee: zhihai xu
>Priority: Minor
> Attachments: YARN-3602.000.patch
>
>
> ResourceLocalizationService.testPublicResourceInitializesLocalDir fails 
> Intermittently due to IOException from cleanup. The stack trace is the 
> following from test report at
> https://builds.apache.org/job/PreCommit-YARN-Build/7729/testReport/org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer/TestResourceLocalizationService/testPublicResourceInitializesLocalDir/
> {code}
> Error Message
> Unable to delete directory 
> target/org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.TestResourceLocalizationService/2/filecache.
> Stacktrace
> java.io.IOException: Unable to delete directory 
> target/org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.TestResourceLocalizationService/2/filecache.
>   at org.apache.commons.io.FileUtils.deleteDirectory(FileUtils.java:1541)
>   at org.apache.commons.io.FileUtils.forceDelete(FileUtils.java:2270)
>   at org.apache.commons.io.FileUtils.cleanDirectory(FileUtils.java:1653)
>   at org.apache.commons.io.FileUtils.deleteDirectory(FileUtils.java:1535)
>   at org.apache.commons.io.FileUtils.forceDelete(FileUtils.java:2270)
>   at org.apache.commons.io.FileUtils.cleanDirectory(FileUtils.java:1653)
>   at org.apache.commons.io.FileUtils.deleteDirectory(FileUtils.java:1535)
>   at 
> org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.TestResourceLocalizationService.cleanup(TestResourceLocalizationService.java:187)
> {code}
> It looks like we can safely ignore the IOException in cleanup which is called 
> after test.
> The IOException may be due to the test machine environment because 
> TestResourceLocalizationService/2/filecache is created by 
> ResourceLocalizationService#initializeLocalDir.
> testPublicResourceInitializesLocalDir created 0/filecache, 1/filecache, 
> 2/filecache and 3/filecache
> {code}
> for (int i = 0; i < 4; ++i) {
>   localDirs.add(lfs.makeQualified(new Path(basedir, i + "")));
>   sDirs[i] = localDirs.get(i).toString();
> }
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (YARN-3602) TestResourceLocalizationService.testPublicResourceInitializesLocalDir fails Intermittently due to IOException from cleanup

2015-05-08 Thread zhihai xu (JIRA) 

 [ 
https://issues.apache.org/jira/browse/YARN-3602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

zhihai xu updated YARN-3602:

Labels: BB2015-05-TBR  (was: )

> TestResourceLocalizationService.testPublicResourceInitializesLocalDir fails 
> Intermittently due to IOException from cleanup
> --
>
> Key: YARN-3602
> URL: https://issues.apache.org/jira/browse/YARN-3602
> Project: Hadoop YARN
>  Issue Type: Bug
>  Components: test
>Reporter: zhihai xu
>Assignee: zhihai xu
>Priority: Minor
>  Labels: BB2015-05-TBR
> Attachments: YARN-3602.000.patch
>
>
> ResourceLocalizationService.testPublicResourceInitializesLocalDir fails 
> Intermittently due to IOException from cleanup. The stack trace is the 
> following from test report at
> https://builds.apache.org/job/PreCommit-YARN-Build/7729/testReport/org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer/TestResourceLocalizationService/testPublicResourceInitializesLocalDir/
> {code}
> Error Message
> Unable to delete directory 
> target/org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.TestResourceLocalizationService/2/filecache.
> Stacktrace
> java.io.IOException: Unable to delete directory 
> target/org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.TestResourceLocalizationService/2/filecache.
>   at org.apache.commons.io.FileUtils.deleteDirectory(FileUtils.java:1541)
>   at org.apache.commons.io.FileUtils.forceDelete(FileUtils.java:2270)
>   at org.apache.commons.io.FileUtils.cleanDirectory(FileUtils.java:1653)
>   at org.apache.commons.io.FileUtils.deleteDirectory(FileUtils.java:1535)
>   at org.apache.commons.io.FileUtils.forceDelete(FileUtils.java:2270)
>   at org.apache.commons.io.FileUtils.cleanDirectory(FileUtils.java:1653)
>   at org.apache.commons.io.FileUtils.deleteDirectory(FileUtils.java:1535)
>   at 
> org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.TestResourceLocalizationService.cleanup(TestResourceLocalizationService.java:187)
> {code}
> It looks like we can safely ignore the IOException in cleanup which is called 
> after test.
> The IOException may be due to the test machine environment because 
> TestResourceLocalizationService/2/filecache is created by 
> ResourceLocalizationService#initializeLocalDir.
> testPublicResourceInitializesLocalDir created 0/filecache, 1/filecache, 
> 2/filecache and 3/filecache
> {code}
> for (int i = 0; i < 4; ++i) {
>   localDirs.add(lfs.makeQualified(new Path(basedir, i + "")));
>   sDirs[i] = localDirs.get(i).toString();
> }
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (YARN-3602) TestResourceLocalizationService.testPublicResourceInitializesLocalDir fails Intermittently due to IOException from cleanup

2015-05-08 Thread zhihai xu (JIRA) 

 [ 
https://issues.apache.org/jira/browse/YARN-3602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

zhihai xu updated YARN-3602:

Attachment: YARN-3602.000.patch

> TestResourceLocalizationService.testPublicResourceInitializesLocalDir fails 
> Intermittently due to IOException from cleanup
> --
>
> Key: YARN-3602
> URL: https://issues.apache.org/jira/browse/YARN-3602
> Project: Hadoop YARN
>  Issue Type: Bug
>  Components: test
>Reporter: zhihai xu
>Assignee: zhihai xu
>Priority: Minor
> Attachments: YARN-3602.000.patch
>
>
> ResourceLocalizationService.testPublicResourceInitializesLocalDir fails 
> Intermittently due to IOException from cleanup. The stack trace is the 
> following from test report at
> https://builds.apache.org/job/PreCommit-YARN-Build/7729/testReport/org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer/TestResourceLocalizationService/testPublicResourceInitializesLocalDir/
> {code}
> Error Message
> Unable to delete directory 
> target/org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.TestResourceLocalizationService/2/filecache.
> Stacktrace
> java.io.IOException: Unable to delete directory 
> target/org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.TestResourceLocalizationService/2/filecache.
>   at org.apache.commons.io.FileUtils.deleteDirectory(FileUtils.java:1541)
>   at org.apache.commons.io.FileUtils.forceDelete(FileUtils.java:2270)
>   at org.apache.commons.io.FileUtils.cleanDirectory(FileUtils.java:1653)
>   at org.apache.commons.io.FileUtils.deleteDirectory(FileUtils.java:1535)
>   at org.apache.commons.io.FileUtils.forceDelete(FileUtils.java:2270)
>   at org.apache.commons.io.FileUtils.cleanDirectory(FileUtils.java:1653)
>   at org.apache.commons.io.FileUtils.deleteDirectory(FileUtils.java:1535)
>   at 
> org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.TestResourceLocalizationService.cleanup(TestResourceLocalizationService.java:187)
> {code}
> It looks like we can safely ignore the IOException in cleanup which is called 
> after test.
> The IOException may be due to the test machine environment because 
> TestResourceLocalizationService/2/filecache is created by 
> ResourceLocalizationService#initializeLocalDir.
> testPublicResourceInitializesLocalDir created 0/filecache, 1/filecache, 
> 2/filecache and 3/filecache
> {code}
> for (int i = 0; i < 4; ++i) {
>   localDirs.add(lfs.makeQualified(new Path(basedir, i + "")));
>   sDirs[i] = localDirs.get(i).toString();
> }
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)