[
https://issues.apache.org/jira/browse/FALCON-1469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14875892#comment-14875892
]
Pallavi Rao commented on FALCON-1469:
-------------------------------------
Root cause:
testDuplicateSubmitCommands invokes TestContext.submitToFalcon() method in 2
separate concurrent threads. The submitToFalcon method not just makes a REST
API call to the Falcon server, but also, deletes staging/working directories
and recreates them before making the rest call.
While one of the threads submits to the Falcon Server and the server is
uploading libs to working dir, the second thread deletes the staging and
working dir. That is when the error is seen.
> Flaky EntityManagerJerseyIT#testDuplicateSubmitCommands
> -------------------------------------------------------
>
> Key: FALCON-1469
> URL: https://issues.apache.org/jira/browse/FALCON-1469
> Project: Falcon
> Issue Type: Sub-task
> Reporter: Ajay Yadava
>
> testDuplicateSubmitCommands(org.apache.falcon.resource.EntityManagerJerseyIT)
> Time elapsed: 0.705 sec <<< FAILURE!
> java.util.concurrent.ExecutionException: java.io.IOException: Unable to setup
> cluster info
> at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:252)
> at java.util.concurrent.FutureTask.get(FutureTask.java:111)
> at
> org.apache.falcon.resource.EntityManagerJerseyIT.testDuplicateSubmitCommands(EntityManagerJerseyIT.java:596)
> Caused by: java.io.IOException: Unable to setup cluster info
> at
> org.apache.falcon.resource.TestContext.submitToFalcon(TestContext.java:358)
> at
> org.apache.falcon.resource.TestContext.submitToFalcon(TestContext.java:345)
> at
> org.apache.falcon.resource.EntityManagerJerseyIT$SubmitCommand.call(EntityManagerJerseyIT.java:1022)
> at
> org.apache.falcon.resource.EntityManagerJerseyIT$SubmitCommand.call(EntityManagerJerseyIT.java:1003)
> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
> at java.util.concurrent.FutureTask.run(FutureTask.java:166)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
> at java.lang.Thread.run(Thread.java:722)
> Caused by: java.lang.RuntimeException: Error while running command to get
> file permissions : ExitCodeException exitCode=2: /bin/ls: cannot access
> <https://builds.apache.org/job/Apache-falcon/ws/webapp/target/tmp-hadoop-jenkins/jail-fs/global/projects/falcon/staging>:
> No such file or directory
> at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
> at org.apache.hadoop.util.Shell.run(Shell.java:455)
> at
> org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:702)
> at org.apache.hadoop.util.Shell.execCommand(Shell.java:791)
> at org.apache.hadoop.util.Shell.execCommand(Shell.java:774)
> at org.apache.hadoop.fs.FileUtil.execCommand(FileUtil.java:1097)
> at
> org.apache.hadoop.fs.RawLocalFileSystem$DeprecatedRawLocalFileStatus.loadPermissionInfo(RawLocalFileSystem.java:572)
> at
> org.apache.hadoop.fs.RawLocalFileSystem$DeprecatedRawLocalFileStatus.getPermission(RawLocalFileSystem.java:547)
> at
> org.apache.falcon.hadoop.JailedFileSystem.getFileStatus(JailedFileSystem.java:185)
> at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:1398)
> at
> org.apache.falcon.resource.TestContext.deleteClusterLocations(TestContext.java:367)
> at
> org.apache.falcon.resource.TestContext.submitToFalcon(TestContext.java:355)
> at
> org.apache.falcon.resource.TestContext.submitToFalcon(TestContext.java:345)
> at
> org.apache.falcon.resource.EntityManagerJerseyIT$SubmitCommand.call(EntityManagerJerseyIT.java:1022)
> at
> org.apache.falcon.resource.EntityManagerJerseyIT$SubmitCommand.call(EntityManagerJerseyIT.java:1003)
> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
> at java.util.concurrent.FutureTask.run(FutureTask.java:166)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
> at java.lang.Thread.run(Thread.java:722)
> at
> org.apache.hadoop.fs.RawLocalFileSystem$DeprecatedRawLocalFileStatus.loadPermissionInfo(RawLocalFileSystem.java:610)
> at
> org.apache.hadoop.fs.RawLocalFileSystem$DeprecatedRawLocalFileStatus.getPermission(RawLocalFileSystem.java:547)
> at
> org.apache.falcon.hadoop.JailedFileSystem.getFileStatus(JailedFileSystem.java:185)
> at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:1398)
> at
> org.apache.falcon.resource.TestContext.deleteClusterLocations(TestContext.java:367)
> at
> org.apache.falcon.resource.TestContext.submitToFalcon(TestContext.java:355)
> at
> org.apache.falcon.resource.TestContext.submitToFalcon(TestContext.java:345)
> at
> org.apache.falcon.resource.EntityManagerJerseyIT$SubmitCommand.call(EntityManagerJerseyIT.java:1022)
> at
> org.apache.falcon.resource.EntityManagerJerseyIT$SubmitCommand.call(EntityManagerJerseyIT.java:1003)
> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
> at java.util.concurrent.FutureTask.run(FutureTask.java:166)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
> at java.lang.Thread.run(Thread.java:722)
> Running org.apache.falcon.resource.EntityManagerJerseySmokeIT
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
