[
https://issues.apache.org/jira/browse/HDFS-3682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Todd Lipcon updated HDFS-3682:
------------------------------
Attachment: hdfs-3682.txt
Here's a patch which adds some error logging when the cluster fails to init. In
order to test, I chmodded my build directory to 000, and then ran one of the
test cases. I got the following in the test log:
2012-10-05 17:44:00,203 ERROR hdfs.MiniDFSCluster
(MiniDFSCluster.java:initMiniDFSCluster(636)) - IOE creating namenodes.
Permissions dump:
path
'/home/todd/git/hadoop-common/hadoop-hdfs-project/hadoop-hdfs/build/test/data/cluster5/data':
absolute:/home/todd/git/hadoop-common/hadoop-hdfs-project/hadoop-hdfs/build/test/data/cluster5/data
permissions: ----
path
'/home/todd/git/hadoop-common/hadoop-hdfs-project/hadoop-hdfs/build/test/data/cluster5':
absolute:/home/todd/git/hadoop-common/hadoop-hdfs-project/hadoop-hdfs/build/test/data/cluster5
permissions: ----
path
'/home/todd/git/hadoop-common/hadoop-hdfs-project/hadoop-hdfs/build/test/data':
absolute:/home/todd/git/hadoop-common/hadoop-hdfs-project/hadoop-hdfs/build/test/data
permissions: ----
path '/home/todd/git/hadoop-common/hadoop-hdfs-project/hadoop-hdfs/build/test':
absolute:/home/todd/git/hadoop-common/hadoop-hdfs-project/hadoop-hdfs/build/test
permissions: ----
path '/home/todd/git/hadoop-common/hadoop-hdfs-project/hadoop-hdfs/build':
absolute:/home/todd/git/hadoop-common/hadoop-hdfs-project/hadoop-hdfs/build
permissions: d---
path '/home/todd/git/hadoop-common/hadoop-hdfs-project/hadoop-hdfs':
absolute:/home/todd/git/hadoop-common/hadoop-hdfs-project/hadoop-hdfs
permissions: drwx
path '/home/todd/git/hadoop-common/hadoop-hdfs-project':
absolute:/home/todd/git/hadoop-common/hadoop-hdfs-project
permissions: drwx
path '/home/todd/git/hadoop-common':
absolute:/home/todd/git/hadoop-common
permissions: drwx
path '/home/todd/git':
absolute:/home/todd/git
permissions: drwx
path '/home/todd':
absolute:/home/todd
permissions: drwx
path '/home':
absolute:/home
permissions: dr-x
path '/':
absolute:/
permissions: dr-x
which would probably help diagnose.
> MiniDFSCluster#init should provide more info when it fails
> ----------------------------------------------------------
>
> Key: HDFS-3682
> URL: https://issues.apache.org/jira/browse/HDFS-3682
> Project: Hadoop HDFS
> Issue Type: Improvement
> Components: test
> Affects Versions: 2.0.0-alpha
> Reporter: Eli Collins
> Assignee: Todd Lipcon
> Priority: Minor
> Labels: test-fail
> Attachments: hdfs-3682.txt
>
>
> I've seen the occasional test failure due to the MiniDFSCluster init failing
> due to "java.io.IOException: Cannot remove data directory" for the
> target/test/data/dfs/data directory. We should improve the error handling
> here so we can better understand the failure, eg perhaps one of the tests
> that chmods a directory fails and causes this failure.
> {noformat}
> org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSCluster.java:596)
> at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:297)
> at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:116)
> at
> org.apache.hadoop.hdfs.MiniDFSCluster$Builder.build(MiniDFSCluster.java:279)
> at
> org.apache.hadoop.hdfs.security.TestDelegationToken.setUp(TestDelegationToken.java:77
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira