Here is my analysis: MiniDFSCluster.java is in hadoop-minicluster module. If pom.xml points to hadoop 2.3, MiniDFSCluster.java would reference StorageType.java which was added on 2014-01-06. StorageType.java was not in hadoop 2.2 release, hence the exception.
Cheers On Wed, Mar 12, 2014 at 2:47 PM, Ted Yu <[email protected]> wrote: > I can reproduce the following locally. > > [INFO] +- org.apache.hbase:hbase-server:test-jar:tests:0.99.0-SNAPSHOT:test > ... > [INFO] | \- org.apache.hadoop:hadoop-hdfs:jar:2.2.0:test > ... > [INFO] +- org.apache.hadoop:hadoop-minicluster:jar:2.3.0:test > ... > [INFO] | +- org.apache.hadoop:hadoop-hdfs:test-jar:tests:2.3.0:test > > Could the dependency difference play a role here ? > > > On Tue, Mar 11, 2014 at 5:35 PM, Nick Dimiduk <[email protected]> wrote: > >> >> ------------------------------------------------------------------------------- >> Test set: org.hbase.downstreamer.TestHBaseMiniCluster >> >> ------------------------------------------------------------------------------- >> Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 1.311 sec >> <<< FAILURE! >> testSpinUpMiniHBaseCluster(org.hbase.downstreamer.TestHBaseMiniCluster) >> Time elapsed: 1.249 sec <<< ERROR! >> java.lang.NoClassDefFoundError: org/apache/hadoop/hdfs/StorageType >> at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:603) >> at >> >> org.apache.hadoop.hbase.HBaseTestingUtility.startMiniDFSCluster(HBaseTestingUtility.java:516) >> at >> >> org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:845) >> at >> >> org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:770) >> at >> >> org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:741) >> at >> >> org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:710) >> at >> >> org.hbase.downstreamer.TestHBaseMiniCluster.testSpinUpMiniHBaseCluster(TestHBaseMiniCluster.java:23) >> >> >> >> On Tue, Mar 11, 2014 at 5:32 PM, Ted Yu <[email protected]> wrote: >> >> > Nick: >> > Can you provide more of the stack trace for the failed test ? >> > >> > Thanks >> > >> > >> > On Tue, Mar 11, 2014 at 5:01 PM, Nick Dimiduk <[email protected]> >> wrote: >> > >> > > Looks like everything worked as documented. I verified using the >> > > hbase-downstreamer project against both hadoop-1.2.1 and hadoop-2.2.0. >> > When >> > > I set hadoop.version to 2.3.0, the test fails: >> > > >> > > Tests in error: >> > > >> > testSpinUpMiniHBaseCluster(org.hbase.downstreamer.TestHBaseMiniCluster): >> > > org/apache/hadoop/hdfs/StorageType >> > > >> > > >> > > >> > > >> > > On Tue, Mar 11, 2014 at 4:31 PM, Jonathan Hsieh <[email protected]> >> > wrote: >> > > >> > > > Go for it. A minor nits on the docs that got me was that >> > > > repository.apache.org is a web login, not ssh. :) >> > > > >> > > > Jon. >> > > > >> > > > >> > > > On Tue, Mar 11, 2014 at 12:09 PM, Enis Söztutar <[email protected] >> > >> > > > wrote: >> > > > >> > > > > Go ahead! >> > > > > >> > > > > >> > > > > On Tue, Mar 11, 2014 at 12:07 PM, Nick Dimiduk < >> [email protected]> >> > > > wrote: >> > > > > >> > > > > > Jeffrey and I are looking at publishing an updated snapshot >> > artifact >> > > to >> > > > > > facilitate Phoenix build/testing. I'm looking at the >> instructions >> > > here >> > > > > [0]. >> > > > > > I've not done thing before, but it looks well documented. >> > > > > > >> > > > > > Any objections? We'll pursue it later this afternoon. >> > > > > > >> > > > > > -n >> > > > > > >> > > > > > [0]: http://hbase.apache.org/book.html#maven.snapshot >> > > > > > >> > > > > >> > > > >> > > > >> > > > >> > > > -- >> > > > // Jonathan Hsieh (shay) >> > > > // HBase Tech Lead, Software Engineer, Cloudera >> > > > // [email protected] // @jmhsieh >> > > > >> > > >> > >> > >
