A tip from Jonathan Hsieh is related to the problem Mikhail was experiencing: -------- Run: umask 022
before running the test on whatever machine you are testing on. -------- Cheers On Wed, Dec 7, 2011 at 10:29 AM, Ted Yu <[email protected]> wrote: > Mikhail: > Your patch was stripped by email server. > > I assume you have verified permission for all components of path: > > /data/users/mbautin/workdirs/hb-os/target/test-data/37d6e996-cba6-4a12-85bc-dbcf2e91d297 > > Cheers > > > On Tue, Dec 6, 2011 at 5:07 PM, Mikhail Bautin < > [email protected]> wrote: > >> Hello, >> >> I've been running into the following issue when running HBase tests. A >> lot of them would fail with an exception similar to the one shown below (I >> added more information to the exception messages). Exit code 141 seems to >> correspond to SIGPIPE, but I did not find anything obvious in Shell.java in >> Hadoop. In Shell.runCommand we read the error stream on a separate thread >> and the output stream on the main thread, and consume both streams >> completely before waiting for the external process to terminate. I ended up >> doing a hacky work-around (patch attached) to be able to run HBase tests, >> but any insight about what could be causing this issue is appreciated. >> HBase trunk uses hadoop-0.20.205.0 by default. >> >> Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 2.544 sec >> <<< FAILURE! >> org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithAbort >> Time elapsed: 0 sec <<< ERROR! >> java.lang.RuntimeException: Error while running command to get file >> permissions : org.apache.hadoop.util.Shell$ExitCodeException: Command: >> [/bin/ls, -ld, >> /data/users/mbautin/workdirs/hb-os/target/test-data/37d6e996-cba6-4a12-85bc-dbcf2e91d297/dfscluster_76df8fc0-6827-4d9d-8728-eb5ee43b0bae/dfs/data/data3], >> message: >> , exitCode: 141 >> at org.apache.hadoop.util.Shell.runCommand(Shell.java:283) >> at org.apache.hadoop.util.Shell.run(Shell.java:183) >> at >> org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:405) >> at org.apache.hadoop.util.Shell.execCommand(Shell.java:491) >> at org.apache.hadoop.util.Shell.execCommand(Shell.java:474) >> at org.apache.hadoop.fs.FileUtil.execCommand(FileUtil.java:703) >> at >> org.apache.hadoop.fs.RawLocalFileSystem$RawLocalFileStatus.loadPermissionInfo(RawLocalFileSystem.java:418) >> at >> org.apache.hadoop.fs.RawLocalFileSystem$RawLocalFileStatus.getPermission(RawLocalFileSystem.java:393) >> at >> org.apache.hadoop.util.DiskChecker.mkdirsWithExistsAndPermissionCheck(DiskChecker.java:146) >> at >> org.apache.hadoop.util.DiskChecker.checkDir(DiskChecker.java:162) >> at >> org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:1537) >> at >> org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1484) >> at >> org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1459) >> at >> org.apache.hadoop.hdfs.MiniDFSCluster.startDataNodes(MiniDFSCluster.java:417) >> at >> org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:280) >> at >> org.apache.hadoop.hbase.HBaseTestingUtility.startMiniDFSCluster(HBaseTestingUtility.java:369) >> at >> org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:537) >> at >> org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:493) >> at >> org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:480) >> at >> org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithAbort.setupBeforeClass(TestRegionServerCoprocessorExceptionWithAbort.java:94) >> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >> at >> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) >> at >> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) >> at java.lang.reflect.Method.invoke(Method.java:597) >> at >> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:45) >> at >> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:15) >> at >> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:42) >> at >> org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:27) >> at >> org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:30) >> at org.junit.runners.ParentRunner.run(ParentRunner.java:300) >> at >> org.apache.maven.surefire.junit4.JUnit4TestSet.execute(JUnit4TestSet.java:53) >> at >> org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:123) >> at >> org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:104) >> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >> at >> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) >> at >> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) >> at java.lang.reflect.Method.invoke(Method.java:597) >> at >> org.apache.maven.surefire.util.ReflectionUtils.invokeMethodWithArray(ReflectionUtils.java:164) >> at >> org.apache.maven.surefire.booter.ProviderFactory$ProviderProxy.invoke(ProviderFactory.java:110) >> at >> org.apache.maven.surefire.booter.SurefireStarter.invokeProvider(SurefireStarter.java:175) >> at >> org.apache.maven.surefire.booter.SurefireStarter.runSuitesInProcessWhenForked(SurefireStarter.java:81) >> at >> org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:68) >> >> Thanks, >> --Mikhail >> > >
