[
https://issues.apache.org/jira/browse/HBASE-10830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13948707#comment-13948707
]
Nick Dimiduk commented on HBASE-10830:
--------------------------------------
I'm taking the jar a spin on an 0.98.0++ cluster, run from the main. It's
launching jobs okay but is getting stuck in #testRunFromOutputCommitter,
something I'm not proud of. Since that part of HCat has gone the way of the
dodo, I'm inclined to reassess that part of TableMapReduceUtil, especially if
it's breaking on MR2/YARN.
Running from maven ({{mvn clean install -DskipTests && cd hbase-it && mvn
failsafe:integration-test -Dit.test=IntegrationTestImportTsv}}), I get
{noformat}
Tests in error:
testGenerateAndLoad(org.apache.hadoop.hbase.mapreduce.IntegrationTestImportTsv):
File does not exist:
hdfs://localhost:33393/homes/hortonnd/.m2/repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar
testRunFromOutputCommitter(org.apache.hadoop.hbase.mapreduce.IntegrationTestImportTsv):
File does not exist:
hdfs://localhost:33393/homes/hortonnd/.m2/repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar
{noformat}
Let me have a look.
> Integration test MR jobs attempt to load htrace jars from the wrong location
> ----------------------------------------------------------------------------
>
> Key: HBASE-10830
> URL: https://issues.apache.org/jira/browse/HBASE-10830
> Project: HBase
> Issue Type: Bug
> Affects Versions: 0.98.1
> Reporter: Andrew Purtell
> Priority: Minor
> Fix For: 0.99.0, 0.98.2
>
>
> The MapReduce jobs submitted by IntegrationTestImportTsv want to load the
> htrace JAR from the local Maven cache but get confused and use a HDFS URI.
> {noformat}
> Tests run: 2, Failures: 0, Errors: 2, Skipped: 0, Time elapsed: 8.489 sec <<<
> FAILURE!
> testGenerateAndLoad(org.apache.hadoop.hbase.mapreduce.IntegrationTestImportTsv)
> Time elapsed: 0.488 sec <<< ERROR!
> java.io.FileNotFoundException: File does not exist:
> hdfs://localhost:37548/home/apurtell/.m2/repository/org/cloudera/htrace/htrace-core/2.04/htrace-core-2.04.jar
> at
> org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem.java:1110)
> at
> org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem.java:1102)
> at
> org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
> at
> org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1102)
> at
> org.apache.hadoop.mapreduce.filecache.ClientDistributedCacheManager.getFileStatus(ClientDistributedCacheManager.java:288)
> at
> org.apache.hadoop.mapreduce.filecache.ClientDistributedCacheManager.getFileStatus(ClientDistributedCacheManager.java:224)
> at
> org.apache.hadoop.mapreduce.filecache.ClientDistributedCacheManager.determineTimestamps(ClientDistributedCacheManager.java:93)
> at
> org.apache.hadoop.mapreduce.filecache.ClientDistributedCacheManager.determineTimestampsAndCacheVisibilities(ClientDistributedCacheManager.java:57)
> at
> org.apache.hadoop.mapreduce.JobSubmitter.copyAndConfigureFiles(JobSubmitter.java:264)
> at
> org.apache.hadoop.mapreduce.JobSubmitter.copyAndConfigureFiles(JobSubmitter.java:300)
> at
> org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:387)
> at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1268)
> at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1265)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:415)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1491)
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:1265)
> at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1286)
> at org.apache.hadoop.hbase.mapreduce.ImportTsv.run(ImportTsv.java:603)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
> at
> org.apache.hadoop.hbase.mapreduce.TestImportTsv.doMROnTableTest(TestImportTsv.java:270)
> at
> org.apache.hadoop.hbase.mapreduce.TestImportTsv.doMROnTableTest(TestImportTsv.java:232)
> at
> org.apache.hadoop.hbase.mapreduce.IntegrationTestImportTsv.testGenerateAndLoad(IntegrationTestImportTsv.java:206)
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.2#6252)
