[
https://issues.apache.org/jira/browse/HCATALOG-151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vandana Ayyalasomayajula updated HCATALOG-151:
----------------------------------------------
Attachment: HCATALOG-151.patch
> HBaseInputFormat assumes hbase table name is hcat table name
> ------------------------------------------------------------
>
> Key: HCATALOG-151
> URL: https://issues.apache.org/jira/browse/HCATALOG-151
> Project: HCatalog
> Issue Type: Bug
> Components: hbase
> Affects Versions: 0.3
> Reporter: David Capwell
> Assignee: Vandana Ayyalasomayajula
> Priority: Blocker
> Labels: hbase
> Attachments: HCATALOG-151.patch
>
>
> If you create a db then a table within that db, the hbase default name is
> $dbName.$tableName. When you launch a job that reads from this table, the
> HBaseInputformat assumes the table name is just $tableName
> CREATE DATABASE readhcatdatatest_1320170553442 LOCATION '/tmp/hcat_hbase;
> USE readhcatdatatest_1320170553442 ; CREATE TABLE readhcatdatatest (key
> string, value map<string, string>) STORED BY
> 'org.apache.hcatalog.hbase.HBaseHCatStorageHandler' TBLPROPERTIES
> ('hbase.columns.mapping'=':key,cf:','hcat.osd'='org.apache.hcatalog.hbase.HBaseOutputStorageDriver','hcat.isd'='org.apache.hcatalog.hbase.HBaseInputStorageDriver');
> ...
> # client mr job
> InputJobInfo inputJobInfo = InputJobInfo.create(dbName, tableName, null,
>
> job.getConfiguration().get(HCatConstants.HCAT_METASTORE_URI),
>
> job.getConfiguration().get(HCatConstants.HCAT_METASTORE_PRINCIPAL));
> HCatInputFormat.setInput(job, inputJobInfo);
> dbName = readhcatdatatest_1320170553442
> tableName = readhcatdatatest
> Here is the error you get:
> ERROR 18:02:45,586 [pool-1-thread-1] TableInputFormat:93 -
> org.apache.hadoop.hbase.TableNotFoundException: readhcatdatatest
> at
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegionInMeta(HConnectionManager.java:724)
> at
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:593)
> at
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:558)
> at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:172)
> at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:146)
> at
> org.apache.hadoop.hbase.mapreduce.TableInputFormat.setConf(TableInputFormat.java:91)
> at
> org.apache.hcatalog.hbase.HBaseInputFormat.setConf(HBaseInputFormat.java:89)
> at
> org.apache.hcatalog.hbase.HBaseInputStorageDriver.getInputFormat(HBaseInputStorageDriver.java:106)
> at
> org.apache.hcatalog.mapreduce.HCatBaseInputFormat.getSplits(HCatBaseInputFormat.java:114)
> at
> org.apache.hadoop.mapred.JobClient.writeNewSplits(JobClient.java:919)
> at org.apache.hadoop.mapred.JobClient.writeSplits(JobClient.java:936)
> at org.apache.hadoop.mapred.JobClient.access$500(JobClient.java:170)
> at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:854)
> at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:807)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059)
> at
> org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:807)
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:465)
> at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:495)
> This is blocking all testing
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
