[ 
https://issues.apache.org/jira/browse/HCATALOG-155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13151447#comment-13151447
 ] 

Ashutosh Chauhan commented on HCATALOG-155:
-------------------------------------------

Instead of extending SequenceFileOutputFormat, HBaseBullkOSD now contains an 
instance of that. Can you explain why this change is needed and how it fixes 
the type problem as reported in the jira?
                
> HBase bulkOSD requires value to be Put rather than HCatRecord
> -------------------------------------------------------------
>
>                 Key: HCATALOG-155
>                 URL: https://issues.apache.org/jira/browse/HCATALOG-155
>             Project: HCatalog
>          Issue Type: Bug
>          Components: hbase
>    Affects Versions: 0.3
>            Reporter: David Capwell
>            Assignee: Francis Liu
>              Labels: hbase
>             Fix For: 0.3
>
>         Attachments: HCATALOG-155.patch
>
>
> So I tried running a MR job writing to hcat+hbase and get the following error:
> [INFO] 02:42:47,857 [pool-1-thread-1] JobClient:1287 - Task Id : 
> attempt_201111040030_0023_r_000000_0, Status : FAILED
> java.io.IOException: wrong value class: org.apache.hadoop.hbase.client.Put is 
> not class org.apache.hcatalog.data.DefaultHCatRecord
>        at 
> org.apache.hadoop.io.SequenceFile$Writer.append(SequenceFile.java:988)
>        at 
> org.apache.hadoop.mapreduce.lib.output.SequenceFileOutputFormat$1.write(SequenceFileOutputFormat.java:74)
>        at 
> org.apache.hcatalog.mapreduce.DefaultRecordWriterContainer.write(DefaultRecordWriterContainer.java:64)
>        at 
> org.apache.hcatalog.mapreduce.DefaultRecordWriterContainer.write(DefaultRecordWriterContainer.java:33)
>        at 
> org.apache.hadoop.mapred.ReduceTask$NewTrackingRecordWriter.write(ReduceTask.java:587)
>        at 
> org.apache.hadoop.mapreduce.TaskInputOutputContext.write(TaskInputOutputContext.java:80)
> It looks like my key has to be ImmutableBytesWritable.class and my value must 
> be Put.class?  Shouldn't my key be WritableComparible and value 
> DefaultHCatRecord (HCatRecord)?

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Reply via email to