[
https://issues.apache.org/jira/browse/HIVE-479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
He Yongqiang updated HIVE-479:
------------------------------
Description:
In one test for hive-477, i found that the below command can not sucessfully
pass:
$HADOOP_HOME/bin/hadoop jar
$HADOOP_HOME/contrib/streaming/hadoop-0.19.0-streaming.jar -input
/user/hive/warehouse/tablerc1 -output testHiveWriter -inputformat
org.apache.hadoop.hive.ql.io.RCFileInputFormat -outputformat
org.apache.hadoop.hive.ql.io.RCFileOutputFormat -mapper
org.apache.hadoop.mapred.lib.IdentityMapper -jobconf mapred.work.output.dir=.
-jobconf hive.io.rcfile.column.number.conf=32 -jobconf
mapred.output.compress=true -numReduceTasks 0
It is caused by the assumption that RCFileOutputFormat thinks the key's class
of passes in records is Void.
was:
In one test for hive-477, i found that the below command can not sucessfully
pass:
{noformat}
$HADOOP_HOME/bin/hadoop jar
$HADOOP_HOME/contrib/streaming/hadoop-0.19.0-streaming.jar -input
/user/hive/warehouse/tablerc1 -output testHiveWriter -inputformat
org.apache.hadoop.hive.ql.io.RCFileInputFormat -outputformat
org.apache.hadoop.hive.ql.io.RCFileOutputFormat -mapper
org.apache.hadoop.mapred.lib.IdentityMapper -jobconf mapred.work.output.dir=.
-jobconf hive.io.rcfile.column.number.conf=32 -jobconf
mapred.output.compress=true -numReduceTasks 0
{noformat}
It is caused by the assumption that RCFileOutputFormat thinks the key's class
of passes in records is Void.
> Change RCFileOutputFormat's generic signatute to be <WritableComparable, ..>
> ----------------------------------------------------------------------------
>
> Key: HIVE-479
> URL: https://issues.apache.org/jira/browse/HIVE-479
> Project: Hadoop Hive
> Issue Type: Improvement
> Reporter: He Yongqiang
>
> In one test for hive-477, i found that the below command can not sucessfully
> pass:
> $HADOOP_HOME/bin/hadoop jar
> $HADOOP_HOME/contrib/streaming/hadoop-0.19.0-streaming.jar -input
> /user/hive/warehouse/tablerc1 -output testHiveWriter -inputformat
> org.apache.hadoop.hive.ql.io.RCFileInputFormat -outputformat
> org.apache.hadoop.hive.ql.io.RCFileOutputFormat -mapper
> org.apache.hadoop.mapred.lib.IdentityMapper -jobconf mapred.work.output.dir=.
> -jobconf hive.io.rcfile.column.number.conf=32 -jobconf
> mapred.output.compress=true -numReduceTasks 0
> It is caused by the assumption that RCFileOutputFormat thinks the key's class
> of passes in records is Void.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
