This is a known issue that has been addressed in the trunk branch. There were a bunch of JIRAs around this...
Ashish -----Original Message----- From: Bill Craig [mailto:[email protected]] Sent: Monday, June 15, 2009 3:17 PM To: [email protected] Subject: Join Errors We are using hive 0.3.0 and are getting the following when joining on Integer fields. We are also getting a very similar problem using the case UDF is this a known problem? java.io.IOException: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassCastException: org.apache.hadoop.io.IntWritable cannot be cast to org.apache.hadoop.io.Text at org.apache.hadoop.hive.ql.exec.ExecReducer.reduce(ExecReducer.java:180) at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:436) at org.apache.hadoop.mapred.Child.main(Child.java:158) Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassCastException: org.apache.hadoop.io.IntWritable cannot be cast to org.apache.hadoop.io.Text at org.apache.hadoop.hive.ql.exec.GroupByOperator.process(GroupByOperator.java:508) at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:383) at org.apache.hadoop.hive.ql.exec.JoinOperator.createForwardJoinObject(JoinOperator.java:293) at org.apache.hadoop.hive.ql.exec.JoinOperator.genObject(JoinOperator.java:536) at org.apache.hadoop.hive.ql.exec.JoinOperator.genObject(JoinOperator.java:525) at org.apache.hadoop.hive.ql.exec.JoinOperator.genObject(JoinOperator.java:525) at org.apache.hadoop.hive.ql.exec.JoinOperator.checkAndGenObject(JoinOperator.java:566) at org.apache.hadoop.hive.ql.exec.JoinOperator.endGroup(JoinOperator.java:548) at org.apache.hadoop.hive.ql.exec.ExecReducer.reduce(ExecReducer.java:145) ... 2 more Caused by: java.lang.ClassCastException: org.apache.hadoop.io.IntWritable cannot be cast to org.apache.hadoop.io.Text at org.apache.hadoop.hive.serde2.objectinspector.primitive.WritableStringObjectInspector.copyObject(WritableStringObjectInspector.java:35) at org.apache.hadoop.hive.serde2.objectinspector.ObjectInspectorUtils.copyToStandardObject(ObjectInspectorUtils.java:186) at org.apache.hadoop.hive.serde2.objectinspector.ObjectInspectorUtils.copyToStandardObject(ObjectInspectorUtils.java:172) at org.apache.hadoop.hive.ql.exec.GroupByOperator.deepCopyElements(GroupByOperator.java:521) at org.apache.hadoop.hive.ql.exec.GroupByOperator.deepCopyElements(GroupByOperator.java:514) at org.apache.hadoop.hive.ql.exec.GroupByOperator.processHashAggr(GroupByOperator.java:534) at org.apache.hadoop.hive.ql.exec.GroupByOperator.process(GroupByOperator.java:502) ... 10 more
