[
https://issues.apache.org/jira/browse/HIVE-1409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Namit Jain updated HIVE-1409:
-----------------------------
Status: Open (was: Patch Available)
> File format information is retrieved from first partition
> ---------------------------------------------------------
>
> Key: HIVE-1409
> URL: https://issues.apache.org/jira/browse/HIVE-1409
> Project: Hadoop Hive
> Issue Type: Bug
> Components: Query Processor
> Affects Versions: 0.6.0
> Reporter: Paul Yang
> Assignee: Paul Yang
> Attachments: HIVE-1409.1.patch
>
>
> Currently, if no partitions match the partition predicate, the first
> partition is used to retrieve the file format. This can cause an problem if
> the table is set to use RCFile, but the first partition uses SequenceFile:
> {code}
> java.lang.RuntimeException: java.lang.NoSuchMethodException:
> org.apache.hadoop.hive.ql.io.RCFile$KeyBuffer.()
> at
> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:115)
> at
> org.apache.hadoop.mapred.SequenceFileRecordReader.createKey(SequenceFileRecordReader.java:65)
> at
> org.apache.hadoop.hive.ql.io.CombineHiveRecordReader.createKey(CombineHiveRecordReader.java:76)
> at
> org.apache.hadoop.hive.ql.io.CombineHiveRecordReader.createKey(CombineHiveRecordReader.java:42)
> at
> org.apache.hadoop.hive.shims.Hadoop20Shims$CombineFileRecordReader.createKey(Hadoop20Shims.java:212)
> at
> org.apache.hadoop.mapred.MapTask$TrackedRecordReader.createKey(MapTask.java:167)
> at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:45)
> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:358)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307)
> at org.apache.hadoop.mapred.Child.main(Child.java:159)
> Caused by: java.lang.NoSuchMethodException:
> org.apache.hadoop.hive.ql.io.RCFile$KeyBuffer.()
> at java.lang.Class.getConstructor0(Class.java:2706)
> at java.lang.Class.getDeclaredConstructor(Class.java:1985)
> at
> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:109)
> ... 9 more
> {code}
> The proposed change is to use the table's metadata in such cases.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
