[ https://issues.apache.org/jira/browse/HIVE-10234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
xuhuan updated HIVE-10234: -------------------------- Description: I apply the RCFileProtobufInputFormat from twitter's elephantbird project into hive to handle Protobuf records which are written in a RCFile file format. What I have done is belowing: 1. compile the soure code of RCFileProtobufInputFormat and make a jar 2. add the jar to hive_aux_jar_path and update the config of server and client 3. create table using inputformat "com.twitter.elephantbird.mapreduce.input.RCFileProtobufInputFormat" Creating table is ok.but when I excute a query like "select * from table test"(there is no data in table test),I got these mistake: FAILED: SemanticException 1:14 Input format must implement InputFormat. Error encountered near token test. I found some cases in stackoverflow,someones said that's because the custom inputformat class implement the new API(org.apache.hadoop.marpreduce) and RCFileProtobufInputFormat class indeed extends the new API. I'm wondering if a custom inputformat must extend the old API(org.apache.hadoop.marpred)? Could this be the reason of my problem? was: I apply the RCFileProtobufInputFormat from twitter's elephantbird project into hive to handle Protobuf records which are written in a RCFile file format. What I have done is belowing: 1. compile the soure code of RCFileProtobufInputFormat and make a jar 2. add the jar to hive_aux_jar_path and update the config of server and client 3. create table using inputformat "com.twitter.elephantbird.mapreduce.input.RCFileProtobufInputFormat" Creating table is ok.but when I excute a query like "select * from table test"(there is no data in table test),I got these mistake: FAILED: SemanticException 1:14 Input format must implement InputFormat. Error encountered near token test. I found some cases in stackoverflow,someones said that's because the custom inputformat class implement the new API(org.apache.hadoop.marpreduce) and RCFileProtobufInputFormat class indeed extends the new API. I'm wondering wheather a custom inputformat must extend the old API(org.apache.hadoop.marpred)? Could this be the reason of my problem? > Problems using custom inputformat > --------------------------------- > > Key: HIVE-10234 > URL: https://issues.apache.org/jira/browse/HIVE-10234 > Project: Hive > Issue Type: Bug > Components: File Formats > Affects Versions: 0.13.1 > Environment: CentOS release 6.3 > CDH-5.3.1-1.cdh5.3.1.p0.5 > hive-0.13.1-cdh5.3.1 > Inputformat: > https://github.com/twitter/elephant-bird/blob/master/rcfile/src/main/java/com/twitter/elephantbird/mapreduce/input/RCFileProtobufInputFormat.java > Reporter: xuhuan > Priority: Critical > Labels: inputformat > > I apply the RCFileProtobufInputFormat from twitter's elephantbird project > into hive to handle Protobuf records which are written in a RCFile file > format. What I have done is belowing: > 1. compile the soure code of RCFileProtobufInputFormat and make a jar > 2. add the jar to hive_aux_jar_path and update the config of server and client > 3. create table using inputformat > "com.twitter.elephantbird.mapreduce.input.RCFileProtobufInputFormat" > Creating table is ok.but when I excute a query like "select * from table > test"(there is no data in table test),I got these mistake: FAILED: > SemanticException 1:14 Input format must implement InputFormat. Error > encountered near token test. > I found some cases in stackoverflow,someones said that's because the custom > inputformat class implement the new API(org.apache.hadoop.marpreduce) and > RCFileProtobufInputFormat class indeed extends the new API. I'm wondering if > a custom inputformat must extend the old API(org.apache.hadoop.marpred)? > Could this be the reason of my problem? -- This message was sent by Atlassian JIRA (v6.3.4#6332)