ChangbingChen commented on issue #4618:
URL: https://github.com/apache/hudi/issues/4618#issuecomment-1015244832
> @ChangbingChen sorry i forget one things, before you use hive to query
hoodie table, do you have set inputformat, eg: set
hive.input.format=org.apache.hudi.hadoop.hive.HoodieCombineHiveInputFormat / or
set hive.input.format= org.apache.hadoop.hive.ql.io.HiveInputFormat
>
> if you have wechat？we can communicate directly through wechat
great! thanks~~
it's ok when set
hive.input.format=org.apache.hadoop.hive.ql.io.HiveInputFormat.
However, when set
hive.input.format=org.apache.hudi.hadoop.hive.HoodieCombineHiveInputFormat, the
query throws an exception. It seems that it's a compatibility problem of hive
version.
the hive version i used is 1.1.0-cdh5.13.3, there is no the
HiveInputFormat.pushProjectionsAndFilters function with same params type, and
while hive version 2.3.1 does have.
```
2022-01-18 17:14:04,796 FATAL [main] org.apache.hadoop.mapred.YarnChild:
Error running child : java.lang.NoSuchMethodError:
org.apache.hudi.hadoop.hive.HoodieCombineHiveInputFormat.pushProjectionsAndFilters(Lorg/apache/hadoop/mapred/JobConf;Ljava/lang/Class;Lorg/apache/hadoop/fs/Path;)V
at
org.apache.hudi.hadoop.hive.HoodieCombineHiveInputFormat.getRecordReader(HoodieCombineHiveInputFormat.java:551)
at
org.apache.hadoop.mapred.MapTask$TrackedRecordReader.<init>(MapTask.java:169)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:438)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1920)
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
```
wx： 13488806793.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
