Neo966 opened a new issue #3795:
URL: https://github.com/apache/hudi/issues/3795
hive version:2.1.1
flink:1.12.2 scala:2.11
1、hive.input.format=org.apache.hadoop.hive.ql.io.CombineHiveInputFormat;
select count(*) from xxx; //103828120, It's not right. actual number is
18874368.
2、hive.input.format=org.apache.hudi.hadoop.hive.HoodieCombineHiveInputFormat;
select count(*) from xxx; //Error: Error while processing statement:
FAILED: Execution Error, return code -101 from
org.apache.hadoop.hive.ql.exec.mr.MapRedTask.
org/apache/hadoop/hive/common/StringInternUtils (state=08S01,code=-101)
3、hive.input.format=org.apache.hadoop.hive.ql.io.HiveInputFormat;
select count(*) from xxx; //18874368
select * from xxx limit 18874360, 10; //it's works, display the last 8
records normally.
select count(*) from xxx where name = 'lisi'; //2097152
select * from xxx where name = 'lisi' limit 2097150, 10; //the result
error, no record return, should return last 2 record.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]