> Caused by: java.lang.ArithmeticException: / by zero
> at 
>org.apache.hadoop.hive.ql.io.orc.OrcInputFormat$SplitGenerator.run(OrcInpu
>tFormat.java:830)

(currentOffset / blockSize != stripe.getOffset() / blockSize)


Looks like this was fixed only recently in S3A impl.

https://issues.apache.org/jira/browse/HADOOP-11584


For backwards compat, ORC should probably do a Math.min(blockSize, 1)
internally.

>> Rajesh has got a backwards port of the seek improvements as a new S3A FS
>> impl, for drop-in replacement for those who can't wait for the next
>> release to try it out.
>> 
>> https://github.com/rajeshbalamohan/hadoop-aws


This FS impl should have that fix.

Cheers,
Gopal


Reply via email to