deshanxiao opened a new issue, #1404:
URL: https://github.com/apache/orc/issues/1404
In Java and C++ reader, we cannot read the statistics exceed 2GB. We should
find a new way or design to support read large statistics files.
```
com.google.protobuf.InvalidProtocolBufferException: Protocol message was too
large. May be malicious. Use CodedInputStream.setSizeLimit() to increase the
size limit.
at
com.google.protobuf.InvalidProtocolBufferException.sizeLimitExceeded(InvalidProtocolBufferException.java:154)
at
com.google.protobuf.CodedInputStream$StreamDecoder.readRawBytesSlowPathOneChunk(CodedInputStream.java:2954)
at
com.google.protobuf.CodedInputStream$StreamDecoder.readBytesSlowPath(CodedInputStream.java:3035)
at
com.google.protobuf.CodedInputStream$StreamDecoder.readBytes(CodedInputStream.java:2446)
at org.apache.orc.OrcProto$StringStatistics.<init>(OrcProto.java:2118)
at org.apache.orc.OrcProto$StringStatistics.<init>(OrcProto.java:2070)
at
org.apache.orc.OrcProto$StringStatistics$1.parsePartialFrom(OrcProto.java:3285)
at
org.apache.orc.OrcProto$StringStatistics$1.parsePartialFrom(OrcProto.java:3279)
at
com.google.protobuf.CodedInputStream$StreamDecoder.readMessage(CodedInputStream.java:2423)
at org.apache.orc.OrcProto$ColumnStatistics.<init>(OrcProto.java:8172)
at org.apache.orc.OrcProto$ColumnStatistics.<init>(OrcProto.java:8093)
at
org.apache.orc.OrcProto$ColumnStatistics$1.parsePartialFrom(OrcProto.java:10494)
at
org.apache.orc.OrcProto$ColumnStatistics$1.parsePartialFrom(OrcProto.java:10488)
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
