dark2momo commented on issue #5105:
URL: https://github.com/apache/paimon/issues/5105#issuecomment-2705646091
I tested the code in branch release-0.9, got:
```prolog
Exception in thread "main" java.lang.ClassCastException: java.lang.Short
cannot be cast to java.lang.Integer
at
org.apache.parquet.schema.PrimitiveComparator$IntComparator.compareNotNulls(PrimitiveComparator.java:85)
at
org.apache.parquet.schema.PrimitiveComparator.compare(PrimitiveComparator.java:63)
at
org.apache.parquet.column.statistics.Statistics.compareMaxToValue(Statistics.java:402)
at
org.apache.parquet.filter2.statisticslevel.StatisticsFilter.visit(StatisticsFilter.java:401)
at
org.apache.parquet.filter2.statisticslevel.StatisticsFilter.visit(StatisticsFilter.java:67)
at
org.apache.parquet.filter2.predicate.Operators$GtEq.accept(Operators.java:246)
at
org.apache.parquet.filter2.statisticslevel.StatisticsFilter.canDrop(StatisticsFilter.java:75)
at
org.apache.parquet.filter2.compat.RowGroupFilter.visit(RowGroupFilter.java:103)
at
org.apache.parquet.filter2.compat.RowGroupFilter.visit(RowGroupFilter.java:45)
at
org.apache.parquet.filter2.compat.FilterCompat$FilterPredicateCompat.accept(FilterCompat.java:149)
at
org.apache.parquet.filter2.compat.RowGroupFilter.filterRowGroups(RowGroupFilter.java:72)
at
org.apache.parquet.hadoop.ParquetFileReader.filterRowGroups(ParquetFileReader.java:900)
at
org.apache.parquet.hadoop.ParquetFileReader.<init>(ParquetFileReader.java:813)
at
org.apache.paimon.format.parquet.ParquetReaderFactory.createReader(ParquetReaderFactory.java:106)
at
org.apache.paimon.format.parquet.ParquetReaderFactory.createReader(ParquetReaderFactory.java:72)
at
org.apache.paimon.io.FileRecordReader.<init>(FileRecordReader.java:82)
at
org.apache.paimon.operation.RawFileSplitRead.createFileReader(RawFileSplitRead.java:263)
at
org.apache.paimon.operation.RawFileSplitRead.lambda$createReader$1(RawFileSplitRead.java:169)
at
org.apache.paimon.mergetree.compact.ConcatRecordReader.create(ConcatRecordReader.java:53)
at
org.apache.paimon.operation.RawFileSplitRead.createReader(RawFileSplitRead.java:177)
at
org.apache.paimon.operation.RawFileSplitRead.createReader(RawFileSplitRead.java:144)
at
org.apache.paimon.table.AppendOnlyFileStoreTable$1.reader(AppendOnlyFileStoreTable.java:128)
at
org.apache.paimon.table.source.AbstractDataTableRead.createReader(AbstractDataTableRead.java:82)
at
org.apache.paimon.table.source.TableRead.lambda$createReader$0(TableRead.java:50)
at
org.apache.paimon.mergetree.compact.ConcatRecordReader.create(ConcatRecordReader.java:53)
at
org.apache.paimon.table.source.TableRead.createReader(TableRead.java:52)
at org.apache.paimon.spark.MomoTest.testShortPredicate(MomoTest.java:63)
at org.apache.paimon.spark.MomoTest.main(MomoTest.java:79)
```
And i alos tested the case in branch release-1.0 and master, got "1" as
expected.
Maybe you can try paimon version 1.0 and above.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
