[
https://issues.apache.org/jira/browse/DRILL-7504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17020188#comment-17020188
]
Bohdan Kazydub commented on DRILL-7504:
---------------------------------------
[~arina], after upgrading the Parquet versions, each of the tests in
`org.apache.drill.metastore.iceberg.write.TestParquetFileWriter` fails with
{code}
java.lang.ExceptionInInitializerError
at
org.apache.iceberg.parquet.Parquet$WriteBuilder.build(Parquet.java:212)
at
org.apache.drill.metastore.iceberg.write.ParquetFileWriter.write(ParquetFileWriter.java:82)
at
org.apache.drill.metastore.iceberg.write.TestParquetFileWriter.testAllTypes(TestParquetFileWriter.java:100)
Caused by: java.lang.RuntimeException: Cannot find constructor for interface
org.apache.parquet.column.page.PageWriteStore
Missing
org.apache.parquet.hadoop.ColumnChunkPageWriteStore(org.apache.parquet.hadoop.CodecFactory$BytesCompressor,org.apache.parquet.schema.MessageType,org.apache.parquet.bytes.ByteBufferAllocator)
[java.lang.NoSuchMethodException:
org.apache.parquet.hadoop.ColumnChunkPageWriteStore.<init>(org.apache.parquet.hadoop.CodecFactory$BytesCompressor,
org.apache.parquet.schema.MessageType,
org.apache.parquet.bytes.ByteBufferAllocator)]
at
org.apache.iceberg.common.DynConstructors$Builder.build(DynConstructors.java:235)
at
org.apache.iceberg.parquet.ParquetWriter.<clinit>(ParquetWriter.java:57)
... 3 more
{code}
This happens because constructor for a Parquet's class
`org.apache.parquet.hadoop.ColumnChunkPageWriteStore` was expanded with more
arguments. Because of this issue, the upgrade is not possible yet, should wait
for a new version, the upgrade is already done in the
[PR|https://github.com/apache/incubator-iceberg/pull/708].
The tests previously being ignored do pass now, checked other test classes
(manually) with Parquet - they seem to pass too, though haven't ran the whole
test suit (advanced, functional and full unit tests).
> Upgrade Parquet library to 1.11.0
> ---------------------------------
>
> Key: DRILL-7504
> URL: https://issues.apache.org/jira/browse/DRILL-7504
> Project: Apache Drill
> Issue Type: Task
> Affects Versions: 1.17.0
> Reporter: Arina Ielchiieva
> Assignee: Bohdan Kazydub
> Priority: Major
> Fix For: 1.18.0
>
>
> Upgrade Parquet library to 1.11.0
> Apache Parquet Format to 2.7.0 (2.8.0 will be released soon)
> Check ignored tests in:
> org.apache.drill.exec.store.parquet.TestParquetMetadataCache
> org.apache.drill.exec.store.parquet.TestPushDownAndPruningForDecimal
> org.apache.drill.exec.store.parquet.TestPushDownAndPruningForVarchar
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
