Zouxxyy commented on PR #7081: URL: https://github.com/apache/paimon/pull/7081#issuecomment-3773273111
Important Note: Parquet 1.16.0 has modified `HadoopInputFile` in `parquet-hadoop`, which now requires `FutureDataInputStreamBuilder` from hadoop-common in Hadoop 3.x. However, Paimon is compiled by default against Hadoop version 2.8. ``` 2026-01-20T03:47:05.9386467Z Caused by: java.lang.NoSuchMethodError: org.apache.hadoop.fs.FileSystem.openFile(Lorg/apache/hadoop/fs/Path;)Lorg/apache/hadoop/fs/FutureDataInputStreamBuilder; 2026-01-20T03:47:05.9386725Z at org.apache.parquet.hadoop.util.HadoopInputFile.newStream(HadoopInputFile.java:114) 2026-01-20T03:47:05.9386977Z at org.apache.parquet.hadoop.ParquetFileReader.readFooter(ParquetFileReader.java:563) 2026-01-20T03:47:05.9387218Z at org.apache.parquet.hadoop.ParquetFileReader.readFooter(ParquetFileReader.java:508) 2026-01-20T03:47:05.9387458Z at org.apache.parquet.hadoop.ParquetFileReader.readFooter(ParquetFileReader.java:490) 2026-01-20T03:47:05.9387794Z at org.apache.hadoop.hive.ql.io.parquet.ParquetRecordReaderBase.getSplit(ParquetRecordReaderBase.java:79) 2026-01-20T03:47:05.9388159Z at org.apache.hadoop.hive.ql.io.parquet.read.ParquetRecordReaderWrapper.<init>(ParquetRecordReaderWrapper.java:75) 2026-01-20T03:47:05.9388517Z at org.apache.hadoop.hive.ql.io.parquet.read.ParquetRecordReaderWrapper.<init>(ParquetRecordReaderWrapper.java:60) 2026-01-20T03:47:05.9388889Z at org.apache.hadoop.hive.ql.io.parquet.MapredParquetInputFormat.getRecordReader(MapredParquetInputFormat.java:75) 2026-01-20T03:47:05.9389377Z at org.apache.flink.connectors.hive.HiveTableMetaStoreFactory$HiveTableMetaStore.gatherFullStats(HiveTableMetaStoreFactory.java:272) ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
