-1. It still throws incompatible exceptions:
Caused by: sbt.ForkMain$ForkError: java.lang.NoSuchMethodError:
java.nio.ByteBuffer.rewind()Ljava/nio/ByteBuffer;
at
org.apache.parquet.hadoop.codec.SnappyCompressor.reset(SnappyCompressor.java:156)
at
org.apache.hadoop.io.compress.CodecPool.returnCompressor(CodecPool.java:210)
at
org.apache.parquet.hadoop.CodecFactory$HeapBytesCompressor.release(CodecFactory.java:177)
at org.apache.parquet.hadoop.CodecFactory.release(CodecFactory.java:250)
at
org.apache.parquet.hadoop.ParquetRecordWriter.close(ParquetRecordWriter.java:168)
at
org.apache.spark.sql.execution.datasources.parquet.ParquetOutputWriter.close(ParquetOutputWriter.scala:41)
at
org.apache.spark.sql.execution.datasources.FileFormatDataWriter.releaseResources(FileFormatDataWriter.scala:58)
at
org.apache.spark.sql.execution.datasources.FileFormatDataWriter.commit(FileFormatDataWriter.scala:75)
at
org.apache.spark.sql.execution.datasources.FileFormatWriter$.$anonfun$executeTask$1(FileFormatWriter.scala:281)
at
org.apache.spark.util.Utils$.tryWithSafeFinallyAndFailureCallbacks(Utils.scala:1471)
at
org.apache.spark.sql.execution.datasources.FileFormatWriter$.executeTask(FileFormatWriter.scala:287)
... 9 morehttps://github.com/apache/spark/pull/31649 https://github.com/apache/spark/runs/1983121842?check_suite_focus=true On 2021/2/25, 19:27, "Gabor Szadovszky" <[email protected]> wrote: External Email Hi everyone, I propose the following RC to be released as the official Apache Parquet 1.12.0 release. The commit id is d859b4435d139f1979f46cf63d2afdf32935ad51 * This corresponds to the tag: apache-parquet-1.12.0-rc2 * https://nam01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Fparquet-mr%2Ftree%2Fd859b4435d139f1979f46cf63d2afdf32935ad51&data=04%7C01%7Cyumwang%40ebay.com%7Cf6486fad02f642f3987008d8d980476f%7C46326bff992841a0baca17c16c94ea99%7C0%7C0%7C637498492264763416%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=BRDSPrv9JNQVY3FEgNd%2B3v%2FUNj3nYnYwRFxH7P%2BeqfI%3D&reserved=0 The release tarball, signature, and checksums are here: * https://nam01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fparquet%2Fapache-parquet-1.12.0-rc2&data=04%7C01%7Cyumwang%40ebay.com%7Cf6486fad02f642f3987008d8d980476f%7C46326bff992841a0baca17c16c94ea99%7C0%7C0%7C637498492264763416%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=6I9cfSlW0hzN5vFtMv6%2FnTb11v%2BMolcoENGod0pwuGk%3D&reserved=0 You can find the KEYS file here: * https://nam01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdownloads.apache.org%2Fparquet%2FKEYS&data=04%7C01%7Cyumwang%40ebay.com%7Cf6486fad02f642f3987008d8d980476f%7C46326bff992841a0baca17c16c94ea99%7C0%7C0%7C637498492264763416%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=XBD6DvGcFxKVpQ0%2Bfq8aF6j0krO4rJjLqR76QYfjhNc%3D&reserved=0 Binary artifacts are staged in Nexus here: * https://nam01.safelinks.protection.outlook.com/?url=https%3A%2F%2Frepository.apache.org%2Fcontent%2Fgroups%2Fstaging%2Forg%2Fapache%2Fparquet%2F&data=04%7C01%7Cyumwang%40ebay.com%7Cf6486fad02f642f3987008d8d980476f%7C46326bff992841a0baca17c16c94ea99%7C0%7C0%7C637498492264763416%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=J05VEyDHfWax42zwNiIUaakX%2BEWBZvRdbfIm%2B4Ku51A%3D&reserved=0 For release content see: * https://nam01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Fparquet-mr%2Fblob%2Fapache-parquet-1.12.0-rc2%2FCHANGES.md&data=04%7C01%7Cyumwang%40ebay.com%7Cf6486fad02f642f3987008d8d980476f%7C46326bff992841a0baca17c16c94ea99%7C0%7C0%7C637498492264763416%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=yxOGzFI5DLpgekoNTGkDX4tYL6NLbLUrzZWS7X8LFTM%3D&reserved=0 Please download, verify, and test. Please vote in the next 72 hours. [ ] +1 Release this as Apache Parquet 1.12.0 [ ] +0 [ ] -1 Do not release this because...
