[
https://issues.apache.org/jira/browse/PARQUET-1975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17286969#comment-17286969
]
ASF GitHub Bot commented on PARQUET-1975:
-----------------------------------------
gszadovszky commented on pull request #872:
URL: https://github.com/apache/parquet-mr/pull/872#issuecomment-781965022
> The problem is
org.apache.hadoop.io.compress.CompressionCodecFactory#CODEC_PROVIDERS
(hadoop-common:2.10.1) -
https://github.com/apache/hadoop/blob/branch-2.10.1/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/compress/CompressionCodecFactory.java#L42.
> It uses ServiceLoader API to load all implementations of
org.apache.hadoop.io.compress.CompressionCodec and brotli-codec fails due to
the missing binary.
> So, having the dependency on the classpath breaks the **loading** of
CompressionCodecFactory class and even code that does not use Brotli but any of
the other compressions fails immediately.
I see, thanks for the explanation. Then, you may try something like
`<arch>!arm64</arch>` instead of using `amd64`. I think `amd64` is too strict
and we may end up not testing something without noticing.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
> Test failure on ARM64 CPU architecture
> --------------------------------------
>
> Key: PARQUET-1975
> URL: https://issues.apache.org/jira/browse/PARQUET-1975
> Project: Parquet
> Issue Type: Bug
> Affects Versions: 1.12.0
> Reporter: Martin Tzvetanov Grigorov
> Priority: Minor
>
> Trying to build Apache Parquet MR on ARM64 fails with:
>
> {code:java}
> $ mvn clean verify
> ...
> Tests in error:
>
> testReadWriteWithCountDeprecated(org.apache.parquet.hadoop.DeprecatedInputFormatTest):
> org.apache.hadoop.io.compress.CompressionCodec: Provider
> org.apache.hadoop.io.compress.BrotliCodec could not be instantiated
> {code}
>
> The reason is that com.github.rdblue:brotli-codec has no binary for aarch64
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
