[
https://issues.apache.org/jira/browse/DRILL-7969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17420245#comment-17420245
]
ASF GitHub Bot commented on DRILL-7969:
---------------------------------------
dzamo commented on pull request #2321:
URL: https://github.com/apache/drill/pull/2321#issuecomment-927269529
@vvysotskyi There are two test errors in the ARM64 build that look like they
would be resolved by adding `libbrotli1` to the `apt: packages` list in the
Travis config.
```
[ERROR] Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed:
1.902 s <<< FAILURE! - in org.apache.drill.TestAggNullable
[ERROR] org.apache.drill.TestAggNullable Time elapsed: 1.902 s <<< ERROR!
java.util.ServiceConfigurationError:
org.apache.hadoop.io.compress.CompressionCodec: Provider
org.apache.hadoop.io.compress.BrotliCodec could not be instantiated
Caused by: java.lang.UnsatisfiedLinkError: Couldn't load native library
'brotli'. [LoaderResult: os.name="Linux", os.arch="aarch64",
os.version="5.4.0-1021-aws", java.vm.name="OpenJDK 64-Bit Server VM",
java.vm.version="25.292-b10", java.vm.vendor="Private Build",
alreadyLoaded="null", loadedFromSystemLibraryPath="false",
nativeLibName="libbrotli.so",
temporaryLibFile="/home/travis/build/apache/drill/exec/java-exec/target/brotli9222326058524323719/libbrotli.so",
libNameWithinClasspath="/lib/linux-aarch64/libbrotli.so",
usedThisClassloader="false", usedSystemClassloader="false",
java.library.path="/usr/java/packages/lib/aarch64:/usr/lib/aarch64-linux-gnu/jni:/lib/aarch64-linux-gnu:/usr/lib/aarch64-linux-gnu:/usr/lib/jni:/lib:/usr/lib"]
```
Do you know how to do that? Even if that fixes it, I must admit that I am
not able to see why the two tests which fail on ARM, `TestAggNullable` and
`CredentialsProviderSerDeTest` even look for this Hadoop compression codec, yet
clearly never did before this PR. Neither test has anything to do with
Parquet, which is the only area I worked in. Perhaps it's buried somewhere in
the test class inheritcance hierarchy.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
> Add support for reading and writing Parquet files using Brotli, LZ4 and
> Zstandard codecs
> ----------------------------------------------------------------------------------------
>
> Key: DRILL-7969
> URL: https://issues.apache.org/jira/browse/DRILL-7969
> Project: Apache Drill
> Issue Type: Improvement
> Components: Storage - Parquet
> Reporter: James Turton
> Assignee: James Turton
> Priority: Minor
> Fix For: 1.20.0
>
>
> All of these codecs have been standardised for the Parquet file format and
> all have support in parquet-mr. Note that LZO is GPL-licensed and therefore
> excluded.
> This improvement will allow Drill users to query more existing Parquet files,
> and give them more choices of codec with they write new Parquet files using
> Drill.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
