[
https://issues.apache.org/jira/browse/PARQUET-2000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17306075#comment-17306075
]
Lutz Weischer commented on PARQUET-2000:
----------------------------------------
Switched to parquet-mr.
[jw@cn05 parquet]$ LC_ALL=C mvn install
...
[INFO]
[INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ parquet-hadoop ---
[INFO] Building jar:
/home/jw/apache/parquet/parquet-hadoop/target/parquet-hadoop-1.12.0-SNAPSHOT.jar
[INFO]
[INFO] --- maven-site-plugin:3.4:attach-descriptor (attach-descriptor) @
parquet-hadoop ---
[INFO]
[INFO] --- maven-jar-plugin:2.4:test-jar (default) @ parquet-hadoop ---
[INFO] Building jar:
/home/jw/apache/parquet/parquet-hadoop/target/parquet-hadoop-1.12.0-SNAPSHOT-tests.jar
[INFO]
[INFO] --- maven-shade-plugin:3.2.1:shade (default) @ parquet-hadoop ---
[INFO] Excluding org.apache.parquet:parquet-column:jar:1.12.0-SNAPSHOT from the
shaded jar.
[INFO] Excluding org.apache.parquet:parquet-common:jar:1.12.0-SNAPSHOT from the
shaded jar.
[INFO] Excluding org.apache.yetus:audience-annotations:jar:0.12.0 from the
shaded jar.
[INFO] Excluding org.apache.parquet:parquet-encoding:jar:1.12.0-SNAPSHOT from
the shaded jar.
[INFO] Including net.openhft:zero-allocation-hashing:jar:0.9 in the shaded jar.
[INFO] Excluding
org.apache.parquet:parquet-format-structures:jar:1.12.0-SNAPSHOT from the
shaded jar.
[INFO] Excluding org.slf4j:slf4j-api:jar:1.7.22 from the shaded jar.
[INFO] Excluding javax.annotation:javax.annotation-api:jar:1.3.2 from the
shaded jar.
[INFO] Excluding org.apache.parquet:parquet-jackson:jar:1.12.0-SNAPSHOT from
the shaded jar.
[INFO] Including com.fasterxml.jackson.core:jackson-core:jar:2.12.2 in the
shaded jar.
[INFO] Including com.fasterxml.jackson.core:jackson-databind:jar:2.12.2 in the
shaded jar.
[INFO] Including com.fasterxml.jackson.core:jackson-annotations:jar:2.12.2 in
the shaded jar.
[INFO] Excluding org.xerial.snappy:snappy-java:jar:1.1.8 from the shaded jar.
[INFO] Excluding commons-pool:commons-pool:jar:1.6 from the shaded jar.
[INFO] Including it.unimi.dsi:fastutil:jar:8.4.2 in the shaded jar.
[INFO] Excluding com.github.luben:zstd-jni:jar:1.4.9-1 from the shaded jar.
[INFO] Minimizing jar org.apache.parquet:parquet-hadoop:jar:1.12.0-SNAPSHOT
[INFO] Minimized 11128 -> 491 (4%)
[INFO] Replacing original artifact with shaded artifact.
[INFO] Replacing
/home/jw/apache/parquet/parquet-hadoop/target/parquet-hadoop-1.12.0-SNAPSHOT.jar
with
/home/jw/apache/parquet/parquet-hadoop/target/parquet-hadoop-1.12.0-SNAPSHOT-shaded.jar
[INFO] Dependency-reduced POM written at:
/home/jw/apache/parquet/parquet-hadoop/dependency-reduced-pom.xml
[INFO]
[INFO] --- maven-failsafe-plugin:2.10:integration-test (default) @
parquet-hadoop ---
[INFO] Failsafe report directory:
/home/jw/apache/parquet/parquet-hadoop/target/failsafe-reports
-------------------------------------------------------
T E S T S
-------------------------------------------------------
Running org.apache.parquet.hadoop.ITTestEncryptionOptions
[main] INFO org.apache.parquet.hadoop.TestEncryptionOptions - ========
testInteropReadEncryptedParquetFiles target/parquet-testing/data ========
[main] INFO org.apache.parquet.hadoop.TestEncryptionOptions - Download interop
files if needed
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by
org.apache.hadoop.security.authentication.util.KerberosUtil
(file:/home/jw/.m2/repository/org/apache/hadoop/hadoop-auth/2.10.1/hadoop-auth-2.10.1.jar)
to method sun.security.krb5.Config.getInstance()
WARNING: Please consider reporting this to the maintainers of
org.apache.hadoop.security.authentication.util.KerberosUtil
WARNING: Use --illegal-access=warn to enable warnings of further illegal
reflective access operations
WARNING: All illegal access operations will be denied in a future release
[main] WARN org.apache.hadoop.util.NativeCodeLoader - Unable to load
native-hadoop library for your platform... using builtin-java classes where
applicable
10:20:52,298 DEBUG Tracer: 106 - sampler.classes = ;
loaded no samplers
10:20:52,318 DEBUG Tracer: 128 - span.receiver.classes
= ; loaded no span receivers
[main] INFO org.apache.parquet.hadoop.TestEncryptionOptions -
target/parquet-testing/data exists?: true
[main] INFO org.apache.parquet.hadoop.TestEncryptionOptions - Download interop
file:
https://github.com/apache/parquet-testing/raw/40379b3/data/uniform_encryption.parquet.encrypted
Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 8.554 sec <<<
FAILURE!
Running org.apache.parquet.encodings.FileEncodingsIT
Testing codecs: [UNCOMPRESSED]
Testing PARQUET_1_0/BOOLEAN/UNCOMPRESSED encodings using ROW_GROUP_SIZE=131072
PAGE_SIZE=16384
Testing PARQUET_2_0/BOOLEAN/UNCOMPRESSED encodings using ROW_GROUP_SIZE=131072
PAGE_SIZE=16384
Testing PARQUET_1_0/BOOLEAN/UNCOMPRESSED + DICTIONARY encodings using
ROW_GROUP_SIZE=131072 PAGE_SIZE=16384
Testing PARQUET_2_0/BOOLEAN/UNCOMPRESSED + DICTIONARY encodings using
ROW_GROUP_SIZE=131072 PAGE_SIZE=16384
Testing PARQUET_1_0/INT32/UNCOMPRESSED encodings using ROW_GROUP_SIZE=131072
PAGE_SIZE=16384
Testing PARQUET_2_0/INT32/UNCOMPRESSED encodings using ROW_GROUP_SIZE=131072
PAGE_SIZE=16384
Testing PARQUET_1_0/INT32/UNCOMPRESSED + DICTIONARY encodings using
ROW_GROUP_SIZE=131072 PAGE_SIZE=16384
Testing PARQUET_2_0/INT32/UNCOMPRESSED + DICTIONARY encodings using
ROW_GROUP_SIZE=131072 PAGE_SIZE=16384
Testing PARQUET_1_0/INT64/UNCOMPRESSED encodings using ROW_GROUP_SIZE=131072
PAGE_SIZE=16384
Testing PARQUET_2_0/INT64/UNCOMPRESSED encodings using ROW_GROUP_SIZE=131072
PAGE_SIZE=16384
Testing PARQUET_1_0/INT64/UNCOMPRESSED + DICTIONARY encodings using
ROW_GROUP_SIZE=131072 PAGE_SIZE=16384
Testing PARQUET_2_0/INT64/UNCOMPRESSED + DICTIONARY encodings using
ROW_GROUP_SIZE=131072 PAGE_SIZE=16384
Testing PARQUET_1_0/INT96/UNCOMPRESSED encodings using ROW_GROUP_SIZE=131072
PAGE_SIZE=16384
Testing PARQUET_2_0/INT96/UNCOMPRESSED encodings using ROW_GROUP_SIZE=131072
PAGE_SIZE=16384
Testing PARQUET_1_0/INT96/UNCOMPRESSED + DICTIONARY encodings using
ROW_GROUP_SIZE=131072 PAGE_SIZE=16384
Testing PARQUET_2_0/INT96/UNCOMPRESSED + DICTIONARY encodings using
ROW_GROUP_SIZE=131072 PAGE_SIZE=16384
Testing PARQUET_1_0/FLOAT/UNCOMPRESSED encodings using ROW_GROUP_SIZE=131072
PAGE_SIZE=16384
Testing PARQUET_2_0/FLOAT/UNCOMPRESSED encodings using ROW_GROUP_SIZE=131072
PAGE_SIZE=16384
Testing PARQUET_1_0/FLOAT/UNCOMPRESSED + DICTIONARY encodings using
ROW_GROUP_SIZE=131072 PAGE_SIZE=16384
Testing PARQUET_2_0/FLOAT/UNCOMPRESSED + DICTIONARY encodings using
ROW_GROUP_SIZE=131072 PAGE_SIZE=16384
Testing PARQUET_1_0/DOUBLE/UNCOMPRESSED encodings using ROW_GROUP_SIZE=131072
PAGE_SIZE=16384
Testing PARQUET_2_0/DOUBLE/UNCOMPRESSED encodings using ROW_GROUP_SIZE=131072
PAGE_SIZE=16384
Testing PARQUET_1_0/DOUBLE/UNCOMPRESSED + DICTIONARY encodings using
ROW_GROUP_SIZE=131072 PAGE_SIZE=16384
Testing PARQUET_2_0/DOUBLE/UNCOMPRESSED + DICTIONARY encodings using
ROW_GROUP_SIZE=131072 PAGE_SIZE=16384
Testing PARQUET_1_0/BINARY/UNCOMPRESSED encodings using ROW_GROUP_SIZE=131072
PAGE_SIZE=16384
Testing PARQUET_2_0/BINARY/UNCOMPRESSED encodings using ROW_GROUP_SIZE=131072
PAGE_SIZE=16384
Testing PARQUET_1_0/BINARY/UNCOMPRESSED + DICTIONARY encodings using
ROW_GROUP_SIZE=131072 PAGE_SIZE=16384
Testing PARQUET_2_0/BINARY/UNCOMPRESSED + DICTIONARY encodings using
ROW_GROUP_SIZE=131072 PAGE_SIZE=16384
Testing PARQUET_1_0/FIXED_LEN_BYTE_ARRAY/UNCOMPRESSED encodings using
ROW_GROUP_SIZE=131072 PAGE_SIZE=16384
Testing PARQUET_2_0/FIXED_LEN_BYTE_ARRAY/UNCOMPRESSED encodings using
ROW_GROUP_SIZE=131072 PAGE_SIZE=16384
Testing PARQUET_1_0/FIXED_LEN_BYTE_ARRAY/UNCOMPRESSED + DICTIONARY encodings
using ROW_GROUP_SIZE=131072 PAGE_SIZE=16384
Testing PARQUET_2_0/FIXED_LEN_BYTE_ARRAY/UNCOMPRESSED + DICTIONARY encodings
using ROW_GROUP_SIZE=131072 PAGE_SIZE=16384
Tests run: 16, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1,108.336 sec
Results :
Tests in error:
testInteropReadEncryptedParquetFiles(org.apache.parquet.hadoop.ITTestEncryptionOptions):
github.com: Name or service not known
Tests run: 17, Failures: 0, Errors: 1, Skipped: 0
[INFO]
[INFO] --- maven-failsafe-plugin:2.10:verify (default) @ parquet-hadoop ---
[INFO] Failsafe report directory:
/home/jw/apache/parquet/parquet-hadoop/target/failsafe-reports
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary for Apache Parquet MR 1.12.0-SNAPSHOT:
[INFO]
[INFO] Apache Parquet MR .................................. SUCCESS [ 10.510 s]
[INFO] Apache Parquet Format Structures ................... SUCCESS [ 9.290 s]
[INFO] Apache Parquet Generator ........................... SUCCESS [ 3.472 s]
[INFO] Apache Parquet Common .............................. SUCCESS [ 10.361 s]
[INFO] Apache Parquet Encodings ........................... SUCCESS [ 37.394 s]
[INFO] Apache Parquet Column .............................. SUCCESS [01:41 min]
[INFO] Apache Parquet Arrow ............................... SUCCESS [ 3.497 s]
[INFO] Apache Parquet Jackson ............................. SUCCESS [ 5.068 s]
[INFO] Apache Parquet Hadoop .............................. FAILURE [23:20 min]
[INFO] Apache Parquet Avro ................................ SKIPPED
[INFO] Apache Parquet Benchmarks .......................... SKIPPED
[INFO] Apache Parquet Pig ................................. SKIPPED
[INFO] Apache Parquet Thrift .............................. SKIPPED
[INFO] Apache Parquet Cascading [Deprecated, will be removed after 1.12] SKIPPED
[INFO] Apache Parquet Cascading (for Cascading 3.0 onwards) [Deprecated, will
be removed after 1.12] SKIPPED
[INFO] Apache Parquet Command-line ........................ SKIPPED
[INFO] Apache Parquet Pig Bundle .......................... SKIPPED
[INFO] Apache Parquet Protobuf ............................ SKIPPED
[INFO] Apache Parquet Scala ............................... SKIPPED
[INFO] Apache Parquet Scrooge [Deprecated, will be removed after 1.12] SKIPPED
[INFO] Apache Parquet Hadoop Bundle ....................... SKIPPED
[INFO] Apache Parquet Tools; [Deprecated, will be removed after 1.12; Use
parquet-cli instead] SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 26:21 min
[INFO] Finished at: 2021-03-22T10:39:29+01:00
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal
org.apache.maven.plugins:maven-failsafe-plugin:2.10:verify (default) on project
parquet-hadoop: There are test failures.
[ERROR]
[ERROR] Please refer to
/home/jw/apache/parquet/parquet-hadoop/target/failsafe-reports for the
individual test results.
[ERROR] -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please
read the following articles:
[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <args> -rf :parquet-hadoop
[jw@cn05 parquet]$
> build failed on AArch64, Fedora 33
> -----------------------------------
>
> Key: PARQUET-2000
> URL: https://issues.apache.org/jira/browse/PARQUET-2000
> Project: Parquet
> Issue Type: Bug
> Reporter: Lutz Weischer
> Priority: Major
>
> Apache Thrift 0.12.0 is required. Building it reports unsupported .NET, etc.
> Installing 0.13.0 using yum results in an error on mvn package.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
