See
<https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Streaming/813/display/redirect?page=changes>
Changes:
[Ismaël Mejía] [BEAM-9282] Move structured streaming runner into Spark 2
specific
[Ismaël Mejía] [BEAM-9282] Separate modules for Spark 2/3
[Ismaël Mejía] [BEAM-9282] Separate modules for Spark 2/3 job-server
[Ismaël Mejía] [BEAM-9282] Separate modules for Spark 2/3 job-server container
[Ismaël Mejía] [BEAM-7092] Run PostCommit tests for Spark 3 module too
[Ismaël Mejía] [BEAM-7092] Update tests invocation for Spark 2 module
[Ismaël Mejía] [BEAM-9283] Add Spark 3 test jobs to the CI (Java 11)
[Ismaël Mejía] [BEAM-11654] Publish Spark 2 and 3 specific Job-Server containers
[Ismaël Mejía] [BEAM-7092] Add paranamer 2.8 license to container (Spark 3 /
Avro)
------------------------------------------
[...truncated 37.36 KB...]
Note: Recompile with -Xlint:unchecked for details.
> Task :runners:spark:3:classes
> Task :runners:spark:3:jar
> Task :runners:spark:3:compileTestJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
> Task :runners:spark:3:testClasses
> Task :runners:spark:3:testJar
> Task :runners:spark:2:compileJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
> Task :runners:spark:2:classes
> Task :runners:spark:2:jar
> Task :runners:spark:2:compileTestJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
> Task :runners:spark:2:testClasses
> Task :runners:spark:2:testJar
> Task :runners:spark:3:job-server:validatesPortableRunnerStreaming
> Task :runners:spark:2:job-server:validatesPortableRunnerStreaming
org.apache.beam.sdk.schemas.AvroSchemaTest > testAvroPipelineGroupBy FAILED
java.lang.AssertionError at AvroSchemaTest.java:497
org.apache.beam.sdk.transforms.FlattenTest > testFlattenIterablesLists FAILED
java.lang.AssertionError at FlattenTest.java:270
org.apache.beam.sdk.transforms.ParDoSchemaTest > testReadAndWrite FAILED
java.lang.AssertionError at ParDoSchemaTest.java:168
> Task :runners:spark:3:job-server:validatesPortableRunnerStreaming
org.apache.beam.sdk.transforms.FlattenTest > testFlattenInputMultipleCopies
FAILED
java.lang.AssertionError at FlattenTest.java:167
org.apache.beam.runners.core.metrics.MetricsPusherTest > pushesSystemMetrics
FAILED
java.lang.NullPointerException at MetricsPusherTest.java:95
> Task :runners:spark:2:job-server:validatesPortableRunnerStreaming
org.apache.beam.runners.core.metrics.MetricsPusherTest > pushesUserMetrics
FAILED
java.lang.NullPointerException at MetricsPusherTest.java:74
org.apache.beam.sdk.transforms.FlattenTest > testFlattenInputMultipleCopies
FAILED
java.lang.AssertionError at FlattenTest.java:167
> Task :runners:spark:3:job-server:validatesPortableRunnerStreaming
org.apache.beam.sdk.transforms.FlattenTest > testFlattenPCollectionsEmpty FAILED
java.lang.AssertionError at FlattenTest.java:135
> Task :runners:spark:2:job-server:validatesPortableRunnerStreaming
Shutting SDK harness down.
> Task :runners:spark:3:job-server:validatesPortableRunnerStreaming
org.apache.beam.sdk.transforms.FlattenTest >
testFlattenWithDifferentInputAndOutputCoders FAILED
java.lang.AssertionError at FlattenTest.java:374
> Task :runners:spark:2:job-server:validatesPortableRunnerStreaming
org.apache.beam.sdk.transforms.ParDoSchemaTest > testFieldAccessSchemaPipeline
FAILED
java.lang.AssertionError at ParDoSchemaTest.java:345
org.apache.beam.sdk.transforms.FlattenTest >
testFlattenMultiplePCollectionsHavingMultipleConsumers FAILED
java.lang.AssertionError at FlattenTest.java:352
> Task :runners:spark:3:job-server:validatesPortableRunnerStreaming
org.apache.beam.sdk.transforms.ParDoSchemaTest > testSimpleSchemaPipeline FAILED
java.lang.AssertionError at ParDoSchemaTest.java:114
> Task :runners:spark:2:job-server:validatesPortableRunnerStreaming
org.apache.beam.sdk.transforms.ParDoSchemaTest > testSchemaConversionPipeline
FAILED
java.lang.AssertionError at ParDoSchemaTest.java:471
> Task :runners:spark:3:job-server:validatesPortableRunnerStreaming
org.apache.beam.sdk.transforms.ParDoSchemaTest >
testReadAndWriteWithSchemaRegistry FAILED
java.lang.AssertionError at ParDoSchemaTest.java:310
org.apache.beam.sdk.transforms.FlattenTest > testFlattenIterablesSets FAILED
java.lang.AssertionError at FlattenTest.java:285
> Task :runners:spark:2:job-server:validatesPortableRunnerStreaming
org.apache.beam.sdk.transforms.FlattenTest > testFlattenIterables FAILED
java.lang.AssertionError at FlattenTest.java:257
org.apache.beam.sdk.transforms.ParDoSchemaTest >
testReadAndWriteWithSchemaRegistry FAILED
java.lang.AssertionError at ParDoSchemaTest.java:310
> Task :runners:spark:3:job-server:validatesPortableRunnerStreaming
org.apache.beam.sdk.transforms.ParDoSchemaTest > testReadAndWriteMultiOutput
FAILED
java.lang.AssertionError at ParDoSchemaTest.java:265
org.apache.beam.sdk.transforms.FlattenTest >
testFlattenPCollectionsEmptyThenParDo FAILED
java.lang.AssertionError at FlattenTest.java:229
> Task :runners:spark:2:job-server:validatesPortableRunnerStreaming
org.apache.beam.sdk.transforms.FlattenTest > testFlattenIterablesSets FAILED
java.lang.AssertionError at FlattenTest.java:285
org.apache.beam.sdk.transforms.ParDoSchemaTest > testReadAndWriteMultiOutput
FAILED
java.lang.AssertionError at ParDoSchemaTest.java:265
> Task :runners:spark:3:job-server:validatesPortableRunnerStreaming
org.apache.beam.sdk.transforms.ParDoSchemaTest > testNestedSchema FAILED
java.lang.AssertionError at ParDoSchemaTest.java:510
org.apache.beam.sdk.transforms.CreateTest > testCreateEmpty FAILED
java.lang.AssertionError at CreateTest.java:105
> Task :runners:spark:2:job-server:validatesPortableRunnerStreaming
org.apache.beam.sdk.transforms.FlattenTest >
testFlattenPCollectionsEmptyThenParDo FAILED
java.lang.AssertionError at FlattenTest.java:229
org.apache.beam.sdk.transforms.ParDoSchemaTest > testNestedSchema FAILED
java.lang.AssertionError at ParDoSchemaTest.java:510
> Task :runners:spark:3:job-server:validatesPortableRunnerStreaming
org.apache.beam.sdk.transforms.CreateTest > testCreateWithKVVoidType FAILED
java.lang.AssertionError at CreateTest.java:341
> Task :runners:spark:2:job-server:validatesPortableRunnerStreaming
org.apache.beam.sdk.transforms.CreateTest > testCreateEmpty FAILED
java.lang.AssertionError at CreateTest.java:105
> Task :runners:spark:3:job-server:validatesPortableRunnerStreaming
org.apache.beam.sdk.transforms.CreateTest > testCreateWithNullsAndValues FAILED
java.lang.AssertionError at CreateTest.java:165
> Task :runners:spark:2:job-server:validatesPortableRunnerStreaming
org.apache.beam.sdk.transforms.CreateTest > testCreateWithKVVoidType FAILED
java.lang.AssertionError at CreateTest.java:341
> Task :runners:spark:3:job-server:validatesPortableRunnerStreaming
org.apache.beam.sdk.transforms.CreateTest > testCreateWithVoidType FAILED
java.lang.AssertionError at CreateTest.java:329
org.apache.beam.sdk.transforms.GroupByKeyTest >
org.apache.beam.sdk.transforms.GroupByKeyTest$WindowTests.testGroupByKeyMergingWindows
FAILED
java.lang.RuntimeException at GroupByKeyTest.java:584
> Task :runners:spark:2:job-server:validatesPortableRunnerStreaming
org.apache.beam.sdk.transforms.GroupByKeyTest >
org.apache.beam.sdk.transforms.GroupByKeyTest$WindowTests.testGroupByKeyMergingWindows
FAILED
java.lang.RuntimeException at GroupByKeyTest.java:584
> Task :runners:spark:3:job-server:validatesPortableRunnerStreaming
org.apache.beam.sdk.transforms.GroupByKeyTest >
org.apache.beam.sdk.transforms.GroupByKeyTest$WindowTests.testGroupByKeyMultipleWindows
FAILED
java.lang.RuntimeException at GroupByKeyTest.java:556
> Task :runners:spark:2:job-server:validatesPortableRunnerStreaming
org.apache.beam.sdk.transforms.GroupByKeyTest >
org.apache.beam.sdk.transforms.GroupByKeyTest$WindowTests.testGroupByKeyMultipleWindows
FAILED
java.lang.RuntimeException at GroupByKeyTest.java:556
> Task :runners:spark:3:job-server:validatesPortableRunnerStreaming
org.apache.beam.sdk.transforms.GroupByKeyTest >
org.apache.beam.sdk.transforms.GroupByKeyTest$WindowTests.testGroupByKeyAndWindows
FAILED
java.lang.RuntimeException at GroupByKeyTest.java:526
> Task :runners:spark:2:job-server:validatesPortableRunnerStreaming
org.apache.beam.sdk.transforms.GroupByKeyTest >
org.apache.beam.sdk.transforms.GroupByKeyTest$WindowTests.testGroupByKeyAndWindows
FAILED
java.lang.RuntimeException at GroupByKeyTest.java:526
> Task :runners:spark:3:job-server:validatesPortableRunnerStreaming
org.apache.beam.sdk.transforms.ReifyTimestampsTest > inValuesSucceeds FAILED
java.lang.AssertionError at ReifyTimestampsTest.java:60
> Task :runners:spark:2:job-server:validatesPortableRunnerStreaming
org.apache.beam.sdk.transforms.ReifyTimestampsTest > extractFromValuesSucceeds
FAILED
java.lang.AssertionError at ReifyTimestampsTest.java:92
> Task :runners:spark:3:job-server:validatesPortableRunnerStreaming
103 tests completed, 18 failed, 1 skipped
> Task :runners:spark:3:job-server:validatesPortableRunnerStreaming FAILED
> Task :runners:spark:2:job-server:validatesPortableRunnerStreaming
103 tests completed, 20 failed, 1 skipped
> Task :runners:spark:2:job-server:validatesPortableRunnerStreaming FAILED
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task
':runners:spark:3:job-server:validatesPortableRunnerStreaming'.
> There were failing tests. See the report at:
> file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Streaming/ws/src/runners/spark/3/job-server/build/reports/tests/validatesPortableRunnerStreaming/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task
':runners:spark:2:job-server:validatesPortableRunnerStreaming'.
> There were failing tests. See the report at:
> file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark_Streaming/ws/src/runners/spark/2/job-server/build/reports/tests/validatesPortableRunnerStreaming/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/6.8/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 36m 27s
87 actionable tasks: 62 executed, 25 from cache
Publishing build scan...
https://gradle.com/s/6un2izhpgojs6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
