See
<https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark2_Streaming/1193/display/redirect?page=changes>
Changes:
[Valentyn Tymofieiev] Add a container for Python 3.9.
[Valentyn Tymofieiev] Allow job submission with Python 3.9 on Dataflow runner
[Valentyn Tymofieiev] Add Python 3.9 test suites. Keep Dataflow V1 suites
unchanged for now.
[Valentyn Tymofieiev] Add py3.9 Github actions suites.
[Valentyn Tymofieiev] Py39 Doc updates.
[Valentyn Tymofieiev] [BEAM-9980] Simplify run_validates_container.sh to avoid
branching.
[Valentyn Tymofieiev] Update Cython to a new version that has py39 wheels.
[Valentyn Tymofieiev] [BEAM-13845] Fix comparison with potentially incomparable
default
[Valentyn Tymofieiev] [BEAM-12920] Assume that bare generators types define
simple generators.
[Valentyn Tymofieiev] Mark Python 3.9 as supported version.
[Valentyn Tymofieiev] [BEAM-13868] Remove gsutil dep from hdfs IT test.
[noreply] [BEAM-13776][Playground] (#16731)
[noreply] [BEAM-13867] Drop NaNs returned by nlargest in flight_delays example
[noreply] Announce Python 3.9 in CHANGES.md (#16802)
[Brian Hulette] Moving to 2.38.0-SNAPSHOT on master branch.
[noreply] [BEAM-11095] Better error handling for iter/reiter/multimap (#16794)
------------------------------------------
[...truncated 41.15 KB...]
org.apache.beam.sdk.testing.PAssertTest > testContainsInAnyOrder FAILED
java.lang.AssertionError at PAssertTest.java:411
org.apache.beam.sdk.transforms.CreateTest > testCreateWithNullsAndValues FAILED
java.lang.AssertionError at CreateTest.java:165
org.apache.beam.sdk.transforms.ParDoTest$BasicTests > testParDoEmptyOutputs
FAILED
java.lang.AssertionError at ParDoTest.java:423
org.apache.beam.sdk.transforms.FlattenTest > testFlattenIterablesLists FAILED
java.lang.AssertionError at FlattenTest.java:270
org.apache.beam.sdk.testing.PAssertTest > testContainsInAnyOrderNotSerializable
FAILED
java.lang.AssertionError at PAssertTest.java:189
org.apache.beam.sdk.transforms.CreateTest > testCreateWithVoidType FAILED
java.lang.AssertionError at CreateTest.java:329
org.apache.beam.sdk.transforms.ParDoTest$MultipleInputsAndOutputTests >
testParDoWithOnlyTaggedOutput FAILED
java.lang.AssertionError at ParDoTest.java:805
org.apache.beam.sdk.transforms.FlattenTest > testFlattenInputMultipleCopies
FAILED
java.lang.AssertionError at FlattenTest.java:167
org.apache.beam.sdk.testing.PAssertTest > testSerializablePredicate FAILED
java.lang.AssertionError at PAssertTest.java:210
org.apache.beam.sdk.transforms.CreateTest > testCreate FAILED
java.lang.AssertionError at CreateTest.java:94
org.apache.beam.sdk.transforms.ParDoTest$MultipleInputsAndOutputTests >
testMultiOutputChaining FAILED
java.lang.AssertionError at ParDoTest.java:1445
org.apache.beam.sdk.transforms.FlattenTest > testFlattenPCollectionsEmpty FAILED
java.lang.AssertionError at FlattenTest.java:135
org.apache.beam.sdk.testing.PAssertTest > testNotEqualTo FAILED
java.lang.AssertionError at PAssertTest.java:370
org.apache.beam.sdk.transforms.PerKeyOrderingTest >
testSingleCallOrderingWithoutShuffle FAILED
java.lang.AssertionError at PerKeyOrderingTest.java:193
org.apache.beam.sdk.transforms.ParDoTest$MultipleInputsAndOutputTests >
testParDoEmptyWithTaggedOutput FAILED
java.lang.AssertionError at ParDoTest.java:752
org.apache.beam.sdk.transforms.FlattenTest >
testFlattenPCollectionsSingletonList FAILED
java.lang.AssertionError at FlattenTest.java:109
org.apache.beam.sdk.testing.PAssertTest > testGlobalWindowContainsInAnyOrder
FAILED
java.lang.AssertionError at PAssertTest.java:433
org.apache.beam.sdk.transforms.PerKeyOrderingTest >
testMultipleStatefulOrderingWithoutShuffle FAILED
java.lang.AssertionError at PerKeyOrderingTest.java:321
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-be5f4124-4efc-432b-8834-9f071e058437
org.apache.beam.sdk.transforms.ParDoTest$MultipleInputsAndOutputTests >
testParDoWithTaggedOutput FAILED
java.lang.AssertionError at ParDoTest.java:710
org.apache.beam.sdk.transforms.FlattenTest > testFlattenPCollections FAILED
java.lang.AssertionError at FlattenTest.java:97
org.apache.beam.sdk.testing.PAssertTest > testContainsInAnyOrderWithMatchers
FAILED
java.lang.AssertionError at PAssertTest.java:424
org.apache.beam.sdk.transforms.FlattenTest > testFlattenPCollectionsThenParDo
FAILED
java.lang.AssertionError at FlattenTest.java:123
org.apache.beam.sdk.transforms.ParDoTest$MultipleInputsAndOutputTests >
testParDoWithEmptyTaggedOutput FAILED
java.lang.AssertionError at ParDoTest.java:776
org.apache.beam.sdk.transforms.GroupByKeyTest >
org.apache.beam.sdk.transforms.GroupByKeyTest$BasicTests.testLargeKeys1MB FAILED
java.lang.AssertionError at GroupByKeyTest.java:471
org.apache.beam.sdk.transforms.ParDoTest$TimestampTests >
testParDoShiftTimestamp FAILED
java.lang.AssertionError at ParDoTest.java:2036
org.apache.beam.sdk.transforms.FlattenTest >
testFlattenMultiplePCollectionsHavingMultipleConsumers FAILED
java.lang.AssertionError at FlattenTest.java:352
org.apache.beam.sdk.transforms.ParDoTest$TimestampTests >
testParDoTaggedOutputWithTimestamp FAILED
java.lang.AssertionError at ParDoTest.java:2013
org.apache.beam.sdk.transforms.FlattenTest >
testFlattenWithDifferentInputAndOutputCoders FAILED
java.lang.AssertionError at FlattenTest.java:374
org.apache.beam.sdk.transforms.GroupByKeyTest >
org.apache.beam.sdk.transforms.GroupByKeyTest$BasicTests.testGroupByKeyEmpty
FAILED
java.lang.AssertionError at GroupByKeyTest.java:153
org.apache.beam.sdk.transforms.FlattenTest > testFlattenIterables FAILED
java.lang.AssertionError at FlattenTest.java:257
org.apache.beam.sdk.transforms.ParDoTest$TimestampTests >
testParDoShiftTimestampUnlimited FAILED
java.lang.AssertionError at ParDoTest.java:2125
org.apache.beam.sdk.transforms.FlattenTest > testFlattenIterablesSets FAILED
java.lang.AssertionError at FlattenTest.java:285
org.apache.beam.sdk.transforms.ParDoTest$TimestampTests >
testParDoOutputWithTimestamp FAILED
java.lang.AssertionError at ParDoTest.java:1978
org.apache.beam.sdk.transforms.GroupByKeyTest >
org.apache.beam.sdk.transforms.GroupByKeyTest$BasicTests.testGroupByKey FAILED
java.lang.AssertionError at GroupByKeyTest.java:136
org.apache.beam.sdk.transforms.ReshuffleTest > testAssignShardFn FAILED
java.lang.AssertionError at ReshuffleTest.java:302
org.apache.beam.sdk.transforms.FlattenTest >
testFlattenPCollectionsEmptyThenParDo FAILED
java.lang.AssertionError at FlattenTest.java:229
org.apache.beam.sdk.transforms.GroupByKeyTest >
org.apache.beam.sdk.transforms.GroupByKeyTest$BasicTests.testLargeKeys10KB
FAILED
java.lang.AssertionError at GroupByKeyTest.java:459
org.apache.beam.sdk.transforms.ReshuffleTest > testReshuffleAfterFixedWindows
FAILED
java.lang.AssertionError at ReshuffleTest.java:235
org.apache.beam.sdk.transforms.ImpulseTest > testImpulse FAILED
java.lang.AssertionError at ImpulseTest.java:47
org.apache.beam.sdk.transforms.GroupByKeyTest >
org.apache.beam.sdk.transforms.GroupByKeyTest$BasicTests.testLargeKeys10MB
FAILED
java.lang.AssertionError at GroupByKeyTest.java:477
org.apache.beam.sdk.transforms.ReshuffleTest > testReshuffleAfterSlidingWindows
FAILED
java.lang.AssertionError at ReshuffleTest.java:255
org.apache.beam.sdk.transforms.WithTimestampsTest >
withTimestampsShouldApplyTimestamps FAILED
java.lang.AssertionError at WithTimestampsTest.java:78
org.apache.beam.sdk.transforms.GroupByKeyTest >
org.apache.beam.sdk.transforms.GroupByKeyTest$BasicTests.testGroupByKeyWithBadEqualsHashCode
FAILED
java.lang.AssertionError at GroupByKeyTest.java:453
org.apache.beam.sdk.transforms.WithTimestampsTest >
withTimestampsBackwardsInTimeAndWithAllowedTimestampSkewShouldSucceed FAILED
java.lang.AssertionError at WithTimestampsTest.java:143
org.apache.beam.sdk.transforms.ReshuffleTest > testReshufflePreservesTimestamps
FAILED
java.lang.AssertionError at ReshuffleTest.java:152
org.apache.beam.sdk.transforms.GroupByKeyTest >
org.apache.beam.sdk.transforms.GroupByKeyTest$BasicTests.testLargeKeys100KB
FAILED
java.lang.AssertionError at GroupByKeyTest.java:465
org.apache.beam.sdk.transforms.ReshuffleTest > testJustReshuffle FAILED
java.lang.AssertionError at ReshuffleTest.java:106
org.apache.beam.sdk.transforms.WithTimestampsTest >
withTimestampsLambdaShouldApplyTimestamps FAILED
java.lang.AssertionError at WithTimestampsTest.java:206
org.apache.beam.sdk.transforms.KeysTest > testKeys FAILED
java.lang.AssertionError at KeysTest.java:66
org.apache.beam.runners.core.metrics.MetricsPusherTest > pushesUserMetrics
FAILED
java.lang.NullPointerException at MetricsPusherTest.java:74
org.apache.beam.sdk.transforms.KeysTest > testKeysEmpty FAILED
java.lang.AssertionError at KeysTest.java:79
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-75eac3f2-c465-4355-8135-f29c724a199a
org.apache.beam.runners.core.metrics.MetricsPusherTest > pushesSystemMetrics
FAILED
java.lang.NullPointerException at MetricsPusherTest.java:95
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-7bc5f4e5-b1eb-4b50-b2cd-ed1b38e08ede
org.apache.beam.sdk.transforms.ParDoSchemaTest > testReadAndWrite FAILED
java.lang.AssertionError at ParDoSchemaTest.java:171
org.apache.beam.sdk.transforms.ParDoSchemaTest > testSchemaFieldSelectionNested
FAILED
java.lang.AssertionError at ParDoSchemaTest.java:654
org.apache.beam.sdk.transforms.ParDoSchemaTest >
testSchemaFieldSelectionUnboxing FAILED
java.lang.AssertionError at ParDoSchemaTest.java:563
org.apache.beam.sdk.transforms.ParDoSchemaTest >
testSchemaFieldDescriptorSelectionUnboxing FAILED
java.lang.AssertionError at ParDoSchemaTest.java:604
org.apache.beam.sdk.transforms.ParDoSchemaTest > testInferredSchemaPipeline
FAILED
java.lang.AssertionError at ParDoSchemaTest.java:426
org.apache.beam.sdk.transforms.ParDoSchemaTest > testFieldAccessSchemaPipeline
FAILED
java.lang.AssertionError at ParDoSchemaTest.java:348
org.apache.beam.sdk.transforms.ParDoSchemaTest > testSimpleSchemaPipeline FAILED
java.lang.AssertionError at ParDoSchemaTest.java:117
org.apache.beam.sdk.transforms.ParDoSchemaTest > testSchemaConversionPipeline
FAILED
java.lang.AssertionError at ParDoSchemaTest.java:474
org.apache.beam.sdk.transforms.ParDoSchemaTest >
testReadAndWriteWithSchemaRegistry FAILED
java.lang.AssertionError at ParDoSchemaTest.java:313
org.apache.beam.sdk.transforms.ParDoSchemaTest > testReadAndWriteMultiOutput
FAILED
java.lang.AssertionError at ParDoSchemaTest.java:268
org.apache.beam.sdk.transforms.ParDoSchemaTest > testNestedSchema FAILED
java.lang.AssertionError at ParDoSchemaTest.java:513
org.apache.beam.sdk.transforms.ParDoTest$LifecycleTests >
testWindowingInStartAndFinishBundle FAILED
java.lang.AssertionError at ParDoTest.java:1787
org.apache.beam.sdk.transforms.ParDoTest$LifecycleTests >
testParDoWithErrorInStartBatch FAILED
java.lang.AssertionError at Assert.java:89
org.apache.beam.sdk.transforms.ParDoTest$LifecycleTests >
testParDoWithErrorInProcessElement FAILED
java.lang.AssertionError at Assert.java:89
org.apache.beam.sdk.transforms.ParDoTest$LifecycleTests >
testParDoWithErrorInFinishBatch FAILED
java.lang.AssertionError at Assert.java:89
org.apache.beam.sdk.transforms.ReifyTimestampsTest >
extractFromValuesWhenValueTimestampedLaterSucceeds FAILED
java.lang.AssertionError at ReifyTimestampsTest.java:128
org.apache.beam.sdk.transforms.ReifyTimestampsTest > extractFromValuesSucceeds
FAILED
java.lang.AssertionError at ReifyTimestampsTest.java:92
org.apache.beam.sdk.transforms.ReifyTimestampsTest > inValuesSucceeds FAILED
java.lang.AssertionError at ReifyTimestampsTest.java:60
org.apache.beam.sdk.transforms.join.CoGroupByKeyTest >
testCoGroupByKeyHandleResults FAILED
java.lang.AssertionError at CoGroupByKeyTest.java:466
org.apache.beam.sdk.values.PCollectionTupleTest > testComposePCollectionTuple
FAILED
java.lang.AssertionError at PCollectionTupleTest.java:106
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-3cd7f994-3193-4e93-8302-2a8c832e4509
113 tests completed, 98 failed, 1 skipped
> Task :runners:spark:2:job-server:validatesPortableRunnerStreaming FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task
':runners:spark:2:job-server:validatesPortableRunnerStreaming'.
> There were failing tests. See the report at:
> file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark2_Streaming/ws/src/runners/spark/2/job-server/build/reports/tests/validatesPortableRunnerStreaming/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 33m 41s
88 actionable tasks: 61 executed, 25 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/t7d6oeqiwdv4i
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]