See
<https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark2_Streaming/1801/display/redirect?page=changes>
Changes:
[egalpin] Moves timestamp skew override to correct place
[egalpin] Adds TestStream to verify window preservation of ElasticsearchIO#write
[egalpin] Removes unnecessary line
[egalpin] Adds validation that ES#Write outputs are in expected windows
[egalpin] Updates window verification test to assert the exact docs in the
window
[egalpin] Uses guava Iterables over shaded avro version
[Robert Bradshaw] Don't try to parse non-flags as retained pipeline options.
[chamikaramj] Enables UnboundedSource wrapped SDF Kafka source by default for
x-lang
[noreply] Merge pull request #22140 from [Playground Task] Sharing any code API
[noreply] RunInference documentation updates. (#22236)
[noreply] Turn pr bot on for remaining common labels (#22257)
------------------------------------------
[...truncated 28.10 KB...]
> Task :runners:java-fn-execution:compileJava FROM-CACHE
> Task :runners:java-fn-execution:classes UP-TO-DATE
> Task :runners:java-fn-execution:jar
> Task :sdks:java:expansion-service:compileJava FROM-CACHE
> Task :sdks:java:expansion-service:classes UP-TO-DATE
> Task :sdks:java:expansion-service:jar
> Task :runners:java-job-service:compileJava FROM-CACHE
> Task :runners:java-job-service:classes UP-TO-DATE
> Task :runners:java-job-service:jar
> Task :sdks:java:io:kafka:compileJava FROM-CACHE
> Task :sdks:java:io:kafka:classes UP-TO-DATE
> Task :runners:core-java:compileTestJava FROM-CACHE
> Task :runners:core-java:testClasses UP-TO-DATE
> Task :sdks:java:io:kafka:jar
> Task :runners:core-construction-java:compileTestJava FROM-CACHE
> Task :runners:core-construction-java:testClasses UP-TO-DATE
> Task :runners:core-java:testJar
> Task :runners:core-construction-java:testJar
> Task :runners:spark:2:compileJava FROM-CACHE
> Task :runners:spark:2:classes
> Task :runners:spark:2:jar
> Task :runners:spark:2:compileTestJava FROM-CACHE
> Task :runners:spark:2:testClasses
> Task :runners:spark:2:testJar
> Task :sdks:java:harness:shadowJar FROM-CACHE
> Task :runners:portability:java:compileJava FROM-CACHE
> Task :runners:portability:java:classes UP-TO-DATE
> Task :runners:portability:java:jar
> Task :runners:portability:java:compileTestJava FROM-CACHE
> Task :runners:portability:java:testClasses UP-TO-DATE
> Task :runners:portability:java:testJar
> Task :runners:spark:2:job-server:validatesPortableRunnerStreaming
org.apache.beam.sdk.transforms.CombineFnsTest > testComposedCombineNullValues
FAILED
java.lang.AssertionError at CombineFnsTest.java:260
org.apache.beam.sdk.PipelineTest > testIdentityTransform FAILED
java.lang.AssertionError at PipelineTest.java:318
org.apache.beam.sdk.metrics.MetricsTest$AttemptedMetricTests >
testAttemptedCounterMetrics FAILED
java.lang.AssertionError at MetricsTest.java:371
org.apache.beam.sdk.transforms.CombineTest$WindowingTests >
testWindowedCombineEmpty FAILED
java.lang.AssertionError at CombineTest.java:1330
org.apache.beam.sdk.testing.PAssertTest > testIsEqualTo FAILED
java.lang.AssertionError at PAssertTest.java:323
org.apache.beam.sdk.PipelineTest > testTupleProjectionTransform FAILED
java.lang.AssertionError at PipelineTest.java:340
org.apache.beam.sdk.transforms.FlattenTest > testFlattenIterablesCollections
FAILED
java.lang.AssertionError at FlattenTest.java:302
org.apache.beam.sdk.transforms.KvSwapTest > testKvSwap FAILED
java.lang.AssertionError at KvSwapTest.java:80
org.apache.beam.sdk.testing.PAssertTest > testEmpty FAILED
java.lang.AssertionError at PAssertTest.java:479
org.apache.beam.sdk.PipelineTest > testMultipleApply FAILED
java.lang.AssertionError at PipelineTest.java:252
org.apache.beam.sdk.transforms.FlattenTest > testFlattenIterablesEmpty FAILED
java.lang.AssertionError at FlattenTest.java:317
org.apache.beam.sdk.transforms.ParDoTest$BasicTests > testParDo FAILED
java.lang.AssertionError at ParDoTest.java:395
org.apache.beam.sdk.testing.PAssertTest >
testPAssertThatListSatisfiesOneMatcher FAILED
java.lang.AssertionError at PAssertTest.java:673
org.apache.beam.sdk.testing.PAssertTest > testPAssertThatFlattened FAILED
java.lang.RuntimeException at PAssertTest.java:634
org.apache.beam.sdk.testing.PAssertTest > testContainsInAnyOrderNotSerializable
FAILED
java.lang.AssertionError at PAssertTest.java:189
org.apache.beam.sdk.transforms.FlattenTest > testFlattenPCollections FAILED
java.lang.AssertionError at FlattenTest.java:97
org.apache.beam.sdk.transforms.CombineTest$BasicTests >
testHotKeyCombiningWithAccumulationMode FAILED
java.lang.AssertionError at CombineTest.java:760
org.apache.beam.sdk.transforms.ParDoTest$LifecycleTests >
testWindowingInStartAndFinishBundle FAILED
java.lang.AssertionError at ParDoTest.java:1791
org.apache.beam.sdk.testing.PAssertTest > testSerializablePredicate FAILED
java.lang.AssertionError at PAssertTest.java:210
org.apache.beam.sdk.transforms.FlattenTest > testFlattenPCollectionsThenParDo
FAILED
java.lang.AssertionError at FlattenTest.java:123
org.apache.beam.sdk.transforms.CreateTest > testCreateEmpty FAILED
java.lang.AssertionError at CreateTest.java:105
org.apache.beam.sdk.transforms.ParDoTest$LifecycleTests >
testParDoWithErrorInStartBatch FAILED
java.lang.AssertionError at Assert.java:89
org.apache.beam.sdk.transforms.FlattenTest >
testFlattenMultiplePCollectionsHavingMultipleConsumers FAILED
java.lang.AssertionError at FlattenTest.java:352
org.apache.beam.sdk.transforms.CreateTest > testCreateWithKVVoidType FAILED
java.lang.AssertionError at CreateTest.java:341
org.apache.beam.sdk.transforms.ParDoTest$LifecycleTests >
testParDoWithErrorInProcessElement FAILED
java.lang.AssertionError at Assert.java:89
org.apache.beam.sdk.testing.PAssertTest > testGlobalWindowContainsInAnyOrder
FAILED
java.lang.AssertionError at PAssertTest.java:433
org.apache.beam.sdk.transforms.FlattenTest >
testFlattenWithDifferentInputAndOutputCoders FAILED
java.lang.AssertionError at FlattenTest.java:374
org.apache.beam.sdk.transforms.FlattenTest > testFlattenIterables FAILED
java.lang.AssertionError at FlattenTest.java:257
org.apache.beam.sdk.transforms.CreateTest > testCreateWithVoidType FAILED
java.lang.AssertionError at CreateTest.java:329
org.apache.beam.sdk.transforms.ReifyTimestampsTest >
extractFromValuesWhenValueTimestampedLaterSucceeds FAILED
java.lang.AssertionError at ReifyTimestampsTest.java:128
org.apache.beam.sdk.transforms.GroupByKeyTest >
org.apache.beam.sdk.transforms.GroupByKeyTest$BasicTests.testLargeKeys1MB FAILED
java.lang.AssertionError at GroupByKeyTest.java:589
org.apache.beam.sdk.transforms.FlattenTest > testFlattenIterablesSets FAILED
java.lang.AssertionError at FlattenTest.java:285
org.apache.beam.sdk.transforms.CreateTest > testCreate FAILED
java.lang.AssertionError at CreateTest.java:94
org.apache.beam.sdk.transforms.ReifyTimestampsTest > extractFromValuesSucceeds
FAILED
java.lang.AssertionError at ReifyTimestampsTest.java:92
org.apache.beam.sdk.transforms.FlattenTest >
testFlattenPCollectionsEmptyThenParDo FAILED
java.lang.AssertionError at FlattenTest.java:229
org.apache.beam.sdk.transforms.WithTimestampsTest >
withTimestampsShouldApplyTimestamps FAILED
java.lang.AssertionError at WithTimestampsTest.java:78
org.apache.beam.sdk.transforms.ReifyTimestampsTest > inValuesSucceeds FAILED
java.lang.AssertionError at ReifyTimestampsTest.java:60
org.apache.beam.sdk.transforms.GroupByKeyTest >
org.apache.beam.sdk.transforms.GroupByKeyTest$BasicTests.testGroupByKeyEmpty
FAILED
java.lang.AssertionError at GroupByKeyTest.java:163
org.apache.beam.sdk.transforms.ImpulseTest > testImpulse FAILED
java.lang.AssertionError at ImpulseTest.java:47
org.apache.beam.sdk.transforms.WithTimestampsTest >
withTimestampsBackwardsInTimeAndWithAllowedTimestampSkewShouldSucceed FAILED
java.lang.AssertionError at WithTimestampsTest.java:143
org.apache.beam.sdk.transforms.join.CoGroupByKeyTest >
testCoGroupByKeyHandleResults FAILED
java.lang.AssertionError at CoGroupByKeyTest.java:466
org.apache.beam.sdk.transforms.ParDoTest$MultipleInputsAndOutputTests >
testParDoWithOnlyTaggedOutput FAILED
java.lang.AssertionError at ParDoTest.java:809
org.apache.beam.sdk.transforms.WithTimestampsTest >
withTimestampsLambdaShouldApplyTimestamps FAILED
java.lang.AssertionError at WithTimestampsTest.java:206
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-e063f17a-9886-4094-8cb9-e851a5aa2f39
org.apache.beam.sdk.values.PCollectionRowTupleTest >
testComposePCollectionRowTuple FAILED
java.lang.AssertionError at PCollectionRowTupleTest.java:104
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-b758253f-c04a-4f52-9bc1-74b91b5ab64d
org.apache.beam.sdk.transforms.GroupByKeyTest >
org.apache.beam.sdk.transforms.GroupByKeyTest$BasicTests.testGroupByKey FAILED
java.lang.AssertionError at GroupByKeyTest.java:146
org.apache.beam.sdk.transforms.ParDoTest$MultipleInputsAndOutputTests >
testMultiOutputChaining FAILED
java.lang.AssertionError at ParDoTest.java:1449
org.apache.beam.sdk.transforms.GroupByKeyTest >
org.apache.beam.sdk.transforms.GroupByKeyTest$BasicTests.testLargeKeys10MB
FAILED
java.lang.AssertionError at GroupByKeyTest.java:595
org.apache.beam.sdk.transforms.ParDoTest$MultipleInputsAndOutputTests >
testParDoWithTaggedOutput FAILED
java.lang.AssertionError at ParDoTest.java:714
org.apache.beam.sdk.transforms.GroupByKeyTest >
org.apache.beam.sdk.transforms.GroupByKeyTest$BasicTests.testGroupByKeyWithBadEqualsHashCode
FAILED
java.lang.AssertionError at GroupByKeyTest.java:571
org.apache.beam.sdk.transforms.ReshuffleTest > testReshuffleAfterFixedWindows
FAILED
java.lang.AssertionError at ReshuffleTest.java:235
org.apache.beam.sdk.transforms.ReshuffleTest > testReshuffleAfterSlidingWindows
FAILED
java.lang.AssertionError at ReshuffleTest.java:255
org.apache.beam.sdk.transforms.ParDoSchemaTest >
testSchemaFieldDescriptorSelectionUnboxing FAILED
java.lang.AssertionError at ParDoSchemaTest.java:605
org.apache.beam.sdk.transforms.ParDoSchemaTest > testFieldAccessSchemaPipeline
FAILED
java.lang.AssertionError at ParDoSchemaTest.java:349
org.apache.beam.sdk.transforms.ParDoSchemaTest > testSimpleSchemaPipeline FAILED
java.lang.AssertionError at ParDoSchemaTest.java:118
org.apache.beam.sdk.transforms.ParDoSchemaTest > testSchemaConversionPipeline
FAILED
java.lang.AssertionError at ParDoSchemaTest.java:475
org.apache.beam.sdk.values.PCollectionTupleTest > testComposePCollectionTuple
FAILED
java.lang.AssertionError at PCollectionTupleTest.java:106
org.apache.beam.sdk.transforms.ParDoSchemaTest > testReadAndWriteMultiOutput
FAILED
java.lang.AssertionError at ParDoSchemaTest.java:269
org.apache.beam.runners.core.metrics.MetricsPusherTest > pushesSystemMetrics
FAILED
java.lang.NullPointerException at MetricsPusherTest.java:95
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-04f48e71-daf2-4d6f-8e21-791661200ec1
org.apache.beam.sdk.transforms.ParDoSchemaTest > testNestedSchema FAILED
java.lang.AssertionError at ParDoSchemaTest.java:514
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-c9d6de01-b590-4ecd-b24d-fc4acbc47fb2
112 tests completed, 59 failed, 1 skipped
> Task :runners:spark:2:job-server:validatesPortableRunnerStreaming FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task
':runners:spark:2:job-server:validatesPortableRunnerStreaming'.
> There were failing tests. See the report at:
> file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_PVR_Spark2_Streaming/ws/src/runners/spark/2/job-server/build/reports/tests/validatesPortableRunnerStreaming/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 23m 57s
91 actionable tasks: 55 executed, 34 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/47tbkbdhxxhjk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
