See
<https://ci-beam.apache.org/job/beam_PostCommit_Java_ValidatesRunner_SparkStructuredStreaming/3984/display/redirect?page=changes>
Changes:
[daria.malkova] Split builder into several builder for each step of pipeline
execution
[Valentyn Tymofieiev] Provide API to check whether a hint is known.
[Valentyn Tymofieiev] [BEAM-12558] Fix doc typo.
[jrmccluskey] [BEAM-10206] Resolve go vet errors in protox package
[noreply] Merge pull request #16482 from [BEAM-13429][Playground] Add builder
for
[noreply] [BEAM-13590] Fix abc imports from collections (#15850)
[Robert Bradshaw] Remove tab from source.
[noreply] Redirecting cross-language transforms content (#16504)
[noreply] doc tweaks (#16498)
[noreply] [BEAM-12621] - Update Jenkins VMs to modern Ubuntu version (#16457)
------------------------------------------
[...truncated 63.02 KB...]
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-561e9953-f2aa-4ba0-804d-5096d6ecee07
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-ed97210e-80ae-4c9b-bea5-59c9e663a919
> Task :runners:spark:3:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-4caa931f-f40a-49cf-a437-ac6e5081e6ab
> Task :runners:spark:2:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-9cfae828-616c-46b7-a2e0-b287c73dc7fd
> Task :runners:spark:3:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-18ef14f5-bd33-41e8-8c14-73bdcff19efe
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-43ac04e7-1699-40b0-b1db-13e53b691e41
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-7de623df-9c60-4eda-8863-bf1bd0053b07
> Task :runners:spark:2:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-99a9d8d1-9584-4fc1-9cf4-b5f16f423d42
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-0b1e3704-0989-4765-be58-33f5554f1a2e
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-03ee74dd-685d-4eac-bc32-f7bdcbb74fbb
> Task :runners:spark:3:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-411066bc-7354-4ddc-88fb-416aabef14e2
> Task :runners:spark:2:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-52b50813-a23d-4826-87f6-aa216131c88c
> Task :runners:spark:3:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-47183ded-8b4b-4080-ba4f-bef2e4caff52
> Task :runners:spark:2:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-c8b7636c-48dc-4906-9065-928c3259d191
org.apache.beam.sdk.transforms.PerKeyOrderingTest >
testMultipleStatefulOrderingWithShuffle FAILED
java.lang.UnsupportedOperationException at PerKeyOrderingTest.java:280
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-e64d36ba-10bd-4c07-b607-8dc9cbaad317
> Task :runners:spark:3:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-5e70000b-434d-4981-b7ef-e6907d65e6db
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-b70a50d1-1c62-4766-86f3-858837e9a13b
org.apache.beam.sdk.transforms.PerKeyOrderingTest >
testMultipleStatefulOrderingWithShuffle FAILED
java.lang.UnsupportedOperationException at PerKeyOrderingTest.java:280
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-0b5cd902-e22c-473b-8e84-3852b9683241
> Task :runners:spark:2:validatesStructuredStreamingRunnerBatch
org.apache.beam.sdk.transforms.PerKeyOrderingTest >
testSingleCallOrderingWithoutShuffle FAILED
java.lang.IllegalStateException at PerKeyOrderingTest.java:193
org.apache.beam.sdk.transforms.PerKeyOrderingTest >
testSingleCallOrderingWithShuffle FAILED
java.lang.IllegalStateException at PerKeyOrderingTest.java:135
org.apache.beam.sdk.transforms.PerKeyOrderingTest >
testMultipleStatefulOrderingWithoutShuffle FAILED
java.lang.UnsupportedOperationException at PerKeyOrderingTest.java:321
[shutdown-hook-0] INFO org.apache.spark.SparkContext - Invoking stop() from
shutdown hook
[dispatcher-event-loop-3] INFO org.apache.spark.MapOutputTrackerMasterEndpoint
- MapOutputTrackerMasterEndpoint stopped!
[shutdown-hook-0] INFO org.apache.spark.storage.memory.MemoryStore -
MemoryStore cleared
[shutdown-hook-0] INFO org.apache.spark.storage.BlockManager - BlockManager
stopped
[shutdown-hook-0] INFO org.apache.spark.storage.BlockManagerMaster -
BlockManagerMaster stopped
[dispatcher-event-loop-0] INFO
org.apache.spark.scheduler.OutputCommitCoordinator$OutputCommitCoordinatorEndpoint
- OutputCommitCoordinator stopped!
[shutdown-hook-0] INFO org.apache.spark.SparkContext - Successfully stopped
SparkContext
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-db54ddf4-5cbf-48a8-a995-f7b015d4ee42
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-92c5d6d0-d126-41ba-bea8-d5ce70dfcb63
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-fb6c2c13-b5e1-4593-8ee2-ecf9b33177e8
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-c898b248-6dfa-42f9-95b5-5a205e2b2a80
> Task :runners:spark:3:validatesStructuredStreamingRunnerBatch
org.apache.beam.sdk.transforms.PerKeyOrderingTest >
testSingleCallOrderingWithoutShuffle FAILED
java.lang.IllegalStateException at PerKeyOrderingTest.java:193
org.apache.beam.sdk.transforms.PerKeyOrderingTest >
testSingleCallOrderingWithShuffle FAILED
java.lang.IllegalStateException at PerKeyOrderingTest.java:135
org.apache.beam.sdk.transforms.PerKeyOrderingTest >
testMultipleStatefulOrderingWithoutShuffle FAILED
java.lang.UnsupportedOperationException at PerKeyOrderingTest.java:321
[shutdown-hook-0] INFO org.apache.spark.SparkContext - Invoking stop() from
shutdown hook
[dispatcher-event-loop-0] INFO org.apache.spark.MapOutputTrackerMasterEndpoint
- MapOutputTrackerMasterEndpoint stopped!
[shutdown-hook-0] INFO org.apache.spark.storage.memory.MemoryStore -
MemoryStore cleared
[shutdown-hook-0] INFO org.apache.spark.storage.BlockManager - BlockManager
stopped
[shutdown-hook-0] INFO org.apache.spark.storage.BlockManagerMaster -
BlockManagerMaster stopped
[dispatcher-event-loop-0] INFO
org.apache.spark.scheduler.OutputCommitCoordinator$OutputCommitCoordinatorEndpoint
- OutputCommitCoordinator stopped!
[shutdown-hook-0] INFO org.apache.spark.SparkContext - Successfully stopped
SparkContext
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-42eae0e6-189c-4c15-8029-8784716aae3b
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-a18a5f2b-37ec-4022-9b93-5d3167069cd5
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-9136adc4-f55b-48cb-8285-6b8c1eb56619
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-ed4e094e-15d2-4653-b940-1d78fb1110e8
> Task :runners:spark:2:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-f57ed7e1-1863-4c80-9c16-1b9741a02938
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-08d6b16d-e38d-4fd5-8dfb-4b74accb0630
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-d5d940ba-bef1-4ea0-af3b-cf53b1c729c5
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-289c4291-37d4-4c06-ba28-ea9a3a6d0920
> Task :runners:spark:3:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-e1a02e7f-f485-40e5-8666-931e47a4b101
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-f17aab5f-ac96-4344-bc29-8bca36e61541
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-d65428f3-b647-4133-bb14-090efbc38206
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-6270f4b3-47bb-4bbe-b505-506d4841247d
> Task :runners:spark:2:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-1bd532ac-600f-491d-8de1-280b98aba618
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-f9741b1c-bd3f-41b5-9a1a-ef7e79da2810
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-44e36998-4c12-4b2e-9873-dcbc01b66c55
> Task :runners:spark:3:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-a5959ff8-0956-422d-855a-9d670c13167c
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-52b7e313-67c9-4da9-a925-f96b32b7e4d1
> Task :runners:spark:2:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-d0cb0125-63e9-451d-81a7-d45384aba711
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-7c1bbe2c-3c5d-4ea3-bd94-97cf6c8cafc2
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-6be1bef3-91d0-44e4-8c4d-34c37f05a407
> Task :runners:spark:3:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-458d8566-b0e2-4a6d-8e90-4baef9e9029c
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-5e52a635-01c0-4fab-bfb1-db3c9a2ab2ab
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-e7e45ec2-4cac-444f-8a7a-f92e50c33a79
> Task :runners:spark:2:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-93f356a5-fff0-439b-a42b-31c9044530a3
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-5d5c0254-d5b0-405b-89ac-90c448b0e7ca
> Task :runners:spark:3:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-378fd037-978e-4b50-9f00-55c8993ae154
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-d52a2ff2-9f2a-47a4-bd8f-43c04b6bfd1f
> Task :runners:spark:2:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-e51d7aa9-9c4b-4b28-9705-960af7ad13a7
> Task :runners:spark:3:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-5e9c6c9f-4cbd-4b51-8d7e-12b1f1466b7f
> Task :runners:spark:2:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-87501f12-fd06-45c4-b943-0b9d54564b87
> Task :runners:spark:3:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-ebbb6eff-c62d-42a3-a142-0a62e6af8d78
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-65bef637-1bfc-43ac-bb61-0777d301bf35
> Task :runners:spark:2:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-1ca3c146-3f26-4e21-953c-0251a1f6555e
221 tests completed, 4 failed, 1 skipped
> Task :runners:spark:2:validatesStructuredStreamingRunnerBatch FAILED
> Task :runners:spark:3:validatesStructuredStreamingRunnerBatch
221 tests completed, 4 failed, 1 skipped
> Task :runners:spark:3:validatesStructuredStreamingRunnerBatch FAILED
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task
':runners:spark:2:validatesStructuredStreamingRunnerBatch'.
> There were failing tests. See the report at:
> file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_ValidatesRunner_SparkStructuredStreaming/ws/src/runners/spark/2/build/reports/tests/validatesStructuredStreamingRunnerBatch/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task
':runners:spark:3:validatesStructuredStreamingRunnerBatch'.
> There were failing tests. See the report at:
> file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_ValidatesRunner_SparkStructuredStreaming/ws/src/runners/spark/3/build/reports/tests/validatesStructuredStreamingRunnerBatch/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 19m 28s
142 actionable tasks: 96 executed, 44 from cache, 2 up-to-date
Publishing build scan...
https://scans.gradle.com/s/awxos5ac7uinq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
