See
<https://ci-beam.apache.org/job/beam_PostCommit_Java_ValidatesRunner_SparkStructuredStreaming/4040/display/redirect?page=changes>
Changes:
[Kyle Weaver] [BEAM-13751] Don't block on gcloud when attempting to get default
GCP
[Kyle Weaver] [BEAM-13751] Parameterize wait timeout so test doesn't waste 2s.
[Kyle Weaver] [BEAM-13751] Add comment explaining sleep.
[noreply] Merge pull request #16505 from [BEAM-13527] [Playground] Pipeline
------------------------------------------
[...truncated 61.78 KB...]
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-e0509257-b9d3-4ee3-bab8-997ddad0d672
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-d90eccdd-24cf-4d5a-82a7-00a00b0bee7b
> Task :runners:spark:2:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-11d765b0-a98c-4dd4-b8fe-2417ab626989
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-5a3c3687-5c70-4b36-836a-a4cd5e043eb1
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-dbff99e2-701a-4b85-83a7-5adc6efbc900
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-d154a243-241c-4904-9476-407821528ca7
> Task :runners:spark:3:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-f209cb10-00f5-4165-8665-41b4fbed08aa
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-43323945-713b-47ed-8866-4f791bede8bc
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-55550776-703b-47bd-acd5-6406af8018c3
> Task :runners:spark:2:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-437e9bb3-54bd-4298-bf2a-fcfbd98d3a6e
> Task :runners:spark:3:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-2d225c57-3d93-4abf-806f-0b9d9155432b
> Task :runners:spark:2:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-ddcc54ef-6883-4c73-8eff-a07dcbd62173
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-e1b4c4d7-139a-48db-a8f0-9710ec654807
> Task :runners:spark:3:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-20ef0180-2aff-4c56-b925-bb1c823fca68
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-7e438f07-d837-4687-a73b-2cbea485b1d1
> Task :runners:spark:2:validatesStructuredStreamingRunnerBatch
org.apache.beam.sdk.transforms.PerKeyOrderingTest >
testMultipleStatefulOrderingWithShuffle FAILED
java.lang.UnsupportedOperationException at PerKeyOrderingTest.java:280
org.apache.beam.sdk.transforms.PerKeyOrderingTest >
testSingleCallOrderingWithoutShuffle FAILED
java.lang.IllegalStateException at PerKeyOrderingTest.java:193
org.apache.beam.sdk.transforms.PerKeyOrderingTest >
testSingleCallOrderingWithShuffle FAILED
java.lang.IllegalStateException at PerKeyOrderingTest.java:135
org.apache.beam.sdk.transforms.PerKeyOrderingTest >
testMultipleStatefulOrderingWithoutShuffle FAILED
java.lang.UnsupportedOperationException at PerKeyOrderingTest.java:321
[shutdown-hook-0] INFO org.apache.spark.SparkContext - Invoking stop() from
shutdown hook
[dispatcher-event-loop-1] INFO org.apache.spark.MapOutputTrackerMasterEndpoint
- MapOutputTrackerMasterEndpoint stopped!
[shutdown-hook-0] INFO org.apache.spark.storage.memory.MemoryStore -
MemoryStore cleared
[shutdown-hook-0] INFO org.apache.spark.storage.BlockManager - BlockManager
stopped
[shutdown-hook-0] INFO org.apache.spark.storage.BlockManagerMaster -
BlockManagerMaster stopped
[dispatcher-event-loop-2] INFO
org.apache.spark.scheduler.OutputCommitCoordinator$OutputCommitCoordinatorEndpoint
- OutputCommitCoordinator stopped!
[shutdown-hook-0] INFO org.apache.spark.SparkContext - Successfully stopped
SparkContext
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-26a8e4ec-162c-4c27-9e1e-d8016b5570e8
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-854ec6c2-1504-42d0-837c-f430a0fb1044
> Task :runners:spark:3:validatesStructuredStreamingRunnerBatch
org.apache.beam.sdk.transforms.PerKeyOrderingTest >
testMultipleStatefulOrderingWithShuffle FAILED
java.lang.UnsupportedOperationException at PerKeyOrderingTest.java:280
org.apache.beam.sdk.transforms.PerKeyOrderingTest >
testSingleCallOrderingWithoutShuffle FAILED
java.lang.IllegalStateException at PerKeyOrderingTest.java:193
org.apache.beam.sdk.transforms.PerKeyOrderingTest >
testSingleCallOrderingWithShuffle FAILED
java.lang.IllegalStateException at PerKeyOrderingTest.java:135
org.apache.beam.sdk.transforms.PerKeyOrderingTest >
testMultipleStatefulOrderingWithoutShuffle FAILED
java.lang.UnsupportedOperationException at PerKeyOrderingTest.java:321
[shutdown-hook-0] INFO org.apache.spark.SparkContext - Invoking stop() from
shutdown hook
[dispatcher-event-loop-2] INFO org.apache.spark.MapOutputTrackerMasterEndpoint
- MapOutputTrackerMasterEndpoint stopped!
[shutdown-hook-0] INFO org.apache.spark.storage.memory.MemoryStore -
MemoryStore cleared
[shutdown-hook-0] INFO org.apache.spark.storage.BlockManager - BlockManager
stopped
[shutdown-hook-0] INFO org.apache.spark.storage.BlockManagerMaster -
BlockManagerMaster stopped
[dispatcher-event-loop-2] INFO
org.apache.spark.scheduler.OutputCommitCoordinator$OutputCommitCoordinatorEndpoint
- OutputCommitCoordinator stopped!
[shutdown-hook-0] INFO org.apache.spark.SparkContext - Successfully stopped
SparkContext
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-1f274a2f-ca9e-487c-a9e6-7acfd8b21a9b
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-98bafffb-d7aa-4353-9a07-3d154bcfe838
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-3a973ed8-43b2-47cf-84ae-55f7a31a6055
> Task :runners:spark:2:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-c7ae5ff1-97b5-4d55-ae44-f74e400008b9
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-bd9d5fa7-7d23-4faa-ad47-f1a53dec3382
> Task :runners:spark:3:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-b1c7074a-8f89-4072-83b6-d50820161c86
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-22b4e8b3-f825-4449-b9f6-5b5599ea2e7e
> Task :runners:spark:2:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-b81022bc-b41a-45b8-9996-6bbed1ca2659
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-41b47493-6839-4543-b10a-f04e3fbed1e8
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-1588f23e-5bbe-4087-be7a-1e6f4fb100a6
> Task :runners:spark:3:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-acdcda76-369f-4015-8275-1746ec98e3e2
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-80a4fb29-6116-451a-bd31-9671df7c35ee
> Task :runners:spark:2:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-158a01fc-fe75-4963-a25e-ee763428e450
> Task :runners:spark:3:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-a2cbe637-802f-4a89-a6f7-38d402ffa320
> Task :runners:spark:2:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-6a6fedda-e8d3-426d-9783-111baf193442
> Task :runners:spark:3:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-cdfd4d3d-2d98-49a1-acd9-28757611a9d4
> Task :runners:spark:2:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-4b118543-653f-446a-a8d4-48f6c339c310
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-bf669d6e-97e1-4e3d-97f0-f7f9fba5879e
> Task :runners:spark:3:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-cf135892-f6f4-4215-bfd1-a7e31e023592
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-a67d29d5-36b2-49e4-847a-0b3c3beccf23
> Task :runners:spark:2:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-736f19f5-8ee3-455f-a95a-12da7e18c0e2
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-55d314e6-1bda-4564-92c6-1015481a725c
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-364b34fa-7c8b-4e42-baa8-814b3776dd1a
> Task :runners:spark:3:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-a96f0da7-9f8e-40bc-8572-ab0a7f6667d9
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-c4ad87dd-8bdc-4978-8c1b-2089062827df
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-52f105f1-7adf-4e03-a53f-4caa06e251d4
> Task :runners:spark:2:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-e76ea8b4-a134-4b4a-88e8-a20dd648847d
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-305d6531-8a6e-409b-9590-f3bb7b6132e4
> Task :runners:spark:3:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-7c6d4547-c94e-461b-94a4-574019101305
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-34887de4-8199-4ffd-aa01-0bd7d0f4b6b8
> Task :runners:spark:2:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-7e4b255e-aff8-46b6-b1c5-1c9c9ee6f52b
> Task :runners:spark:3:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-591530b9-2c21-43ae-96ab-7b8cbd7d4545
> Task :runners:spark:2:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-0c0845b1-5ad4-4673-9300-845edd66f6c6
> Task :runners:spark:3:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-2d2dd517-b856-49a5-84a8-a2db8b3e32b0
> Task :runners:spark:2:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-edeaff75-a032-42cd-ac1b-c229297a88d6
> Task :runners:spark:3:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-72b3a8df-e94a-4a3e-a3e0-af32d3a6c6ee
> Task :runners:spark:2:validatesStructuredStreamingRunnerBatch
221 tests completed, 4 failed, 1 skipped
> Task :runners:spark:2:validatesStructuredStreamingRunnerBatch FAILED
> Task :runners:spark:3:validatesStructuredStreamingRunnerBatch
221 tests completed, 4 failed, 1 skipped
> Task :runners:spark:3:validatesStructuredStreamingRunnerBatch FAILED
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task
':runners:spark:2:validatesStructuredStreamingRunnerBatch'.
> There were failing tests. See the report at:
> file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_ValidatesRunner_SparkStructuredStreaming/ws/src/runners/spark/2/build/reports/tests/validatesStructuredStreamingRunnerBatch/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task
':runners:spark:3:validatesStructuredStreamingRunnerBatch'.
> There were failing tests. See the report at:
> file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_ValidatesRunner_SparkStructuredStreaming/ws/src/runners/spark/3/build/reports/tests/validatesStructuredStreamingRunnerBatch/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
BUILD FAILED in 16m 7s
142 actionable tasks: 87 executed, 53 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/lhwqm3ancrbz6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
