See
<https://ci-beam.apache.org/job/beam_PostCommit_Java_ValidatesRunner_SparkStructuredStreaming/3980/display/redirect?page=changes>
Changes:
[noreply] [BEAM-13480] Increase pipeline timeout for
[noreply] Stronger typing inference for CoGBK. (#16465)
[noreply] [BEAM-12464] Change ProtoSchemaTranslator beam schema creation to
match
[noreply] Introduce the notion of a JoinIndex for fewer shuffles. (#16101)
[noreply] Merge pull request #16467 from [BEAM-12164]: SpannerIO
[noreply] Merge pull request #16385 from [BEAM-13535] [Playground] add cancel
[noreply] Merge pull request #16485 from [BEAM-13486] [Playground] For unit
tests
------------------------------------------
[...truncated 63.99 KB...]
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-3f00a319-72bd-44f5-85e6-bbb47bcc20c7
> Task :runners:spark:3:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-1cc6f1ab-c450-414d-8f52-bb79dddaa3e3
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-0a688c0a-3735-498d-b006-ba6cf111248c
> Task :runners:spark:2:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-53004762-ec1f-4aaf-bcc1-3e7d8aa03e80
> Task :runners:spark:3:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-3f639c90-ae1e-40b3-a053-349afb4f1b90
> Task :runners:spark:2:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-9a7a0386-75f1-4760-a291-569993904895
> Task :runners:spark:3:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-e6cb66ee-b5c5-4467-9836-869275fb62b6
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-2b6cf7b1-5073-4947-97d5-f8dacedbed51
> Task :runners:spark:2:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-12d50635-e826-4427-ad30-53e7d018896e
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-a80b39c8-9b9c-4cfa-ab2a-deefe2751e5d
org.apache.beam.sdk.transforms.PerKeyOrderingTest >
testMultipleStatefulOrderingWithShuffle FAILED
java.lang.UnsupportedOperationException at PerKeyOrderingTest.java:280
> Task :runners:spark:3:validatesStructuredStreamingRunnerBatch
org.apache.beam.sdk.transforms.PerKeyOrderingTest >
testMultipleStatefulOrderingWithShuffle FAILED
java.lang.UnsupportedOperationException at PerKeyOrderingTest.java:280
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-c36619e7-4d0c-412e-ab08-cf0180f3d72f
org.apache.beam.sdk.transforms.PerKeyOrderingTest >
testSingleCallOrderingWithoutShuffle FAILED
java.lang.IllegalStateException at PerKeyOrderingTest.java:193
org.apache.beam.sdk.transforms.PerKeyOrderingTest >
testSingleCallOrderingWithShuffle FAILED
java.lang.IllegalStateException at PerKeyOrderingTest.java:135
> Task :runners:spark:2:validatesStructuredStreamingRunnerBatch
org.apache.beam.sdk.transforms.PerKeyOrderingTest >
testSingleCallOrderingWithoutShuffle FAILED
java.lang.IllegalStateException at PerKeyOrderingTest.java:193
org.apache.beam.sdk.transforms.PerKeyOrderingTest >
testSingleCallOrderingWithShuffle FAILED
java.lang.IllegalStateException at PerKeyOrderingTest.java:135
org.apache.beam.sdk.transforms.PerKeyOrderingTest >
testMultipleStatefulOrderingWithoutShuffle FAILED
java.lang.UnsupportedOperationException at PerKeyOrderingTest.java:321
[shutdown-hook-0] INFO org.apache.spark.SparkContext - Invoking stop() from
shutdown hook
[dispatcher-event-loop-1] INFO org.apache.spark.MapOutputTrackerMasterEndpoint
- MapOutputTrackerMasterEndpoint stopped!
[shutdown-hook-0] INFO org.apache.spark.storage.memory.MemoryStore -
MemoryStore cleared
[shutdown-hook-0] INFO org.apache.spark.storage.BlockManager - BlockManager
stopped
[shutdown-hook-0] INFO org.apache.spark.storage.BlockManagerMaster -
BlockManagerMaster stopped
[dispatcher-event-loop-2] INFO
org.apache.spark.scheduler.OutputCommitCoordinator$OutputCommitCoordinatorEndpoint
- OutputCommitCoordinator stopped!
[shutdown-hook-0] INFO org.apache.spark.SparkContext - Successfully stopped
SparkContext
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-6ceb964f-917a-4493-9afd-da825da94409
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-a63fe3dd-36e8-4c07-8fe2-fdcac9d0f59b
> Task :runners:spark:3:validatesStructuredStreamingRunnerBatch
org.apache.beam.sdk.transforms.PerKeyOrderingTest >
testMultipleStatefulOrderingWithoutShuffle FAILED
java.lang.UnsupportedOperationException at PerKeyOrderingTest.java:321
[shutdown-hook-0] INFO org.apache.spark.SparkContext - Invoking stop() from
shutdown hook
[dispatcher-event-loop-0] INFO org.apache.spark.MapOutputTrackerMasterEndpoint
- MapOutputTrackerMasterEndpoint stopped!
[shutdown-hook-0] INFO org.apache.spark.storage.memory.MemoryStore -
MemoryStore cleared
[shutdown-hook-0] INFO org.apache.spark.storage.BlockManager - BlockManager
stopped
[shutdown-hook-0] INFO org.apache.spark.storage.BlockManagerMaster -
BlockManagerMaster stopped
[dispatcher-event-loop-0] INFO
org.apache.spark.scheduler.OutputCommitCoordinator$OutputCommitCoordinatorEndpoint
- OutputCommitCoordinator stopped!
[shutdown-hook-0] INFO org.apache.spark.SparkContext - Successfully stopped
SparkContext
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-f9b73934-e6c7-4396-a2ed-c57be181142b
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-34a07da3-b271-4ee6-ba17-e3c51883d8da
> Task :runners:spark:2:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-f3b41124-b9c5-425e-bfb1-03301a67b5f6
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-3af19d03-4428-42e2-bf5b-121ffe7a767c
> Task :runners:spark:3:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-aad84396-299c-49d5-b353-f4aa037f927a
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-0c2d26f6-a455-4e8e-a753-a21943214c18
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-4e405b55-8427-4161-b065-8d87d0806a64
> Task :runners:spark:2:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-16d84a78-6de8-4ba7-9b49-9f3ec8f8f1f2
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-9a7e3b12-cc8c-40fe-b7ff-49c9ccc996da
> Task :runners:spark:3:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-93af40a9-2409-4329-a43b-4aeed0b68f98
> Task :runners:spark:2:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-28bc5d3f-f05a-4995-bb85-614fbf5c4c76
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-b1f65b55-93cd-4546-97ab-90c775a19701
> Task :runners:spark:3:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-9ea04264-3027-4822-bacd-fd83be66331c
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-c3fe3a5e-a15c-44fd-b79d-de215293a785
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-2fd2662a-621a-46cf-96ca-97b3cac9d9aa
> Task :runners:spark:2:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-6d8102d6-6130-49c9-9fa9-580c7550ceff
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-cd50d6ca-0ec0-4c7d-8636-9d927dfd9892
> Task :runners:spark:3:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-57d6dcb9-6ba5-4491-9763-d9efad9935a7
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-76bc5ec9-ebe3-4e0a-8f17-305b68b6dce0
> Task :runners:spark:2:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-9b1cb933-8146-45fc-a388-014b9e389c2c
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-b5059c46-bff5-4730-bdb4-419f0eefcc8e
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-abca1fed-51aa-4007-9ff0-4592d8686408
> Task :runners:spark:3:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-44abca83-78a8-4544-8de7-35c9ef3b80a6
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-b6c9dd75-e353-465a-a69a-4ba7ce1e4f30
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-51ed479c-2871-4bc4-a847-7cb03ed3842b
> Task :runners:spark:2:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-28d643b7-9dd5-4194-9be0-755875cd8b61
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-22e35ec9-1a64-4561-b159-4ab9935b151a
> Task :runners:spark:3:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-29ce5770-495f-4075-8054-264a1d34c118
> Task :runners:spark:2:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-4b01f3ff-1b23-4394-a353-df62b2db0e04
> Task :runners:spark:3:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-9624fd92-6305-42b9-8db4-3ddab1008460
> Task :runners:spark:2:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-cf7c551e-e504-4bc1-b7cf-f4cf42f5792a
> Task :runners:spark:3:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-1a99877f-6022-408c-ad5e-5e5588317c57
> Task :runners:spark:2:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-fbcfa5e3-39dc-4278-b163-312b2884d166
> Task :runners:spark:3:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-54fa1afc-a72e-41a9-bc15-fa08d8bf7305
> Task :runners:spark:2:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-26822ddd-ad84-4b0c-a9cc-56de40790e52
> Task :runners:spark:3:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-22d24d13-7060-4525-b53d-0a410326fb2d
> Task :runners:spark:2:validatesStructuredStreamingRunnerBatch
221 tests completed, 4 failed, 1 skipped
> Task :runners:spark:2:validatesStructuredStreamingRunnerBatch FAILED
> Task :runners:spark:3:validatesStructuredStreamingRunnerBatch
221 tests completed, 4 failed, 1 skipped
> Task :runners:spark:3:validatesStructuredStreamingRunnerBatch FAILED
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task
':runners:spark:2:validatesStructuredStreamingRunnerBatch'.
> There were failing tests. See the report at:
> file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_ValidatesRunner_SparkStructuredStreaming/ws/src/runners/spark/2/build/reports/tests/validatesStructuredStreamingRunnerBatch/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task
':runners:spark:3:validatesStructuredStreamingRunnerBatch'.
> There were failing tests. See the report at:
> file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_ValidatesRunner_SparkStructuredStreaming/ws/src/runners/spark/3/build/reports/tests/validatesStructuredStreamingRunnerBatch/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 32m 33s
142 actionable tasks: 92 executed, 48 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/f64zpmf2u4pi2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
