See
<https://ci-beam.apache.org/job/beam_PostCommit_Java_ValidatesRunner_SparkStructuredStreaming/4028/display/redirect?page=changes>
Changes:
[noreply] [BEAM-13310] remove call to get offset consumer config, which was rep…
------------------------------------------
[...truncated 62.40 KB...]
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-368ffed8-1b38-4990-abab-0b2962688db8
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-3884014c-f400-4ce1-be26-7d47fe8e05c7
> Task :runners:spark:3:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-ad6f22f3-2549-4bf4-9d89-99459f478bf8
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-ad844730-2ac0-4daa-8b33-d7f458a4cc70
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-cc76bccb-8140-4c59-ba03-6c3d11d79d9c
> Task :runners:spark:2:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-73f6ba31-965d-419e-9efa-489447df3f9a
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-9c7cb1e5-0047-4baa-9d1f-2df701701dc1
> Task :runners:spark:3:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-aa79acf2-4e46-40af-adba-cccf0da6fd7c
> Task :runners:spark:2:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-f3c8e974-af92-4474-a3b4-f27cdcfb08b9
> Task :runners:spark:3:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-a332b782-3cb4-488c-a150-3d460de054f9
> Task :runners:spark:2:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-a2f7cc8e-77b2-4eca-bde0-f0b9792607b6
> Task :runners:spark:3:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-3a14c632-46d0-4a33-ad3b-8663ef2a5cc0
> Task :runners:spark:2:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-98d59050-2ce6-49f2-81fd-a32d3ef545ce
org.apache.beam.sdk.transforms.PerKeyOrderingTest >
testMultipleStatefulOrderingWithShuffle FAILED
java.lang.UnsupportedOperationException at PerKeyOrderingTest.java:280
> Task :runners:spark:3:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-1219080c-92c6-4b00-b06f-9cfa37386de4
> Task :runners:spark:2:validatesStructuredStreamingRunnerBatch
org.apache.beam.sdk.transforms.PerKeyOrderingTest >
testSingleCallOrderingWithoutShuffle FAILED
java.lang.IllegalStateException at PerKeyOrderingTest.java:193
org.apache.beam.sdk.transforms.PerKeyOrderingTest >
testSingleCallOrderingWithShuffle FAILED
java.lang.IllegalStateException at PerKeyOrderingTest.java:135
org.apache.beam.sdk.transforms.PerKeyOrderingTest >
testMultipleStatefulOrderingWithoutShuffle FAILED
java.lang.UnsupportedOperationException at PerKeyOrderingTest.java:321
[shutdown-hook-0] INFO org.apache.spark.SparkContext - Invoking stop() from
shutdown hook
[dispatcher-event-loop-3] INFO org.apache.spark.MapOutputTrackerMasterEndpoint
- MapOutputTrackerMasterEndpoint stopped!
[shutdown-hook-0] INFO org.apache.spark.storage.memory.MemoryStore -
MemoryStore cleared
[shutdown-hook-0] INFO org.apache.spark.storage.BlockManager - BlockManager
stopped
[shutdown-hook-0] INFO org.apache.spark.storage.BlockManagerMaster -
BlockManagerMaster stopped
[dispatcher-event-loop-3] INFO
org.apache.spark.scheduler.OutputCommitCoordinator$OutputCommitCoordinatorEndpoint
- OutputCommitCoordinator stopped!
[shutdown-hook-0] INFO org.apache.spark.SparkContext - Successfully stopped
SparkContext
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-0d5d7ae2-948b-4111-b9f7-4981f9f2cf7a
> Task :runners:spark:3:validatesStructuredStreamingRunnerBatch
org.apache.beam.sdk.transforms.PerKeyOrderingTest >
testMultipleStatefulOrderingWithShuffle FAILED
java.lang.UnsupportedOperationException at PerKeyOrderingTest.java:280
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-98fa2cb7-218b-4cb2-8a48-6470b4344ff3
org.apache.beam.sdk.transforms.PerKeyOrderingTest >
testSingleCallOrderingWithoutShuffle FAILED
java.lang.IllegalStateException at PerKeyOrderingTest.java:193
org.apache.beam.sdk.transforms.PerKeyOrderingTest >
testSingleCallOrderingWithShuffle FAILED
java.lang.IllegalStateException at PerKeyOrderingTest.java:135
org.apache.beam.sdk.transforms.PerKeyOrderingTest >
testMultipleStatefulOrderingWithoutShuffle FAILED
java.lang.UnsupportedOperationException at PerKeyOrderingTest.java:321
[shutdown-hook-0] INFO org.apache.spark.SparkContext - Invoking stop() from
shutdown hook
[dispatcher-event-loop-0] INFO org.apache.spark.MapOutputTrackerMasterEndpoint
- MapOutputTrackerMasterEndpoint stopped!
[shutdown-hook-0] INFO org.apache.spark.storage.memory.MemoryStore -
MemoryStore cleared
[shutdown-hook-0] INFO org.apache.spark.storage.BlockManager - BlockManager
stopped
[shutdown-hook-0] INFO org.apache.spark.storage.BlockManagerMaster -
BlockManagerMaster stopped
[dispatcher-event-loop-0] INFO
org.apache.spark.scheduler.OutputCommitCoordinator$OutputCommitCoordinatorEndpoint
- OutputCommitCoordinator stopped!
[shutdown-hook-0] INFO org.apache.spark.SparkContext - Successfully stopped
SparkContext
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-18758a5d-7bb7-44e5-9a0c-28d36cef2e26
> Task :runners:spark:2:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-40318a09-aa30-4ce2-9500-af0815c3d230
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-aea84fac-2bfb-4ab5-a9b1-400ab4fd674f
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-dc1b7219-8ba2-494e-972c-c73032f877a9
> Task :runners:spark:3:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-bf304100-1f12-4cc8-87c8-f8b85fad0c28
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-91873900-8145-42ef-ab45-f6aaca9f144e
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-0cb32bbb-7b0d-4f84-834c-f2bedabd45d4
> Task :runners:spark:2:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-e2bc97b1-4fab-4448-8262-ac02c6a302a7
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-ed5b48af-4061-4b87-812c-473f76fbd199
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-10bde3ef-7780-438c-ab0b-170417d50396
> Task :runners:spark:3:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-b5271b55-622a-49df-a8b1-7c7fd6d3d546
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-30f290c2-08c8-42f7-8c8b-c4e7de47aca6
> Task :runners:spark:2:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-0ad0cb5e-34a6-401b-8337-6cb3ab7753b5
> Task :runners:spark:3:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-6c973783-6a99-445c-861c-6c2bc2d03e46
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-bcbf851a-52ac-41bf-98cd-2cb53761b498
> Task :runners:spark:2:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-dd04ce0c-911a-4f42-9a56-7c7b4ea23fca
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-df502518-8320-49f4-8f5e-c0c0c81c1ce9
> Task :runners:spark:3:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-3072246c-b60a-4b0b-810f-10ca74421ec1
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-2ae85493-01a6-45af-9a85-db15efc9a7c3
> Task :runners:spark:2:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-e129faa5-391c-47a1-89c4-e247fb48f556
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-53dbc284-5175-4eac-bfbb-f0e11adaf7fe
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-3f503cf5-da75-42b8-9593-1a34c0419605
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-2f438d57-d357-44ff-9b0e-caed88d09e05
> Task :runners:spark:3:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-d247fd8d-46f1-4410-a220-b4ef19cf06b9
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-58130a24-84a0-4f63-9139-f85593c75821
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-7b2a25d3-acbe-44fa-939d-9de676a6f71b
> Task :runners:spark:2:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-63811374-7dcc-4f75-8475-3463aaa46765
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-ea4ef7cc-f732-4fda-9bc9-bd9464c81385
> Task :runners:spark:3:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-98b5933a-24d0-43d8-bb12-93d1653ff1e4
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-088031b4-a698-4022-a9e2-fb1f28512e01
> Task :runners:spark:2:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-af996da9-a00a-43b0-bd16-512aa193fa90
> Task :runners:spark:3:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-c96eeb74-f6c3-46ad-af9e-d3e88dd04a1d
> Task :runners:spark:2:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-1417d687-4ca4-4d7d-8226-30a37f759415
> Task :runners:spark:3:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-a9cce468-988f-4507-a94d-5d057c71850d
> Task :runners:spark:2:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-6565c80c-ae90-4cc7-8ba5-965efa0bef77
> Task :runners:spark:3:validatesStructuredStreamingRunnerBatch
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting
directory /tmp/spark-e71fbda7-2801-4231-8e82-723b3561f209
> Task :runners:spark:2:validatesStructuredStreamingRunnerBatch
221 tests completed, 4 failed, 1 skipped
> Task :runners:spark:2:validatesStructuredStreamingRunnerBatch FAILED
> Task :runners:spark:3:validatesStructuredStreamingRunnerBatch
221 tests completed, 4 failed, 1 skipped
> Task :runners:spark:3:validatesStructuredStreamingRunnerBatch FAILED
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task
':runners:spark:2:validatesStructuredStreamingRunnerBatch'.
> There were failing tests. See the report at:
> file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_ValidatesRunner_SparkStructuredStreaming/ws/src/runners/spark/2/build/reports/tests/validatesStructuredStreamingRunnerBatch/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task
':runners:spark:3:validatesStructuredStreamingRunnerBatch'.
> There were failing tests. See the report at:
> file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_ValidatesRunner_SparkStructuredStreaming/ws/src/runners/spark/3/build/reports/tests/validatesStructuredStreamingRunnerBatch/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
BUILD FAILED in 19m 55s
142 actionable tasks: 87 executed, 53 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/t37oqhd4ritag
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
