See 
<https://ci-beam.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Spark_Java11/1109/display/redirect?page=changes>

Changes:

[rsl4] [BEAM-13397] Bump numpy to 1.21 for M1 chip

[rsl4] re-generate requirements.txt

[Kyle Weaver] [BEAM-13498] Sickbay portable Flink testProcessElementSkew.

[noreply] Update flink cluster to use a supported dataproc version (1.2 -> 1.5)

[noreply] [BEAM-13499] Add warning about hcatalog to release notes and javadoc

[noreply] [BEAM-13430] Remove propdeps and replace with compileOnly (#16308)

[noreply] Merge pull request #16304 from [BEAM-13491] [Playground] Examples'

[noreply] Merge pull request #16283 from [BEAM-13448] [Playground] track run 
code

[noreply] Merge pull request #16244 from [BEAM-13463] [Playground] add retries 
to

[noreply] Merge pull request #16241 from [BEAM-13440] [Playground] Implement

[noreply] [BEAM-13399] Add integration test for Go SDK expansion service JAR

[noreply] [BEAM-13421] Fix bug with xs called with non-tuple key (#16258)


------------------------------------------
[...truncated 79.73 KB...]
[dispatcher-event-loop-2] INFO 
org.apache.spark.scheduler.OutputCommitCoordinator$OutputCommitCoordinatorEndpoint
 - OutputCommitCoordinator stopped!
[shutdown-hook-0] INFO org.apache.spark.SparkContext - Successfully stopped 
SparkContext
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown 
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting 
directory /tmp/spark-40a33651-6af1-46cd-ae88-adccc1e64e09
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by org.apache.spark.unsafe.Platform 
(file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.apache.spark/spark-unsafe_2.12/3.1.2/b737592d20b39a2a0624bd8954c77d73d9d35bec/spark-unsafe_2.12-3.1.2.jar)
 to constructor java.nio.DirectByteBuffer(long,int)
WARNING: Please consider reporting this to the maintainers of 
org.apache.spark.unsafe.Platform
WARNING: Use --illegal-access=warn to enable warnings of further illegal 
reflective access operations
WARNING: All illegal access operations will be denied in a future release
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by org.apache.spark.unsafe.Platform 
(file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.apache.spark/spark-unsafe_2.12/3.1.2/b737592d20b39a2a0624bd8954c77d73d9d35bec/spark-unsafe_2.12-3.1.2.jar)
 to constructor java.nio.DirectByteBuffer(long,int)
WARNING: Please consider reporting this to the maintainers of 
org.apache.spark.unsafe.Platform
WARNING: Use --illegal-access=warn to enable warnings of further illegal 
reflective access operations
WARNING: All illegal access operations will be denied in a future release
[shutdown-hook-0] INFO org.apache.spark.SparkContext - Invoking stop() from 
shutdown hook
[dispatcher-event-loop-2] INFO org.apache.spark.MapOutputTrackerMasterEndpoint 
- MapOutputTrackerMasterEndpoint stopped!
[shutdown-hook-0] INFO org.apache.spark.storage.memory.MemoryStore - 
MemoryStore cleared
[shutdown-hook-0] INFO org.apache.spark.storage.BlockManager - BlockManager 
stopped
[shutdown-hook-0] INFO org.apache.spark.storage.BlockManagerMaster - 
BlockManagerMaster stopped
[dispatcher-event-loop-1] INFO 
org.apache.spark.scheduler.OutputCommitCoordinator$OutputCommitCoordinatorEndpoint
 - OutputCommitCoordinator stopped!
[shutdown-hook-0] INFO org.apache.spark.SparkContext - Successfully stopped 
SparkContext
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown 
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting 
directory /tmp/spark-56d107d1-b0ac-41fe-b1c3-bcd2d59880f5
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by org.apache.spark.unsafe.Platform 
(file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.apache.spark/spark-unsafe_2.12/3.1.2/b737592d20b39a2a0624bd8954c77d73d9d35bec/spark-unsafe_2.12-3.1.2.jar)
 to constructor java.nio.DirectByteBuffer(long,int)
WARNING: Please consider reporting this to the maintainers of 
org.apache.spark.unsafe.Platform
WARNING: Use --illegal-access=warn to enable warnings of further illegal 
reflective access operations
WARNING: All illegal access operations will be denied in a future release
[shutdown-hook-0] INFO org.apache.spark.SparkContext - Invoking stop() from 
shutdown hook
[dispatcher-event-loop-2] INFO org.apache.spark.MapOutputTrackerMasterEndpoint 
- MapOutputTrackerMasterEndpoint stopped!
[shutdown-hook-0] INFO org.apache.spark.storage.memory.MemoryStore - 
MemoryStore cleared
[shutdown-hook-0] INFO org.apache.spark.storage.BlockManager - BlockManager 
stopped
[shutdown-hook-0] INFO org.apache.spark.storage.BlockManagerMaster - 
BlockManagerMaster stopped
[dispatcher-event-loop-2] INFO 
org.apache.spark.scheduler.OutputCommitCoordinator$OutputCommitCoordinatorEndpoint
 - OutputCommitCoordinator stopped!
[shutdown-hook-0] INFO org.apache.spark.SparkContext - Successfully stopped 
SparkContext
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown 
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting 
directory /tmp/spark-0bd38b88-a8ea-469c-830a-b4506641556f

[task-result-getter-2] INFO org.apache.spark.scheduler.TaskSetManager - 
Finished task 0.0 in stage 15.0 (TID 63) in 170 ms on localhost (executor 
driver) (2/4)
[task-result-getter-2] INFO org.apache.spark.scheduler.TaskSchedulerImpl - 
Removed TaskSet 15.0, whose tasks have all completed, from pool 
[task-result-getter-3] INFO org.apache.spark.scheduler.TaskSetManager - Lost 
task 1.0 in stage 15.0 (TID 61) on localhost, executor driver: 
org.apache.beam.sdk.util.UserCodeException (java.lang.Exception: Hasn't yet 
thrown) [duplicate 1]
[task-result-getter-3] INFO org.apache.spark.scheduler.TaskSchedulerImpl - 
Removed TaskSet 15.0, whose tasks have all completed, from pool 

> Task :runners:spark:3:validatesRunnerBatch
[dispatcher-BlockManagerMaster] INFO org.apache.spark.storage.BlockManagerInfo 
- Removed broadcast_4_piece0 on localhost:37665 in memory (size: 9.3 KiB, free: 
1663.1 MiB)
[shutdown-hook-0] INFO org.apache.spark.SparkContext - Invoking stop() from 
shutdown hook
[dispatcher-event-loop-0] INFO org.apache.spark.MapOutputTrackerMasterEndpoint 
- MapOutputTrackerMasterEndpoint stopped!
[shutdown-hook-0] INFO org.apache.spark.storage.memory.MemoryStore - 
MemoryStore cleared
[shutdown-hook-0] INFO org.apache.spark.storage.BlockManager - BlockManager 
stopped
[shutdown-hook-0] INFO org.apache.spark.storage.BlockManagerMaster - 
BlockManagerMaster stopped
[dispatcher-event-loop-0] INFO 
org.apache.spark.scheduler.OutputCommitCoordinator$OutputCommitCoordinatorEndpoint
 - OutputCommitCoordinator stopped!
[shutdown-hook-0] INFO org.apache.spark.SparkContext - Successfully stopped 
SparkContext
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown 
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting 
directory /tmp/spark-6f93562a-2436-43b7-b5d9-31ac8664d009
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by org.apache.spark.unsafe.Platform 
(file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.apache.spark/spark-unsafe_2.12/3.1.2/b737592d20b39a2a0624bd8954c77d73d9d35bec/spark-unsafe_2.12-3.1.2.jar)
 to constructor java.nio.DirectByteBuffer(long,int)
WARNING: Please consider reporting this to the maintainers of 
org.apache.spark.unsafe.Platform
WARNING: Use --illegal-access=warn to enable warnings of further illegal 
reflective access operations
WARNING: All illegal access operations will be denied in a future release
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by org.apache.spark.unsafe.Platform 
(file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.apache.spark/spark-unsafe_2.12/3.1.2/b737592d20b39a2a0624bd8954c77d73d9d35bec/spark-unsafe_2.12-3.1.2.jar)
 to constructor java.nio.DirectByteBuffer(long,int)
WARNING: Please consider reporting this to the maintainers of 
org.apache.spark.unsafe.Platform
WARNING: Use --illegal-access=warn to enable warnings of further illegal 
reflective access operations
WARNING: All illegal access operations will be denied in a future release
[shutdown-hook-0] INFO org.apache.spark.SparkContext - Invoking stop() from 
shutdown hook
[dispatcher-event-loop-3] INFO org.apache.spark.MapOutputTrackerMasterEndpoint 
- MapOutputTrackerMasterEndpoint stopped!
[shutdown-hook-0] INFO org.apache.spark.storage.memory.MemoryStore - 
MemoryStore cleared
[shutdown-hook-0] INFO org.apache.spark.storage.BlockManager - BlockManager 
stopped
[shutdown-hook-0] INFO org.apache.spark.storage.BlockManagerMaster - 
BlockManagerMaster stopped
[dispatcher-event-loop-0] INFO 
org.apache.spark.scheduler.OutputCommitCoordinator$OutputCommitCoordinatorEndpoint
 - OutputCommitCoordinator stopped!
[shutdown-hook-0] INFO org.apache.spark.SparkContext - Successfully stopped 
SparkContext
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown 
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting 
directory /tmp/spark-a51db6f9-cd3e-4ffa-b1ae-14267901edab
[shutdown-hook-0] INFO org.apache.spark.SparkContext - Invoking stop() from 
shutdown hook
[dispatcher-BlockManagerMaster] INFO org.apache.spark.storage.BlockManagerInfo 
- Removed broadcast_0_piece0 on localhost:33215 in memory (size: 9.8 KiB, free: 
1663.1 MiB)
[dispatcher-event-loop-1] INFO org.apache.spark.MapOutputTrackerMasterEndpoint 
- MapOutputTrackerMasterEndpoint stopped!
[shutdown-hook-0] INFO org.apache.spark.storage.memory.MemoryStore - 
MemoryStore cleared
[shutdown-hook-0] INFO org.apache.spark.storage.BlockManager - BlockManager 
stopped
[shutdown-hook-0] INFO org.apache.spark.storage.BlockManagerMaster - 
BlockManagerMaster stopped
[dispatcher-event-loop-1] INFO 
org.apache.spark.scheduler.OutputCommitCoordinator$OutputCommitCoordinatorEndpoint
 - OutputCommitCoordinator stopped!
[shutdown-hook-0] INFO org.apache.spark.SparkContext - Successfully stopped 
SparkContext
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown 
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting 
directory /tmp/spark-bd016b45-d39d-421d-af17-84d427017eaf
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by org.apache.spark.unsafe.Platform 
(file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.apache.spark/spark-unsafe_2.12/3.1.2/b737592d20b39a2a0624bd8954c77d73d9d35bec/spark-unsafe_2.12-3.1.2.jar)
 to constructor java.nio.DirectByteBuffer(long,int)
WARNING: Please consider reporting this to the maintainers of 
org.apache.spark.unsafe.Platform
WARNING: Use --illegal-access=warn to enable warnings of further illegal 
reflective access operations
WARNING: All illegal access operations will be denied in a future release
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by org.apache.spark.unsafe.Platform 
(file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.apache.spark/spark-unsafe_2.12/3.1.2/b737592d20b39a2a0624bd8954c77d73d9d35bec/spark-unsafe_2.12-3.1.2.jar)
 to constructor java.nio.DirectByteBuffer(long,int)
WARNING: Please consider reporting this to the maintainers of 
org.apache.spark.unsafe.Platform
WARNING: Use --illegal-access=warn to enable warnings of further illegal 
reflective access operations
WARNING: All illegal access operations will be denied in a future release
[task-result-getter-0] INFO org.apache.spark.scheduler.TaskSetManager - Lost 
task 0.0 in stage 5.0 (TID 17) on localhost, executor driver: 
org.apache.beam.sdk.util.UserCodeException (java.lang.RuntimeException: test 
error in finalize) [duplicate 2]
[task-result-getter-0] INFO org.apache.spark.scheduler.TaskSchedulerImpl - 
Removed TaskSet 5.0, whose tasks have all completed, from pool 
[shutdown-hook-0] INFO org.apache.spark.SparkContext - Invoking stop() from 
shutdown hook
[dispatcher-event-loop-0] INFO org.apache.spark.MapOutputTrackerMasterEndpoint 
- MapOutputTrackerMasterEndpoint stopped!
[shutdown-hook-0] INFO org.apache.spark.storage.memory.MemoryStore - 
MemoryStore cleared
[shutdown-hook-0] INFO org.apache.spark.storage.BlockManager - BlockManager 
stopped
[shutdown-hook-0] INFO org.apache.spark.storage.BlockManagerMaster - 
BlockManagerMaster stopped
[dispatcher-event-loop-0] INFO 
org.apache.spark.scheduler.OutputCommitCoordinator$OutputCommitCoordinatorEndpoint
 - OutputCommitCoordinator stopped!
[shutdown-hook-0] INFO org.apache.spark.SparkContext - Successfully stopped 
SparkContext
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown 
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting 
directory /tmp/spark-a745596a-1ac1-4968-a3a9-2df3837e83d6
[shutdown-hook-0] INFO org.apache.spark.SparkContext - Invoking stop() from 
shutdown hook
[dispatcher-event-loop-0] INFO org.apache.spark.MapOutputTrackerMasterEndpoint 
- MapOutputTrackerMasterEndpoint stopped!
[shutdown-hook-0] INFO org.apache.spark.storage.memory.MemoryStore - 
MemoryStore cleared
[shutdown-hook-0] INFO org.apache.spark.storage.BlockManager - BlockManager 
stopped
[shutdown-hook-0] INFO org.apache.spark.storage.BlockManagerMaster - 
BlockManagerMaster stopped
[dispatcher-event-loop-0] INFO 
org.apache.spark.scheduler.OutputCommitCoordinator$OutputCommitCoordinatorEndpoint
 - OutputCommitCoordinator stopped!
[shutdown-hook-0] INFO org.apache.spark.SparkContext - Successfully stopped 
SparkContext
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown 
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting 
directory /tmp/spark-0367613a-b3fe-4b74-9c9f-db5fdcb8f073
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by org.apache.spark.unsafe.Platform 
(file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.apache.spark/spark-unsafe_2.12/3.1.2/b737592d20b39a2a0624bd8954c77d73d9d35bec/spark-unsafe_2.12-3.1.2.jar)
 to constructor java.nio.DirectByteBuffer(long,int)
WARNING: Please consider reporting this to the maintainers of 
org.apache.spark.unsafe.Platform
WARNING: Use --illegal-access=warn to enable warnings of further illegal 
reflective access operations
WARNING: All illegal access operations will be denied in a future release
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by org.apache.spark.unsafe.Platform 
(file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.apache.spark/spark-unsafe_2.12/3.1.2/b737592d20b39a2a0624bd8954c77d73d9d35bec/spark-unsafe_2.12-3.1.2.jar)
 to constructor java.nio.DirectByteBuffer(long,int)
WARNING: Please consider reporting this to the maintainers of 
org.apache.spark.unsafe.Platform
WARNING: Use --illegal-access=warn to enable warnings of further illegal 
reflective access operations
WARNING: All illegal access operations will be denied in a future release
[shutdown-hook-0] INFO org.apache.spark.SparkContext - Invoking stop() from 
shutdown hook
[dispatcher-event-loop-1] INFO org.apache.spark.MapOutputTrackerMasterEndpoint 
- MapOutputTrackerMasterEndpoint stopped!
[shutdown-hook-0] INFO org.apache.spark.storage.memory.MemoryStore - 
MemoryStore cleared
[shutdown-hook-0] INFO org.apache.spark.storage.BlockManager - BlockManager 
stopped
[shutdown-hook-0] INFO org.apache.spark.storage.BlockManagerMaster - 
BlockManagerMaster stopped
[dispatcher-event-loop-1] INFO 
org.apache.spark.scheduler.OutputCommitCoordinator$OutputCommitCoordinatorEndpoint
 - OutputCommitCoordinator stopped!
[shutdown-hook-0] INFO org.apache.spark.SparkContext - Successfully stopped 
SparkContext
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown 
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting 
directory /tmp/spark-150e81d7-65ed-468a-a9a8-a06fdf0aec8c
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by org.apache.spark.unsafe.Platform 
(file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.apache.spark/spark-unsafe_2.12/3.1.2/b737592d20b39a2a0624bd8954c77d73d9d35bec/spark-unsafe_2.12-3.1.2.jar)
 to constructor java.nio.DirectByteBuffer(long,int)
WARNING: Please consider reporting this to the maintainers of 
org.apache.spark.unsafe.Platform
WARNING: Use --illegal-access=warn to enable warnings of further illegal 
reflective access operations
WARNING: All illegal access operations will be denied in a future release
[shutdown-hook-0] INFO org.apache.spark.SparkContext - Invoking stop() from 
shutdown hook
[dispatcher-event-loop-2] INFO org.apache.spark.MapOutputTrackerMasterEndpoint 
- MapOutputTrackerMasterEndpoint stopped!
[shutdown-hook-0] INFO org.apache.spark.storage.memory.MemoryStore - 
MemoryStore cleared
[shutdown-hook-0] INFO org.apache.spark.storage.BlockManager - BlockManager 
stopped
[shutdown-hook-0] INFO org.apache.spark.storage.BlockManagerMaster - 
BlockManagerMaster stopped
[dispatcher-event-loop-0] INFO 
org.apache.spark.scheduler.OutputCommitCoordinator$OutputCommitCoordinatorEndpoint
 - OutputCommitCoordinator stopped!
[shutdown-hook-0] INFO org.apache.spark.SparkContext - Successfully stopped 
SparkContext
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown 
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting 
directory /tmp/spark-65310f4a-d7de-4d75-8db4-2473558cda5a
[shutdown-hook-0] INFO org.apache.spark.SparkContext - Invoking stop() from 
shutdown hook
[dispatcher-event-loop-3] INFO org.apache.spark.MapOutputTrackerMasterEndpoint 
- MapOutputTrackerMasterEndpoint stopped!
[shutdown-hook-0] INFO org.apache.spark.storage.memory.MemoryStore - 
MemoryStore cleared
[shutdown-hook-0] INFO org.apache.spark.storage.BlockManager - BlockManager 
stopped
[shutdown-hook-0] INFO org.apache.spark.storage.BlockManagerMaster - 
BlockManagerMaster stopped
[dispatcher-event-loop-3] INFO 
org.apache.spark.scheduler.OutputCommitCoordinator$OutputCommitCoordinatorEndpoint
 - OutputCommitCoordinator stopped!
[shutdown-hook-0] INFO org.apache.spark.SparkContext - Successfully stopped 
SparkContext
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown 
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting 
directory /tmp/spark-1f7d7ade-25e9-48ca-919a-e4b746f4c624
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by org.apache.spark.unsafe.Platform 
(file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.apache.spark/spark-unsafe_2.12/3.1.2/b737592d20b39a2a0624bd8954c77d73d9d35bec/spark-unsafe_2.12-3.1.2.jar)
 to constructor java.nio.DirectByteBuffer(long,int)
WARNING: Please consider reporting this to the maintainers of 
org.apache.spark.unsafe.Platform
WARNING: Use --illegal-access=warn to enable warnings of further illegal 
reflective access operations
WARNING: All illegal access operations will be denied in a future release
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by org.apache.spark.unsafe.Platform 
(file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.apache.spark/spark-unsafe_2.12/3.1.2/b737592d20b39a2a0624bd8954c77d73d9d35bec/spark-unsafe_2.12-3.1.2.jar)
 to constructor java.nio.DirectByteBuffer(long,int)
WARNING: Please consider reporting this to the maintainers of 
org.apache.spark.unsafe.Platform
WARNING: Use --illegal-access=warn to enable warnings of further illegal 
reflective access operations
WARNING: All illegal access operations will be denied in a future release
[shutdown-hook-0] INFO org.apache.spark.SparkContext - Invoking stop() from 
shutdown hook
[dispatcher-event-loop-2] INFO org.apache.spark.MapOutputTrackerMasterEndpoint 
- MapOutputTrackerMasterEndpoint stopped!
[shutdown-hook-0] INFO org.apache.spark.storage.memory.MemoryStore - 
MemoryStore cleared
[shutdown-hook-0] INFO org.apache.spark.storage.BlockManager - BlockManager 
stopped
[shutdown-hook-0] INFO org.apache.spark.storage.BlockManagerMaster - 
BlockManagerMaster stopped
[dispatcher-event-loop-2] INFO 
org.apache.spark.scheduler.OutputCommitCoordinator$OutputCommitCoordinatorEndpoint
 - OutputCommitCoordinator stopped!
[shutdown-hook-0] INFO org.apache.spark.SparkContext - Successfully stopped 
SparkContext
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown 
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting 
directory /tmp/spark-cc7cefc5-6f13-4e16-ac53-3ade940451a9
[dispatcher-BlockManagerMaster] INFO org.apache.spark.storage.BlockManagerInfo 
- Removed broadcast_22_piece0 on localhost:34265 in memory (size: 14.1 KiB, 
free: 1663.0 MiB)
[shutdown-hook-0] INFO org.apache.spark.SparkContext - Invoking stop() from 
shutdown hook
[dispatcher-event-loop-2] INFO org.apache.spark.MapOutputTrackerMasterEndpoint 
- MapOutputTrackerMasterEndpoint stopped!
[shutdown-hook-0] INFO org.apache.spark.storage.memory.MemoryStore - 
MemoryStore cleared
[shutdown-hook-0] INFO org.apache.spark.storage.BlockManager - BlockManager 
stopped
[shutdown-hook-0] INFO org.apache.spark.storage.BlockManagerMaster - 
BlockManagerMaster stopped
[dispatcher-event-loop-2] INFO 
org.apache.spark.scheduler.OutputCommitCoordinator$OutputCommitCoordinatorEndpoint
 - OutputCommitCoordinator stopped!
[shutdown-hook-0] INFO org.apache.spark.SparkContext - Successfully stopped 
SparkContext
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown 
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting 
directory /tmp/spark-d196c040-c94e-4b3e-9a0e-2f0dade31b57
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by org.apache.spark.unsafe.Platform 
(file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.apache.spark/spark-unsafe_2.12/3.1.2/b737592d20b39a2a0624bd8954c77d73d9d35bec/spark-unsafe_2.12-3.1.2.jar)
 to constructor java.nio.DirectByteBuffer(long,int)
WARNING: Please consider reporting this to the maintainers of 
org.apache.spark.unsafe.Platform
WARNING: Use --illegal-access=warn to enable warnings of further illegal 
reflective access operations
WARNING: All illegal access operations will be denied in a future release
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown 
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting 
directory /tmp/spark-fc250cb5-1393-4d3d-b75f-af2b4414ed2f

281 tests completed, 3 failed, 1 skipped

> Task :runners:spark:3:validatesRunnerBatch FAILED

> Task :runners:spark:3:validatesRunnerStreaming
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by org.apache.spark.unsafe.Platform 
(file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.apache.spark/spark-unsafe_2.12/3.1.2/b737592d20b39a2a0624bd8954c77d73d9d35bec/spark-unsafe_2.12-3.1.2.jar)
 to constructor java.nio.DirectByteBuffer(long,int)
WARNING: Please consider reporting this to the maintainers of 
org.apache.spark.unsafe.Platform
WARNING: Use --illegal-access=warn to enable warnings of further illegal 
reflective access operations
WARNING: All illegal access operations will be denied in a future release
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by org.apache.spark.unsafe.Platform 
(file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.apache.spark/spark-unsafe_2.12/3.1.2/b737592d20b39a2a0624bd8954c77d73d9d35bec/spark-unsafe_2.12-3.1.2.jar)
 to constructor java.nio.DirectByteBuffer(long,int)
WARNING: Please consider reporting this to the maintainers of 
org.apache.spark.unsafe.Platform
WARNING: Use --illegal-access=warn to enable warnings of further illegal 
reflective access operations
WARNING: All illegal access operations will be denied in a future release
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by org.apache.spark.unsafe.Platform 
(file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.apache.spark/spark-unsafe_2.12/3.1.2/b737592d20b39a2a0624bd8954c77d73d9d35bec/spark-unsafe_2.12-3.1.2.jar)
 to constructor java.nio.DirectByteBuffer(long,int)
WARNING: Please consider reporting this to the maintainers of 
org.apache.spark.unsafe.Platform
WARNING: Use --illegal-access=warn to enable warnings of further illegal 
reflective access operations
WARNING: All illegal access operations will be denied in a future release
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown 
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting 
directory /tmp/spark-5f03ee25-bfdd-4ce3-a34d-97d5be940d2f
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown 
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting 
directory /tmp/spark-20283e4e-cb4f-4a50-9375-ccbcb35f1fad
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown 
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting 
directory /tmp/spark-b26646f7-28ed-424a-bf0d-5e196a54bf4b
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by org.apache.spark.unsafe.Platform 
(file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.apache.spark/spark-unsafe_2.12/3.1.2/b737592d20b39a2a0624bd8954c77d73d9d35bec/spark-unsafe_2.12-3.1.2.jar)
 to constructor java.nio.DirectByteBuffer(long,int)
WARNING: Please consider reporting this to the maintainers of 
org.apache.spark.unsafe.Platform
WARNING: Use --illegal-access=warn to enable warnings of further illegal 
reflective access operations
WARNING: All illegal access operations will be denied in a future release
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown 
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting 
directory /tmp/spark-d42779ee-212c-41c6-8d26-bf2db3213a6c

FAILURE: Build failed with an exception.

* What went wrong:
Execution failed for task ':runners:spark:3:validatesRunnerBatch'.
> There were failing tests. See the report at: 
> file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Spark_Java11/ws/src/runners/spark/3/build/reports/tests/validatesRunnerBatch/index.html>

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug 
option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with 
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See 
https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 22m 43s
2 actionable tasks: 2 executed

Publishing build scan...
https://gradle.com/s/7qwimqakqsutg

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to