See 
<https://ci-beam.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Spark_Java11/1306/display/redirect?page=changes>

Changes:

[Valentyn Tymofieiev] Add a container for Python 3.9.

[Valentyn Tymofieiev] Allow job submission with Python 3.9 on Dataflow runner

[Valentyn Tymofieiev] Add Python 3.9 test suites. Keep Dataflow V1 suites 
unchanged for now.

[Valentyn Tymofieiev] Add py3.9 Github actions suites.

[Valentyn Tymofieiev] Py39 Doc updates.

[Valentyn Tymofieiev] [BEAM-9980] Simplify run_validates_container.sh to avoid 
branching.

[Valentyn Tymofieiev] Update Cython to a new version that has py39 wheels.

[Valentyn Tymofieiev] [BEAM-13845] Fix comparison with potentially incomparable 
default

[Valentyn Tymofieiev] [BEAM-12920] Assume that bare generators types define 
simple generators.

[Valentyn Tymofieiev] Mark Python 3.9 as supported version.

[Valentyn Tymofieiev] [BEAM-13868] Remove gsutil dep from hdfs IT test.

[noreply] [BEAM-13776][Playground] (#16731)

[noreply] [BEAM-13867] Drop NaNs returned by nlargest in flight_delays example

[noreply] Announce Python 3.9 in CHANGES.md (#16802)

[Brian Hulette] Moving to 2.38.0-SNAPSHOT on master branch.

[noreply] [BEAM-11095] Better error handling for iter/reiter/multimap (#16794)


------------------------------------------
[...truncated 81.46 KB...]
[shutdown-hook-0] INFO org.apache.spark.storage.BlockManager - BlockManager 
stopped
[shutdown-hook-0] INFO org.apache.spark.storage.BlockManagerMaster - 
BlockManagerMaster stopped
[dispatcher-event-loop-1] INFO 
org.apache.spark.scheduler.OutputCommitCoordinator$OutputCommitCoordinatorEndpoint
 - OutputCommitCoordinator stopped!
[shutdown-hook-0] INFO org.apache.spark.SparkContext - Successfully stopped 
SparkContext
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown 
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting 
directory /tmp/spark-875d21c0-4f26-47f5-954b-dd378a00c59d
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by org.apache.spark.unsafe.Platform 
(file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.apache.spark/spark-unsafe_2.12/3.1.2/b737592d20b39a2a0624bd8954c77d73d9d35bec/spark-unsafe_2.12-3.1.2.jar)
 to constructor java.nio.DirectByteBuffer(long,int)
WARNING: Please consider reporting this to the maintainers of 
org.apache.spark.unsafe.Platform
WARNING: Use --illegal-access=warn to enable warnings of further illegal 
reflective access operations
WARNING: All illegal access operations will be denied in a future release
[dispatcher-BlockManagerMaster] INFO org.apache.spark.storage.BlockManagerInfo 
- Removed broadcast_9_piece0 on localhost:39205 in memory (size: 11.0 KiB, 
free: 1663.1 MiB)
[shutdown-hook-0] INFO org.apache.spark.SparkContext - Invoking stop() from 
shutdown hook
[dispatcher-event-loop-2] INFO org.apache.spark.MapOutputTrackerMasterEndpoint 
- MapOutputTrackerMasterEndpoint stopped!
[shutdown-hook-0] INFO org.apache.spark.storage.memory.MemoryStore - 
MemoryStore cleared
[shutdown-hook-0] INFO org.apache.spark.storage.BlockManager - BlockManager 
stopped
[shutdown-hook-0] INFO org.apache.spark.storage.BlockManagerMaster - 
BlockManagerMaster stopped
[dispatcher-event-loop-2] INFO 
org.apache.spark.scheduler.OutputCommitCoordinator$OutputCommitCoordinatorEndpoint
 - OutputCommitCoordinator stopped!
[shutdown-hook-0] INFO org.apache.spark.SparkContext - Successfully stopped 
SparkContext
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown 
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting 
directory /tmp/spark-fb9743ed-2a29-4f65-b9e0-d99db76777ae
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by org.apache.spark.unsafe.Platform 
(file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.apache.spark/spark-unsafe_2.12/3.1.2/b737592d20b39a2a0624bd8954c77d73d9d35bec/spark-unsafe_2.12-3.1.2.jar)
 to constructor java.nio.DirectByteBuffer(long,int)
WARNING: Please consider reporting this to the maintainers of 
org.apache.spark.unsafe.Platform
WARNING: Use --illegal-access=warn to enable warnings of further illegal 
reflective access operations
WARNING: All illegal access operations will be denied in a future release
[shutdown-hook-0] INFO org.apache.spark.SparkContext - Invoking stop() from 
shutdown hook
[dispatcher-BlockManagerMaster] INFO org.apache.spark.storage.BlockManagerInfo 
- Removed broadcast_2_piece0 on localhost:44939 in memory (size: 15.0 KiB, 
free: 1662.8 MiB)
[dispatcher-event-loop-3] INFO org.apache.spark.MapOutputTrackerMasterEndpoint 
- MapOutputTrackerMasterEndpoint stopped!
[shutdown-hook-0] INFO org.apache.spark.storage.memory.MemoryStore - 
MemoryStore cleared
[shutdown-hook-0] INFO org.apache.spark.storage.BlockManager - BlockManager 
stopped
[shutdown-hook-0] INFO org.apache.spark.storage.BlockManagerMaster - 
BlockManagerMaster stopped
[dispatcher-event-loop-0] INFO 
org.apache.spark.scheduler.OutputCommitCoordinator$OutputCommitCoordinatorEndpoint
 - OutputCommitCoordinator stopped!
[shutdown-hook-0] INFO org.apache.spark.SparkContext - Successfully stopped 
SparkContext
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown 
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting 
directory /tmp/spark-0cf24739-830b-4ad0-a711-3985ce78599d
[shutdown-hook-0] INFO org.apache.spark.SparkContext - Invoking stop() from 
shutdown hook
[dispatcher-event-loop-2] INFO org.apache.spark.MapOutputTrackerMasterEndpoint 
- MapOutputTrackerMasterEndpoint stopped!
[shutdown-hook-0] INFO org.apache.spark.storage.memory.MemoryStore - 
MemoryStore cleared
[shutdown-hook-0] INFO org.apache.spark.storage.BlockManager - BlockManager 
stopped
[shutdown-hook-0] INFO org.apache.spark.storage.BlockManagerMaster - 
BlockManagerMaster stopped
[dispatcher-event-loop-2] INFO 
org.apache.spark.scheduler.OutputCommitCoordinator$OutputCommitCoordinatorEndpoint
 - OutputCommitCoordinator stopped!
[shutdown-hook-0] INFO org.apache.spark.SparkContext - Successfully stopped 
SparkContext
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown 
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting 
directory /tmp/spark-622992ed-d925-45bf-8586-e29653f6fb05
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by org.apache.spark.unsafe.Platform 
(file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.apache.spark/spark-unsafe_2.12/3.1.2/b737592d20b39a2a0624bd8954c77d73d9d35bec/spark-unsafe_2.12-3.1.2.jar)
 to constructor java.nio.DirectByteBuffer(long,int)
WARNING: Please consider reporting this to the maintainers of 
org.apache.spark.unsafe.Platform
WARNING: Use --illegal-access=warn to enable warnings of further illegal 
reflective access operations
WARNING: All illegal access operations will be denied in a future release
[shutdown-hook-0] INFO org.apache.spark.SparkContext - Invoking stop() from 
shutdown hook
[dispatcher-event-loop-1] INFO org.apache.spark.MapOutputTrackerMasterEndpoint 
- MapOutputTrackerMasterEndpoint stopped!
[shutdown-hook-0] INFO org.apache.spark.storage.memory.MemoryStore - 
MemoryStore cleared
[shutdown-hook-0] INFO org.apache.spark.storage.BlockManager - BlockManager 
stopped
[shutdown-hook-0] INFO org.apache.spark.storage.BlockManagerMaster - 
BlockManagerMaster stopped
[dispatcher-event-loop-1] INFO 
org.apache.spark.scheduler.OutputCommitCoordinator$OutputCommitCoordinatorEndpoint
 - OutputCommitCoordinator stopped!
[shutdown-hook-0] INFO org.apache.spark.SparkContext - Successfully stopped 
SparkContext
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown 
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting 
directory /tmp/spark-49413d88-a15e-4265-8c39-89ba1fd1712a
[shutdown-hook-0] INFO org.apache.spark.SparkContext - Invoking stop() from 
shutdown hook
[dispatcher-event-loop-3] INFO org.apache.spark.MapOutputTrackerMasterEndpoint 
- MapOutputTrackerMasterEndpoint stopped!
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by org.apache.spark.unsafe.Platform 
(file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.apache.spark/spark-unsafe_2.12/3.1.2/b737592d20b39a2a0624bd8954c77d73d9d35bec/spark-unsafe_2.12-3.1.2.jar)
 to constructor java.nio.DirectByteBuffer(long,int)
WARNING: Please consider reporting this to the maintainers of 
org.apache.spark.unsafe.Platform
WARNING: Use --illegal-access=warn to enable warnings of further illegal 
reflective access operations
WARNING: All illegal access operations will be denied in a future release
[shutdown-hook-0] INFO org.apache.spark.storage.memory.MemoryStore - 
MemoryStore cleared
[shutdown-hook-0] INFO org.apache.spark.storage.BlockManager - BlockManager 
stopped
[shutdown-hook-0] INFO org.apache.spark.storage.BlockManagerMaster - 
BlockManagerMaster stopped
[dispatcher-event-loop-3] INFO 
org.apache.spark.scheduler.OutputCommitCoordinator$OutputCommitCoordinatorEndpoint
 - OutputCommitCoordinator stopped!
[shutdown-hook-0] INFO org.apache.spark.SparkContext - Successfully stopped 
SparkContext
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown 
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting 
directory /tmp/spark-bc9c9935-638a-43a9-aebf-4e4fdeed2edf
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by org.apache.spark.unsafe.Platform 
(file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.apache.spark/spark-unsafe_2.12/3.1.2/b737592d20b39a2a0624bd8954c77d73d9d35bec/spark-unsafe_2.12-3.1.2.jar)
 to constructor java.nio.DirectByteBuffer(long,int)
WARNING: Please consider reporting this to the maintainers of 
org.apache.spark.unsafe.Platform
WARNING: Use --illegal-access=warn to enable warnings of further illegal 
reflective access operations
WARNING: All illegal access operations will be denied in a future release
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by org.apache.spark.unsafe.Platform 
(file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.apache.spark/spark-unsafe_2.12/3.1.2/b737592d20b39a2a0624bd8954c77d73d9d35bec/spark-unsafe_2.12-3.1.2.jar)
 to constructor java.nio.DirectByteBuffer(long,int)
WARNING: Please consider reporting this to the maintainers of 
org.apache.spark.unsafe.Platform
WARNING: Use --illegal-access=warn to enable warnings of further illegal 
reflective access operations
WARNING: All illegal access operations will be denied in a future release
[shutdown-hook-0] INFO org.apache.spark.SparkContext - Invoking stop() from 
shutdown hook
[dispatcher-event-loop-1] INFO org.apache.spark.MapOutputTrackerMasterEndpoint 
- MapOutputTrackerMasterEndpoint stopped!
[shutdown-hook-0] INFO org.apache.spark.storage.memory.MemoryStore - 
MemoryStore cleared
[shutdown-hook-0] INFO org.apache.spark.storage.BlockManager - BlockManager 
stopped
[shutdown-hook-0] INFO org.apache.spark.storage.BlockManagerMaster - 
BlockManagerMaster stopped
[dispatcher-event-loop-1] INFO 
org.apache.spark.scheduler.OutputCommitCoordinator$OutputCommitCoordinatorEndpoint
 - OutputCommitCoordinator stopped!
[shutdown-hook-0] INFO org.apache.spark.SparkContext - Successfully stopped 
SparkContext
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown 
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting 
directory /tmp/spark-8fdb5b36-063c-4a12-be3f-69e0940e2360
[shutdown-hook-0] INFO org.apache.spark.SparkContext - Invoking stop() from 
shutdown hook
[dispatcher-event-loop-1] INFO org.apache.spark.MapOutputTrackerMasterEndpoint 
- MapOutputTrackerMasterEndpoint stopped!
[shutdown-hook-0] INFO org.apache.spark.storage.memory.MemoryStore - 
MemoryStore cleared
[shutdown-hook-0] INFO org.apache.spark.storage.BlockManager - BlockManager 
stopped
[shutdown-hook-0] INFO org.apache.spark.storage.BlockManagerMaster - 
BlockManagerMaster stopped
[dispatcher-event-loop-1] INFO 
org.apache.spark.scheduler.OutputCommitCoordinator$OutputCommitCoordinatorEndpoint
 - OutputCommitCoordinator stopped!
[shutdown-hook-0] INFO org.apache.spark.SparkContext - Successfully stopped 
SparkContext
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown 
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting 
directory /tmp/spark-df8462f9-fc2b-48a0-8ef8-d8712639216f
[shutdown-hook-0] INFO org.apache.spark.SparkContext - Invoking stop() from 
shutdown hook
[dispatcher-event-loop-2] INFO org.apache.spark.MapOutputTrackerMasterEndpoint 
- MapOutputTrackerMasterEndpoint stopped!
[shutdown-hook-0] INFO org.apache.spark.storage.memory.MemoryStore - 
MemoryStore cleared
[shutdown-hook-0] INFO org.apache.spark.storage.BlockManager - BlockManager 
stopped
[shutdown-hook-0] INFO org.apache.spark.storage.BlockManagerMaster - 
BlockManagerMaster stopped
[dispatcher-event-loop-0] INFO 
org.apache.spark.scheduler.OutputCommitCoordinator$OutputCommitCoordinatorEndpoint
 - OutputCommitCoordinator stopped!
[shutdown-hook-0] INFO org.apache.spark.SparkContext - Successfully stopped 
SparkContext
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown 
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting 
directory /tmp/spark-4a4db7d7-50cd-4758-8d6c-ec6c1923a142
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by org.apache.spark.unsafe.Platform 
(file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.apache.spark/spark-unsafe_2.12/3.1.2/b737592d20b39a2a0624bd8954c77d73d9d35bec/spark-unsafe_2.12-3.1.2.jar)
 to constructor java.nio.DirectByteBuffer(long,int)
WARNING: Please consider reporting this to the maintainers of 
org.apache.spark.unsafe.Platform
WARNING: Use --illegal-access=warn to enable warnings of further illegal 
reflective access operations
WARNING: All illegal access operations will be denied in a future release
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by org.apache.spark.unsafe.Platform 
(file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.apache.spark/spark-unsafe_2.12/3.1.2/b737592d20b39a2a0624bd8954c77d73d9d35bec/spark-unsafe_2.12-3.1.2.jar)
 to constructor java.nio.DirectByteBuffer(long,int)
WARNING: Please consider reporting this to the maintainers of 
org.apache.spark.unsafe.Platform
WARNING: Use --illegal-access=warn to enable warnings of further illegal 
reflective access operations
WARNING: All illegal access operations will be denied in a future release
[shutdown-hook-0] INFO org.apache.spark.SparkContext - Invoking stop() from 
shutdown hook
[dispatcher-event-loop-3] INFO org.apache.spark.MapOutputTrackerMasterEndpoint 
- MapOutputTrackerMasterEndpoint stopped!
[shutdown-hook-0] INFO org.apache.spark.storage.memory.MemoryStore - 
MemoryStore cleared
[shutdown-hook-0] INFO org.apache.spark.storage.BlockManager - BlockManager 
stopped
[shutdown-hook-0] INFO org.apache.spark.storage.BlockManagerMaster - 
BlockManagerMaster stopped
[dispatcher-event-loop-1] INFO 
org.apache.spark.scheduler.OutputCommitCoordinator$OutputCommitCoordinatorEndpoint
 - OutputCommitCoordinator stopped!
[shutdown-hook-0] INFO org.apache.spark.SparkContext - Successfully stopped 
SparkContext
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown 
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting 
directory /tmp/spark-6d3f8c5d-8fb7-4415-936b-876d9291a50b
[shutdown-hook-0] INFO org.apache.spark.SparkContext - Invoking stop() from 
shutdown hook
[dispatcher-event-loop-2] INFO org.apache.spark.MapOutputTrackerMasterEndpoint 
- MapOutputTrackerMasterEndpoint stopped!
[shutdown-hook-0] INFO org.apache.spark.storage.memory.MemoryStore - 
MemoryStore cleared
[shutdown-hook-0] INFO org.apache.spark.storage.BlockManager - BlockManager 
stopped
[shutdown-hook-0] INFO org.apache.spark.storage.BlockManagerMaster - 
BlockManagerMaster stopped
[dispatcher-event-loop-2] INFO 
org.apache.spark.scheduler.OutputCommitCoordinator$OutputCommitCoordinatorEndpoint
 - OutputCommitCoordinator stopped!
[shutdown-hook-0] INFO org.apache.spark.SparkContext - Successfully stopped 
SparkContext
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown 
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting 
directory /tmp/spark-3168912b-85fb-4b29-b8a6-275089154301
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by org.apache.spark.unsafe.Platform 
(file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.apache.spark/spark-unsafe_2.12/3.1.2/b737592d20b39a2a0624bd8954c77d73d9d35bec/spark-unsafe_2.12-3.1.2.jar)
 to constructor java.nio.DirectByteBuffer(long,int)
WARNING: Please consider reporting this to the maintainers of 
org.apache.spark.unsafe.Platform
WARNING: Use --illegal-access=warn to enable warnings of further illegal 
reflective access operations
WARNING: All illegal access operations will be denied in a future release
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by org.apache.spark.unsafe.Platform 
(file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.apache.spark/spark-unsafe_2.12/3.1.2/b737592d20b39a2a0624bd8954c77d73d9d35bec/spark-unsafe_2.12-3.1.2.jar)
 to constructor java.nio.DirectByteBuffer(long,int)
WARNING: Please consider reporting this to the maintainers of 
org.apache.spark.unsafe.Platform
WARNING: Use --illegal-access=warn to enable warnings of further illegal 
reflective access operations
WARNING: All illegal access operations will be denied in a future release
[shutdown-hook-0] INFO org.apache.spark.SparkContext - Invoking stop() from 
shutdown hook
[dispatcher-event-loop-2] INFO org.apache.spark.MapOutputTrackerMasterEndpoint 
- MapOutputTrackerMasterEndpoint stopped!
[shutdown-hook-0] INFO org.apache.spark.storage.memory.MemoryStore - 
MemoryStore cleared
[shutdown-hook-0] INFO org.apache.spark.storage.BlockManager - BlockManager 
stopped
[shutdown-hook-0] INFO org.apache.spark.storage.BlockManagerMaster - 
BlockManagerMaster stopped
[dispatcher-event-loop-2] INFO 
org.apache.spark.scheduler.OutputCommitCoordinator$OutputCommitCoordinatorEndpoint
 - OutputCommitCoordinator stopped!
[shutdown-hook-0] INFO org.apache.spark.SparkContext - Successfully stopped 
SparkContext
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown 
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting 
directory /tmp/spark-58f4226b-4344-4470-a6b7-4345f3ccddcd
[shutdown-hook-0] INFO org.apache.spark.SparkContext - Invoking stop() from 
shutdown hook
[dispatcher-event-loop-3] INFO org.apache.spark.MapOutputTrackerMasterEndpoint 
- MapOutputTrackerMasterEndpoint stopped!
[shutdown-hook-0] INFO org.apache.spark.storage.memory.MemoryStore - 
MemoryStore cleared
[shutdown-hook-0] INFO org.apache.spark.storage.BlockManager - BlockManager 
stopped
[shutdown-hook-0] INFO org.apache.spark.storage.BlockManagerMaster - 
BlockManagerMaster stopped
[dispatcher-event-loop-3] INFO 
org.apache.spark.scheduler.OutputCommitCoordinator$OutputCommitCoordinatorEndpoint
 - OutputCommitCoordinator stopped!
[shutdown-hook-0] INFO org.apache.spark.SparkContext - Successfully stopped 
SparkContext
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown 
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting 
directory /tmp/spark-7206aebd-ee47-4b6d-8a02-8f0cfb74f261
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by org.apache.spark.unsafe.Platform 
(file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.apache.spark/spark-unsafe_2.12/3.1.2/b737592d20b39a2a0624bd8954c77d73d9d35bec/spark-unsafe_2.12-3.1.2.jar)
 to constructor java.nio.DirectByteBuffer(long,int)
WARNING: Please consider reporting this to the maintainers of 
org.apache.spark.unsafe.Platform
WARNING: Use --illegal-access=warn to enable warnings of further illegal 
reflective access operations
WARNING: All illegal access operations will be denied in a future release
[shutdown-hook-0] INFO org.apache.spark.SparkContext - Invoking stop() from 
shutdown hook
[dispatcher-event-loop-3] INFO org.apache.spark.MapOutputTrackerMasterEndpoint 
- MapOutputTrackerMasterEndpoint stopped!
[shutdown-hook-0] INFO org.apache.spark.storage.memory.MemoryStore - 
MemoryStore cleared
[shutdown-hook-0] INFO org.apache.spark.storage.BlockManager - BlockManager 
stopped
[shutdown-hook-0] INFO org.apache.spark.storage.BlockManagerMaster - 
BlockManagerMaster stopped
[dispatcher-event-loop-3] INFO 
org.apache.spark.scheduler.OutputCommitCoordinator$OutputCommitCoordinatorEndpoint
 - OutputCommitCoordinator stopped!
[shutdown-hook-0] INFO org.apache.spark.SparkContext - Successfully stopped 
SparkContext
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown 
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting 
directory /tmp/spark-692221a5-69c0-4955-a7e6-60fbb9c174ac
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by org.apache.spark.unsafe.Platform 
(file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.apache.spark/spark-unsafe_2.12/3.1.2/b737592d20b39a2a0624bd8954c77d73d9d35bec/spark-unsafe_2.12-3.1.2.jar)
 to constructor java.nio.DirectByteBuffer(long,int)
WARNING: Please consider reporting this to the maintainers of 
org.apache.spark.unsafe.Platform
WARNING: Use --illegal-access=warn to enable warnings of further illegal 
reflective access operations
WARNING: All illegal access operations will be denied in a future release
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown 
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting 
directory /tmp/spark-08636784-c3b3-4d55-a3c4-d15971222b99

277 tests completed, 1 failed, 1 skipped

> Task :runners:spark:3:validatesRunnerBatch FAILED

> Task :runners:spark:3:validatesRunnerStreaming
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by org.apache.spark.unsafe.Platform 
(file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.apache.spark/spark-unsafe_2.12/3.1.2/b737592d20b39a2a0624bd8954c77d73d9d35bec/spark-unsafe_2.12-3.1.2.jar)
 to constructor java.nio.DirectByteBuffer(long,int)
WARNING: Please consider reporting this to the maintainers of 
org.apache.spark.unsafe.Platform
WARNING: Use --illegal-access=warn to enable warnings of further illegal 
reflective access operations
WARNING: All illegal access operations will be denied in a future release
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by org.apache.spark.unsafe.Platform 
(file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.apache.spark/spark-unsafe_2.12/3.1.2/b737592d20b39a2a0624bd8954c77d73d9d35bec/spark-unsafe_2.12-3.1.2.jar)
 to constructor java.nio.DirectByteBuffer(long,int)
WARNING: Please consider reporting this to the maintainers of 
org.apache.spark.unsafe.Platform
WARNING: Use --illegal-access=warn to enable warnings of further illegal 
reflective access operations
WARNING: All illegal access operations will be denied in a future release
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by org.apache.spark.unsafe.Platform 
(file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.apache.spark/spark-unsafe_2.12/3.1.2/b737592d20b39a2a0624bd8954c77d73d9d35bec/spark-unsafe_2.12-3.1.2.jar)
 to constructor java.nio.DirectByteBuffer(long,int)
WARNING: Please consider reporting this to the maintainers of 
org.apache.spark.unsafe.Platform
WARNING: Use --illegal-access=warn to enable warnings of further illegal 
reflective access operations
WARNING: All illegal access operations will be denied in a future release
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown 
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting 
directory /tmp/spark-0dcd0ac9-d663-47f8-8fb5-f441797a86ba
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown 
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting 
directory /tmp/spark-563db799-0486-4189-b5be-c0863a9477ea
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by org.apache.spark.unsafe.Platform 
(file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.apache.spark/spark-unsafe_2.12/3.1.2/b737592d20b39a2a0624bd8954c77d73d9d35bec/spark-unsafe_2.12-3.1.2.jar)
 to constructor java.nio.DirectByteBuffer(long,int)
WARNING: Please consider reporting this to the maintainers of 
org.apache.spark.unsafe.Platform
WARNING: Use --illegal-access=warn to enable warnings of further illegal 
reflective access operations
WARNING: All illegal access operations will be denied in a future release
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown 
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting 
directory /tmp/spark-e33ebb04-8fe4-4fd1-a255-29b1af7b9d91
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown 
hook called
[shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting 
directory /tmp/spark-f043b7af-6a1f-4ea3-96b4-5e02ca54ae8c

FAILURE: Build failed with an exception.

* What went wrong:
Execution failed for task ':runners:spark:3:validatesRunnerBatch'.
> There were failing tests. See the report at: 
> file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Spark_Java11/ws/src/runners/spark/3/build/reports/tests/validatesRunnerBatch/index.html>

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with 
Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings 
and determine if they come from your own scripts or plugins.

See 
https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 10m 49s
12 actionable tasks: 4 executed, 2 from cache, 6 up-to-date

Publishing build scan...
https://gradle.com/s/ehc3gtnfomuf4

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to