See <https://ci-beam.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Spark/9928/display/redirect?page=changes>
Changes: [noreply] [BEAM-13821] Add automated expansion service start-up to KafkaIO [noreply] [BEAM-13799] Created a Dataproc cluster manager for Interactive Beam [noreply] Merge pull request #16727: [BEAM-11971] remove unsafe Concurrent data ------------------------------------------ [...truncated 125.37 KB...] [dispatcher-BlockManagerMaster] INFO org.apache.spark.storage.BlockManagerInfo - Removed broadcast_20_piece0 on localhost:45139 in memory (size: 14.2 KiB, free: 1458.4 MiB) [dispatcher-event-loop-3] INFO org.apache.spark.MapOutputTrackerMasterEndpoint - MapOutputTrackerMasterEndpoint stopped! [shutdown-hook-0] INFO org.apache.spark.storage.memory.MemoryStore - MemoryStore cleared [shutdown-hook-0] INFO org.apache.spark.storage.BlockManager - BlockManager stopped [shutdown-hook-0] INFO org.apache.spark.storage.BlockManagerMaster - BlockManagerMaster stopped [dispatcher-event-loop-0] INFO org.apache.spark.scheduler.OutputCommitCoordinator$OutputCommitCoordinatorEndpoint - OutputCommitCoordinator stopped! [shutdown-hook-0] INFO org.apache.spark.SparkContext - Successfully stopped SparkContext [shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown hook called [shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting directory /tmp/spark-35e3a245-be34-45d5-8742-db0ebb0c0874 > Task :runners:spark:2:validatesRunnerBatch [shutdown-hook-0] INFO org.apache.spark.SparkContext - Invoking stop() from shutdown hook [dispatcher-event-loop-2] INFO org.apache.spark.MapOutputTrackerMasterEndpoint - MapOutputTrackerMasterEndpoint stopped! [shutdown-hook-0] INFO org.apache.spark.storage.memory.MemoryStore - MemoryStore cleared [shutdown-hook-0] INFO org.apache.spark.storage.BlockManager - BlockManager stopped [shutdown-hook-0] INFO org.apache.spark.storage.BlockManagerMaster - BlockManagerMaster stopped [dispatcher-event-loop-2] INFO org.apache.spark.scheduler.OutputCommitCoordinator$OutputCommitCoordinatorEndpoint - OutputCommitCoordinator stopped! [shutdown-hook-0] INFO org.apache.spark.SparkContext - Successfully stopped SparkContext [shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown hook called [shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting directory /tmp/spark-7b5d5e72-cb78-4298-b3da-cd9e83f0e655 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned accumulator 3103 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned accumulator 3486 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned accumulator 3203 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned accumulator 3362 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned accumulator 3378 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned accumulator 3270 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned accumulator 3484 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned accumulator 3104 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned accumulator 2767 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned accumulator 3253 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned accumulator 3021 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned accumulator 3022 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned accumulator 3251 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned accumulator 3233 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned accumulator 2911 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned accumulator 2424 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned accumulator 2619 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned accumulator 2654 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned accumulator 2535 [dispatcher-event-loop-3] INFO org.apache.spark.storage.BlockManagerInfo - Removed broadcast_138_piece0 on localhost:34549 in memory (size: 4.3 KB, free: 1458.1 MB) [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned accumulator 2755 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned accumulator 2752 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned accumulator 2435 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned accumulator 2855 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned accumulator 3344 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned accumulator 2962 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned accumulator 3339 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned accumulator 2944 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned accumulator 3145 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned accumulator 3359 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned accumulator 2728 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned accumulator 2568 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned accumulator 2576 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned accumulator 2498 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned accumulator 3076 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned accumulator 3047 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned accumulator 2475 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned accumulator 2602 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned accumulator 2967 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned accumulator 2770 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned accumulator 3197 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned accumulator 3149 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned accumulator 2890 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned accumulator 3097 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned accumulator 3433 [dispatcher-event-loop-1] INFO org.apache.spark.storage.BlockManagerInfo - Removed broadcast_131_piece0 on localhost:34549 in memory (size: 7.9 KB, free: 1458.2 MB) [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned accumulator 3215 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned accumulator 3260 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned accumulator 2798 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned accumulator 2280 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned accumulator 3157 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned accumulator 3148 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned accumulator 2917 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned accumulator 2336 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned accumulator 2502 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned accumulator 2795 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned accumulator 3337 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned accumulator 2581 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned accumulator 2869 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned accumulator 3272 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned accumulator 2419 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned accumulator 2616 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned accumulator 3249 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned accumulator 2490 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned accumulator 3243 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned accumulator 3163 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned accumulator 2895 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned accumulator 3018 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned accumulator 2333 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned accumulator 2784 [shutdown-hook-0] INFO org.apache.spark.SparkContext - Invoking stop() from shutdown hook [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned shuffle 39 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned accumulator 3454 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned accumulator 2936 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned accumulator 2976 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned accumulator 3184 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned accumulator 3015 [Spark Context Cleaner] INFO org.apache.spark.ContextCleaner - Cleaned accumulator 2762 [dispatcher-event-loop-0] INFO org.apache.spark.storage.BlockManagerInfo - Removed broadcast_155_piece0 on localhost:34549 in memory (size: 115.0 B, free: 1458.2 MB) [dispatcher-event-loop-2] INFO org.apache.spark.MapOutputTrackerMasterEndpoint - MapOutputTrackerMasterEndpoint stopped! [shutdown-hook-0] INFO org.apache.spark.storage.memory.MemoryStore - MemoryStore cleared [shutdown-hook-0] INFO org.apache.spark.storage.BlockManager - BlockManager stopped [shutdown-hook-0] INFO org.apache.spark.storage.BlockManagerMaster - BlockManagerMaster stopped [dispatcher-event-loop-0] INFO org.apache.spark.scheduler.OutputCommitCoordinator$OutputCommitCoordinatorEndpoint - OutputCommitCoordinator stopped! [shutdown-hook-0] INFO org.apache.spark.SparkContext - Successfully stopped SparkContext [shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown hook called [shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting directory /tmp/spark-21e521ed-b532-476c-9cae-c59859642ec6 > Task :runners:spark:3:validatesRunnerBatch [shutdown-hook-0] INFO org.apache.spark.SparkContext - Invoking stop() from shutdown hook [dispatcher-event-loop-0] INFO org.apache.spark.MapOutputTrackerMasterEndpoint - MapOutputTrackerMasterEndpoint stopped! [shutdown-hook-0] INFO org.apache.spark.storage.memory.MemoryStore - MemoryStore cleared [shutdown-hook-0] INFO org.apache.spark.storage.BlockManager - BlockManager stopped [shutdown-hook-0] INFO org.apache.spark.storage.BlockManagerMaster - BlockManagerMaster stopped [dispatcher-event-loop-3] INFO org.apache.spark.scheduler.OutputCommitCoordinator$OutputCommitCoordinatorEndpoint - OutputCommitCoordinator stopped! [shutdown-hook-0] INFO org.apache.spark.SparkContext - Successfully stopped SparkContext [shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown hook called [shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting directory /tmp/spark-0c39299c-9287-49d7-b61e-8edfb939c5c7 > Task :runners:spark:2:validatesRunnerBatch [shutdown-hook-0] INFO org.apache.spark.SparkContext - Invoking stop() from shutdown hook [dispatcher-event-loop-2] INFO org.apache.spark.MapOutputTrackerMasterEndpoint - MapOutputTrackerMasterEndpoint stopped! [shutdown-hook-0] INFO org.apache.spark.storage.memory.MemoryStore - MemoryStore cleared [shutdown-hook-0] INFO org.apache.spark.storage.BlockManager - BlockManager stopped [shutdown-hook-0] INFO org.apache.spark.storage.BlockManagerMaster - BlockManagerMaster stopped [dispatcher-event-loop-2] INFO org.apache.spark.scheduler.OutputCommitCoordinator$OutputCommitCoordinatorEndpoint - OutputCommitCoordinator stopped! [shutdown-hook-0] INFO org.apache.spark.SparkContext - Successfully stopped SparkContext [shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown hook called [shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting directory /tmp/spark-59a19ae4-463a-440d-8c63-c95437589f1d [shutdown-hook-0] INFO org.apache.spark.SparkContext - Invoking stop() from shutdown hook [dispatcher-event-loop-2] INFO org.apache.spark.MapOutputTrackerMasterEndpoint - MapOutputTrackerMasterEndpoint stopped! [shutdown-hook-0] INFO org.apache.spark.storage.memory.MemoryStore - MemoryStore cleared [shutdown-hook-0] INFO org.apache.spark.storage.BlockManager - BlockManager stopped [shutdown-hook-0] INFO org.apache.spark.storage.BlockManagerMaster - BlockManagerMaster stopped [dispatcher-event-loop-2] INFO org.apache.spark.scheduler.OutputCommitCoordinator$OutputCommitCoordinatorEndpoint - OutputCommitCoordinator stopped! [shutdown-hook-0] INFO org.apache.spark.SparkContext - Successfully stopped SparkContext [shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown hook called [shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting directory /tmp/spark-2b3dca4c-b9f5-4444-9599-e7fd420ecb2b > Task :runners:spark:3:validatesRunnerBatch [shutdown-hook-0] INFO org.apache.spark.SparkContext - Invoking stop() from shutdown hook [dispatcher-event-loop-3] INFO org.apache.spark.MapOutputTrackerMasterEndpoint - MapOutputTrackerMasterEndpoint stopped! [shutdown-hook-0] INFO org.apache.spark.storage.memory.MemoryStore - MemoryStore cleared [shutdown-hook-0] INFO org.apache.spark.storage.BlockManager - BlockManager stopped [shutdown-hook-0] INFO org.apache.spark.storage.BlockManagerMaster - BlockManagerMaster stopped [dispatcher-event-loop-0] INFO org.apache.spark.scheduler.OutputCommitCoordinator$OutputCommitCoordinatorEndpoint - OutputCommitCoordinator stopped! [shutdown-hook-0] INFO org.apache.spark.SparkContext - Successfully stopped SparkContext [shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown hook called [shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting directory /tmp/spark-979d9329-940b-4df4-98f6-a5e8ea4e68ad [shutdown-hook-0] INFO org.apache.spark.SparkContext - Invoking stop() from shutdown hook [dispatcher-event-loop-3] INFO org.apache.spark.MapOutputTrackerMasterEndpoint - MapOutputTrackerMasterEndpoint stopped! [shutdown-hook-0] INFO org.apache.spark.storage.memory.MemoryStore - MemoryStore cleared [shutdown-hook-0] INFO org.apache.spark.storage.BlockManager - BlockManager stopped [shutdown-hook-0] INFO org.apache.spark.storage.BlockManagerMaster - BlockManagerMaster stopped [dispatcher-event-loop-3] INFO org.apache.spark.scheduler.OutputCommitCoordinator$OutputCommitCoordinatorEndpoint - OutputCommitCoordinator stopped! [shutdown-hook-0] INFO org.apache.spark.SparkContext - Successfully stopped SparkContext [shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown hook called [shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting directory /tmp/spark-f6baeb06-9902-41ee-8014-6393fe0a04d0 [shutdown-hook-0] INFO org.apache.spark.SparkContext - Invoking stop() from shutdown hook [dispatcher-event-loop-0] INFO org.apache.spark.MapOutputTrackerMasterEndpoint - MapOutputTrackerMasterEndpoint stopped! [shutdown-hook-0] INFO org.apache.spark.storage.memory.MemoryStore - MemoryStore cleared [shutdown-hook-0] INFO org.apache.spark.storage.BlockManager - BlockManager stopped [shutdown-hook-0] INFO org.apache.spark.storage.BlockManagerMaster - BlockManagerMaster stopped [dispatcher-event-loop-1] INFO org.apache.spark.scheduler.OutputCommitCoordinator$OutputCommitCoordinatorEndpoint - OutputCommitCoordinator stopped! [shutdown-hook-0] INFO org.apache.spark.SparkContext - Successfully stopped SparkContext [shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown hook called [shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting directory /tmp/spark-7858b2b0-4a31-41b3-b67b-387280755031 > Task :runners:spark:2:validatesRunnerBatch [shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown hook called [shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting directory /tmp/spark-8701d6f3-af60-46ee-9dcb-1d57d9ff6bae 277 tests completed, 1 failed, 1 skipped > Task :runners:spark:2:validatesRunnerBatch FAILED > Task :runners:spark:2:validatesRunnerStreaming [shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown hook called [shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting directory /tmp/spark-ee3e07d1-f12a-41e0-9462-1969ab275e45 > Task :runners:spark:3:validatesRunnerBatch [shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown hook called [shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting directory /tmp/spark-944c2bc5-8283-4a2c-a28f-c3c9d0b719eb 277 tests completed, 1 failed, 1 skipped > Task :runners:spark:3:validatesRunnerBatch FAILED > Task :runners:spark:2:validatesRunnerStreaming [shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown hook called [shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting directory /tmp/spark-c536bed7-b7c8-4ea4-837f-6b48cb13581e > Task :runners:spark:3:validatesRunnerStreaming > Task :runners:spark:2:validatesRunnerStreaming [shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown hook called [shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting directory /tmp/spark-b23f3616-8593-4807-b7d0-6dfc120e93da > Task :runners:spark:3:validatesRunnerStreaming [shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown hook called [shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting directory /tmp/spark-4d32fdc9-8bcf-452d-842f-430b6ab3b9c0 [shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown hook called [shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting directory /tmp/spark-d7869ec2-ab9a-4de6-b8e7-94a8156cbe21 > Task :runners:spark:2:validatesRunnerStreaming [shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown hook called [shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting directory /tmp/spark-11368c4c-ace0-41f3-ad98-b7b307dea7f2 > Task :runners:spark:3:validatesRunnerStreaming [shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown hook called [shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting directory /tmp/spark-9b73a3e1-9ca1-4fbb-97a5-759585eb3766 [shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Shutdown hook called [shutdown-hook-0] INFO org.apache.spark.util.ShutdownHookManager - Deleting directory /tmp/spark-ae1620e5-869b-44d1-a262-ebebcec12788 FAILURE: Build completed with 2 failures. 1: Task failed with an exception. ----------- * What went wrong: Execution failed for task ':runners:spark:2:validatesRunnerBatch'. > There were failing tests. See the report at: > file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Spark/ws/src/runners/spark/2/build/reports/tests/validatesRunnerBatch/index.html> * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. > Run with --scan to get full insights. ============================================================================== 2: Task failed with an exception. ----------- * What went wrong: Execution failed for task ':runners:spark:3:validatesRunnerBatch'. > There were failing tests. See the report at: > file://<https://ci-beam.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Spark/ws/src/runners/spark/3/build/reports/tests/validatesRunnerBatch/index.html> * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. > Run with --scan to get full insights. ============================================================================== * Get more help at https://help.gradle.org BUILD FAILED in 15m 27s 144 actionable tasks: 95 executed, 47 from cache, 2 up-to-date Publishing build scan... https://gradle.com/s/qftnkxhwfmn4m Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
