[
https://issues.apache.org/jira/browse/FLINK-34427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18129127#comment-18129127
]
Martijn Visser commented on FLINK-34427:
----------------------------------------
Twenty more since 2026-10-08, on all four branches, every fork log with the
same FATAL right after testSlotAllocationAccordingToStrategyResult:
master
https://github.com/apache/flink/actions/runs/37872448628/job/113637313975 (push
2026-10-09, JDK 17; surefire names ExecutionGraphRestartTest)
https://github.com/apache/flink/actions/runs/38104423523/job/114370263105
(nightly 2026-10-11, Hadoop 3.4.3, JDK 17; FinalizeOnMasterTest)
https://github.com/apache/flink/actions/runs/39088631157/job/117562012469
(nightly 2026-10-18, JDK 21; ExecutionGraphRestartTest)
https://github.com/apache/flink/actions/runs/39129343601/job/117682869643 (push
2026-10-18, JDK 17; ExecutionVertexCancelTest)
release-2.3
https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=80033&view=logs&j=77a9d8e1-d610-59b3-fc2a-4766541e0e33
(nightly 2026-10-11; ExecutionGraphRestartTest)
https://github.com/apache/flink/actions/runs/38195297569/job/114649567804
(nightly 2026-10-12, AdaptiveScheduler; ExecutionVertexCancelTest)
https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=80050&view=logs&j=77a9d8e1-d610-59b3-fc2a-4766541e0e33
(nightly 2026-10-12; ExecutionGraphRestartTest)
https://github.com/apache/flink/actions/runs/38838333241/job/116784494530
(nightly 2026-10-16, Hadoop 3.1.3)
https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=80228&view=logs&j=77a9d8e1-d610-59b3-fc2a-4766541e0e33
(nightly 2026-10-17; DefaultExecutionGraphDeploymentTest)
https://github.com/apache/flink/actions/runs/39356761323/job/118435756201
(nightly 2026-10-20, AdaptiveScheduler; ExecutionGraphRestartTest)
release-2.2
https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=80276&view=logs&j=77a9d8e1-d610-59b3-fc2a-4766541e0e33
(nightly 2026-10-19)
release-1.20
https://github.com/apache/flink/actions/runs/37873516400/job/113648161517
(nightly 2026-10-09, JDK 11; ResourceManagerServiceImplTest)
https://github.com/apache/flink/actions/runs/38016045562/job/114114914584
(nightly 2026-10-10, AdaptiveScheduler; ResourceManagerPartitionLifecycleTest)
https://github.com/apache/flink/actions/runs/38154906771/job/114525563001 (push
2026-10-11; ConnectionUtilsTest)
https://github.com/apache/flink/actions/runs/38735563441/job/116448592953 (push
2026-10-15; ResourceManagerPartitionLifecycleTest)
https://github.com/apache/flink/actions/runs/38838333238/job/116785282569
(nightly 2026-10-16, Hadoop 3.1.3; ConnectionUtilsTest)
https://github.com/apache/flink/actions/runs/38993323373/job/117288521193
(nightly 2026-10-17, Hadoop 3.1.3; ConnectionUtilsTest)
https://github.com/apache/flink/actions/runs/39088629416/job/117569541213
(nightly 2026-10-18, JDK 17; MemoryManagerConcurrentModReleaseTest)
https://github.com/apache/flink/actions/runs/39188312676/job/117870054567
(nightly 2026-10-19, Hadoop 3.1.3; ConnectionUtilsTest)
https://github.com/apache/flink/actions/runs/39356761314/job/118426745894
(nightly 2026-10-20, JDK 11; SSLUtilsTest)
{code}
Test
org.apache.flink.runtime.resourcemanager.slotmanager.FineGrainedSlotManagerTest.testSlotAllocationAccordingToStrategyResult[testSlotAllocationAccordingToStrategyResult()]
successfully run.
03:02:27,445 [ pool-467-thread-1] ERROR
org.apache.flink.util.FatalExitExceptionHandler [] - FATAL: Thread
'pool-467-thread-1' produced an uncaught exception. Stopping the process...
java.util.concurrent.CompletionException:
java.util.concurrent.RejectedExecutionException: Task
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@4c881d46[Not
completed, ...] rejected from
java.util.concurrent.ScheduledThreadPoolExecutor@...[Shutting down, ...]
at
java.base/java.util.concurrent.CompletableFuture.handleAsync(CompletableFuture.java:2276)
at
org.apache.flink.runtime.resourcemanager.slotmanager.DefaultSlotStatusSyncer.allocateSlot(DefaultSlotStatusSyncer.java:138)
at
org.apache.flink.runtime.resourcemanager.slotmanager.FineGrainedSlotManager.allocateSlotsAccordingTo(FineGrainedSlotManager.java:755)
{code}
That is 12 of the 131 runs in the last seven days. release-1.20 hit it in 5 of
its last 7 GitHub nightlies.
> FineGrainedSlotManagerTest fails fatally (exit code 239)
> --------------------------------------------------------
>
> Key: FLINK-34427
> URL: https://issues.apache.org/jira/browse/FLINK-34427
> Project: Flink
> Issue Type: Bug
> Components: Runtime / Coordination
> Affects Versions: 1.19.0, 1.18.1, 2.2.2, 1.20.6, 2.3.1, 2.4.0
> Reporter: Matthias Pohl
> Assignee: Sergey Nuyanzin
> Priority: Critical
> Labels: pull-request-available, test-stability
>
> https://github.com/apache/flink/actions/runs/7866453350/job/21460921911#step:10:8959
> {code}
> Error: 02:28:53 02:28:53.220 [ERROR] Process Exit Code: 239
> Error: 02:28:53 02:28:53.220 [ERROR] Crashed tests:
> Error: 02:28:53 02:28:53.220 [ERROR]
> org.apache.flink.runtime.resourcemanager.ResourceManagerTaskExecutorTest
> Error: 02:28:53 02:28:53.220 [ERROR]
> org.apache.maven.surefire.booter.SurefireBooterForkException:
> ExecutionException The forked VM terminated without properly saying goodbye.
> VM crash or System.exit called?
> Error: 02:28:53 02:28:53.220 [ERROR] Command was /bin/sh -c cd
> '/root/flink/flink-runtime' &&
> '/usr/lib/jvm/java-8-openjdk-amd64/jre/bin/java' '-XX:+UseG1GC' '-Xms256m'
> '-XX:+IgnoreUnrecognizedVMOptions'
> '--add-opens=java.base/java.util=ALL-UNNAMED'
> '--add-opens=java.base/java.lang=ALL-UNNAMED'
> '--add-opens=java.base/java.net=ALL-UNNAMED'
> '--add-opens=java.base/java.io=ALL-UNNAMED'
> '--add-opens=java.base/java.util.concurrent=ALL-UNNAMED' '-Xmx768m' '-jar'
> '/root/flink/flink-runtime/target/surefire/surefirebooter-20240212022332296_94.jar'
> '/root/flink/flink-runtime/target/surefire'
> '2024-02-12T02-21-39_495-jvmRun3' 'surefire-20240212022332296_88tmp'
> 'surefire_26-20240212022332296_91tmp'
> Error: 02:28:53 02:28:53.220 [ERROR] Error occurred in starting fork, check
> output in log
> Error: 02:28:53 02:28:53.220 [ERROR] Process Exit Code: 239
> Error: 02:28:53 02:28:53.220 [ERROR] Crashed tests:
> Error: 02:28:53 02:28:53.221 [ERROR]
> org.apache.flink.runtime.resourcemanager.ResourceManagerTaskExecutorTest
> Error: 02:28:53 02:28:53.221 [ERROR] at
> org.apache.maven.plugin.surefire.booterclient.ForkStarter.awaitResultsDone(ForkStarter.java:456)
> [...]
> {code}
> The fatal error is triggered most likely within the
> {{FineGrainedSlotManagerTest}}:
> {code}
> 02:26:39,362 [ pool-643-thread-1] ERROR
> org.apache.flink.util.FatalExitExceptionHandler [] - FATAL:
> Thread 'pool-643-thread-1' produced an uncaught exception. Stopping the
> process...
> java.util.concurrent.CompletionException:
> java.util.concurrent.RejectedExecutionException: Task
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@4bbc0b10
> rejected from
> java.util.concurrent.ScheduledThreadPoolExecutor@7a45cd9a[Shutting down, pool
> size = 1, active threads = 1, queued tasks = 1, completed tasks = 194]
> at
> java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:273)
> ~[?:1.8.0_392]
> at
> java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:280)
> ~[?:1.8.0_392]
> at
> java.util.concurrent.CompletableFuture.uniHandle(CompletableFuture.java:838)
> ~[?:1.8.0_392]
> at
> java.util.concurrent.CompletableFuture$UniHandle.tryFire(CompletableFuture.java:811)
> ~[?:1.8.0_392]
> at
> java.util.concurrent.CompletableFuture.uniHandleStage(CompletableFuture.java:851)
> ~[?:1.8.0_392]
> at
> java.util.concurrent.CompletableFuture.handleAsync(CompletableFuture.java:2178)
> ~[?:1.8.0_392]
> at
> org.apache.flink.runtime.resourcemanager.slotmanager.DefaultSlotStatusSyncer.allocateSlot(DefaultSlotStatusSyncer.java:138)
> ~[classes/:?]
> at
> org.apache.flink.runtime.resourcemanager.slotmanager.FineGrainedSlotManager.allocateSlotsAccordingTo(FineGrainedSlotManager.java:722)
> ~[classes/:?]
> at
> org.apache.flink.runtime.resourcemanager.slotmanager.FineGrainedSlotManager.checkResourceRequirements(FineGrainedSlotManager.java:645)
> ~[classes/:?]
> at
> org.apache.flink.runtime.resourcemanager.slotmanager.FineGrainedSlotManager.lambda$null$12(FineGrainedSlotManager.java:603)
> ~[classes/:?]
> at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
> [?:1.8.0_392]
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> [?:1.8.0_392]
> at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
> [?:1.8.0_392]
> at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
> [?:1.8.0_392]
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> [?:1.8.0_392]
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> [?:1.8.0_392]
> at java.lang.Thread.run(Thread.java:750) [?:1.8.0_392]
> Caused by: java.util.concurrent.RejectedExecutionException: Task
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@4bbc0b10
> rejected from
> java.util.concurrent.ScheduledThreadPoolExecutor@7a45cd9a[Shutting down, pool
> size = 1, active threads = 1, queued tasks = 1, completed tasks = 194]
> at
> java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063)
> ~[?:1.8.0_392]
> at
> java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830)
> ~[?:1.8.0_392]
> at
> java.util.concurrent.ScheduledThreadPoolExecutor.delayedExecute(ScheduledThreadPoolExecutor.java:326)
> ~[?:1.8.0_392]
> at
> java.util.concurrent.ScheduledThreadPoolExecutor.schedule(ScheduledThreadPoolExecutor.java:533)
> ~[?:1.8.0_392]
> at
> java.util.concurrent.ScheduledThreadPoolExecutor.execute(ScheduledThreadPoolExecutor.java:622)
> ~[?:1.8.0_392]
> at
> java.util.concurrent.Executors$DelegatedExecutorService.execute(Executors.java:668)
> ~[?:1.8.0_392]
> at
> java.util.concurrent.CompletableFuture$UniCompletion.claim(CompletableFuture.java:543)
> ~[?:1.8.0_392]
> at
> java.util.concurrent.CompletableFuture.uniHandle(CompletableFuture.java:826)
> ~[?:1.8.0_392]
> ... 14 more
> {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
