Yun Gao created FLINK-26459: ------------------------------- Summary: Streaming File Sink s3 end-to-end test failed on azure due to not enough resource Key: FLINK-26459 URL: https://issues.apache.org/jira/browse/FLINK-26459 Project: Flink Issue Type: Bug Components: Runtime / Coordination Affects Versions: 1.15.0 Reporter: Yun Gao
[https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=32459&view=logs&j=af184cdd-c6d8-5084-0b69-7e9c67b35f7a&t=160c9ae5-96fd-516e-1c91-deb81f59292a&l=2859] {code:java} Digest: sha256:a61ed0bca213081b64be94c5e1b402ea58bc549f457c2682a86704dd55231e09 Status: Downloaded newer image for stedolan/jq:latest Mar 03 03:44:51 Number of produced values 13161/60000 Mar 03 03:58:11 Test (pid: 119568) did not finish after 900 seconds. {code} This test first tried to kill & restart 1 TM, then kill & restart 2 TM. After them there should still be 4 TM, but from the log it seems only 2 remaining: {code:java} 2022-03-03 03:58:20,707 WARN org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager [] - Could not fulfill resource requirements of job be4a30280fdc43d689d06ec02846e2e6. Free slots: 0 2022-03-03 03:58:20,707 WARN org.apache.flink.runtime.jobmaster.slotpool.DeclarativeSlotPoolBridge [] - Could not acquire the minimum required resources, failing slot requests. Acquired: [ResourceRequirement{resourceProfile=ResourceProfile{cpuCores=1, taskHeapMemory=384.000mb (402653174 bytes), taskOffHeapMemory=0 bytes, managedMemory=512.000mb (536870920 bytes), networkMemory=128.000mb (134217730 bytes)}, numberOfRequiredSlots=2}]. Current slot pool status: Registered TMs: 2, registered slots: 2 free slots: 0 2022-03-03 03:58:20,708 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Sink: Unnamed (2/4) (0c9ff357e74f9a97559152d5de065ae5) switched from SCHEDULED to FAILED on [unassigned resource]. org.apache.flink.runtime.jobmanager.scheduler.NoResourceAvailableException: Could not acquire the minimum required resources. {code} -- This message was sent by Atlassian Jira (v8.20.1#820001)