Robert Metzger created FLINK-1952: ------------------------------------- Summary: Cannot run ConnectedComponents example: Could not allocate a slot on instance Key: FLINK-1952 URL: https://issues.apache.org/jira/browse/FLINK-1952 Project: Flink Issue Type: Bug Components: Scheduler Affects Versions: 0.9 Reporter: Robert Metzger
Steps to reproduce {code} ./bin/yarn-session.sh -n 350 {code} ... wait until they are connected ... {code} Number of connected TaskManagers changed to 266. Slots available: 266 Number of connected TaskManagers changed to 323. Slots available: 323 Number of connected TaskManagers changed to 334. Slots available: 334 Number of connected TaskManagers changed to 343. Slots available: 343 Number of connected TaskManagers changed to 350. Slots available: 350 {code} Start CC {code} ./bin/flink run -p 350 ./examples/flink-java-examples-0.9-SNAPSHOT-ConnectedComponents.jar {code} ---> it runs Run KMeans, let it fail with {code} Failed to deploy the task Map (Map at main(KMeans.java:100)) (1/350) - execution #0 to slot SimpleSlot (2)(2)(0) - 182b7661ca9547a84591de940c47a200 - ALLOCATED/ALIVE: java.io.IOException: Insufficient number of network buffers: required 350, but only 254 available. The total number of network buffers is currently set to 2048. You can increase this number by setting the configuration key 'taskmanager.network.numberOfBuffers'. {code} ... as expected. (I've waited for 10 minutes between the two submissions) Starting CC now will fail: {code} ./bin/flink run -p 350 ./examples/flink-java-examples-0.9-SNAPSHOT-ConnectedComponents.jar {code} Error message(s): {code} Caused by: java.lang.IllegalStateException: Could not schedule consumer vertex IterationHead(WorksetIteration (Unnamed Delta Iteration)) (19/350) at org.apache.flink.runtime.executiongraph.Execution$3.call(Execution.java:479) at org.apache.flink.runtime.executiongraph.Execution$3.call(Execution.java:469) at akka.dispatch.Futures$$anonfun$future$1.apply(Future.scala:94) at scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24) at scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24) at scala.concurrent.impl.ExecutionContextImpl$$anon$3.exec(ExecutionContextImpl.scala:107) ... 4 more Caused by: org.apache.flink.runtime.jobmanager.scheduler.NoResourceAvailableException: Could not allocate a slot on instance 4a6d761cb084c32310ece1f849556faf @ cloud-19 - 1 slots - URL: akka.tcp://flink@130.149.21.23:51400/user/taskmanager, as required by the co-location constraint. at org.apache.flink.runtime.jobmanager.scheduler.Scheduler.scheduleTask(Scheduler.java:247) at org.apache.flink.runtime.jobmanager.scheduler.Scheduler.scheduleImmediately(Scheduler.java:110) at org.apache.flink.runtime.executiongraph.Execution.scheduleForExecution(Execution.java:262) at org.apache.flink.runtime.executiongraph.ExecutionVertex.scheduleForExecution(ExecutionVertex.java:436) at org.apache.flink.runtime.executiongraph.Execution$3.call(Execution.java:475) ... 9 more {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)