Hi Pawel,
I'm pretty sure that our Flink experts will answer.
I'm assuming you are using a single JVM for Flink, right ?
I think it could be related to Flink StreamExecutionEnvironment and the
number of core on your machine.
More your machine has cores, more you should increase the numberOfBuffers.
Regards
JB
On 07/06/2016 11:26 AM, Pawel Szczur wrote:
When running my simple pipeline from time to time I'm getting below
exception:
Caused by: java.io.IOException: Insufficient number of network buffers:
required 1, but only 0 available. The total number of network buffers is
currently set to 2048. You can increase this number by setting the
configuration key 'taskmanager.network.numberOfBuffers'.
at
org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.createBufferPool(NetworkBufferPool.java:196)
at
org.apache.flink.runtime.io.network.NetworkEnvironment.registerTask(NetworkEnvironment.java:298)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:469)
at java.lang.Thread.run(Thread.java:745)
I'm using trunk of Beam with FlinkRunner. I guess it's well known Flink
problem? Idea how to prevent it?
Pawel
--
Jean-Baptiste Onofré
[email protected]
http://blog.nanthrax.net
Talend - http://www.talend.com
