Strange, and you're saying you only sometimes get this exception? Not reproducibly?
On Wed, 6 Jul 2016 at 12:02 Pawel Szczur <[email protected]> wrote: > I have 8 cores. > Just IDE. > > 2016-07-06 12:00 GMT+02:00 Aljoscha Krettek <[email protected]>: > >> Hi, >> are you running this in an IDE or on an actual cluster? >> >> - >> Aljoscha >> >> On Wed, 6 Jul 2016 at 11:57 Jean-Baptiste Onofré <[email protected]> wrote: >> >>> Hi Pawel, >>> >>> I'm pretty sure that our Flink experts will answer. >>> >>> I'm assuming you are using a single JVM for Flink, right ? >>> I think it could be related to Flink StreamExecutionEnvironment and the >>> number of core on your machine. >>> More your machine has cores, more you should increase the >>> numberOfBuffers. >>> >>> Regards >>> JB >>> >>> On 07/06/2016 11:26 AM, Pawel Szczur wrote: >>> > When running my simple pipeline from time to time I'm getting below >>> > exception: >>> > >>> > Caused by: java.io.IOException: Insufficient number of network buffers: >>> > required 1, but only 0 available. The total number of network buffers >>> is >>> > currently set to 2048. You can increase this number by setting the >>> > configuration key 'taskmanager.network.numberOfBuffers'. >>> > at >>> > org.apache.flink.runtime.io >>> .network.buffer.NetworkBufferPool.createBufferPool(NetworkBufferPool.java:196) >>> > at >>> > org.apache.flink.runtime.io >>> .network.NetworkEnvironment.registerTask(NetworkEnvironment.java:298) >>> > at org.apache.flink.runtime.taskmanager.Task.run(Task.java:469) >>> > at java.lang.Thread.run(Thread.java:745) >>> > >>> > >>> > I'm using trunk of Beam with FlinkRunner. I guess it's well known Flink >>> > problem? Idea how to prevent it? >>> > >>> > Pawel >>> >>> -- >>> Jean-Baptiste Onofré >>> [email protected] >>> http://blog.nanthrax.net >>> Talend - http://www.talend.com >>> >> >
