I have 8 cores. Just IDE. 2016-07-06 12:00 GMT+02:00 Aljoscha Krettek <[email protected]>:
> Hi, > are you running this in an IDE or on an actual cluster? > > - > Aljoscha > > On Wed, 6 Jul 2016 at 11:57 Jean-Baptiste Onofré <[email protected]> wrote: > >> Hi Pawel, >> >> I'm pretty sure that our Flink experts will answer. >> >> I'm assuming you are using a single JVM for Flink, right ? >> I think it could be related to Flink StreamExecutionEnvironment and the >> number of core on your machine. >> More your machine has cores, more you should increase the numberOfBuffers. >> >> Regards >> JB >> >> On 07/06/2016 11:26 AM, Pawel Szczur wrote: >> > When running my simple pipeline from time to time I'm getting below >> > exception: >> > >> > Caused by: java.io.IOException: Insufficient number of network buffers: >> > required 1, but only 0 available. The total number of network buffers is >> > currently set to 2048. You can increase this number by setting the >> > configuration key 'taskmanager.network.numberOfBuffers'. >> > at >> > org.apache.flink.runtime.io >> .network.buffer.NetworkBufferPool.createBufferPool(NetworkBufferPool.java:196) >> > at >> > org.apache.flink.runtime.io >> .network.NetworkEnvironment.registerTask(NetworkEnvironment.java:298) >> > at org.apache.flink.runtime.taskmanager.Task.run(Task.java:469) >> > at java.lang.Thread.run(Thread.java:745) >> > >> > >> > I'm using trunk of Beam with FlinkRunner. I guess it's well known Flink >> > problem? Idea how to prevent it? >> > >> > Pawel >> >> -- >> Jean-Baptiste Onofré >> [email protected] >> http://blog.nanthrax.net >> Talend - http://www.talend.com >> >
