Hello again,
I'm facing a problem in my program execution.
If I do not define the "numberOfBuffers" variable in the
flink-conf.yaml, my program execution fail with the following exception:
"
Job execution switched to status FAILED
Error: The program execution failed: dbis72 has not enough buffers to
safely execute CoGroup
(org.apache.flink.allIn.PSIJoinJob$CoGroupSignatures) (154 buffers missing)
.....
"
I tried to set the "numberOfBuffers" to 404800.
My program finished without executions (in 535.59 seconds).
Next I tried to set the "numberOfBuffers" to 40480.
The program execution was much faster: 75.19 seconds
Seems like, the number of buffers has a deep impact on the runtime.
Is there a way to automatically minimize the number of network buffers
for my program.
I*would **we**lcome**your**response.
Greetings Florian
*
