Github user zhijiangW commented on the issue:
https://github.com/apache/flink/pull/3467
@NicoK ï¼thank you for explanation, and I already trace the code in your
local branch. Wish your further change commit in global pool.
@StephanEwen , thanks for further elaboration. From my understanding, each
task can decide the core number of buffers in `LocalBufferPool` based on input,
output channels and configuration, the maximum number of buffers based on
`ResultPartitionType`. And all the `LocalBufferPool`s make effect on the total
number of buffers in `NetworkBufferPool`, may need consider maximum memory
usages.
And my concern is to consider the memory usages in `NetworkBufferPool`
before starts the `TaskManager`, and this part of memory should be added into
the total resource of `TaskManager`.
I am willing to do that as a part of my current work in [Fine-grained
Resource Configuration](https://issues.apache.org/jira/browse/FLINK-5131) after
this feature completes.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---