Re: Overview of Memory Management in Flink

2015-03-19 Thread Maximilian Michels
We should have all parts of Flink documented that well. Very nice overview, Stephan! Two comments: Considering the lazy memory segment allocation. Besides, the problem of initial garbage collection of these dynamically allocated segments, wouldn't it also have the disadvantage that we could not g

Overview of Memory Management in Flink

2015-03-18 Thread Stephan Ewen
Hi all! Here is a first version of the documentation how memory management works in Flink. I hope it sheds some light on the magic we do. Let me know if certain sections are still confusing. https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=53741525 Greetings, Stephan