zhoukang created SPARK-21956:
--------------------------------
Summary: Fetch up to max bytes when buf really released
Key: SPARK-21956
URL: https://issues.apache.org/jira/browse/SPARK-21956
Project: Spark
Issue Type: Improvement
Components: Shuffle, Spark Core
Affects Versions: 2.1.0
Reporter: zhoukang
Right now,ShuffleBlockFetcherIterator will decrease bytesInFlight immediatily
when take from results queue.But currentresult's bytebuf has not been released
at that time.Then direct memory may be a little out of control.
We should decrease bytesInFlight when currentresult's bytebuf really been
released.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
