Rajesh Balamohan created MAPREDUCE-5786:
-------------------------------------------
Summary: Support Keep-Alive connections in ShuffleHandler
Key: MAPREDUCE-5786
URL: https://issues.apache.org/jira/browse/MAPREDUCE-5786
Project: Hadoop Map/Reduce
Issue Type: Bug
Affects Versions: 2.4.0
Reporter: Rajesh Balamohan
Assignee: Rajesh Balamohan
Currently ShuffleHandler supports fetching map-outputs in batches from same
host. But there are scenarios wherein, fetchers pull data aggressively (i.e
start pulling the data as & when they are available). In this case, the number
of mapIds that are pulled from same host remains at 1. This causes lots of
connections to be established.
Number of connections can be reduced a lot if ShuffleHandler supports
Keep-Alive.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
