[ http://issues.apache.org/jira/browse/HADOOP-312?page=comments#action_12419048 ]
Devaraj Das commented on HADOOP-312: ------------------------------------ Had a discussion with Eric/Owen on this subject and decided to do the following: * Have time-based connection caching - i.e., on the client side, disconnect those connections that have been idle for a (configurable) period of time (default is 1 sec). * Postpone tweaking the heartbeat logic until we see a problem there. > Connections should not be cached > -------------------------------- > > Key: HADOOP-312 > URL: http://issues.apache.org/jira/browse/HADOOP-312 > Project: Hadoop > Type: Improvement > Components: ipc > Versions: 0.4.0 > Reporter: Devaraj Das > Attachments: config_connection_cache.patch > > Servers and clients (client include datanodes, tasktrackers, DFSClients & > tasks) should not cache connections or maybe cache them for very short > periods of time. Clients should set up & tear down connections to the servers > everytime they need to contact the servers (including the heartbeats). If > connection is cached, then reuse the existing connection for a few subsequent > transactions until the connection expires. The heartbeat interval should be > more so that many more clients (order of tens of thousands) can be > accomodated within 1 heartbeat interval. -- This message is automatically generated by JIRA. - If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa - For more information on JIRA, see: http://www.atlassian.com/software/jira
