Thank you. Now comes the hard work of making the changes, and ensuring nothing breaks. :)
-----Original Message----- From: Sandy Ryza [mailto:[email protected]] Sent: Friday, December 06, 2013 11:58 AM To: [email protected] Subject: Re: changing socket calls for ApplicationMaster That's correct that ipc.Client and Server handle inter-node/process communication in Hadoop. -Sandy On Fri, Dec 6, 2013 at 8:48 AM, Black, James A. <[email protected]> wrote: > It appears that it would be in hadoop-common in > org.apache.hadoop.ipc.Server and org.apache.hadoop.ipc.Client, as the > path I followed was: > ContainerManagerImpl -> ContainerManagementProtocolPBServiceImpl -> > ProtobufRpcEngine->Server > > Before I start making the changes to an event-based communication > platform it would be nice to know that this is indeed the correct place. > > Thank you. > > From: Black, James A. > Sent: Friday, December 06, 2013 9:47 AM > To: '[email protected]' > Subject: changing socket calls for ApplicationMaster > > Hello, > I am working on a project to get Hadoop 2 to work on a Cray > supercomputer, and for that I need to change it from using TCP/IP > sockets to using something else, as sockets run slow on the Cray computers we > have. > > So, I am looking at AMRMClientImpl and it seems that that section > needs to be changed, but which class is actually used to communicate > between the ApplicationMaster and the Containers? I am looking for > the place where the actual socket calls are made so I can change it to a > different library. > > Thank you. >
