Thanks for the explain and diagram uploaded. It is quite clear. -----Original message----- From:Thomas Jungblut <[email protected]> To:[email protected] Date:Tue, 6 Dec 2011 19:11:12 +0100 Subject:Re: Hama Yarn module, process flow diagram
Soo here is the apache.org upload: http://people.apache.org/~tjungblut/yarn-hama-diagram.pdf<http://people.apache.org/~tjungblut/Efficient%20Barrier%20Synchronization%20Mechanism.pdf> http://people.apache.org/~tjungblut/yarn-hama-diagram.pptx Let me explain it though. The client submits the job to the YARN infrastructure's resource manager. This will take care to schedule the BSPApplicationMaster container (actually this is going through the NodeManager as well). Once the BSPApplicationmaster runs, it will examine the conf, start the RPC servers needed (zookeeper as well) and then reports back to the Resourcemanager (actually I missed to put the arrow back to the resourcemanager, it is currently pointing to the scheduler). However, the Resourcemanager will then start the required containers through the NodeManagers once again. If the BSPRunner runs the real task, it will piggyback heartbeats to the BSPApplicationMaster. The container which is running is always piggybacking to the nodemanager as well. Sorry for the filehoster upload. 2011/12/6 Thomas Jungblut <[email protected]> > I updated this, sorry I can't upload on apache because I have no key at > this pc. > > http://uploading.com/files/2af323d7/yarn-hama-diagram.pdf/ > http://uploading.com/files/34m35aee/yarn-hama-diagram.pptx/ > > > 2011/12/6 ChiaHung Lin <[email protected]> > >> >> Do it have pdf or png format? I can't read it because I don't have MS >> office suite. >> >> -----Original message----- >> From:Edward J. Yoon <[email protected]> >> To:[email protected] >> Date:Tue, 6 Dec 2011 17:02:31 +0900 >> Subject:Hama Yarn module, process flow diagram >> >> Hi all, >> >> Roughly I just draw a process flow diagram of YARN module[1]. Please >> feel free to use this for any purpose and update it. >> >> And this is minor issue but I'd like to renaming several classes. >> e.g., BSPRunner to BSPTask if I draw correctly. >> >> 1. http://people.apache.org/~edwardyoon/documents/yarn-hama-diagram.pptx >> >> -- >> Best Regards, Edward J. Yoon >> @eddieyoon >> >> >> -- >> ChiaHung Lin >> Department of Information Management >> National University of Kaohsiung >> Taiwan >> > > > > -- > Thomas Jungblut > Berlin <[email protected]> > -- Thomas Jungblut Berlin <[email protected]> -- ChiaHung Lin Department of Information Management National University of Kaohsiung Taiwan
