What happens if some task no longer need to communicate with others? I didn't look at the code recently but I guess that the problem is related with comparison of znode size and task size.
> I am going to write a RPC barrier sync. Zookeeper sucks in this case. Won't much different. Let's focusing on NG integration and In/Output system. On Fri, Sep 23, 2011 at 8:21 PM, Thomas Jungblut <[email protected]> wrote: > I am going to write a RPC barrier sync. Zookeeper sucks in this case. > > 2011/9/23 Edward J. Yoon <[email protected]> > >> P.S., Tested on 16 nodes using 10 tasks per node. >> >> On Fri, Sep 23, 2011 at 7:19 PM, Edward J. Yoon <[email protected]> >> wrote: >> > Hi, >> > >> > Today I ran the sssp example with 4GB sample file. >> > >> > At 32th step, some tasks are finished and others hang forever. >> > >> > Could anyone figure out this problem? >> > >> > Plus, there're too many INFO-level logs. Let's reduce them. >> > >> > Thanks. >> > >> > -- >> > Best Regards, Edward J. Yoon >> > @eddieyoon >> > >> >> >> >> -- >> Best Regards, Edward J. Yoon >> @eddieyoon >> > > > > -- > Thomas Jungblut > Berlin > > mobile: 0170-3081070 > > business: [email protected] > private: [email protected] > -- Best Regards, Edward J. Yoon @eddieyoon
