TB or hundreds GB data job, and long-time running job. I test a 200GB dataset for kmeans this afternoon, every superstep taken about 30m(our cluster is small), it will throw "Filesystem closed" exception occasionally.
2012/9/27 Edward J. Yoon <[email protected]> > Hi, > > Today I tested Hama TRUNK on 1152 cores cluster, everything seems OK > except the AvroMessageManager and Memory issues. > > I'm planning on testing new FT system 2 weeks later (I'll be vacation > Next week). So, could you please let me know where I should > concentrate my efforts? > > -- > Best Regards, Edward J. Yoon > @eddieyoon >
