Re: Perfect configuration setting

2013-12-03 Thread Sandy Ryza
Hi Geelong, Check out Todd Lipcon's presentation on tuning MapReduce performance: http://www.slideshare.net/cloudera/mr-perf -Sandy On Mon, Dec 2, 2013 at 11:14 PM, Geelong Yao geelong...@gmail.com wrote: Hi Everyone I am now testing the best performance of my cluster Can anyone give me

Re: Perfect configuration setting

2013-12-03 Thread Azuryy Yu
Hi Sandy, I think there are some permission limited on your shared URL. maybe only Cloudera employees allowed. On Tue, Dec 3, 2013 at 4:26 PM, Sandy Ryza sandy.r...@cloudera.com wrote: Hi Geelong, Check out Todd Lipcon's presentation on tuning MapReduce performance:

Re: Perfect configuration setting

2013-12-03 Thread Sandy Ryza
Weird. I just tried exiting the Cloudera VPN and opening it from a browser I never use and was still able to access it. On Tue, Dec 3, 2013 at 5:46 PM, Azuryy Yu azury...@gmail.com wrote: Hi Sandy, I think there are some permission limited on your shared URL. maybe only Cloudera employees

Re: Perfect configuration setting

2013-12-03 Thread Azuryy Yu
Sandy, I can access it now. but I do failed many times before I reply your mail. Thanks. On Wed, Dec 4, 2013 at 9:49 AM, Sandy Ryza sandy.r...@cloudera.com wrote: Weird. I just tried exiting the Cloudera VPN and opening it from a browser I never use and was still able to access it. On

Perfect configuration setting

2013-12-02 Thread Geelong Yao
Hi Everyone I am now testing the best performance of my cluster Can anyone give me some *formulas or suggestion* for all setting values in MR program? eg. io.sort.mb io.sort.spill.percent mapred.local.dir mapred.child.java.opts etc. Any details would be great BRs Geelong -- From Good To