Re: Is there any way to limit the concurrent running mappers per job?

2015-04-26 Thread Zhe Li
J [ha...@cloudera.com] Sent: Thursday, April 23, 2015 11:24 To: user@hadoop.apache.org Subject: Re: Is there any way to limit the concurrent running mappers per job? This has been introduced as a 2.7.0 feature, see MAPREDUCE-5583. On Tue, Apr 21, 2015 at 4:32 AM, Zhe Li allenlee

RE: Is there any way to limit the concurrent running mappers per job?

2015-04-23 Thread Naganarasimha G R (Naga)
worked, right? One workaround is to use queue to limit it, but it's not easy to control it from job submitter. Is there any way to limit the concurrent running mappers per job? Any documents or discussions before? BTW, any way to search this mailing list before I post a new question? Thanks

Re: Is there any way to limit the concurrent running mappers per job?

2015-04-22 Thread Harsh J
queue to limit it, but it's not easy to control it from job submitter. Is there any way to limit the concurrent running mappers per job? Any documents or discussions before? BTW, any way to search this mailing list before I post a new question? Thanks very much. -- Harsh J

Re: Is there any way to limit the concurrent running mappers per job?

2015-04-22 Thread Zhe Li
@hadoop.apache.org *Subject:* Re: Is there any way to limit the concurrent running mappers per job? Hi, Check if this works for you, mapreduce.jobtracker.taskscheduler.maxrunningtasks.perjob Some properties have been changed with yarn implementation https://hadoop.apache.org/docs/stable

RE: Is there any way to limit the concurrent running mappers per job?

2015-04-22 Thread Naganarasimha G R (Naga)
it from job submitter. Is there any way to limit the concurrent running mappers per job? Any documents or discussions before? BTW, any way to search this mailing list before I post a new question? Thanks very much. _ The information

Re: Is there any way to limit the concurrent running mappers per job?

2015-04-21 Thread Sanjeev Tripurari
the concurrent running mappers per job? Any documents or discussions before? BTW, any way to search this mailing list before I post a new question? Thanks very much. -- _ The information contained in this communication is intended

Re: Is there any way to limit the concurrent running mappers per job?

2015-04-21 Thread Zhe Li
that 'mapred.jobtracker.taskScheduler.maxRunningTasksPerJob' no longer worked, right? One workaround is to use queue to limit it, but it's not easy to control it from job submitter. Is there any way to limit the concurrent running mappers per job? Any documents or discussions before? BTW, any way to search this mailing list

RE: Is there any way to limit the concurrent running mappers per job?

2015-04-21 Thread Naganarasimha G R (Naga)
/hadoop-yarn/hadoop-yarn-site/FairScheduler.html. Regards, Naga From: Sanjeev Tripurari [sanjeev.tripur...@inmobi.com] Sent: Tuesday, April 21, 2015 11:54 To: user@hadoop.apache.org Subject: Re: Is there any way to limit the concurrent running mappers per job? Hi

Is there any way to limit the concurrent running mappers per job?

2015-04-20 Thread Zhe Li
Hi, after upgraded to Hadoop 2 (yarn), I found that 'mapred.jobtracker.taskScheduler.maxRunningTasksPerJob' no longer worked, right? One workaround is to use queue to limit it, but it's not easy to control it from job submitter. Is there any way to limit the concurrent running mappers per job