I did restart TaskTracker after setting
mapred.tasktracker.map.tasks.maximum.
But I have been using
Configuration.setInt("mapred.tasktracker.map.tasks.maximum",6).
When I set mapred.tasktracker.map.tasks.maximum to 6 in
mapred-site.xml, I see 6 concurrent map tasks running.
That solves my problem !
Thanks!
Shing
----- Original Message -----
From: Harsh J <[email protected]>
To: [email protected]; Shing Hing Man <[email protected]>
Cc:
Sent: Saturday, September 29, 2012 8:23 PM
Subject: Re: Pseudo distributed mode : How to increase no of concurrent map task
Did you restart your TaskTrackers after increasing the
mapred.tasktracker.map.tasks.maximum value in mapred-site.xml? It is a
TaskTracker property, not a per-job one.
On Sun, Sep 30, 2012 at 12:36 AM, Shing Hing Man <[email protected]> wrote:
>
> Hi,
> I am running Hadoop 1.03 in Pseudo distributed mode, on a quad core Xeon
> processor with
> hyper-threading enabled.
> When I submit a job to process a file of size about 1.6 GB, only two
> concurrent map tasks
> are running.
> I have set
> mapred.tasktracker.map.tasks.maximum to 6.
> In job.xml,
> mapred.map.tasks =25
> mapred.min.split.size =0
> dfs.block.size = 64MB
> How to increase the the number of concurrent map task ?
>
> Thanks in advance for any assistance !
>
> Shing
>
--
Harsh J
