"mapreduce-user@hadoop.apache.org"
Sent: Tue, November 24, 2009 4:11:01 AM
Subject: Re: Maps getting stuck at 100%
Re: Maps getting stuck at 100% Even if code is the same, if the data it
processes has changed (for eg: date related data), or the parameters are
different(for eg:sort/spill
From: Todd Lipcon
To: mapreduce-user@hadoop.apache.org
Sent: Tue, November 24, 2009 2:52:51 AM
Subject: Re: Maps getting stuck at 100%
Hi Himanshu,
The map progress percentage is calculated based on the input read, rather than
the processing actually done. So, if you're
nt: Tue, November 24, 2009 2:52:51 AM
Subject: Re: Maps getting stuck at 100%
Hi Himanshu,
The map progress percentage is calculated based on the input read, rather than
the processing actually done. So, if you're doing a lot of work in your mapper,
or reading ahead of what you've proce
Hi Himanshu,
The map progress percentage is calculated based on the input read, rather
than the processing actually done. So, if you're doing a lot of work in your
mapper, or reading ahead of what you've processed, you'll see this behavior
reasonably often. It also can show up sometimes in streami
Hi,
I use cloudera's distribution for hadoop. What I see is that a small fraction
of maps get stuck at 100%. They show up as 100% but continue running. After a
lot of delay, they succeed finally but it takes a while, like 10 mins from the
time when they show up as 100%.
We recently reformatted
