it sets mapred.map.tasks to 145 and mapred.reduce.tasks to just 1...
just one more question on this. It looks like the algorithm overrides
the default values for mapred.map.tasks and mapred.reduce.tasks. how did
you decide on those? it doesn't look optimal.
For example for job
RecommenderJob-IdentityMapper-AggregateAndRecommendReducer
- Re: mapreduce memory issues Tamas Jambor
- Re: mapreduce memory issues Tamas Jambor
- Re: mapreduce memory issues Ted Dunning
- Re: mapreduce memory issues Tamas Jambor
- Re: mapreduce memory issues Sean Owen
- Re: mapreduce memory issues Ted Dunning
- Re: mapreduce memory issues Tamas Jambor
- Re: mapreduce memory issues Sean Owen
- Re: mapreduce memory issues Tamas Jambor
- Re: mapreduce memory issues Sean Owen
- Re: mapreduce memory issues Tamas Jambor