Re: What is the class that launches the reducers?

How are you intending to verify the map output? It's only partially dumped to disk. None of the intermediate data goes into HDFS. Daniel On Aug 25, 2016 4:10 PM, "xeon Mailinglist" wrote: > But then I need to set identity maps to run the reducers. If I suspend a >

Re: Setting JIRA fix versions for 3.0.0 releases

I've taken a look at the Common and HDFS compat issues. * A bunch of them are from the known removals of the deprecated Metrics 1 and RCC. JACC understands and can filter @Deprecated annotations, but HADOOP-7266 isn't in 2.7.2, and apparently JACC doesn't look at the class annotation when telling

Re: What is the class that launches the reducers?

Mappers and reducers that are all scheduled when the job starts running. Don't think there is a knob to suspend the job once all mappers finish. On Thu, Aug 25, 2016 at 4:10 PM, xeon Mailinglist wrote: > But then I need to set identity maps to run the reducers. If I

Re: What is the class that launches the reducers?

But then I need to set identity maps to run the reducers. If I suspend a job after the maps finish, I don't need to set identity maps up. I want to suspend a job so that I don't run identity maps and get better performance. On Aug 25, 2016 10:12 PM, "Haibo Chen" wrote:

Re: What is the class that launches the reducers?

One thing you can try is to write a map-only job first and then verify the map out. On Thu, Aug 25, 2016 at 1:18 PM, xeon Mailinglist wrote: > I am using Mapreduce v2. > > On Aug 25, 2016 8:18 PM, "xeon Mailinglist" > wrote: > > > I am

Re: What is the class that launches the reducers?

I am using Mapreduce v2. On Aug 25, 2016 8:18 PM, "xeon Mailinglist" wrote: > I am trying to implement a mechanism in MapReduce v2 that allows to > suspend and resume a job. I must suspend a job when all the mappers finish, > and resume the job from that point after

What is the class that launches the reducers?

I am trying to implement a mechanism in MapReduce v2 that allows to suspend and resume a job. I must suspend a job when all the mappers finish, and resume the job from that point after some time. I do this, because I want to verify the integrity of the map output before executing the reducers. I

Re: [VOTE] Release Apache Hadoop 2.7.3 RC2

Here’s my +1 to conclude the vote. With 8 binding +1s, 9 non-binding +1s and no -1s, this vote passes. I’ll push the RC forward to an official release. Thanks to everyone who voted! +Vinod > On Aug 24, 2016, at 10:30 PM, Wangda Tan wrote: > > +1 Binding. > > - Built

Re: Setting JIRA fix versions for 3.0.0 releases

Sean gave me some pointers on using Java ACC, I've made a report using the script I've been working on at YETUS-445: http://home.apache.org/~wang/h3/report.html Invocation was something like this: -> % ~/dev/yetus/check-java-compatibility/checkjavacompatibility.py --annotation

[jira] [Created] (HADOOP-13549) Eliminate intermediate buffer for server-side PB encoding

Daryn Sharp created HADOOP-13549: Summary: Eliminate intermediate buffer for server-side PB encoding Key: HADOOP-13549 URL: https://issues.apache.org/jira/browse/HADOOP-13549 Project: Hadoop Common

[jira] [Resolved] (HADOOP-10934) AbstractCounters.readFields doesn't clear "other" groups

[ https://issues.apache.org/jira/browse/HADOOP-10934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Loss resolved HADOOP-10934. - Resolution: Duplicate It appears that MAPREDUCE-6199 fixes took care of this issue. >

[jira] [Created] (HADOOP-13548) Remove recursive dependencies of credential providers in LdapGroupsMapping

Wei-Chiu Chuang created HADOOP-13548: Summary: Remove recursive dependencies of credential providers in LdapGroupsMapping Key: HADOOP-13548 URL: https://issues.apache.org/jira/browse/HADOOP-13548

[jira] [Created] (HADOOP-13547) Optimize IPC client protobuf decoding

Daryn Sharp created HADOOP-13547: Summary: Optimize IPC client protobuf decoding Key: HADOOP-13547 URL: https://issues.apache.org/jira/browse/HADOOP-13547 Project: Hadoop Common Issue Type:

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/144/ [Aug 24, 2016 7:47:52 AM] (aajisaka) HADOOP-13538. Deprecate getInstance and initialize methods with Path in [Aug 24, 2016 1:46:47 PM] (daryn) HDFS-10762. Pass IIP for file status related methods [Aug 24,