Re: [VOTE] Release Apache Hadoop 2.8.3 (RC0)

+1 I built from source code deployed a cluster and successfully ran jobs while restarting RM as well Jian > On Dec 12, 2017, at 4:28 PM, John Zhuge wrote: > > Thanks Junping for the great effort! > > > - Verified checksums and signatures of all tarballs > - Built

Re: [VOTE] Merge Absolute resource configuration support in Capacity Scheduler (YARN-5881) to trunk

My late +1 > On Dec 7, 2017, at 7:38 PM, Sunil G wrote: > > Thank You all. > > We merged the branch to trunk and updated jiras accordingly. Thanks > everyone who helped in this feature. > > - Sunil and Wangda > > > On Thu, Dec 7, 2017 at 10:13 PM Sunil G

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

+1 (binding) Built from source code. Successfully ran jobs and in the meantime tried to restart RM. Jian > On Nov 13, 2017, at 4:10 PM, Arun Suresh wrote: > > Hi Folks, > > Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be the > starting release for

Re: [VOTE] Merge yarn-native-services branch into trunk

Okay, I just merged the branch to trunk (108 commits in total !) Again, thanks for all who contributed to this feature! Jian On Nov 6, 2017, at 1:26 PM, Jian He <j...@hortonworks.com<mailto:j...@hortonworks.com>> wrote: Here’s +1 from myself. The vote passes with 7 (+1) bindings an

Re: [VOTE] Merge yarn-native-services branch into trunk

On Mon, Oct 30, 2017 at 1:06 PM, Jian He <j...@hortonworks.com<mailto:j...@hortonworks.com>> wrote: Hi All, I would like to restart the vote for merging yarn-native-services to trunk. Since last vote, we have been working on several issues in documentation, DNS, CLI modificat

Re: [VOTE] Merge yarn-native-services branch into trunk

/apache/hadoop/blob/yarn-native-services/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/yarn-service/Examples.md And the vote lasts 7 days as usual. Thanks, Jian On Oct 30, 2017, at 1:06 PM, Jian He <j...@hortonworks.com<mailto:j...@hortonworks.com>> wrote: Hi A

[VOTE] Merge yarn-native-services branch into trunk

Hi All, I would like to restart the vote for merging yarn-native-services to trunk. Since last vote, we have been working on several issues in documentation, DNS, CLI modifications etc. We believe now the feature is in a much better shape. Some back ground: At a high level, the following are

Re: YARN native services Re: 2017-10-06 Hadoop 3 release status update

Allen, I was under the impression (and, maybe this was my misunderstanding. if so, sorry) that “the goal” for this first pass was to integrate the existing Apache Slider functionality into YARN. As it stands, I don’t think those goals have been met. It doesn’t seem to be much different than

Re: 2017-10-06 Hadoop 3 release status update

Hi Allen, Thanks for spending the time reviewing it. A new patch was uploaded yesterday on YARN-7198 to address the documentation of missing config, you might want to check. The api-server is basically a REST server which accepts user requests to deploy services, it now has an option to be run

Re: [VOTE] Merge yarn-native-services branch into trunk

Hi Allen, Thanks for sharing the feedback. I opened YARN-7191 for addressing the feedback. We can move the discussions there. Thanks, Jian > On Sep 13, 2017, at 10:10 AM, Allen Wittenauer <a...@effectivemachines.com> > wrote: > > >> On Sep 8, 2017, at 9:25 AM, Jian

Re: [DISCUSS] Merge yarn-native-services branch into trunk

r this ? * I understand YARN-7126 has some introductory documentation, But I think we need to flesh it up a bit more before release, I would also like to see steps to deploy a sample service. Cheers -Arun On Thu, Aug 31, 2017 at 12:40 AM, Jian He <j...@hortonworks.com<mailto:j...@horto

Re: [VOTE] Merge yarn-native-services branch into trunk

e're planning GA for Nov 1st, and 3.1.0 for January. > > Best, > Andrew > > On Wed, Sep 6, 2017 at 10:19 AM, Jian He <j...@hortonworks.com> wrote: > >>> Please correct me if I’m wrong, but the current summary of the >> branch, post these changes, looks

Re: [VOTE] Merge yarn-native-services branch into trunk

:19 AM, Jian He <j...@hortonworks.com> wrote: > >> Please correct me if I’m wrong, but the current summary of the branch, >> post these changes, looks like: > Sorry for confusion, I was actively writing the formal documentation for how > to use/how it works et

Re: [VOTE] Merge yarn-native-services branch into trunk

AM, Allen Wittenauer <a...@effectivemachines.com> > wrote: > > >> On Sep 5, 2017, at 6:23 PM, Jian He <j...@hortonworks.com> wrote: >> >>> If it doesn’t have all the bells and whistles, then it shouldn’t be on >>> port 53 by default. >

Re: [VOTE] Merge yarn-native-services branch into trunk

script. > Check the output. It’s pretty obviously borked: Thanks for pointing out. Missed this when rebasing onto trunk. > On Sep 5, 2017, at 3:11 PM, Allen Wittenauer <a...@effectivemachines.com> > wrote: > > >> On Sep 5, 2017, at 2:53 PM, Jian He <j...@hortonwork

Re: [VOTE] Merge yarn-native-services branch into trunk

> 1) Did I miss it or is there no actual end-user documentation on how to use > this? Yes, we are in the process of finishing up the the doc and posting it. We considered this a release blocker for 3.0.0-beta1 and so working on it in parallel while the branch merge happens. > 2) Lots

Re: [DISCUSS] Merge yarn-native-services branch into trunk

YARN-7127 to run the entire patch against trunk, once that goes green, I plan to start a formal vote. Thanks, Jian On Aug 18, 2017, at 2:48 PM, Andrew Wang <andrew.w...@cloudera.com<mailto:andrew.w...@cloudera.com>> wrote: Hi Jian, thanks for the reply, On Thu, Aug 17, 2017 at 1:0

Re: [VOTE] Merge feature branch YARN-5355 (Timeline Service v2) to trunk

gt; effort. >> >> We paid close attention to ensure that once disabled Timeline Service v.2 >> does not impact existing functionality when disabled (by default). >> >> Special thanks to a team of folks who worked hard and contributed towards >> this effort wit

Re: [DISCUSS] Merge yarn-native-services branch into trunk

drew On Tue, Aug 15, 2017 at 1:56 PM, Jian He <j...@hortonworks.com<mailto:j...@hortonworks.com>> wrote: Hi All, I would like to bring up the discussion of merging yarn-native-services branch into trunk in a few weeks. There are a few issues left under YARN-5079 that are being activ

[DISCUSS] Merge yarn-native-services branch into trunk

Hi All, I would like to bring up the discussion of merging yarn-native-services branch into trunk in a few weeks. There are a few issues left under YARN-5079 that are being actively worked upon. As soon as they are resolved, we plan on start a vote hopefully in next 2 weeks. The goal is to get

Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)

+1 (binding) - built from source - deployed a pseudo cluster - ran basic example tests. - Navigate the UI a bit, looks good. Jian > On Mar 22, 2017, at 9:03 PM, larry mccay wrote: > > +1 (non-binding) > > - verified signatures > - built from source and ran tests > -

Re: [VOTE] Release Apache Hadoop 2.7.3 RC2

+1 Built from source code. Deployed single node cluster. Successfully ran some example jobs. Jian > On Aug 18, 2016, at 10:05 AM, Vinod Kumar Vavilapalli > wrote: > > Hi all, > > I've created a new release candidate RC2 for Apache Hadoop 2.7.3. > > As discussed before,

Re: [VOTE] Release Apache Hadoop 2.7.3 RC0

+1 for the source tarball. - Compiled and built from the source code - Deployed a cluster - Successfully ran some sample jobs. Thanks, Jian > On Jul 27, 2016, at 10:11 AM, Akira Ajisaka > wrote: > > +1 for the source tarball. > > - Downloaded source tarball and

Re: [Release thread] 2.8.0 release activities

For MapReduce/YARN, I closed a few staled ones. Only 4 jiras needs attention for 2.8 MAPREDUCE-6288 YARN-1815 YARN-4685 YARN-4844 The rest are either improvements or long-standing issues and does not qualify release blocker, IMO. I think we’ll try to get these 4 jiras in asap. The rest will be

[jira] [Resolved] (MAPREDUCE-6099) Adding getSplits(JobContext job, List stats) to mapreduce CombineFileInputFormat

[ https://issues.apache.org/jira/browse/MAPREDUCE-6099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He resolved MAPREDUCE-6099. Resolution: Won't Fix Close as Jason mentioned > Adding getSplits(JobContext job, List st

Re: [VOTE] Release Apache Hadoop 2.7.2 RC2

+1, - built from source code - deployed a single cluster - run sample jobs which pass successfully. Jian > On Jan 22, 2016, at 6:52 AM, Sunil Govind wrote: > > +1 (Non Binding) > > * Built tar ball from source and deployed > * Verified few MR Jobs for various nodelabel

Re: [VOTE] Release Apache Hadoop 2.6.3 RC0

+1, Build and deploy the cluster from source code. Ran a few example jobs and passed successfully. Jian > On Dec 16, 2015, at 2:19 PM, Vinod Kumar Vavilapalli > wrote: > > +1 (binding) for the RC except for my question below about the tag. > > I checked 2.6.3-RC0, based

Re: Planning Apache Hadoop 2.7.2

sorry, missed the cut.. I’d like to merge YARN-4127 into branch-2.7.2 also. That’s important because it prevents RM to startup, if the problem is hit. > On Nov 3, 2015, at 3:24 PM, Vinod Vavilapalli wrote: > > I’m closing down 2.7.2 now, almost there. > > Created a

Re: [VOTE] Release Apache Hadoop 2.6.1 RC1

+1 (binding) Build from source code. Deployed a local cluster. Validated sample jobs passed. Jian > On Sep 18, 2015, at 7:34 AM, Wangda Tan wrote: > > Deployed a local cluster, verified configured cluster with node labels, run > jobs with/without node labels. > > +1

Re: Planning Hadoop 2.6.1 release

Can we include YARN-3999 too, if the list is not yet frozen. On Aug 11, 2015, at 1:49 PM, Hitesh Shah hit...@apache.org wrote: Jason Lowe just filed YARN-4047 ( patch available too ) which probably is also a good candidate for 2.6.1 or 2.6.2 if the list is frozen. I have labelled the

Re: [VOTE] Release Apache Hadoop 2.6.0

+1, Built from source. Deployed a single node cluster. Ran sample MapReduce jobs while restarting RM successfully. Jian On Tue, Nov 18, 2014 at 8:47 AM, Eric Payne erichadoo...@yahoo.com.invalid wrote: +1 . Thanks Arun, for producing this release. I downloaded and built the source. I started

[jira] [Created] (MAPREDUCE-6087) MRJobConfig#MR_CLIENT_TO_AM_IPC_MAX_RETRIES_ON_TIMEOUTS config name is wrong

Jian He created MAPREDUCE-6087: -- Summary: MRJobConfig#MR_CLIENT_TO_AM_IPC_MAX_RETRIES_ON_TIMEOUTS config name is wrong Key: MAPREDUCE-6087 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6087

Re: hadoop-2.5 - June end?

Just found the roadmap includes a wrong jira link for RM Webservices YARN-1731, it should be YARN-1695 https://issues.apache.org/jira/browse/YARN-1695. Jian On Mon, Jun 23, 2014 at 2:51 PM, Karthik Kambatla ka...@cloudera.com wrote: While YARN-1492 would greatly benefit performance, I think

Re: [VOTE] Release Apache Hadoop 2.4.1

+1, built from source code. installed single node cluster. ran a few sample jobs successfully. Jian On Wed, Jun 18, 2014 at 12:13 PM, Vinod Kumar Vavilapalli vino...@apache.org wrote: There is one item [MAPREDUCE-5830 HostUtil.getTaskLogUrl is not backwards binary compatible with 2.3]

[jira] [Created] (MAPREDUCE-5838) TestRMDelegationTokens#testRMDTMasterKeyStateOnRollingMasterKey is failing intermittently

Jian He created MAPREDUCE-5838: -- Summary: TestRMDelegationTokens#testRMDTMasterKeyStateOnRollingMasterKey is failing intermittently Key: MAPREDUCE-5838 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5838

[jira] [Created] (MAPREDUCE-5832) TestJobClient fails sometimes on Windows

Jian He created MAPREDUCE-5832: -- Summary: TestJobClient fails sometimes on Windows Key: MAPREDUCE-5832 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5832 Project: Hadoop Map/Reduce Issue

Re: [VOTE] Release Apache Hadoop 2.4.0

+1 non-binding Built from source code, tested on a single node cluster. Successfully ran a few MR sample jobs. Tested RM restart while job is running. Thanks, Jian On Tue, Apr 1, 2014 at 5:42 PM, Travis Thompson tthomp...@linkedin.comwrote: +1 non-binding Built from git. Started with 120

[jira] [Created] (MAPREDUCE-5818) hsadmin cmd is missing in mapred.cmd

Jian He created MAPREDUCE-5818: -- Summary: hsadmin cmd is missing in mapred.cmd Key: MAPREDUCE-5818 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5818 Project: Hadoop Map/Reduce Issue

[jira] [Resolved] (MAPREDUCE-5397) AM crashes because Webapp failed to start on multi node cluster

[ https://issues.apache.org/jira/browse/MAPREDUCE-5397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He resolved MAPREDUCE-5397. Resolution: Cannot Reproduce AM crashes because Webapp failed to start on multi node cluster

Re: [VOTE] Release Apache Hadoop 2.2.0

+1 non-binding Built from source code, and ran a few sample jobs on single node cluster, tested RM and AM recovery. Thanks, Jian On Thu, Oct 10, 2013 at 10:59 AM, Chris Nauroth cnaur...@hortonworks.comwrote: +1 non-binding I verified the checksum and signature. I deployed the tarball to a

[jira] [Created] (MAPREDUCE-5568) JHS return invalid string for reducer completion percentage if AM restarts with 0 reducer.

Jian He created MAPREDUCE-5568: -- Summary: JHS return invalid string for reducer completion percentage if AM restarts with 0 reducer. Key: MAPREDUCE-5568 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5568

[jira] [Created] (MAPREDUCE-5535) TestClusterMRNotification.testMR is failing

Jian He created MAPREDUCE-5535: -- Summary: TestClusterMRNotification.testMR is failing Key: MAPREDUCE-5535 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5535 Project: Hadoop Map/Reduce

[jira] [Resolved] (MAPREDUCE-5516) TestMRJobClient fails on trunk

[ https://issues.apache.org/jira/browse/MAPREDUCE-5516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He resolved MAPREDUCE-5516. Resolution: Duplicate TestMRJobClient fails on trunk

[jira] [Created] (MAPREDUCE-5516) TestMRJobClient fails, TestUberAM hangs on trunk

Jian He created MAPREDUCE-5516: -- Summary: TestMRJobClient fails, TestUberAM hangs on trunk Key: MAPREDUCE-5516 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5516 Project: Hadoop Map/Reduce

[jira] [Resolved] (MAPREDUCE-5471) Succeed job tries to restart after RMrestart

[ https://issues.apache.org/jira/browse/MAPREDUCE-5471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He resolved MAPREDUCE-5471. Resolution: Duplicate Closed as a duplicate of YARN-540 Succeed job tries

[jira] [Created] (MAPREDUCE-5505) Clients should be notified job finished after job successfully unregistered

Jian He created MAPREDUCE-5505: -- Summary: Clients should be notified job finished after job successfully unregistered Key: MAPREDUCE-5505 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5505

[jira] [Created] (MAPREDUCE-5497) '5s sleep' in MRAppMaster.shutDownJob is only needed before stopping ClientService

Jian He created MAPREDUCE-5497: -- Summary: '5s sleep' in MRAppMaster.shutDownJob is only needed before stopping ClientService Key: MAPREDUCE-5497 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5497

[jira] [Created] (MAPREDUCE-5436) Better exception handling for Invalid AMRMToken exception for MapReduce

Jian He created MAPREDUCE-5436: -- Summary: Better exception handling for Invalid AMRMToken exception for MapReduce Key: MAPREDUCE-5436 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5436 Project

[jira] [Created] (MAPREDUCE-5412) Change MR to use multiple containers API of ContainerManager after YARN-926

Jian He created MAPREDUCE-5412: -- Summary: Change MR to use multiple containers API of ContainerManager after YARN-926 Key: MAPREDUCE-5412 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5412

[jira] [Created] (MAPREDUCE-5397) AM crashes because Webapp failed to start on multi node cluster

Jian He created MAPREDUCE-5397: -- Summary: AM crashes because Webapp failed to start on multi node cluster Key: MAPREDUCE-5397 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5397 Project: Hadoop

[jira] [Created] (MAPREDUCE-5303) Changes on MR after moving ProtoBase to package impl.pb on YARN-724

Jian He created MAPREDUCE-5303: -- Summary: Changes on MR after moving ProtoBase to package impl.pb on YARN-724 Key: MAPREDUCE-5303 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5303 Project

[jira] [Created] (MAPREDUCE-5297) Update MR App after YARN-748

Jian He created MAPREDUCE-5297: -- Summary: Update MR App after YARN-748 Key: MAPREDUCE-5297 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5297 Project: Hadoop Map/Reduce Issue Type: Bug

[jira] [Created] (MAPREDUCE-5285) Update MR App to use immutable ApplicationAttemptID, ContainerID, NodeID after YARN-735

Jian He created MAPREDUCE-5285: -- Summary: Update MR App to use immutable ApplicationAttemptID, ContainerID, NodeID after YARN-735 Key: MAPREDUCE-5285 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5285

[jira] [Created] (MAPREDUCE-5270) Migrate from using BuilderUtil factory methods to individual record factory method on MapReduce side

Jian He created MAPREDUCE-5270: -- Summary: Migrate from using BuilderUtil factory methods to individual record factory method on MapReduce side Key: MAPREDUCE-5270 URL: https://issues.apache.org/jira/browse/MAPREDUCE