Re: [VOTE] Release Apache Hadoop 2.8.3 (RC0)

2017-12-12 Thread Jian He
+1 I built from source code deployed a cluster and successfully ran jobs while restarting RM as well Jian > On Dec 12, 2017, at 4:28 PM, John Zhuge wrote: > > Thanks Junping for the great effort! > > > - Verified checksums and signatures of all tarballs > - Built

Re: [VOTE] Merge Absolute resource configuration support in Capacity Scheduler (YARN-5881) to trunk

2017-12-07 Thread Jian He
My late +1 > On Dec 7, 2017, at 7:38 PM, Sunil G wrote: > > Thank You all. > > We merged the branch to trunk and updated jiras accordingly. Thanks > everyone who helped in this feature. > > - Sunil and Wangda > > > On Thu, Dec 7, 2017 at 10:13 PM Sunil G

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

2017-11-14 Thread Jian He
+1 (binding) Built from source code. Successfully ran jobs and in the meantime tried to restart RM. Jian > On Nov 13, 2017, at 4:10 PM, Arun Suresh wrote: > > Hi Folks, > > Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be the > starting release for

Re: [VOTE] Merge yarn-native-services branch into trunk

2017-11-06 Thread Jian He
Okay, I just merged the branch to trunk (108 commits in total !) Again, thanks for all who contributed to this feature! Jian On Nov 6, 2017, at 1:26 PM, Jian He <j...@hortonworks.com<mailto:j...@hortonworks.com>> wrote: Here’s +1 from myself. The vote passes with 7 (+1) bindings an

Re: [VOTE] Merge yarn-native-services branch into trunk

2017-11-06 Thread Jian He
On Mon, Oct 30, 2017 at 1:06 PM, Jian He <j...@hortonworks.com<mailto:j...@hortonworks.com>> wrote: Hi All, I would like to restart the vote for merging yarn-native-services to trunk. Since last vote, we have been working on several issues in documentation, DNS, CLI modificat

Re: [VOTE] Merge yarn-native-services branch into trunk

2017-10-30 Thread Jian He
/apache/hadoop/blob/yarn-native-services/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/yarn-service/Examples.md And the vote lasts 7 days as usual. Thanks, Jian On Oct 30, 2017, at 1:06 PM, Jian He <j...@hortonworks.com<mailto:j...@hortonworks.com>> wrote: Hi A

[VOTE] Merge yarn-native-services branch into trunk

2017-10-30 Thread Jian He
Hi All, I would like to restart the vote for merging yarn-native-services to trunk. Since last vote, we have been working on several issues in documentation, DNS, CLI modifications etc. We believe now the feature is in a much better shape. Some back ground: At a high level, the following are

Re: YARN native services Re: 2017-10-06 Hadoop 3 release status update

2017-10-09 Thread Jian He
Allen, I was under the impression (and, maybe this was my misunderstanding. if so, sorry) that “the goal” for this first pass was to integrate the existing Apache Slider functionality into YARN. As it stands, I don’t think those goals have been met. It doesn’t seem to be much different than

Re: 2017-10-06 Hadoop 3 release status update

2017-10-06 Thread Jian He
Hi Allen, Thanks for spending the time reviewing it. A new patch was uploaded yesterday on YARN-7198 to address the documentation of missing config, you might want to check. The api-server is basically a REST server which accepts user requests to deploy services, it now has an option to be run

Re: [VOTE] Merge yarn-native-services branch into trunk

2017-09-13 Thread Jian He
Hi Allen, Thanks for sharing the feedback. I opened YARN-7191 for addressing the feedback. We can move the discussions there. Thanks, Jian > On Sep 13, 2017, at 10:10 AM, Allen Wittenauer <a...@effectivemachines.com> > wrote: > > >> On Sep 8, 2017, at 9:25 AM, Jian

Re: [DISCUSS] Merge yarn-native-services branch into trunk

2017-09-08 Thread Jian He
r this ? * I understand YARN-7126 has some introductory documentation, But I think we need to flesh it up a bit more before release, I would also like to see steps to deploy a sample service. Cheers -Arun On Thu, Aug 31, 2017 at 12:40 AM, Jian He <j...@hortonworks.com<mailto:j...@horto

Re: [VOTE] Merge yarn-native-services branch into trunk

2017-09-08 Thread Jian He
e're planning GA for Nov 1st, and 3.1.0 for January. > > Best, > Andrew > > On Wed, Sep 6, 2017 at 10:19 AM, Jian He <j...@hortonworks.com> wrote: > >>> Please correct me if I’m wrong, but the current summary of the >> branch, post these changes, looks

Re: [VOTE] Merge yarn-native-services branch into trunk

2017-09-08 Thread Jian He
:19 AM, Jian He <j...@hortonworks.com> wrote: > >> Please correct me if I’m wrong, but the current summary of the branch, >> post these changes, looks like: > Sorry for confusion, I was actively writing the formal documentation for how > to use/how it works et

Re: [VOTE] Merge yarn-native-services branch into trunk

2017-09-06 Thread Jian He
AM, Allen Wittenauer <a...@effectivemachines.com> > wrote: > > >> On Sep 5, 2017, at 6:23 PM, Jian He <j...@hortonworks.com> wrote: >> >>> If it doesn’t have all the bells and whistles, then it shouldn’t be on >>> port 53 by default. >

Re: [VOTE] Merge yarn-native-services branch into trunk

2017-09-05 Thread Jian He
script. > Check the output. It’s pretty obviously borked: Thanks for pointing out. Missed this when rebasing onto trunk. > On Sep 5, 2017, at 3:11 PM, Allen Wittenauer <a...@effectivemachines.com> > wrote: > > >> On Sep 5, 2017, at 2:53 PM, Jian He <j...@hortonwork

Re: [VOTE] Merge yarn-native-services branch into trunk

2017-09-05 Thread Jian He
> 1) Did I miss it or is there no actual end-user documentation on how to use > this? Yes, we are in the process of finishing up the the doc and posting it. We considered this a release blocker for 3.0.0-beta1 and so working on it in parallel while the branch merge happens. > 2) Lots

[VOTE] Merge yarn-native-services branch into trunk

2017-08-31 Thread Jian He
Hi All, I would like to call a vote for merging yarn-native-services to trunk. The vote will run for 7 days as usual. At a high level, the following are the key feautres implemented. - YARN-5079[1]. A native YARN framework (ApplicationMaster) to migrate and orchestrate existing services to

Re: [DISCUSS] Merge yarn-native-services branch into trunk

2017-08-31 Thread Jian He
YARN-7127 to run the entire patch against trunk, once that goes green, I plan to start a formal vote. Thanks, Jian On Aug 18, 2017, at 2:48 PM, Andrew Wang <andrew.w...@cloudera.com<mailto:andrew.w...@cloudera.com>> wrote: Hi Jian, thanks for the reply, On Thu, Aug 17, 2017 at 1:0

Re: [VOTE] Merge feature branch YARN-5355 (Timeline Service v2) to trunk

2017-08-28 Thread Jian He
gt; effort. >> >> We paid close attention to ensure that once disabled Timeline Service v.2 >> does not impact existing functionality when disabled (by default). >> >> Special thanks to a team of folks who worked hard and contributed towards >> this effort wit

Re: [DISCUSS] Merge yarn-native-services branch into trunk

2017-08-17 Thread Jian He
drew On Tue, Aug 15, 2017 at 1:56 PM, Jian He <j...@hortonworks.com<mailto:j...@hortonworks.com>> wrote: Hi All, I would like to bring up the discussion of merging yarn-native-services branch into trunk in a few weeks. There are a few issues left under YARN-5079 that are being activ

[DISCUSS] Merge yarn-native-services branch into trunk

2017-08-15 Thread Jian He
Hi All, I would like to bring up the discussion of merging yarn-native-services branch into trunk in a few weeks. There are a few issues left under YARN-5079 that are being actively worked upon. As soon as they are resolved, we plan on start a vote hopefully in next 2 weeks. The goal is to get

Re: Trunk fails

2017-07-22 Thread Jian He
, Brahma Reddy Battula <brahmareddy.batt...@hotmail.com<mailto:brahmareddy.batt...@hotmail.com>> wrote: FYI..After Jian he comment on YARN-6804,I reverted. Now trunk build will pass. From: Brahma Reddy Battula <brahmareddy.batt...@hotmail.com<mailt

Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)

2017-03-22 Thread Jian He
+1 (binding) - built from source - deployed a pseudo cluster - ran basic example tests. - Navigate the UI a bit, looks good. Jian > On Mar 22, 2017, at 9:03 PM, larry mccay wrote: > > +1 (non-binding) > > - verified signatures > - built from source and ran tests > -

[jira] [Reopened] (HADOOP-14062) ApplicationMasterProtocolPBClientImpl.allocate fails with EOFException when RPC privacy is enabled

2017-03-08 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He reopened HADOOP-14062: -- > ApplicationMasterProtocolPBClientImpl.allocate fails with EOFException when > RPC privacy is e

[jira] [Created] (HADOOP-14116) FailoverOnNetworkExceptionRetry does not wait when failover on certain exception

2017-02-23 Thread Jian He (JIRA)
Jian He created HADOOP-14116: Summary: FailoverOnNetworkExceptionRetry does not wait when failover on certain exception Key: HADOOP-14116 URL: https://issues.apache.org/jira/browse/HADOOP-14116 Project

[jira] [Created] (HADOOP-14080) UserGroupInformation#loginUserFromKeytab does not load hadoop tokens ?

2017-02-13 Thread Jian He (JIRA)
Jian He created HADOOP-14080: Summary: UserGroupInformation#loginUserFromKeytab does not load hadoop tokens ? Key: HADOOP-14080 URL: https://issues.apache.org/jira/browse/HADOOP-14080 Project: Hadoop

Re: [VOTE] Release Apache Hadoop 2.7.3 RC2

2016-08-20 Thread Jian He
+1 Built from source code. Deployed single node cluster. Successfully ran some example jobs. Jian > On Aug 18, 2016, at 10:05 AM, Vinod Kumar Vavilapalli > wrote: > > Hi all, > > I've created a new release candidate RC2 for Apache Hadoop 2.7.3. > > As discussed before,

Re: [VOTE] Release Apache Hadoop 2.7.3 RC0

2016-07-27 Thread Jian He
+1 for the source tarball. - Compiled and built from the source code - Deployed a cluster - Successfully ran some sample jobs. Thanks, Jian > On Jul 27, 2016, at 10:11 AM, Akira Ajisaka > wrote: > > +1 for the source tarball. > > - Downloaded source tarball and

Re: [Release thread] 2.8.0 release activities

2016-05-11 Thread Jian He
For MapReduce/YARN, I closed a few staled ones. Only 4 jiras needs attention for 2.8 MAPREDUCE-6288 YARN-1815 YARN-4685 YARN-4844 The rest are either improvements or long-standing issues and does not qualify release blocker, IMO. I think we’ll try to get these 4 jiras in asap. The rest will be

Re: [VOTE] Release Apache Hadoop 2.7.2 RC2

2016-01-22 Thread Jian He
+1, - built from source code - deployed a single cluster - run sample jobs which pass successfully. Jian > On Jan 22, 2016, at 6:52 AM, Sunil Govind wrote: > > +1 (Non Binding) > > * Built tar ball from source and deployed > * Verified few MR Jobs for various nodelabel

Re: [VOTE] Release Apache Hadoop 2.6.3 RC0

2015-12-16 Thread Jian He
+1, Build and deploy the cluster from source code. Ran a few example jobs and passed successfully. Jian > On Dec 16, 2015, at 2:19 PM, Vinod Kumar Vavilapalli > wrote: > > +1 (binding) for the RC except for my question below about the tag. > > I checked 2.6.3-RC0, based

[jira] [Reopened] (HADOOP-11017) KMS delegation token secret manager should be able to use zookeeper as store

2014-09-22 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He reopened HADOOP-11017: -- Took one more look. Looks like AbstractDelegationTokenSecretManager#addKey is changed to call

[jira] [Created] (HADOOP-11109) Site build is broken

2014-09-18 Thread Jian He (JIRA)
Jian He created HADOOP-11109: Summary: Site build is broken Key: HADOOP-11109 URL: https://issues.apache.org/jira/browse/HADOOP-11109 Project: Hadoop Common Issue Type: Bug Reporter

[jira] [Created] (HADOOP-10519) In HDFS HA mode, Distcp/SLive with webhdfs on secure cluster fails with Client cannot authenticate via:[TOKEN, KERBEROS] error

2014-04-17 Thread Jian He (JIRA)
Jian He created HADOOP-10519: Summary: In HDFS HA mode, Distcp/SLive with webhdfs on secure cluster fails with Client cannot authenticate via:[TOKEN, KERBEROS] error Key: HADOOP-10519 URL: https://issues.apache.org

[jira] [Created] (HADOOP-9907) Webapp http://hostname:port/metrics link is not working

2013-08-27 Thread Jian He (JIRA)
Jian He created HADOOP-9907: --- Summary: Webapp http://hostname:port/metrics link is not working Key: HADOOP-9907 URL: https://issues.apache.org/jira/browse/HADOOP-9907 Project: Hadoop Common

[jira] [Reopened] (HADOOP-9574) Add new methods in AbstractDelegationTokenSecretManager for restoring RMDelegationTokens on RMRestart

2013-05-29 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-9574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He reopened HADOOP-9574: - TestDelegationToken.testRollMasterKey is possibly failing because of timing issue Add

[jira] [Created] (HADOOP-9589) Extra master key is created when AbstractDelegationTokenSecretManager is started

2013-05-21 Thread Jian He (JIRA)
Jian He created HADOOP-9589: --- Summary: Extra master key is created when AbstractDelegationTokenSecretManager is started Key: HADOOP-9589 URL: https://issues.apache.org/jira/browse/HADOOP-9589 Project

[jira] [Created] (HADOOP-9574) Adding new methods in AbstractDelegationTokenSecretManager for restoring RMDelegationTokens on RMRestart

2013-05-17 Thread Jian He (JIRA)
Jian He created HADOOP-9574: --- Summary: Adding new methods in AbstractDelegationTokenSecretManager for restoring RMDelegationTokens on RMRestart Key: HADOOP-9574 URL: https://issues.apache.org/jira/browse/HADOOP-9574

[jira] [Created] (HADOOP-9576) Make NetUtils.wrapException throw EOFException instead of wrapping it as IOException

2013-05-17 Thread Jian He (JIRA)
Jian He created HADOOP-9576: --- Summary: Make NetUtils.wrapException throw EOFException instead of wrapping it as IOException Key: HADOOP-9576 URL: https://issues.apache.org/jira/browse/HADOOP-9576 Project