from:"Naganarasimha Garla"

Re: [VOTE] Release Apache Hadoop 3.2.1 - RC0

2019-09-17 Thread Naganarasimha Garla

Verified the source and the binary tar and the sha512 checksums
Installed and verified the basic hadoop operations (ran few MR tasks)

+1.

Thanks,
+ Naga

On Wed, Sep 18, 2019 at 1:32 AM Anil Sadineni  wrote:

> +1 (non-binding)
>
> On Tue, Sep 17, 2019 at 9:55 AM Santosh Marella  wrote:
>
> > +1 (non-binding)
> >
> > On Wed, Sep 11, 2019 at 12:26 AM Rohith Sharma K S <
> > rohithsharm...@apache.org> wrote:
> >
> > > Hi folks,
> > >
> > > I have put together a release candidate (RC0) for Apache Hadoop 3.2.1.
> > >
> > > The RC is available at:
> > > http://home.apache.org/~rohithsharmaks/hadoop-3.2.1-RC0/
> > >
> > > The RC tag in git is release-3.2.1-RC0:
> > > https://github.com/apache/hadoop/tree/release-3.2.1-RC0
> > >
> > >
> > > The maven artifacts are staged at
> > >
> https://repository.apache.org/content/repositories/orgapachehadoop-1226/
> > >
> > > You can find my public key at:
> > > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> > >
> > > This vote will run for 7 days(5 weekdays), ending on 18th Sept at 11:59
> > pm
> > > PST.
> > >
> > > I have done testing with a pseudo cluster and distributed shell job. My
> > +1
> > > to start.
> > >
> > > Thanks & Regards
> > > Rohith Sharma K S
> > >
> >
>
>
> --
> Thanks & Regards,
> Anil Sadineni
> Solutions Architect, Optlin Inc
> Ph: 571-438-1974 | www.optlin.com
>

Re: [VOTE] Moving Submarine to a separate Apache project proposal

2019-09-02 Thread Naganarasimha Garla

+ 1,
I would also like start participate in this project, hope to get myself
added to the project.

Thanks and Regards,
+ Naga

On Tue, Sep 3, 2019 at 8:35 AM Wangda Tan  wrote:

> Hi Sree,
>
> I put it to the proposal, please let me know what you think:
>
> The traditional path at Apache would have been to create an incubator
> > project, but the code is already being released by Apache and most of the
> > developers are familiar with Apache rules and guidelines. In particular,
> > the proposed PMC has 2 Apache TLP PMCs and proposed initial committers
> > have 4 Apache TLP PMCs (from 3 different companies). They will provide
> > oversight and guidance for the developers that are less experienced in
> the
> > Apache Way. Therefore, the Submarine project would like to propose
> becoming
> > a Top Level Project at Apache.
> >
>
> To me, putting to TLP has mostly pros, it is an easier process (same as ORC
> spin-off from Hive), much less overhead to both dev community and Apache
> side.
>
> Thanks,
> Wangda
>
> On Sun, Sep 1, 2019 at 2:04 PM Sree Vaddi  wrote:
>
> > +1 to move submarine to separate apache project.
> >
> > It is not clear in the proposal, if submarine majority voted to move to a
> > seperate apache project,
> > will it go through the incubation and TLP (top level project) later ?
> > 1. Incubation
> > pros and cons
> > efforts towards making it a TLP
> >
> > 2. direct TLP
> >
> >
> > Thank you.
> > /Sree
> >
> >
> >
> >
> > On Saturday, August 31, 2019, 10:19:06 PM PDT, Wangda Tan <
> > wheele...@gmail.com> wrote:
> >
> >
> > Hi all,
> >
> > As we discussed in the previous thread [1],
> >
> > I just moved the spin-off proposal to CWIKI and completed all TODO parts.
> >
> >
> >
> https://cwiki.apache.org/confluence/display/HADOOP/Submarine+Project+Spin-Off+to+TLP+Proposal
> >
> > If you have interests to learn more about this. Please review the
> proposal
> > let me know if you have any questions/suggestions for the proposal. This
> > will be sent to board post voting passed. (And please note that the
> > previous voting thread [2] to move Submarine to a separate Github repo
> is a
> > necessary effort to move Submarine to a separate Apache project but not
> > sufficient so I sent two separate voting thread.)
> >
> > Please let me know if I missed anyone in the proposal, and reply if you'd
> > like to be included in the project.
> >
> > This voting runs for 7 days and will be concluded at Sep 7th, 11 PM PDT.
> >
> > Thanks,
> > Wangda Tan
> >
> > [1]
> >
> >
> https://lists.apache.org/thread.html/4a2210d567cbc05af92c12aa6283fd09b857ce209d537986ed800029@%3Cyarn-dev.hadoop.apache.org%3E
> > [2]
> >
> >
> https://lists.apache.org/thread.html/6e94469ca105d5a15dc63903a541bd21c7ef70b8bcff475a16b5ed73@%3Cyarn-dev.hadoop.apache.org%3E
> >
>

Re: [VOTE] Propose to start new Hadoop sub project "submarine"

2019-02-01 Thread Naganarasimha Garla

+1

On Sat, 2 Feb 2019, 09:51 Rohith Sharma K S  +1
>
> On Sat, Feb 2, 2019, 3:54 AM Wangda Tan  wrote:
>
> > Hi all,
> >
> > According to positive feedbacks from the thread [1]
> >
> > This is vote thread to start a new subproject named "hadoop-submarine"
> > which follows the release process already established for ozone.
> >
> > The vote runs for usual 7 days, which ends at Feb 8th 5 PM PDT.
> >
> > Thanks,
> > Wangda Tan
> >
> > [1]
> >
> >
> https://lists.apache.org/thread.html/f864461eb188bd12859d51b0098ec38942c4429aae7e4d001a633d96@%3Cyarn-dev.hadoop.apache.org%3E
> >
>

Re: [VOTE] Release Apache Hadoop 3.2.0 - RC1

2019-01-16 Thread Naganarasimha Garla

+1 (binding) Apologies for one more late vote!

- Built from source and also installed the release tar.
- Verified all Node Labels and node .
-  Ran sample jobs and verified UI

Thanks and Regards,
+ Naga

On Wed, Jan 16, 2019 at 10:34 PM Rohith Sharma K S <
rohithsharm...@apache.org> wrote:

> +1 (binding) Apologies for late vote!
>
> - Built from source for hbase profile=2.0 and deployed RM HA cluster along
> with ATSv2.0 enabled.
> - Ran sample jobs and verified all ATSv2.0 data are publishing.
> - Verified UI2 for ATSv2.0 data!
>
> -Rohith Sharma K S
>
> On Wed, 16 Jan 2019 at 07:00, Sunil G  wrote:
>
> > Thanks everyone for helping to vote this release!
> >
> > With 7 binding votes, 10 non-binding votes and no veto, this vote stands
> >  passed,
> > I'm going to work on staging the release.
> >
> > Thanks,
> > Sunil
> >
> > On Tue, Jan 15, 2019 at 9:59 PM Weiwei Yang  wrote:
> >
> > > +1 (binding)
> > >
> > > - Setup a cluster, run teragen/terasort jobs
> > > - Verified general readability of documentation (titles/navigations)
> > > - Run some simple yarn commands: app/applicationattempt/container
> > > - Checked restful APIs: RM cluster/metrics/scheduler/nodes, NM
> > > node/apps/container
> > > - Verified simple failover scenario
> > > - Submitted distributed shell apps with affinity/anti-affinity
> > constraints
> > > - Configured conf based node attribute provider, alter attribute values
> > > and verified the change
> > > - Verified CLI add/list/remove node-attributes, submitted app with
> simple
> > > node-attribute constraint
> > >
> > > --
> > > Weiwei
> > >
> >
>

Re: [Vote] Merge discussion for Node attribute support feature YARN-3409

2018-09-12 Thread Naganarasimha Garla

Thanks for reporting Sean and Sunil for acting on it. My bad i had used
alias to compile which was skipping the javadoc !
Will try to commit as soon as the jenkins results are out.

On Thu, Sep 13, 2018 at 1:18 AM Sunil G  wrote:

> Thanks Sean
>
> YARN-8768 is raised and we will get this in very soon.
>
> - Sunil
>
> On Wed, Sep 12, 2018 at 9:16 PM Sean Mackrory 
> wrote:
>
>> `mvn install` fails on trunk right now due to javadoc error in yarn-api.
>> Is
>> that related? If so, can we revert or fix ASAP please?
>>
>> On Wed, Sep 12, 2018 at 6:05 AM Naganarasimha Garla <
>> naganarasimha...@apache.org> wrote:
>>
>> > Hi All,
>> >  Me and Sunil have successfully merged YARN-3409 to the trunk
>> and
>> > we have created new umbrella jira YARN-8766 to track the pending jiras
>> and
>> > the remaining planned improvement features.
>> > Thanks all for the support !
>> >
>> > Regards,
>> > + Naga
>> >
>> >
>> > On Wed, Sep 12, 2018 at 7:46 AM Naganarasimha Garla <
>> > naganarasimha...@apache.org> wrote:
>> >
>> > > Hi All,
>> > >  Voting has been running since 6 days and adding my vote we
>> have
>> > 4
>> > > binding and 2 non binding +1's with no -1's this voting passes and we
>> > will
>> > > be merging the branch shortly. Thanks for all who participated in the
>> > > discussion and voting thread !
>> > >
>> > > Thanks and Regards,
>> > > + Naga
>> > >
>> > > On Mon, Sep 10, 2018 at 2:50 PM Zian Chen 
>> wrote:
>> > >
>> > >> +1 for merge.
>> > >>
>> > >> > On Sep 9, 2018, at 10:47 PM, Weiwei Yang 
>> wrote:
>> > >> >
>> > >> > +1 for the merge
>> > >> >
>> > >> > On Mon, Sep 10, 2018 at 12:06 PM Rohith Sharma K S <
>> > >> > rohithsharm...@apache.org> wrote:
>> > >> >
>> > >> >> +1 for merge
>> > >> >>
>> > >> >> -Rohith Sharma K S
>> > >> >>
>> > >> >> On Wed, 5 Sep 2018 at 18:01, Naganarasimha Garla <
>> > >> >> naganarasimha...@apache.org> wrote:
>> > >> >>
>> > >> >>> Hi All,
>> > >> >>>Thanks for feedback folks, based on the positive response
>> > >> >> starting
>> > >> >>> a Vote thread for merging YARN-3409 to master.
>> > >> >>>
>> > >> >>> Regards,
>> > >> >>> + Naga & Sunil
>> > >> >>>
>> > >> >>> On Wed, 5 Sep 2018 2:51 am Wangda Tan, 
>> wrote:
>> > >> >>>
>> > >> >>>> +1 for the merge, it gonna be a great addition to 3.2.0 release.
>> > >> Thanks
>> > >> >>> to
>> > >> >>>> everybody for pushing this feature to complete.
>> > >> >>>>
>> > >> >>>> Best,
>> > >> >>>> Wangda
>> > >> >>>>
>> > >> >>>> On Tue, Sep 4, 2018 at 8:25 AM Bibinchundatt <
>> > >> >> bibin.chund...@huawei.com>
>> > >> >>>> wrote:
>> > >> >>>>
>> > >> >>>>> +1 for merge. Fetaure would be a good addition to 3.2 release.
>> > >> >>>>>
>> > >> >>>>> --
>> > >> >>>>> Bibin A Chundatt
>> > >> >>>>> M: +91-9742095715 <+91%2097420%2095715>
>> > >> >>>>> E: bibin.chund...@huawei.com<mailto:bibin.chund...@huawei.com>
>> > >> >>>>> 2012实验室-印研IT BU分部
>> > >> >>>>> 2012 Laboratories-IT BU Branch Dept.
>> > >> >>>>> From:Naganarasimha Garla
>> > >> >>>>> To:common-dev@hadoop.apache.org,Hdfs-dev,
>> > yarn-...@hadoop.apache.org
>> > >> ,
>> > >> >>>>> mapreduce-...@hadoop.apache.org,
>> > >> >>>>> Date:2018-08-29 20:00:44
>> > >> >>>>> Subject:[Discuss] Merge discussion for Node attribute support
>> > >> feat

Re: [Vote] Merge discussion for Node attribute support feature YARN-3409

2018-09-12 Thread Naganarasimha Garla

Hi All,
 Me and Sunil have successfully merged YARN-3409 to the trunk and
we have created new umbrella jira YARN-8766 to track the pending jiras and
the remaining planned improvement features.
Thanks all for the support !

Regards,
+ Naga


On Wed, Sep 12, 2018 at 7:46 AM Naganarasimha Garla <
naganarasimha...@apache.org> wrote:

> Hi All,
>  Voting has been running since 6 days and adding my vote we have 4
> binding and 2 non binding +1's with no -1's this voting passes and we will
> be merging the branch shortly. Thanks for all who participated in the
> discussion and voting thread !
>
> Thanks and Regards,
> + Naga
>
> On Mon, Sep 10, 2018 at 2:50 PM Zian Chen  wrote:
>
>> +1 for merge.
>>
>> > On Sep 9, 2018, at 10:47 PM, Weiwei Yang  wrote:
>> >
>> > +1 for the merge
>> >
>> > On Mon, Sep 10, 2018 at 12:06 PM Rohith Sharma K S <
>> > rohithsharm...@apache.org> wrote:
>> >
>> >> +1 for merge
>> >>
>> >> -Rohith Sharma K S
>> >>
>> >> On Wed, 5 Sep 2018 at 18:01, Naganarasimha Garla <
>> >> naganarasimha...@apache.org> wrote:
>> >>
>> >>> Hi All,
>> >>>Thanks for feedback folks, based on the positive response
>> >> starting
>> >>> a Vote thread for merging YARN-3409 to master.
>> >>>
>> >>> Regards,
>> >>> + Naga & Sunil
>> >>>
>> >>> On Wed, 5 Sep 2018 2:51 am Wangda Tan,  wrote:
>> >>>
>> >>>> +1 for the merge, it gonna be a great addition to 3.2.0 release.
>> Thanks
>> >>> to
>> >>>> everybody for pushing this feature to complete.
>> >>>>
>> >>>> Best,
>> >>>> Wangda
>> >>>>
>> >>>> On Tue, Sep 4, 2018 at 8:25 AM Bibinchundatt <
>> >> bibin.chund...@huawei.com>
>> >>>> wrote:
>> >>>>
>> >>>>> +1 for merge. Fetaure would be a good addition to 3.2 release.
>> >>>>>
>> >>>>> --
>> >>>>> Bibin A Chundatt
>> >>>>> M: +91-9742095715
>> >>>>> E: bibin.chund...@huawei.com<mailto:bibin.chund...@huawei.com>
>> >>>>> 2012实验室-印研IT BU分部
>> >>>>> 2012 Laboratories-IT BU Branch Dept.
>> >>>>> From:Naganarasimha Garla
>> >>>>> To:common-dev@hadoop.apache.org,Hdfs-dev,yarn-...@hadoop.apache.org
>> ,
>> >>>>> mapreduce-...@hadoop.apache.org,
>> >>>>> Date:2018-08-29 20:00:44
>> >>>>> Subject:[Discuss] Merge discussion for Node attribute support
>> feature
>> >>>>> YARN-3409
>> >>>>>
>> >>>>> Hi All,
>> >>>>>
>> >>>>> We would like to hear your thoughts on merging “Node Attributes
>> >> Support
>> >>> in
>> >>>>> YARN” branch (YARN-3409) [2] into trunk in a few weeks. The goal is
>> to
>> >>> get
>> >>>>> it in for HADOOP 3.2.
>> >>>>>
>> >>>>> *Major work happened in this branch*
>> >>>>>
>> >>>>> YARN-6858. Attribute Manager to store and provide node attributes in
>> >> RM
>> >>>>> YARN-7871. Support Node attributes reporting from NM to RM(
>> >> distributed
>> >>>>> node attributes)
>> >>>>> YARN-7863. Modify placement constraints to support node attributes
>> >>>>> YARN-7875. Node Attribute store for storing and recovering
>> attributes
>> >>>>>
>> >>>>> *Detailed Design:*
>> >>>>>
>> >>>>> Please refer [1] for detailed design document.
>> >>>>>
>> >>>>> *Testing Efforts:*
>> >>>>>
>> >>>>> We did detailed tests for the feature in the last few weeks.
>> >>>>> This feature will be enabled only when Node Attributes constraints
>> are
>> >>>>> specified through SchedulingRequest from AM.
>> >>>>> Manager implementation will help to store and recover Node
>> Attributes.
>> >>>>> This
>> >>>>> works with existing placement constraints.
>> >>>>>
>> >>>>> *Regarding to API stability:*
>> >>>>>
>> >>>>> All newly added @Public APIs are @Unstable.
>> >>>>>
>> >>>>> Documentation jira [3] could help to provide detailed configuration
>> >>>>> details. This feature works from end-to-end and we tested this in
>> our
>> >>>>> local
>> >>>>> cluster. Branch code is run against trunk and tracked via [4].
>> >>>>>
>> >>>>> We would love to get your thoughts before opening a voting thread.
>> >>>>>
>> >>>>> Special thanks to a team of folks who worked hard and contributed
>> >>> towards
>> >>>>> this efforts including design discussion / patch / reviews, etc.:
>> >> Weiwei
>> >>>>> Yang, Bibin Chundatt, Wangda Tan, Vinod Kumar Vavilappali,
>> >> Konstantinos
>> >>>>> Karanasos, Arun Suresh, Varun Saxena, Devaraj Kavali, Lei Guo, Chong
>> >>> Chen.
>> >>>>>
>> >>>>> [1] :
>> >>>>>
>> >>>>>
>> >>>
>> >>
>> https://issues.apache.org/jira/secure/attachment/12937633/Node-Attributes-Requirements-Design-doc_v2.pdf
>> >>>>> [2] : https://issues.apache.org/jira/browse/YARN-3409
>> >>>>> [3] : https://issues.apache.org/jira/browse/YARN-7865
>> >>>>> [4] : https://issues.apache.org/jira/browse/YARN-8718
>> >>>>>
>> >>>>> Thanks,
>> >>>>> + Naga & Sunil Govindan
>> >>>>>
>> >>>>
>> >>>
>> >>
>> >
>> >
>> > --
>> > Weiwei Yang
>>
>>

Re: [Vote] Merge discussion for Node attribute support feature YARN-3409

2018-09-05 Thread Naganarasimha Garla

Hi All,
 Thanks for feedback folks, based on the positive response starting
a Vote thread for merging YARN-3409 to master.

Regards,
+ Naga & Sunil

On Wed, 5 Sep 2018 2:51 am Wangda Tan,  wrote:

> +1 for the merge, it gonna be a great addition to 3.2.0 release. Thanks to
> everybody for pushing this feature to complete.
>
> Best,
> Wangda
>
> On Tue, Sep 4, 2018 at 8:25 AM Bibinchundatt 
> wrote:
>
>> +1 for merge. Fetaure would be a good addition to 3.2 release.
>>
>> --
>> Bibin A Chundatt
>> M: +91-9742095715
>> E: bibin.chund...@huawei.com
>> 2012实验室-印研IT BU分部
>> 2012 Laboratories-IT BU Branch Dept.
>> From:Naganarasimha Garla
>> To:common-dev@hadoop.apache.org,Hdfs-dev,yarn-...@hadoop.apache.org,
>> mapreduce-...@hadoop.apache.org,
>> Date:2018-08-29 20:00:44
>> Subject:[Discuss] Merge discussion for Node attribute support feature
>> YARN-3409
>>
>> Hi All,
>>
>> We would like to hear your thoughts on merging “Node Attributes Support in
>> YARN” branch (YARN-3409) [2] into trunk in a few weeks. The goal is to get
>> it in for HADOOP 3.2.
>>
>> *Major work happened in this branch*
>>
>> YARN-6858. Attribute Manager to store and provide node attributes in RM
>> YARN-7871. Support Node attributes reporting from NM to RM( distributed
>> node attributes)
>> YARN-7863. Modify placement constraints to support node attributes
>> YARN-7875. Node Attribute store for storing and recovering attributes
>>
>> *Detailed Design:*
>>
>> Please refer [1] for detailed design document.
>>
>> *Testing Efforts:*
>>
>> We did detailed tests for the feature in the last few weeks.
>> This feature will be enabled only when Node Attributes constraints are
>> specified through SchedulingRequest from AM.
>> Manager implementation will help to store and recover Node Attributes.
>> This
>> works with existing placement constraints.
>>
>> *Regarding to API stability:*
>>
>> All newly added @Public APIs are @Unstable.
>>
>> Documentation jira [3] could help to provide detailed configuration
>> details. This feature works from end-to-end and we tested this in our
>> local
>> cluster. Branch code is run against trunk and tracked via [4].
>>
>> We would love to get your thoughts before opening a voting thread.
>>
>> Special thanks to a team of folks who worked hard and contributed towards
>> this efforts including design discussion / patch / reviews, etc.: Weiwei
>> Yang, Bibin Chundatt, Wangda Tan, Vinod Kumar Vavilappali, Konstantinos
>> Karanasos, Arun Suresh, Varun Saxena, Devaraj Kavali, Lei Guo, Chong Chen.
>>
>> [1] :
>>
>> https://issues.apache.org/jira/secure/attachment/12937633/Node-Attributes-Requirements-Design-doc_v2.pdf
>> [2] : https://issues.apache.org/jira/browse/YARN-3409
>> [3] : https://issues.apache.org/jira/browse/YARN-7865
>> [4] : https://issues.apache.org/jira/browse/YARN-8718
>>
>> Thanks,
>> + Naga & Sunil Govindan
>>
>

[Discuss] Merge discussion for Node attribute support feature YARN-3409

2018-08-29 Thread Naganarasimha Garla

Hi All,

We would like to hear your thoughts on merging “Node Attributes Support in
YARN” branch (YARN-3409) [2] into trunk in a few weeks. The goal is to get
it in for HADOOP 3.2.

*Major work happened in this branch*

YARN-6858. Attribute Manager to store and provide node attributes in RM
YARN-7871. Support Node attributes reporting from NM to RM( distributed
node attributes)
YARN-7863. Modify placement constraints to support node attributes
YARN-7875. Node Attribute store for storing and recovering attributes

*Detailed Design:*

Please refer [1] for detailed design document.

*Testing Efforts:*

We did detailed tests for the feature in the last few weeks.
This feature will be enabled only when Node Attributes constraints are
specified through SchedulingRequest from AM.
Manager implementation will help to store and recover Node Attributes. This
works with existing placement constraints.

*Regarding to API stability:*

All newly added @Public APIs are @Unstable.

Documentation jira [3] could help to provide detailed configuration
details. This feature works from end-to-end and we tested this in our local
cluster. Branch code is run against trunk and tracked via [4].

We would love to get your thoughts before opening a voting thread.

Special thanks to a team of folks who worked hard and contributed towards
this efforts including design discussion / patch / reviews, etc.: Weiwei
Yang, Bibin Chundatt, Wangda Tan, Vinod Kumar Vavilappali, Konstantinos
Karanasos, Arun Suresh, Varun Saxena, Devaraj Kavali, Lei Guo, Chong Chen.

[1] :
https://issues.apache.org/jira/secure/attachment/12937633/Node-Attributes-Requirements-Design-doc_v2.pdf
[2] : https://issues.apache.org/jira/browse/YARN-3409
[3] : https://issues.apache.org/jira/browse/YARN-7865
[4] : https://issues.apache.org/jira/browse/YARN-8718

Thanks,
+ Naga & Sunil Govindan

Re: [VOTE] Release Apache Hadoop 3.1.0 (RC1)

2018-04-05 Thread Naganarasimha Garla

+1 (binding)

* Verified signatures
* Verified checksums for source and binary artefacts
* Built from source
* Deployed a pseudo Hadoop cluster
* Verified YARN & HDFS web UIs
* Ran sample MapReduce jobs
* Tested NodeLabels

Regards,
+ Naga

On Thu, Apr 5, 2018 at 2:59 AM, Suma Shivaprasad <
sumasai.shivapra...@gmail.com> wrote:

> +1 (non binding)
>
>
> *Verified - User Group Queue mapping - Node labels with New UI- Dynamic
> queuesThanksSuma*
>
>
> On Wed, Apr 4, 2018 at 11:48 AM, Steve Loughran 
> wrote:
>
> > that's "dangerously interesting". I think you are right, and I also think
> > it'll just be the version files which get generated
> >
> > anyway, +1 binding
> >
> > * ran my new Hadoop-3 profile on spark (SPARK-23807), with the committer
> > binding, then my downstream tests. All is well, provided you also have a
> > spark hive JAR patched to accept hadoop 3 as a legitimate hadoop version.
> > That's an ongoing issue in the Spark project. With that JAR on my CP my
> > downstream tests were all happy (yesterday)
> >
> > * today the staging files seem to be missing, at least maven is unable to
> > find them even when I turn the spark snapshots-and-staging profile on.
> > That'll be the maven dist process at play, nothing else
> >
> > On 4 Apr 2018, at 04:13, Wangda Tan  > eele...@gmail.com>> wrote:
> >
> > Hi Vinod / Arpit,
> >
> > I checked following versions:
> > - 2.6.5 / 2.7.5 / 2.8.3 / 2.9.0 / 3.0.1:
> >
> > Jars in maven repo [1] are *always* different from jars in the binary
> > tarball [2]: (I only checked hadoop-yarn-api-version.jar)
> >
> > (Following numbers are sizes of the jar)
> > 2.6.5:
> > - Jar in Maven: 1896185
> > - Jar in tarball: 1891485
> >
> > 2.7.5:
> > - Jar in Maven: 2039371 (md5: 15e76f7c734b49315ef2bce952509ddf)
> > - Jar in tarball: 2039371 (md5: 0ef9f42f587401f5b49b39f27459f3ef)
> > (Even size is same, md5 is different)
> >
> > 2.8.3:
> > - Jar in Maven: 2451433
> > - Jar in tarball: 2438975
> >
> > 2.9.0:
> > - Jar in Maven: 2791477
> > - Jar in tarball: 289
> >
> > 3.0.1:
> > - Jar in Maven: 2852604
> > - Jar in tarball: 2851373
> >
> > I guess the differences come from our release process.
> >
> > Thanks,
> > Wangda
> >
> > [1] Maven jars are downloaded from
> > https://repository.apache.org/service/local/repositories/
> > releases/content/org/apache/hadoop/hadoop-yarn-api/
> > /hadoop-yarn-api-.jar
> > [2] Binary tarballs downloaded from http://apache.claz.org/hadoop/
> common/
> >
> >
> > On Tue, Apr 3, 2018 at 4:25 PM, Vinod Kumar Vavilapalli <
> > vino...@apache.org>
> > wrote:
> >
> > We vote on the source code. The binaries are convenience artifacts.
> >
> > This is what I would do - (a) Just replace both the maven jars as well as
> > the binaries to be consistent and correct. And then (b) Give a couple
> more
> > days for folks who tested on the binaries to reverify - I count one such
> > clear vote as of now.
> >
> > Thanks
> > +Vinod
> >
> >
> > On Apr 3, 2018, at 3:30 PM, Wangda Tan  > eele...@gmail.com>> wrote:
> >
> > HI Arpit,
> >
> > I think it won't match if we do rebuild. It should be fine as far as
> > they're signed, correct? I don't see any policy doesn't allow this.
> >
> > Thanks,
> > Wangda
> >
> >
> > On Tue, Apr 3, 2018 at 9:33 AM, Arpit Agarwal  > mailto:aagar...@hortonworks.com>>
> > wrote:
> >
> > Thanks Wangda, I see the shaded jars now.
> >
> > Are the repo jars required to be the same as the binary release? They
> > don’t match right now, probably they got rebuilt.
> >
> > +1 (binding), modulo that remaining question.
> >
> > * Verified signatures
> > * Verified checksums for source and binary artefacts
> > * Sanity checked jars on r.a.o.
> > * Built from source
> > * Deployed to 3 node secure cluster with NameNode HA
> > * Verified HDFS web UIs
> > * Tried out HDFS shell commands
> > * Ran sample MapReduce jobs
> >
> > Thanks!
> >
> >
> > --
> > From: Wangda Tan >
> > Date: Monday, April 2, 2018 at 9:25 PM
> > To: Arpit Agarwal  > com>>
> > Cc: Gera Shegalov >, Sunil G <
> > sun...@apache.org>, "
> > yarn-...@hadoop.apache.org" <
> > yarn-...@hadoop.apache.org>,
> Hdfs-dev <
> > hdfs-...@hadoop.apache.org>, Hadoop
> > Common  > >>,
> > "mapreduce-...@hadoop.apache.org >"
> >  >>,
> > Vinod Kumar Vavilapalli >
> > Subject: Re:

Re: [RESULT] [VOTE] Release Apache Hadoop 2.7.5 (RC1)

2017-12-15 Thread Naganarasimha Garla

Sorry for the delayed reply,  and thanks for the work Konstantin
+1 Binding

Verified the following:
- Downloaded the tar on Ubuntu and verified the signatures
- Deployed pseudo cluster
- Sanity checks
- Basic hdfs operations
- Spark PyWordcount & few MR jobs (sleep , word count ..)
- Accessed most of the web UI's

Regards,
+ Naga

On Sat, Dec 16, 2017 at 12:29 AM, Konstantin Shvachko 
wrote:

> Correction:
> With 7 binding and 4 non-binding +1s and no -1s the vote for Apache Release
> 2.7.5 passes.
> Thank you everybody for contributing to the release, testing it, and
> voting.
>
> Binding +1s
> Kihwal Lee
> Jason Lowe
> John Zhuge
> Rohith Sharma K S
> Eric Payne
> Zhe Zhang
> Konstantin Shvachko
>
> Non-binding +1s
> Erik Krogen
> Brahma Reddy Battula
> Eric Badger
> Jonathan Hung
>
>
> On Fri, Dec 15, 2017 at 8:25 AM, Konstantin Shvachko  >
> wrote:
>
> > Hi everybody,
> >
> > With 6 binding and 4 non-binding +1s and no -1s the vote for Apache
> > Release 2.7.5 passes.
> > Thank you everybody for contributing to the release, testing it, and
> > voting.
> >
> > Binding +1s
> > Kihwal Lee
> > Jason Lowe
> > John Zhuge
> > Rohith Sharma K S
> > Eric Payne
> > Zhe Zhang
> >
> > Non-binding +1s
> > Erik Krogen
> > Brahma Reddy Battula
> > Eric Badger
> > Jonathan Hung
> >
> >
> > On Thu, Dec 7, 2017 at 7:22 PM, Konstantin Shvachko <
> shv.had...@gmail.com>
> > wrote:
> >
> >> Hi everybody,
> >>
> >> I updated CHANGES.txt and fixed documentation links.
> >> Also committed  MAPREDUCE-6165, which fixes a consistently failing test.
> >>
> >> This is RC1 for the next dot release of Apache Hadoop 2.7 line. The
> >> previous one 2.7.4 was release August 4, 2017.
> >> Release 2.7.5 includes critical bug fixes and optimizations. See more
> >> details in Release Note:
> >> http://home.apache.org/~shv/hadoop-2.7.5-RC1/releasenotes.html
> >>
> >> The RC0 is available at: http://home.apache.org/~shv/hadoop-2.7.5-RC1/
> >>
> >> Please give it a try and vote on this thread. The vote will run for 5
> >> days ending 12/13/2017.
> >>
> >> My up to date public key is available from:
> >> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> >>
> >> Thanks,
> >> --Konstantin
> >>
> >
> >
>

Re: [VOTE] Release Apache Hadoop 2.8.3 (RC0)

2017-12-13 Thread Naganarasimha Garla

Thanks Junping for the release. +1 (binding)

Tested on a single node pseudo cluster, I performed the following tests:
- Downloaded the tars and verified the signatures, installed using the tar
- Successfully ran few MR jobs
- Verified few hdfs operations
- Verified RM,NM and HDFS webui's
- configured labels and submitted some apps

Thanks and Regards,
+ Naga

On Wed, Dec 13, 2017 at 8:14 PM, Sunil G  wrote:

> +1 (binding)
>
> Thanks Junping for the effort.
> I have deployed a cluster built from source tar ball.
>
>
>- Ran few MR apps and verified UI. CLI commands are also fine related to
>app.
>- Tested below feature sanity
>   - Application priority
>   - Application timeout
>- Tested basic NodeLabel scenarios.
>   - Added some labels to couple of nodes
>   - Verified old UI for labels
>   - Submitted apps to labelled cluster and it works fine.
>   - Also performed few cli commands related to nodelabel
>- Test basic HA cases
>
>
> Thanks
> Sunil G
>
>
> On Tue, Dec 5, 2017 at 3:28 PM Junping Du  wrote:
>
> > Hi all,
> >  I've created the first release candidate (RC0) for Apache Hadoop
> > 2.8.3. This is our next maint release to follow up 2.8.2. It includes 79
> > important fixes and improvements.
> >
> >   The RC artifacts are available at:
> > http://home.apache.org/~junping_du/hadoop-2.8.3-RC0
> >
> >   The RC tag in git is: release-2.8.3-RC0
> >
> >   The maven artifacts are available via repository.apache.org at:
> > https://repository.apache.org/content/repositories/orgapachehadoop-1072
> >
> >   Please try the release and vote; the vote will run for the usual 5
> > working days, ending on 12/12/2017 PST time.
> >
> > Thanks,
> >
> > Junping
> >
>

Re: VOTE] Release Apache Hadoop 2.7.5 (RC0)

2017-12-06 Thread Naganarasimha Garla

Thanks for the release Konstantin.

Verified the following:
- Downloaded the tar on Ubuntu and verified the signatures
- Deployed pseudo cluster
- Sanity checks
- Basic hdfs operations
- Spark PyWordcount & few MR jobs
- Accessed most of the web UI's

when accessing the docs(from the tar) was able to notice :
-  Release Notes, Common, HDFS, MapReduce Changes showing file not
found
-  I observed that changes for all components were not available
for 2.7.4 as well (
http://hadoop.apache.org/docs/r2.7.4/hadoop-project-dist/hadoop-common/CHANGES.txt
)

So not sure whether its missed or not required, else everything else is
fine.

Regards,
+ Naga


On Tue, Dec 5, 2017 at 2:50 PM, Brahma Reddy Battula <
brahmareddy.batt...@huawei.com> wrote:

> +1  (non-binding), thanks Konstantin for driving this.
>
>
> --Built from the source
> --Installed 3 Node HA Cluster
> --Ran basic shell commands
> --Verified append/snapshot/truncate
> --Ran sample jobs like pi,wordcount
>
>
> Looks follow commits are missed in changes.txt.
>
> MAPREDUCE-6975
> HADOOP-14919
> HDFS-12596
> YARN-7084
> HADOOP-14881
> HADOOP-14827
> HDFS-12832
>
>
> --Brahma Reddy Battula
>
> -Original Message-
> From: Konstantin Shvachko [mailto:shv.had...@gmail.com]
> Sent: 02 December 2017 10:13
> To: common-dev@hadoop.apache.org; hdfs-...@hadoop.apache.org;
> mapreduce-...@hadoop.apache.org; yarn-...@hadoop.apache.org
> Subject: VOTE] Release Apache Hadoop 2.7.5 (RC0)
>
> Hi everybody,
>
> This is the next dot release of Apache Hadoop 2.7 line. The previous one
> 2.7.4 was release August 4, 2017.
> Release 2.7.5 includes critical bug fixes and optimizations. See more
> details in Release Note:
> http://home.apache.org/~shv/hadoop-2.7.5-RC0/releasenotes.html
>
> The RC0 is available at: http://home.apache.org/~shv/hadoop-2.7.5-RC0/
>
> Please give it a try and vote on this thread. The vote will run for 5 days
> ending 12/08/2017.
>
> My up to date public key is available from:
> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>
> Thanks,
> --Konstantin
>

Re: [VOTE] Merge feature branch YARN-5355 (Timeline Service v2) to trunk

2017-08-23 Thread Naganarasimha Garla

+1 (Binding), Great work guys, unwavering dedication and team effort. Kudos
to the whole team.
Though i have not tested, just went through the jiras and features added.

Just wanted to know whether there was any other key out standing features
left after phase 2 and their impacts ?
And it would interesting to share the plans (if available) of upstream
projects like Tez, Spark to incorporate ATSv2.

Regards,
+ Naga



On Thu, Aug 24, 2017 at 12:28 AM, varunsax...@apache.org <
varun.saxena.apa...@gmail.com> wrote:

> Hi All,
>
> Just to update.
> Folks who may be interested in going through the documentation for the
> feature can refer to current documentation attached in pdf format, on the
> umbrella JIRA i.e. YARN-5355.
>
> Furthermore, we have run the YARN-5355 patch(with all the changes made in
> the branch) against trunk and the build is almost green barring a few
> checkstyle issues. The test failures which come up in the build are
> outstanding issues on trunk.
> Refer to https://issues.apache.org/jira/browse/YARN-5355?focusedCo
> mmentId=16138266=com.atlassian.jira.plugin.system.
> issuetabpanels:comment-tabpanel#comment-16138266
>
> Thanks,
> Varun Saxena.
>
> On Tue, Aug 22, 2017 at 12:02 PM, Vrushali Channapattan <
> vrushalic2...@gmail.com> wrote:
>
> > Hi folks,
> >
> > Per earlier discussion [1], I'd like to start a formal vote to merge
> > feature branch YARN-5355 [2] (Timeline Service v.2) to trunk. The vote
> will
> > run for 7 days, and will end August 29 11:00 PM PDT.
> >
> > We have previously completed one merge onto trunk [3] and Timeline
> Service
> > v2 has been part of Hadoop release 3.0.0-alpha1.
> >
> > Since then, we have been working on extending the capabilities of
> Timeline
> > Service v2 in a feature branch [2] for a while, and we are reasonably
> > confident that the state of the feature meets the criteria to be merged
> > onto trunk and we'd love folks to get their hands on it in a test
> capacity
> > and provide valuable feedback so that we can make it production-ready.
> >
> > In a nutshell, Timeline Service v.2 delivers significant scalability and
> > usability improvements based on a new architecture. What we would like to
> > merge to trunk is termed "alpha 2" (milestone 2). The feature has a
> > complete end-to-end read/write flow with security and read level
> > authorization via whitelists. You should be able to start setting it up
> and
> > testing it.
> >
> > At a high level, the following are the key features that have been
> > implemented since alpha1:
> > - Security via Kerberos Authentication and delegation tokens
> > - Read side simple authorization via whitelist
> > - Client configurable entity sort ordering
> > - Richer REST APIs for apps, app attempts, containers, fetching metrics
> by
> > timerange, pagination, sub-app entities
> > - Support for storing sub-application entities (entities that exist
> outside
> > the scope of an application)
> > - Configurable TTLs (time-to-live) for tables, configurable table
> prefixes,
> > configurable hbase cluster
> > - Flow level aggregations done as dynamic (table level) coprocessors
> > - Uses latest stable HBase release 1.2.6
> >
> > There are a total of 82 subtasks that were completed as part of this
> > effort.
> >
> > We paid close attention to ensure that once disabled Timeline Service v.2
> > does not impact existing functionality when disabled (by default).
> >
> > Special thanks to a team of folks who worked hard and contributed towards
> > this effort with patches, reviews and guidance: Rohith Sharma K S, Varun
> > Saxena, Haibo Chen, Sangjin Lee, Li Lu, Vinod Kumar Vavilapalli, Joep
> > Rottinghuis, Jason Lowe, Jian He, Robert Kanter, Micheal Stack.
> >
> > Regards,
> > Vrushali
> >
> > [1] http://www.mail-archive.com/yarn-dev@hadoop.apache.org/msg27383.html
> > [2] https://issues.apache.org/jira/browse/YARN-5355
> > [3] https://issues.apache.org/jira/browse/YARN-2928
> > [4] https://github.com/apache/hadoop/commits/YARN-5355
> >
>

Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)

2017-03-22 Thread Naganarasimha Garla

Thanks Junping for putting this up,.

+1 (non-binding)

* downloaded verified signature and md5.
* Built from source & deployed  pseudo cluster with labels enabled
* ran some sample jobs with partitions specified.
* Navigate through YARN & MR UI's
* executed basic dfs cmds.

Regards,
+ Naga



On Wed, Mar 22, 2017 at 11:23 PM, Rakesh Radhakrishnan 
wrote:

> Thanks Junping for getting this out.
>
> +1 (non-binding)
>
> * downloaded and built from source with jdk1.8.0_45
> * deployed HDFS-HA cluster
> * ran some sample jobs
> * run balancer
> * executed basic dfs cmds
>
>
> Rakesh
>
> On Wed, Mar 22, 2017 at 8:30 PM, Jian He  wrote:
>
> > +1 (binding)
> >
> > - built from source
> > - deployed a pseudo cluster
> > - ran basic example tests.
> > - Navigate the UI a bit, looks good.
> >
> > Jian
> >
> > > On Mar 22, 2017, at 9:03 PM, larry mccay 
> wrote:
> > >
> > > +1 (non-binding)
> > >
> > > - verified signatures
> > > - built from source and ran tests
> > > - deployed pseudo cluster
> > > - ran basic tests for hdfs, wordcount, credential provider API and
> > related
> > > commands
> > > - tested webhdfs with knox
> > >
> > >
> > > On Wed, Mar 22, 2017 at 7:21 AM, Ravi Prakash 
> > wrote:
> > >
> > >> Thanks for all the effort Junping!
> > >>
> > >> +1 (binding)
> > >> + Verified signature and MD5, SHA1, SHA256 checksum of tarball
> > >> + Verified SHA ID in git corresponds to RC3 tag
> > >> + Verified wordcount for one small text file produces same output as
> > >> hadoop-2.7.3.
> > >> + HDFS Namenode UI looks good.
> > >>
> > >> I agree none of the issues reported so far are blockers. Looking
> > forward to
> > >> another great release.
> > >>
> > >> Thanks
> > >> Ravi
> > >>
> > >> On Tue, Mar 21, 2017 at 8:10 PM, Junping Du 
> > wrote:
> > >>
> > >>> Thanks all for response with verification work and vote!
> > >>>
> > >>>
> > >>> Sounds like we are hitting several issues here, although none seems
> to
> > be
> > >>> blockers so far. Given the large commit set - 2000+ commits first
> > landed
> > >> in
> > >>> branch-2 release, we may should follow 2.7.0 practice that to claim
> > this
> > >>> release is not for production cluster, just like Vinod's suggestion
> in
> > >>> previous email. We should quickly come up with 2.8.1 release in next
> 1
> > >> or 2
> > >>> month for production deployment.
> > >>>
> > >>>
> > >>> We will close the vote in next 24 hours. For people who haven't vote,
> > >>> please keep on verification work and report any issues if founded - I
> > >> will
> > >>> check if another round of RC is needed based on your findings.
> Thanks!
> > >>>
> > >>>
> > >>> Thanks,
> > >>>
> > >>>
> > >>> Junping
> > >>>
> > >>>
> > >>> 
> > >>> From: Kuhu Shukla 
> > >>> Sent: Tuesday, March 21, 2017 3:17 PM
> > >>> Cc: Junping Du; common-dev@hadoop.apache.org;
> > hdfs-...@hadoop.apache.org
> > >> ;
> > >>> yarn-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org
> > >>> Subject: Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)
> > >>>
> > >>>
> > >>> +1 (non-binding)
> > >>>
> > >>> - Verified signatures.
> > >>> - Downloaded and built from source tar.gz.
> > >>> - Deployed a pseudo-distributed cluster on Mac Sierra.
> > >>> - Ran example Sleep job successfully.
> > >>> - Deployed latest Apache Tez 0.9 and ran sample Tez orderedwordcount
> > >>> successfully.
> > >>>
> > >>> Thank you Junping and everyone else who worked on getting this
> release
> > >> out.
> > >>>
> > >>> Warm Regards,
> > >>> Kuhu
> > >>> On Tuesday, March 21, 2017, 3:42:46 PM CDT, Eric Badger
> > >>>  wrote:
> > >>> +1 (non-binding)
> > >>>
> > >>> - Verified checksums and signatures of all files
> > >>> - Built from source on MacOS Sierra via JDK 1.8.0 u65
> > >>> - Deployed single-node cluster
> > >>> - Successfully ran a few sample jobs
> > >>>
> > >>> Thanks,
> > >>>
> > >>> Eric
> > >>>
> > >>> On Tuesday, March 21, 2017 2:56 PM, John Zhuge  >
> > >>> wrote:
> > >>>
> > >>>
> > >>>
> > >>> +1. Thanks for the great effort, Junping!
> > >>>
> > >>>
> > >>>  - Verified checksums and signatures of the tarballs
> > >>>  - Built source code with Java 1.8.0_66-b17 on Mac OS X 10.12.3
> > >>>  - Built source and native code with Java 1.8.0_111 on Centos
> 7.2.1511
> > >>>  - Cloud connectors:
> > >>>  - s3a: integration tests, basic fs commands
> > >>>  - adl: live unit tests, basic fs commands. See notes below.
> > >>>  - Deployed a pseudo cluster, passed the following sanity tests in
> > >>>  both insecure and SSL mode:
> > >>>  - HDFS: basic dfs, distcp, ACL commands
> > >>>  - KMS and HttpFS: basic tests
> > >>>  - MapReduce wordcount
> > >>>  - balancer start/stop
> > >>>
> > >>>
> > >>> Needs the following JIRAs to pass all ADL tests:
> > >>>
> > >>>  - HADOOP-14205. No FileSystem

Re: [VOTE] Release Apache Hadoop 2.6.5 (RC1)

2016-10-08 Thread Naganarasimha Garla

+1 (non-binding)


* Downloaded and verified signatures
* Deployed a standalone cluster using the binaries
* ran some jobs, like sleep, PI, etc
* tested some basic ui operations.

Regards,
+  Naga

On Sat, Oct 8, 2016 at 12:03 AM, Junping Du  wrote:

> +1 binding, based on:
>
> - Download and build from source, check signatures
>
> - Deploy a single node cluster and run some simple jobs, like sleep, PI,
> etc.
>
> Thanks Sangjin and Chris for working on 2.6.5 release!
>
> Thanks,
>
> Junping
> 
> From: larry mccay 
> Sent: Saturday, October 08, 2016 3:43 AM
> To: Karthik Kambatla
> Cc: Yongjun Zhang; Sangjin Lee; Andrew Wang; Wangda Tan; Zhihai Xu;
> Masatake Iwasaki; common-dev@hadoop.apache.org; hdfs-...@hadoop.apache.org;
> yarn-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org
> Subject: Re: [VOTE] Release Apache Hadoop 2.6.5 (RC1)
>
> +1 (non-binding)
>
>
> * Downloaded and verified signatures
>
> * Built from source
>
> * Deployed a standalone cluster
>
> * Tested HDFS commands and job submit
>
> * Tested webhdfs through Apache Knox
>
> On Fri, Oct 7, 2016 at 10:35 PM, Karthik Kambatla 
> wrote:
>
> > Thanks for putting the RC together, Sangjin.
> >
> > +1 (binding)
> >
> > Built from source, deployed pseudo distributed cluster and ran some
> example
> > MR jobs.
> >
> > On Fri, Oct 7, 2016 at 6:01 PM, Yongjun Zhang 
> wrote:
> >
> > > Hi Sangjin,
> > >
> > > Thanks a lot for your work here.
> > >
> > > My +1 (binding).
> > >
> > > - Downloaded both binary and src tarballs
> > > - Verified md5 checksum and signature for both
> > > - Build from source tarball
> > > - Deployed 2 pseudo clusters, one with the released tarball and the
> other
> > > with what I built from source, and did the following on both:
> > > - Run basic HDFS operations, and distcp jobs
> > > - Run pi job
> > > - Examined HDFS webui, YARN webui.
> > >
> > > Best,
> > >
> > > --Yongjun
> > >
> > > > > > * verified basic HDFS operations and Pi job.
> > > > > > * Did a sanity check for RM and NM UI.
> > >
> > >
> > > On Fri, Oct 7, 2016 at 5:08 PM, Sangjin Lee  wrote:
> > >
> > > > I'm casting my vote: +1 (binding)
> > > >
> > > > Regards,
> > > > Sangjin
> > > >
> > > > On Fri, Oct 7, 2016 at 3:12 PM, Andrew Wang <
> andrew.w...@cloudera.com>
> > > > wrote:
> > > >
> > > > > Thanks to Chris and Sangjin for working on this release.
> > > > >
> > > > > +1 binding
> > > > >
> > > > > * Verified signatures
> > > > > * Built from source tarball
> > > > > * Started HDFS and did some basic ops
> > > > >
> > > > > Thanks,
> > > > > Andrew
> > > > >
> > > > > On Fri, Oct 7, 2016 at 2:50 PM, Wangda Tan 
> > > wrote:
> > > > >
> > > > > > Thanks Sangjin for cutting this release!
> > > > > >
> > > > > > +1 (Binding)
> > > > > >
> > > > > > - Downloaded binary tar ball and setup a single node cluster.
> > > > > > - Submit a few applications and which can successfully run.
> > > > > >
> > > > > > Thanks,
> > > > > > Wangda
> > > > > >
> > > > > >
> > > > > > On Fri, Oct 7, 2016 at 10:33 AM, Zhihai Xu <
> zhihaixu2...@gmail.com
> > >
> > > > > wrote:
> > > > > >
> > > > > > > Thanks Sangjin for creating release 2.6.5 RC1.
> > > > > > >
> > > > > > > +1 (non-binding)
> > > > > > >
> > > > > > > * Downloaded and built from source
> > > > > > > * Verified md5 checksums and signature
> > > > > > > * Deployed a pseudo cluster
> > > > > > > * verified basic HDFS operations and Pi job.
> > > > > > > * Did a sanity check for RM and NM UI.
> > > > > > >
> > > > > > > Thanks
> > > > > > > zhihai
> > > > > > >
> > > > > > > On Fri, Oct 7, 2016 at 8:16 AM, Sangjin Lee 
> > > > wrote:
> > > > > > >
> > > > > > > > Thanks Masatake!
> > > > > > > >
> > > > > > > > Today's the last day for this vote, and I'd like to ask you
> to
> > > try
> > > > > out
> > > > > > > the
> > > > > > > > RC and vote on this today. So far there has been no binding
> > vote.
> > > > > > Thanks
> > > > > > > > again.
> > > > > > > >
> > > > > > > > Regards,
> > > > > > > > Sangjin
> > > > > > > >
> > > > > > > > On Fri, Oct 7, 2016 at 6:45 AM, Masatake Iwasaki <
> > > > > > > > iwasak...@oss.nttdata.co.jp> wrote:
> > > > > > > >
> > > > > > > > > +1(non-binding)
> > > > > > > > >
> > > > > > > > > * verified signature and md5.
> > > > > > > > > * built with -Pnative on CentOS6 and OpenJDK7.
> > > > > > > > > * built documentation and skimmed the contents.
> > > > > > > > > * built rpms by bigtop and ran smoke-tests of hdfs, yarn
> and
> > > > > > mapreduce
> > > > > > > on
> > > > > > > > > 3-node cluster.
> > > > > > > > >
> > > > > > > > > Thanks,
> > > > > > > > > Masatake Iwasaki
> > > > > > > > >
> > > > > > > > > On 10/3/16 09:12, Sangjin Lee wrote:
> > > > > > > > >
> > > > > > > > >> Hi folks,
> > > > > > > > >>
> > > > > > > > >> I have pushed a new release candidate (R1) for the

Re: [VOTE] Release Apache Hadoop 2.7.3 RC2

2016-08-23 Thread Naganarasimha Garla

+1 (non-binding)

- Downloaded source and tar verified the checksum
- Installed pseudo cluster with Node Labels and ATSV1 enabled.
- Verified with running MR apps with and without labels.
- Verified ATSV1 UI.

Regards,
+ Naga

On Mon, Aug 22, 2016 at 11:55 PM, Jason Lowe 
wrote:

> +1 (binding)
> - Verified signatures and digests- Successfully built from source with
> native support- Deployed a single-node cluster- Ran some sample jobs
> successfully
>
> Jason
>
>   From: Vinod Kumar Vavilapalli 
>  To: "common-dev@hadoop.apache.org" ;
> hdfs-...@hadoop.apache.org; yarn-...@hadoop.apache.org; "
> mapreduce-...@hadoop.apache.org" 
> Cc: Vinod Kumar Vavilapalli 
>  Sent: Wednesday, August 17, 2016 9:05 PM
>  Subject: [VOTE] Release Apache Hadoop 2.7.3 RC2
>
> Hi all,
>
> I've created a new release candidate RC2 for Apache Hadoop 2.7.3.
>
> As discussed before, this is the next maintenance release to follow up
> 2.7.2.
>
> The RC is available for validation at: http://home.apache.org/~
> vinodkv/hadoop-2.7.3-RC2/  vinodkv/hadoop-2.7.3-RC2/>
>
> The RC tag in git is: release-2.7.3-RC2
>
> The maven artifacts are available via repository.apache.org <
> http://repository.apache.org/> at https://repository.apache.org/
> content/repositories/orgapachehadoop-1046  org/content/repositories/orgapachehadoop-1046>
>
> The release-notes are inside the tar-balls at location
> hadoop-common-project/hadoop-common/src/main/docs/releasenotes.html. I
> hosted this at http://home.apache.org/~vinodkv/hadoop-2.7.3-RC2/
> releasenotes.html  releasenotes.html> for your quick perusal.
>
> As you may have noted,
>  - few issues with RC0 forced a RC1 [1]
>  - few more issues with RC1 forced a RC2 [2]
>  - a very long fix-cycle for the License & Notice issues (HADOOP-12893)
> caused 2.7.3 (along with every other Hadoop release) to slip by quite a
> bit. This release's related discussion thread is linked below: [3].
>
> Please try the release and vote; the vote will run for the usual 5 days.
>
> Thanks,
> Vinod
>
> [1] [VOTE] Release Apache Hadoop 2.7.3 RC0: https://www.mail-archive.com/
> hdfs-dev%40hadoop.apache.org/index.html#26106 <
> https://www.mail-archive.com/hdfs-dev@hadoop.apache.org/index.html#26106>
> [2] [VOTE] Release Apache Hadoop 2.7.3 RC1: https://www.mail-archive.com/
> hdfs-dev%40hadoop.apache.org/msg26336.html  hdfs-...@hadoop.apache.org/msg26336.html>
> [3] 2.7.3 release plan: https://www.mail-archive.com/
> hdfs-dev%40hadoop.apache.org/msg24439.html  6yv2fyrs4jlepmmr>
>
>
>

Re: [VOTE] Release Apache Hadoop 2.7.3 RC0

2016-07-26 Thread Naganarasimha Garla

Tested as follows
- deployed a pseudo cluster from RC0 tar
- Verified signature and checksum
- Run MR sleep on YARN
- With/Without node labels enabled.
- Verified ATS V1 (One small issue though not regression, tracking URL for
running app is shown as Unassigned, will check and raise if required )

Regards,
+ Naga

On Wed, Jul 27, 2016 at 12:42 AM, Vinod Kumar Vavilapalli <
vino...@apache.org> wrote:

> But, everyone please do continue your sanity checking on RC0 in case there
> are more issues to be fixed.
>
> Thanks
> +Vinod
>
> > On Jul 26, 2016, at 12:11 PM, Vinod Kumar Vavilapalli <
> vino...@apache.org> wrote:
> >
> > Thanks Daniel and Wei.
> >
> > I think these are worth fixing, I’m withdrawing this RC. Will look at
> fixing these issues and roll a new candidate with the fixes as soon as
> possible.
> >
> > Thanks
> > +Vinod
> >
> >> On Jul 26, 2016, at 11:05 AM, Wei-Chiu Chuang  > wrote:
> >>
> >> I noticed two issues:
> >>
> >> (1) I ran hadoop checknative, but it seems the binary tarball was not
> compiled with native library for Linux. On the contrary, the Hadoop built
> from source tarball with maven -Pnative can find the native libraries on
> the same host.
> >>
> >> (2) I noticed that the release dates in CHANGES.txt in tag
> release-2.7.3-RC0 are set to Release 2.7.3 - 2016-07-27.
> >> However, the release dates in CHANGES.txt in the source and binary tar
> balls are set to Release 2.7.3 - 2016-08-01. This is probably a non-issue
> though.
> >>
> >> * Downloaded source and binary.
> >> * Verified signature.
> >> * Verified checksum.
> >> * Built from source using 64-bit Java 7 (1.7.0.75) and 8 (1.8.0.05).
> Both went fine.
> >> * Ran hadoop checknative
> >>
> >> On Tue, Jul 26, 2016 at 9:12 AM, Rushabh Shah
> >
> wrote:
> >> Thanks Vinod for all the release work !
> >> +1 (non-binding).
> >> * Downloaded from source and built it.* Deployed a pseudo distributed
> cluster.
> >> * Ran some sample jobs: sleep, pi* Ran some dfs commands.* Everything
> works fine.
> >>
> >>
> >> On Friday, July 22, 2016 9:16 PM, Vinod Kumar Vavilapalli <
> vino...@apache.org > wrote:
> >>
> >>
> >>  Hi all,
> >>
> >> I've created a release candidate RC0 for Apache Hadoop 2.7.3.
> >>
> >> As discussed before, this is the next maintenance release to follow up
> 2.7.2.
> >>
> >> The RC is available for validation at:
> http://home.apache.org/~vinodkv/hadoop-2.7.3-RC0/ <
> http://home.apache.org/~vinodkv/hadoop-2.7.3-RC0/> <
> http://home.apache.org/~vinodkv/hadoop-2.7.3-RC0/ <
> http://home.apache.org/~vinodkv/hadoop-2.7.3-RC0/>>
> >>
> >> The RC tag in git is: release-2.7.3-RC0
> >>
> >> The maven artifacts are available via repository.apache.org <
> http://repository.apache.org/>  http://repository.apache.org/>> at
> https://repository.apache.org/content/repositories/orgapachehadoop-1040/ <
> https://repository.apache.org/content/repositories/orgapachehadoop-1040/>
>   >>
> >>
> >> The release-notes are inside the tar-balls at location
> hadoop-common-project/hadoop-common/src/main/docs/releasenotes.html. I
> hosted this at
> http://home.apache.org/~vinodkv/hadoop-2.7.3-RC0/releasenotes.html <
> http://home.apache.org/~vinodkv/hadoop-2.7.3-RC0/releasenotes.html> <
> http://people.apache.org/~vinodkv/hadoop-2.7.2-RC1/releasenotes.html <
> http://people.apache.org/~vinodkv/hadoop-2.7.2-RC1/releasenotes.html>>
> for your quick perusal.
> >>
> >> As you may have noted, a very long fix-cycle for the License & Notice
> issues (HADOOP-12893) caused 2.7.3 (along with every other Hadoop release)
> to slip by quite a bit. This release's related discussion thread is linked
> below: [1].
> >>
> >> Please try the release and vote; the vote will run for the usual 5 days.
> >>
> >> Thanks,
> >> Vinod
> >>
> >> [1]: 2.7.3 release plan:
> https://www.mail-archive.com/hdfs-dev%40hadoop.apache.org/msg24439.html <
> https://www.mail-archive.com/hdfs-dev%40hadoop.apache.org/msg24439.html> <
> http://markmail.org/thread/6yv2fyrs4jlepmmr <
> http://markmail.org/thread/6yv2fyrs4jlepmmr>>
> >>
> >>
> >>
> >
>
>

Re: [VOTE] Release Apache Hadoop 2.6.4 RC0

2016-02-08 Thread Naganarasimha Garla

+1 (non binding)

* Downloaded hadoop-2.6.4-RC0-src.tar.gz- built from source both package,
install, and verified the MD5 checksum
* Did a Pseudo cluster and tested basic hdfs operations
* Ran sleep job and Pi job
* Added node label and ran job under the label by
configuring default-node-label-expression and it ran fine

Eric Payne,
Hope you tried adding/replacing the labels using NodeId/Node Address and
not the HTTP address!
I executed the following command to configure the label and node
  "./yarn rmadmin -replaceLabelsOnNode  "localhost:43795,test1"  "
After this was able to submit the job for a label

Regards,
+ Naga

On Mon, Feb 8, 2016 at 11:06 PM, Eric Payne <
eric.payne1...@yahoo.com.invalid> wrote:

> Hi Junping Du. Thank you for your work preparing this release.
> I did the following things to test release Hadoop 2.6.4 rc0:-
> Downloaded hadoop-2.6.4-RC0-src.tar.gz- built from source both package,
> install, and eclipse:eclipse- Set up a 3-node, unsecured cluster with 3
> queues, one of which has preemption enabled- Ran a successful test to
> ensure that preemption would happen to containers on the preemptable queue
> if they were needed for an application on another queue.- Ran successful
> streaming and yarn shell tests
> Junping, I did have a concern about labelled nodes and queues. Is full
> label support backported to 2.6.4? I see that the syntax for the rmadmin
> command lists label commands like -addToClusterNodeLabels
> and -replaceLabelsOnNode. I was able to add a label
> (using -addToClusterNodeLabels) and I was able to define a queue whose
> accessible node label was listed with my specified label. However, when I
> tried to set the node label to a specific node using -replaceLabelsOnNode,
> the label does not show up on the specified node in cluster nodes UI (
> http://RM:8088/cluster/nodes). I also confirmed that submitting a job to
> the labelled queue gets accepted but never runs, which is the behavior I
> would expect if no node had the specified label. I will also add that this
> procedure works fine in 2.7.
> Thanks,-Eric Payne
>
>   From: Junping Du 
>  To: "hdfs-...@hadoop.apache.org" ; "
> yarn-...@hadoop.apache.org" ; "
> mapreduce-...@hadoop.apache.org" ; "
> common-dev@hadoop.apache.org" 
>  Sent: Wednesday, February 3, 2016 1:01 AM
>  Subject: [VOTE] Release Apache Hadoop 2.6.4 RC0
>
> Hi community folks,
>   I've created a release candidate RC0 for Apache Hadoop 2.6.4 (the next
> maintenance release to follow up 2.6.3.) according to email thread of
> release plan 2.6.4 [1]. Below is details of this release candidate:
>
> The RC is available for validation at:
> *http://people.apache.org/~junping_du/hadoop-2.6.4-RC0/
> *
>
> The RC tag in git is: release-2.6.4-RC0
>
> The maven artifacts are staged via repository.apache.org at:
> *https://repository.apache.org/content/repositories/orgapachehadoop-1028/?
>  >*
>
> You can find my public key at:
> http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS
>
> Please try the release and vote. The vote will run for the usual 5 days.
>
> Thanks!
>
>
> Cheers,
>
> Junping
>
>
> [1]: 2.6.4 release plan: http://markmail.org/message/fk3ud3c665lscvx5?
>
>
>
>

Re: [VOTE] Release Apache Hadoop 2.7.2 RC2

2016-01-24 Thread Naganarasimha Garla

+1 (non-binding)- Built from source tar ball
- Deployed Pseudo cluster
- Ran a simple MR job several times and all succeeded.
- Verified nodelabels cli and ran few jobs with it.
- Verified RM, ATS Web UI and tested few RM REST queries.


On Sat, Jan 23, 2016 at 3:34 AM, Jian He  wrote:

> +1,
> - built from source code
> - deployed a single cluster
> - run sample jobs which pass successfully.
>
> Jian
>
> > On Jan 22, 2016, at 6:52 AM, Sunil Govind 
> wrote:
> >
> > +1 (Non Binding)
> >
> > * Built tar ball from source and deployed
> > * Verified few MR Jobs for various nodelabel and preemption cases.
> > * Verified RM Web UI and REST queries. looks fine.
> >
> > Thanks and Regards
> > Sunil G
> >
> > On Fri, Jan 15, 2016 at 10:27 AM Vinod Kumar Vavilapalli <
> vino...@apache.org>
> > wrote:
> >
> >> Hi all,
> >>
> >> I've created an updated release candidate RC2 for Apache Hadoop 2.7.2.
> >>
> >> As discussed before, this is the next maintenance release to follow up
> >> 2.7.1.
> >>
> >> The RC is available for validation at:
> >> http://people.apache.org/~vinodkv/hadoop-2.7.2-RC2/
> >>
> >> The RC tag in git is: release-2.7.2-RC2
> >>
> >> The maven artifacts are available via repository.apache.org <
> >> http://repository.apache.org/> at
> >> https://repository.apache.org/content/repositories/orgapachehadoop-1027
> <
> >> https://repository.apache.org/content/repositories/orgapachehadoop-1027
> >
> >>
> >> The release-notes are inside the tar-balls at location
> >> hadoop-common-project/hadoop-common/src/main/docs/releasenotes.html. I
> >> hosted this at
> >> http://people.apache.org/~vinodkv/hadoop-2.7.2-RC2/releasenotes.html <
> >> http://people.apache.org/~vinodkv/hadoop-2.7.2-RC1/releasenotes.html>
> for
> >> your quick perusal.
> >>
> >> As you may have noted,
> >> - I terminated the RC1 related voting thread after finding out that we
> >> didn’t have a bunch of patches that are already in the released 2.6.3
> >> version. After a brief discussion, we decided to keep the parallel 2.6.x
> >> and 2.7.x releases incremental, see [4] for this discussion.
> >> - The RC0 related voting thread got halted due to some critical issues.
> >> It took a while again for getting all those blockers out of the way. See
> >> the previous voting thread [3] for details.
> >> - Before RC0, an unusually long 2.6.3 release caused 2.7.2 to slip by
> >> quite a bit. This release's related discussion threads are linked below:
> >> [1] and [2].
> >>
> >> Please try the release and vote; the vote will run for the usual 5 days.
> >>
> >> Thanks,
> >> Vinod
> >>
> >> [1]: 2.7.2 release plan: http://markmail.org/message/oozq3gvd4nhzsaes <
> >> http://markmail.org/message/oozq3gvd4nhzsaes>
> >> [2]: Planning Apache Hadoop 2.7.2
> >> http://markmail.org/message/iktqss2qdeykgpqk <
> >> http://markmail.org/message/iktqss2qdeykgpqk>
> >> [3]: [VOTE] Release Apache Hadoop 2.7.2 RC0:
> >> http://markmail.org/message/5txhvr2qdiqglrwc <
> >> http://markmail.org/message/5txhvr2qdiqglrwc>
> >> [4] Retracted [VOTE] Release Apache Hadoop 2.7.2 RC1:
> >> http://markmail.org/thread/n7ljbsnquihn3wlw
>
>

Re: [VOTE] Release Apache Hadoop 2.6.3 RC0

2015-12-15 Thread Naganarasimha Garla

Hi Junping,

+0 (non binding)

Though everything else is working  fine (downloaded the tar ball and
installed single node cluster setup and  verified  few MR jobs),
submission of Unmanaged AM is getting the RM down. YARN-4452 has
already been raised and i am working on it. Will provide the patch for
the trunk and the 2.6.3 version asap

Regards,

+ Naga

Thanks for the work Junping! Downloaded the src tarball. Built locally
and successfully ran
in single node mode with a few map reduce jobs. LGTM.

Li Lu

On Dec 14, 2015, at 04:23, Junping Du
>
wrote:

?Thanks Sarjeet and Tsuyoshi for reporting this. I just fix permission
issue and download
should work now. Please try to download it again. Thanks!

Thanks,

Junping

From: sarjeet singh >
Sent: Sunday, December 13, 2015 6:44 PM
To: common-dev@hadoop.apache.org
Cc: mapreduce-...@hadoop.apache.org;
hdfs-...@hadoop.apache.org;yarn-...@hadoop.apache.org;
junping...@apache.org
Subject: Re: [VOTE] Release Apache Hadoop 2.6.3 RC0

I am also getting the same error when downloading tar.gz:

"You don't have permission to access
/~junping_du/hadoop-2.6.3-RC0/hadoop-2.6.3-RC0-src.tar.gz
on this server."

- Sarjeet Singh

On Sat, Dec 12, 2015 at 4:17 PM, Tsuyoshi Ozawa
>
wrote:
Hi Junping,

Thank you for starting the voting.
I cannot access the tar.gz file because of permission error. Could you
check the permission to access the files?

Forbidden
You don't have permission to access
/~junping_du/hadoop-2.6.3-RC0/hadoop-2.6.3-RC0-src.tar.gz
on this server.

Thanks,
- Tsuyoshi

On Sat, Dec 12, 2015 at 9:16 AM, Junping Du
>
wrote:

Hi all developers in hadoop community,
  I've created a release candidate RC0 for Apache Hadoop 2.6.3 (the
next maintenance release
to follow up 2.6.2.) according to email thread of release plan 2.6.3
[1]. Sorry for this RC
coming a bit late as several blocker issues were getting committed
until yesterday. Below
is the details:

The RC is available for validation at:
*http://people.apache.org/~junping_du/hadoop-2.6.3-RC0/
*

The RC tag in git is: release-2.6.3-RC0

The maven artifacts are staged via
repository.apache.org
at:
*https://repository.apache.org/content/repositories/orgapachehadoop-1025/?
*

You can find my public key
at:http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS

Please try the release and vote. The vote will run for the usual 5 days.

Thanks and happy weekend!

Cheers,

Junping

[1]: 2.6.3 release plan: http://markmail.org/thread/nc2jogbgni37vu6y

Re: [VOTE] Release Apache Hadoop 3.2.1 - RC0

Re: [VOTE] Moving Submarine to a separate Apache project proposal

Re: [VOTE] Propose to start new Hadoop sub project "submarine"

Re: [VOTE] Release Apache Hadoop 3.2.0 - RC1

Re: [Vote] Merge discussion for Node attribute support feature YARN-3409

Re: [Vote] Merge discussion for Node attribute support feature YARN-3409

Re: [Vote] Merge discussion for Node attribute support feature YARN-3409

[Discuss] Merge discussion for Node attribute support feature YARN-3409

Re: [VOTE] Release Apache Hadoop 3.1.0 (RC1)

Re: [RESULT] [VOTE] Release Apache Hadoop 2.7.5 (RC1)

Re: [VOTE] Release Apache Hadoop 2.8.3 (RC0)

Re: VOTE] Release Apache Hadoop 2.7.5 (RC0)

Re: [VOTE] Merge feature branch YARN-5355 (Timeline Service v2) to trunk

Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)

Re: [VOTE] Release Apache Hadoop 2.6.5 (RC1)

Re: [VOTE] Release Apache Hadoop 2.7.3 RC2

Re: [VOTE] Release Apache Hadoop 2.7.3 RC0

Re: [VOTE] Release Apache Hadoop 2.6.4 RC0

Re: [VOTE] Release Apache Hadoop 2.7.2 RC2

Re: [VOTE] Release Apache Hadoop 2.6.3 RC0

20 matches

Site Navigation

Mail list logo

Footer information