Re: [VOTE] Release Apache Hadoop 2.7.7

[Vinod Kumar Vavilapalli]

Steve,

Looks like you didn't add the links to 2.7.7 source release at all on the 
http://hadoop.apache.org/releases.html page!

I just did it, FYI: 
https://svn.apache.org/viewvc?view=revision=1837966 


Thanks
+Vinod

> On Jul 16, 2018, at 4:23 PM, Steve Loughran  wrote:
> 
> and of course, my own +1 (binding)
> 
> * downloaded
> * verified all signatures
> * rebuilt on a Docker image, including native bits
> * retested, inc hadoop-aws and hadoop-azure. Failure on KMS 
> (testStartStopHttpKerberos, "Connection Reset"), which I didn't look into.
> * Basic command line
> * did a spark build, so verifying poms, but not a full test run there. Not 
> been building it enough to know if a failure would have been a regression 
> anyway.
> 
> 
> Nobody else has noticed, but the 2.7 native bits don't build on macosI 
> didn't pull that patch in from branch-2 but I will for future branch 2.7 
> maint. I also had to do changes to get the docker image to work (but work it 
> did!); these have been done outside the source tree, again, I'll try and get 
> that it. What it does mean is that the source distro here can't completely 
> bring up the docker image for a full release build, including GPG signing.
> 
> I realise I could be better set up for qualifying releases here. I normally 
> get to rely on our automated QE tests telling me that something has broken; I 
> plan to see what I can do with bigtop locally, so have a better set up for 
> end-to-end testing of packaging.
> 
> Now, let me count those votes.
> 
> -Steve
> 
> 
> 
> 
> 
> 
> 
> 
> On 16 Jul 2018, at 21:50, Eric Badger 
> mailto:ebad...@oath.com>> wrote:
> 
> +1 (non-binding)
> 
> - Verified all hashes and checksums
> - Built from source on macOS 10.13.5, Java 1.8.0u65
> - Deployed a pseudo cluster
> - Ran some example jobs
> 
> 
> On Mon, Jul 16, 2018 at 2:18 PM, Kihwal Lee 
> mailto:kih...@oath.com.invalid>> wrote:
> +1 (binding)
> -Built from the source
> -Brought up a single node pseudo-distributed cluster
> -Ran basic tests
> -Verified basic hdfs and dfsadmin commands working
> 
> 
> On Wed, Jul 11, 2018 at 10:05 AM Steve Loughran 
> mailto:ste...@hortonworks.com>>
> wrote:
> 
>> 
>> 
>> Hi
>> 
>> I've got RC0 of Hadoop 2.7.7 up for people to download and play with
>> 
>> http://people.apache.org/~stevel/hadoop-2.7.7/RC0/
>> 
>> Nexus artifacts 2.7.7 are up in staging
>> https://repository.apache.org/content/repositories/orgapachehadoop-1135
>> 
>> Git (signed) tag release-2.7.7-RC0, checksum
>> c1aad84bd27cd79c3d1a7dd58202a8c3ee1ed3ac
>> 
>> My current GPG key is 38237EE425050285077DB57AD22CF846DBB162A0
>> you can download this direct (and it MUST be direct) from the ASF HTTPS
>> site
>> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>> 
>> Please try the release and vote. The vote will run for 5 days.
>> 
>> Thanks
>> 
>> -Steve
>> 
>> (I should add: this is my first ever attempt at a Hadoop release, please
>> be (a) rigorous and (b) forgiving. Credit to Wei-Chiu Chuang for his
>> advice).
>> 
>> 
>> -
>> To unsubscribe, e-mail: 
>> common-dev-unsubscr...@hadoop.apache.org
>> For additional commands, e-mail: 
>> common-dev-h...@hadoop.apache.org
>> 
>> 
> 
> 

Re: [VOTE] Release Apache Hadoop 2.7.7

[Steve Loughran]

and of course, my own +1 (binding)

* downloaded
* verified all signatures
* rebuilt on a Docker image, including native bits
* retested, inc hadoop-aws and hadoop-azure. Failure on KMS 
(testStartStopHttpKerberos, "Connection Reset"), which I didn't look into.
* Basic command line
* did a spark build, so verifying poms, but not a full test run there. Not been 
building it enough to know if a failure would have been a regression anyway.


Nobody else has noticed, but the 2.7 native bits don't build on macosI 
didn't pull that patch in from branch-2 but I will for future branch 2.7 maint. 
I also had to do changes to get the docker image to work (but work it did!); 
these have been done outside the source tree, again, I'll try and get that it. 
What it does mean is that the source distro here can't completely bring up the 
docker image for a full release build, including GPG signing.

I realise I could be better set up for qualifying releases here. I normally get 
to rely on our automated QE tests telling me that something has broken; I plan 
to see what I can do with bigtop locally, so have a better set up for 
end-to-end testing of packaging.

Now, let me count those votes.

-Steve








On 16 Jul 2018, at 21:50, Eric Badger 
mailto:ebad...@oath.com>> wrote:

+1 (non-binding)

- Verified all hashes and checksums
- Built from source on macOS 10.13.5, Java 1.8.0u65
- Deployed a pseudo cluster
- Ran some example jobs


On Mon, Jul 16, 2018 at 2:18 PM, Kihwal Lee 
mailto:kih...@oath.com.invalid>> wrote:
+1 (binding)
-Built from the source
-Brought up a single node pseudo-distributed cluster
-Ran basic tests
-Verified basic hdfs and dfsadmin commands working


On Wed, Jul 11, 2018 at 10:05 AM Steve Loughran 
mailto:ste...@hortonworks.com>>
wrote:

>
>
> Hi
>
> I've got RC0 of Hadoop 2.7.7 up for people to download and play with
>
> http://people.apache.org/~stevel/hadoop-2.7.7/RC0/
>
> Nexus artifacts 2.7.7 are up in staging
> https://repository.apache.org/content/repositories/orgapachehadoop-1135
>
> Git (signed) tag release-2.7.7-RC0, checksum
> c1aad84bd27cd79c3d1a7dd58202a8c3ee1ed3ac
>
> My current GPG key is 38237EE425050285077DB57AD22CF846DBB162A0
> you can download this direct (and it MUST be direct) from the ASF HTTPS
> site
> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>
> Please try the release and vote. The vote will run for 5 days.
>
> Thanks
>
> -Steve
>
> (I should add: this is my first ever attempt at a Hadoop release, please
> be (a) rigorous and (b) forgiving. Credit to Wei-Chiu Chuang for his
> advice).
>
>
> -
> To unsubscribe, e-mail: 
> common-dev-unsubscr...@hadoop.apache.org
> For additional commands, e-mail: 
> common-dev-h...@hadoop.apache.org
>
>

Re: [VOTE] Release Apache Hadoop 2.7.7

[Eric Badger]

+1 (non-binding)

- Verified all hashes and checksums
- Built from source on macOS 10.13.5, Java 1.8.0u65
- Deployed a pseudo cluster
- Ran some example jobs


On Mon, Jul 16, 2018 at 2:18 PM, Kihwal Lee  wrote:

> +1 (binding)
> -Built from the source
> -Brought up a single node pseudo-distributed cluster
> -Ran basic tests
> -Verified basic hdfs and dfsadmin commands working
>
>
> On Wed, Jul 11, 2018 at 10:05 AM Steve Loughran 
> wrote:
>
> >
> >
> > Hi
> >
> > I've got RC0 of Hadoop 2.7.7 up for people to download and play with
> >
> > http://people.apache.org/~stevel/hadoop-2.7.7/RC0/
> >
> > Nexus artifacts 2.7.7 are up in staging
> > https://repository.apache.org/content/repositories/orgapachehadoop-1135
> >
> > Git (signed) tag release-2.7.7-RC0, checksum
> > c1aad84bd27cd79c3d1a7dd58202a8c3ee1ed3ac
> >
> > My current GPG key is 38237EE425050285077DB57AD22CF846DBB162A0
> > you can download this direct (and it MUST be direct) from the ASF HTTPS
> > site
> > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> >
> > Please try the release and vote. The vote will run for 5 days.
> >
> > Thanks
> >
> > -Steve
> >
> > (I should add: this is my first ever attempt at a Hadoop release, please
> > be (a) rigorous and (b) forgiving. Credit to Wei-Chiu Chuang for his
> > advice).
> >
> >
> > -
> > To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
> > For additional commands, e-mail: common-dev-h...@hadoop.apache.org
> >
> >
>

Re: [VOTE] Release Apache Hadoop 2.7.7

[Kihwal Lee]

+1 (binding)
-Built from the source
-Brought up a single node pseudo-distributed cluster
-Ran basic tests
-Verified basic hdfs and dfsadmin commands working


On Wed, Jul 11, 2018 at 10:05 AM Steve Loughran 
wrote:

>
>
> Hi
>
> I've got RC0 of Hadoop 2.7.7 up for people to download and play with
>
> http://people.apache.org/~stevel/hadoop-2.7.7/RC0/
>
> Nexus artifacts 2.7.7 are up in staging
> https://repository.apache.org/content/repositories/orgapachehadoop-1135
>
> Git (signed) tag release-2.7.7-RC0, checksum
> c1aad84bd27cd79c3d1a7dd58202a8c3ee1ed3ac
>
> My current GPG key is 38237EE425050285077DB57AD22CF846DBB162A0
> you can download this direct (and it MUST be direct) from the ASF HTTPS
> site
> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>
> Please try the release and vote. The vote will run for 5 days.
>
> Thanks
>
> -Steve
>
> (I should add: this is my first ever attempt at a Hadoop release, please
> be (a) rigorous and (b) forgiving. Credit to Wei-Chiu Chuang for his
> advice).
>
>
> -
> To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
> For additional commands, e-mail: common-dev-h...@hadoop.apache.org
>
>

Re: [VOTE] Release Apache Hadoop 2.7.7

[Kuhu Shukla]

+1 (non-binding)

- Built from source
- Deployed to a pseudo distributed cluster.
- Ran sample jobs like sleep

Also it might be a good idea to add yarn-dev and hdfs-dev (etc.) to the
recipient list to get more traction and audience.

Thank you Steve for your efforts!

Kuhu

On Mon, Jul 16, 2018 at 10:39 AM, Jason Lowe  wrote:

> Thanks for driving this release, Steve!
>
> +1 (binding)
>
> - Verified signatures and digests
> - Successfully performed a native build from source
> - Deployed a single-node cluster
> - Ran some sample jobs and checked web UI and logs
>
> Jason
>
>
> On Wed, Jul 11, 2018 at 10:05 AM, Steve Loughran 
> wrote:
>
> >
> >
> > Hi
> >
> > I've got RC0 of Hadoop 2.7.7 up for people to download and play with
> >
> > http://people.apache.org/~stevel/hadoop-2.7.7/RC0/
> >
> > Nexus artifacts 2.7.7 are up in staging
> > https://repository.apache.org/content/repositories/orgapachehadoop-1135
> >
> > Git (signed) tag release-2.7.7-RC0, checksum
> c1aad84bd27cd79c3d1a7dd58202a8
> > c3ee1ed3ac
> >
> > My current GPG key is 38237EE425050285077DB57AD22CF846DBB162A0
> > you can download this direct (and it MUST be direct) from the ASF HTTPS
> > site
> > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> >
> > Please try the release and vote. The vote will run for 5 days.
> >
> > Thanks
> >
> > -Steve
> >
> > (I should add: this is my first ever attempt at a Hadoop release, please
> > be (a) rigorous and (b) forgiving. Credit to Wei-Chiu Chuang for his
> > advice).
> >
> >
> > -
> > To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
> > For additional commands, e-mail: common-dev-h...@hadoop.apache.org
> >
> >
>

Re: [VOTE] Release Apache Hadoop 2.7.7

[Jason Lowe]

Thanks for driving this release, Steve!

+1 (binding)

- Verified signatures and digests
- Successfully performed a native build from source
- Deployed a single-node cluster
- Ran some sample jobs and checked web UI and logs

Jason


On Wed, Jul 11, 2018 at 10:05 AM, Steve Loughran 
wrote:

>
>
> Hi
>
> I've got RC0 of Hadoop 2.7.7 up for people to download and play with
>
> http://people.apache.org/~stevel/hadoop-2.7.7/RC0/
>
> Nexus artifacts 2.7.7 are up in staging
> https://repository.apache.org/content/repositories/orgapachehadoop-1135
>
> Git (signed) tag release-2.7.7-RC0, checksum c1aad84bd27cd79c3d1a7dd58202a8
> c3ee1ed3ac
>
> My current GPG key is 38237EE425050285077DB57AD22CF846DBB162A0
> you can download this direct (and it MUST be direct) from the ASF HTTPS
> site
> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>
> Please try the release and vote. The vote will run for 5 days.
>
> Thanks
>
> -Steve
>
> (I should add: this is my first ever attempt at a Hadoop release, please
> be (a) rigorous and (b) forgiving. Credit to Wei-Chiu Chuang for his
> advice).
>
>
> -
> To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
> For additional commands, e-mail: common-dev-h...@hadoop.apache.org
>
>

Re: [VOTE] Release Apache Hadoop 2.7.7

[Zsolt Venczel]

Thanks for your efforts Steve!

+1 (non-binding)

* checked out git tag release-2.7.7-RC0
* built from source on Ubuntu 16.04, java 8.0.172-zulu
* deployed on 4 node cluster
* executed snapshot commands: create, diff, checked file presence in
.snapshot directory
* execute map-reduce examples: teragen, terasort, teravalidate
* checked out web UI: file browser, snapshots
* executed unit tests for hadoop-hdfs-project/hadoop-hdfs module that have
all passed

Best regards,
Zsolt

On Fri, Jul 13, 2018 at 1:49 PM Kitti Nánási 
wrote:

> Thanks for working on this, Steve!
>
> +1 (non-binding)
>
> checked out git tag release-2.7.7-RC0
> built from source on Mac OS X 10.13.4, java version 8.0.172-zulu
> deployed on a 3 node cluster
> ran terasort, teragen, teravalidate with success
> executed basic hdfs commands
> executed basic snapshot related commands
>
> Thanks,
> Kitti
>
>
> On Thu, Jul 12, 2018 at 6:42 PM, Gabor Bota  .invalid
> > wrote:
>
> >   Thanks for the work Steve!
> >
> >   +1 (non-binding)
> >
> >   checked out git tag release-2.7.7-RC0
> >   built from source on Mac OS X 10.13.5, java version 8.0.171-oracle
> >   deployed on a 3 node cluster
> >   verified pi job (yarn), teragen, terasort and teravalidate
> >
> >   Regards,
> >   Gabor Bota
> >
> > On Thu, Jul 12, 2018 at 3:19 AM Ajay Kumar 
> > wrote:
> >
> > > Thanks for working on this,  Steve!!
> > >
> > > +1 non-binding
> > > - Built from source on 1.8.0_111-b14, mac
> > > - Verified checksum
> > > - Built non secure local cluster
> > > - Run yarn jobs like: pi,word count, DFSIO (read/write)
> > > - Performed basic HDFS operations
> > > - Basic sanity for NameNode and RM UI.
> > >
> > > Best,
> > > Ajay
> > >
> > > On 7/11/18, 8:05 AM, "Steve Loughran"  wrote:
> > >
> > >
> > >
> > > Hi
> > >
> > > I've got RC0 of Hadoop 2.7.7 up for people to download and play
> with
> > >
> > > http://people.apache.org/~stevel/hadoop-2.7.7/RC0/
> > >
> > > Nexus artifacts 2.7.7 are up in staging
> > >
> > >
> https://repository.apache.org/content/repositories/orgapachehadoop-1135
> > >
> > > Git (signed) tag release-2.7.7-RC0, checksum
> > > c1aad84bd27cd79c3d1a7dd58202a8c3ee1ed3ac
> > >
> > > My current GPG key is 38237EE425050285077DB57AD22CF846DBB162A0
> > > you can download this direct (and it MUST be direct) from the ASF
> > > HTTPS site
> > > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> > >
> > > Please try the release and vote. The vote will run for 5 days.
> > >
> > > Thanks
> > >
> > > -Steve
> > >
> > > (I should add: this is my first ever attempt at a Hadoop release,
> > > please be (a) rigorous and (b) forgiving. Credit to Wei-Chiu Chuang for
> > his
> > > advice).
> > >
> > >
> > > 
> > -
> > > To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
> > > For additional commands, e-mail: common-dev-h...@hadoop.apache.org
> > >
> > >
> > >
> > >
> >
>

Re: [VOTE] Release Apache Hadoop 2.7.7

[Kitti Nánási]

Thanks for working on this, Steve!

+1 (non-binding)

checked out git tag release-2.7.7-RC0
built from source on Mac OS X 10.13.4, java version 8.0.172-zulu
deployed on a 3 node cluster
ran terasort, teragen, teravalidate with success
executed basic hdfs commands
executed basic snapshot related commands

Thanks,
Kitti


On Thu, Jul 12, 2018 at 6:42 PM, Gabor Bota  wrote:

>   Thanks for the work Steve!
>
>   +1 (non-binding)
>
>   checked out git tag release-2.7.7-RC0
>   built from source on Mac OS X 10.13.5, java version 8.0.171-oracle
>   deployed on a 3 node cluster
>   verified pi job (yarn), teragen, terasort and teravalidate
>
>   Regards,
>   Gabor Bota
>
> On Thu, Jul 12, 2018 at 3:19 AM Ajay Kumar 
> wrote:
>
> > Thanks for working on this,  Steve!!
> >
> > +1 non-binding
> > - Built from source on 1.8.0_111-b14, mac
> > - Verified checksum
> > - Built non secure local cluster
> > - Run yarn jobs like: pi,word count, DFSIO (read/write)
> > - Performed basic HDFS operations
> > - Basic sanity for NameNode and RM UI.
> >
> > Best,
> > Ajay
> >
> > On 7/11/18, 8:05 AM, "Steve Loughran"  wrote:
> >
> >
> >
> > Hi
> >
> > I've got RC0 of Hadoop 2.7.7 up for people to download and play with
> >
> > http://people.apache.org/~stevel/hadoop-2.7.7/RC0/
> >
> > Nexus artifacts 2.7.7 are up in staging
> >
> > https://repository.apache.org/content/repositories/orgapachehadoop-1135
> >
> > Git (signed) tag release-2.7.7-RC0, checksum
> > c1aad84bd27cd79c3d1a7dd58202a8c3ee1ed3ac
> >
> > My current GPG key is 38237EE425050285077DB57AD22CF846DBB162A0
> > you can download this direct (and it MUST be direct) from the ASF
> > HTTPS site
> > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> >
> > Please try the release and vote. The vote will run for 5 days.
> >
> > Thanks
> >
> > -Steve
> >
> > (I should add: this is my first ever attempt at a Hadoop release,
> > please be (a) rigorous and (b) forgiving. Credit to Wei-Chiu Chuang for
> his
> > advice).
> >
> >
> > 
> -
> > To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
> > For additional commands, e-mail: common-dev-h...@hadoop.apache.org
> >
> >
> >
> >
>

Re: [VOTE] Release Apache Hadoop 2.7.7

[Gabor Bota]

  Thanks for the work Steve!

  +1 (non-binding)

  checked out git tag release-2.7.7-RC0
  built from source on Mac OS X 10.13.5, java version 8.0.171-oracle
  deployed on a 3 node cluster
  verified pi job (yarn), teragen, terasort and teravalidate

  Regards,
  Gabor Bota

On Thu, Jul 12, 2018 at 3:19 AM Ajay Kumar 
wrote:

> Thanks for working on this,  Steve!!
>
> +1 non-binding
> - Built from source on 1.8.0_111-b14, mac
> - Verified checksum
> - Built non secure local cluster
> - Run yarn jobs like: pi,word count, DFSIO (read/write)
> - Performed basic HDFS operations
> - Basic sanity for NameNode and RM UI.
>
> Best,
> Ajay
>
> On 7/11/18, 8:05 AM, "Steve Loughran"  wrote:
>
>
>
> Hi
>
> I've got RC0 of Hadoop 2.7.7 up for people to download and play with
>
> http://people.apache.org/~stevel/hadoop-2.7.7/RC0/
>
> Nexus artifacts 2.7.7 are up in staging
>
> https://repository.apache.org/content/repositories/orgapachehadoop-1135
>
> Git (signed) tag release-2.7.7-RC0, checksum
> c1aad84bd27cd79c3d1a7dd58202a8c3ee1ed3ac
>
> My current GPG key is 38237EE425050285077DB57AD22CF846DBB162A0
> you can download this direct (and it MUST be direct) from the ASF
> HTTPS site
> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>
> Please try the release and vote. The vote will run for 5 days.
>
> Thanks
>
> -Steve
>
> (I should add: this is my first ever attempt at a Hadoop release,
> please be (a) rigorous and (b) forgiving. Credit to Wei-Chiu Chuang for his
> advice).
>
>
> -
> To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
> For additional commands, e-mail: common-dev-h...@hadoop.apache.org
>
>
>
>

Re: [VOTE] Release Apache Hadoop 2.7.7

[Ajay Kumar]

Thanks for working on this,  Steve!!

+1 non-binding
- Built from source on 1.8.0_111-b14, mac
- Verified checksum
- Built non secure local cluster
- Run yarn jobs like: pi,word count, DFSIO (read/write)
- Performed basic HDFS operations
- Basic sanity for NameNode and RM UI. 

Best,
Ajay

On 7/11/18, 8:05 AM, "Steve Loughran"  wrote:



Hi

I've got RC0 of Hadoop 2.7.7 up for people to download and play with

http://people.apache.org/~stevel/hadoop-2.7.7/RC0/

Nexus artifacts 2.7.7 are up in staging 
https://repository.apache.org/content/repositories/orgapachehadoop-1135

Git (signed) tag release-2.7.7-RC0, checksum 
c1aad84bd27cd79c3d1a7dd58202a8c3ee1ed3ac

My current GPG key is 38237EE425050285077DB57AD22CF846DBB162A0
you can download this direct (and it MUST be direct) from the ASF HTTPS 
site 
https://dist.apache.org/repos/dist/release/hadoop/common/KEYS

Please try the release and vote. The vote will run for 5 days.

Thanks

-Steve

(I should add: this is my first ever attempt at a Hadoop release, please be 
(a) rigorous and (b) forgiving. Credit to Wei-Chiu Chuang for his advice).


-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org