Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-19 Thread Arun C Murthy
With 24 +1s (10 binding) and no -1s the vote passes.

Thanks for everyone who tried the release and provided feedback.

I'll push the bits and send out a note.

thanks,
Arun

On Nov 13, 2014, at 3:08 PM, Arun C Murthy  wrote:

> Folks,
> 
> I've created another release candidate (rc1) for hadoop-2.6.0 based on the 
> feedback.
> 
> The RC is available at: http://people.apache.org/~acmurthy/hadoop-2.6.0-rc1
> The RC tag in git is: release-2.6.0-rc1
> 
> The maven artifacts are available via repository.apache.org at 
> https://repository.apache.org/content/repositories/orgapachehadoop-1013.
> 
> Please try the release and vote; the vote will run for the usual 5 days.
> 
> thanks,
> Arun
> 



-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.


Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-18 Thread Masatake Iwasaki

+1 (non-binding)

+ built from source tarball
+ ran some example jobs in HiBench such as
  nutchindexing, wordcount, dfsioe, hivebench, kmeans, pagerank, bayes, sort, 
terasort
  on 3 node cluster.

I'm on the same side with Tsuyoshi and would like HDFS-6833 to be fixed in 
2.6.1 at least.

Masatake Iwasaki

(11/19/14, 7:41), Tsuyoshi OZAWA wrote:

+1 if once discussion about HDFS-6833 is done(non-binding).

* Verified checksum.
* Deployed cluster and ran some mr examples.
* Checked RM restart while running jobs.


  I think you have to pass along -Pdist too… afaik that is how the Jenkins we 
use for building release artifacts operates.


Thanks for your comment, Arun. It's still fails with -Pdist option. It
can be environment-depend problem. +1 for fixing at 2.6.1.

Thanks,
- Tsuyoshi

On Wed, Nov 19, 2014 at 5:04 AM, Karthik Kambatla  wrote:

+1 (binding) on the source tarball, would be nice to redo the binary
tarball.

- Stood up a pseudo-dist cluster, and ran some HDFS and MR jobs.
- The binary is about 40 MB larger than the previous release; it appears
the docs are copied over twice - share/doc/hadoop and share/hadoop. The
binary tarball from the release build should have everything in the right
place, I can help with this if needed.
- index.html (under share/doc/hadoop) is stale, and could be updated. If we
ship the bits as is, we should at least put the new features on the
website. Also, highlight the alpha features (like YARN reservations) as
alpha.

Thanks for putting this together, Arun.

Karthik

On Tue, Nov 18, 2014 at 11:07 AM, Jian He  wrote:


+1,

Built from source.
Deployed a single node cluster.
Ran sample MapReduce jobs while restarting RM successfully.

Jian

On Tue, Nov 18, 2014 at 8:47 AM, Eric Payne 


wrote:


+1 . Thanks Arun, for producing this release. I downloaded and built
the source. I started local cluster and ran wordcount, sleep, and

streaming

jobs.

  - I ran a distributed shell job which tested preserving containers

across

AM restart by setting the -keep_containers_across_application_attempts

flag

and killing the first AM once the containers start. I checked the results
by looking in the timeline server and comparing the start times of the
non-AM containers against the start times of the later AM container. -
I enabled the preemption feature and verified containers were preempted

and

queues were adjusted to guaranteed levels.
- I ran unit tests for hadoop-yarn-server-resourcemanage. All passed with
the exception of TestContainerResourceUsage. - I ran unit tests for
hadoop-hdfs. All passed with the exception of
TestBPOfferService#testBasicFunctionality (HDFS-3930) Thank you,-Eric

Payne





   From: Arun C Murthy 
  To: "common-dev@hadoop.apache.org" ; "
hdfs-...@hadoop.apache.org" ; "
yarn-...@hadoop.apache.org" ; "
mapreduce-...@hadoop.apache.org" 
  Sent: Thursday, November 13, 2014 5:08 PM
  Subject: [VOTE] Release Apache Hadoop 2.6.0

Folks,

I've created another release candidate (rc1) for hadoop-2.6.0 based on

the

feedback.

The RC is available at:
http://people.apache.org/~acmurthy/hadoop-2.6.0-rc1
The RC tag in git is: release-2.6.0-rc1

The maven artifacts are available via repository.apache.org at
https://repository.apache.org/content/repositories/orgapachehadoop-1013.

Please try the release and vote; the vote will run for the usual 5 days.

thanks,
Arun


--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity

to

which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified

that

any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender

immediately

and delete it from your system. Thank You.






--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.









Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-18 Thread Tsuyoshi OZAWA
+1 if once discussion about HDFS-6833 is done(non-binding).

* Verified checksum.
* Deployed cluster and ran some mr examples.
* Checked RM restart while running jobs.

>  I think you have to pass along -Pdist too… afaik that is how the Jenkins we 
> use for building release artifacts operates.

Thanks for your comment, Arun. It's still fails with -Pdist option. It
can be environment-depend problem. +1 for fixing at 2.6.1.

Thanks,
- Tsuyoshi

On Wed, Nov 19, 2014 at 5:04 AM, Karthik Kambatla  wrote:
> +1 (binding) on the source tarball, would be nice to redo the binary
> tarball.
>
> - Stood up a pseudo-dist cluster, and ran some HDFS and MR jobs.
> - The binary is about 40 MB larger than the previous release; it appears
> the docs are copied over twice - share/doc/hadoop and share/hadoop. The
> binary tarball from the release build should have everything in the right
> place, I can help with this if needed.
> - index.html (under share/doc/hadoop) is stale, and could be updated. If we
> ship the bits as is, we should at least put the new features on the
> website. Also, highlight the alpha features (like YARN reservations) as
> alpha.
>
> Thanks for putting this together, Arun.
>
> Karthik
>
> On Tue, Nov 18, 2014 at 11:07 AM, Jian He  wrote:
>
>> +1,
>>
>> Built from source.
>> Deployed a single node cluster.
>> Ran sample MapReduce jobs while restarting RM successfully.
>>
>> Jian
>>
>> On Tue, Nov 18, 2014 at 8:47 AM, Eric Payne > >
>> wrote:
>>
>> > +1 . Thanks Arun, for producing this release. I downloaded and built
>> > the source. I started local cluster and ran wordcount, sleep, and
>> streaming
>> > jobs.
>> >
>> >  - I ran a distributed shell job which tested preserving containers
>> across
>> > AM restart by setting the -keep_containers_across_application_attempts
>> flag
>> > and killing the first AM once the containers start. I checked the results
>> > by looking in the timeline server and comparing the start times of the
>> > non-AM containers against the start times of the later AM container. -
>> > I enabled the preemption feature and verified containers were preempted
>> and
>> > queues were adjusted to guaranteed levels.
>> > - I ran unit tests for hadoop-yarn-server-resourcemanage. All passed with
>> > the exception of TestContainerResourceUsage. - I ran unit tests for
>> > hadoop-hdfs. All passed with the exception of
>> > TestBPOfferService#testBasicFunctionality (HDFS-3930) Thank you,-Eric
>> Payne
>> >
>> >
>> >
>> >
>> >   From: Arun C Murthy 
>> >  To: "common-dev@hadoop.apache.org" ; "
>> > hdfs-...@hadoop.apache.org" ; "
>> > yarn-...@hadoop.apache.org" ; "
>> > mapreduce-...@hadoop.apache.org" 
>> >  Sent: Thursday, November 13, 2014 5:08 PM
>> >  Subject: [VOTE] Release Apache Hadoop 2.6.0
>> >
>> > Folks,
>> >
>> > I've created another release candidate (rc1) for hadoop-2.6.0 based on
>> the
>> > feedback.
>> >
>> > The RC is available at:
>> > http://people.apache.org/~acmurthy/hadoop-2.6.0-rc1
>> > The RC tag in git is: release-2.6.0-rc1
>> >
>> > The maven artifacts are available via repository.apache.org at
>> > https://repository.apache.org/content/repositories/orgapachehadoop-1013.
>> >
>> > Please try the release and vote; the vote will run for the usual 5 days.
>> >
>> > thanks,
>> > Arun
>> >
>> >
>> > --
>> > CONFIDENTIALITY NOTICE
>> > NOTICE: This message is intended for the use of the individual or entity
>> to
>> > which it is addressed and may contain information that is confidential,
>> > privileged and exempt from disclosure under applicable law. If the reader
>> > of this message is not the intended recipient, you are hereby notified
>> that
>> > any printing, copying, dissemination, distribution, disclosure or
>> > forwarding of this communication is strictly prohibited. If you have
>> > received this communication in error, please contact the sender
>> immediately
>> > and delete it from your system. Thank You.
>> >
>> >
>> >
>> >
>>
>> --
>> CONFIDENTIALITY NOTICE
>> NOTICE: This message is intended for the use of the individual or entity to
>> which it is addressed and may contain information that is confidential,
>> privileged and exempt from disclosure under applicable law. If the reader
>> of this message is not the intended recipient, you are hereby notified that
>> any printing, copying, dissemination, distribution, disclosure or
>> forwarding of this communication is strictly prohibited. If you have
>> received this communication in error, please contact the sender immediately
>> and delete it from your system. Thank You.
>>



-- 
- Tsuyoshi


Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-18 Thread Karthik Kambatla
+1 (binding) on the source tarball, would be nice to redo the binary
tarball.

- Stood up a pseudo-dist cluster, and ran some HDFS and MR jobs.
- The binary is about 40 MB larger than the previous release; it appears
the docs are copied over twice - share/doc/hadoop and share/hadoop. The
binary tarball from the release build should have everything in the right
place, I can help with this if needed.
- index.html (under share/doc/hadoop) is stale, and could be updated. If we
ship the bits as is, we should at least put the new features on the
website. Also, highlight the alpha features (like YARN reservations) as
alpha.

Thanks for putting this together, Arun.

Karthik

On Tue, Nov 18, 2014 at 11:07 AM, Jian He  wrote:

> +1,
>
> Built from source.
> Deployed a single node cluster.
> Ran sample MapReduce jobs while restarting RM successfully.
>
> Jian
>
> On Tue, Nov 18, 2014 at 8:47 AM, Eric Payne  >
> wrote:
>
> > +1 . Thanks Arun, for producing this release. I downloaded and built
> > the source. I started local cluster and ran wordcount, sleep, and
> streaming
> > jobs.
> >
> >  - I ran a distributed shell job which tested preserving containers
> across
> > AM restart by setting the -keep_containers_across_application_attempts
> flag
> > and killing the first AM once the containers start. I checked the results
> > by looking in the timeline server and comparing the start times of the
> > non-AM containers against the start times of the later AM container. -
> > I enabled the preemption feature and verified containers were preempted
> and
> > queues were adjusted to guaranteed levels.
> > - I ran unit tests for hadoop-yarn-server-resourcemanage. All passed with
> > the exception of TestContainerResourceUsage. - I ran unit tests for
> > hadoop-hdfs. All passed with the exception of
> > TestBPOfferService#testBasicFunctionality (HDFS-3930) Thank you,-Eric
> Payne
> >
> >
> >
> >
> >   From: Arun C Murthy 
> >  To: "common-dev@hadoop.apache.org" ; "
> > hdfs-...@hadoop.apache.org" ; "
> > yarn-...@hadoop.apache.org" ; "
> > mapreduce-...@hadoop.apache.org" 
> >  Sent: Thursday, November 13, 2014 5:08 PM
> >  Subject: [VOTE] Release Apache Hadoop 2.6.0
> >
> > Folks,
> >
> > I've created another release candidate (rc1) for hadoop-2.6.0 based on
> the
> > feedback.
> >
> > The RC is available at:
> > http://people.apache.org/~acmurthy/hadoop-2.6.0-rc1
> > The RC tag in git is: release-2.6.0-rc1
> >
> > The maven artifacts are available via repository.apache.org at
> > https://repository.apache.org/content/repositories/orgapachehadoop-1013.
> >
> > Please try the release and vote; the vote will run for the usual 5 days.
> >
> > thanks,
> > Arun
> >
> >
> > --
> > CONFIDENTIALITY NOTICE
> > NOTICE: This message is intended for the use of the individual or entity
> to
> > which it is addressed and may contain information that is confidential,
> > privileged and exempt from disclosure under applicable law. If the reader
> > of this message is not the intended recipient, you are hereby notified
> that
> > any printing, copying, dissemination, distribution, disclosure or
> > forwarding of this communication is strictly prohibited. If you have
> > received this communication in error, please contact the sender
> immediately
> > and delete it from your system. Thank You.
> >
> >
> >
> >
>
> --
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity to
> which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
>


Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-18 Thread Eric Payne
+1 . Thanks Arun, for producing this release. I downloaded and built the 
source. I started local cluster and ran wordcount, sleep, and streaming jobs.

 - I ran a distributed shell job which tested preserving containers across AM 
restart by setting the -keep_containers_across_application_attempts flag and 
killing the first AM once the containers start. I checked the results by 
looking in the timeline server and comparing the start times of the non-AM 
containers against the start times of the later AM container. - I enabled the 
preemption feature and verified containers were preempted and queues were 
adjusted to guaranteed levels.
- I ran unit tests for hadoop-yarn-server-resourcemanage. All passed with the 
exception of TestContainerResourceUsage. - I ran unit tests for hadoop-hdfs. 
All passed with the exception of TestBPOfferService#testBasicFunctionality 
(HDFS-3930) Thank you,-Eric Payne

 


  From: Arun C Murthy 
 To: "common-dev@hadoop.apache.org" ; 
"hdfs-...@hadoop.apache.org" ; 
"yarn-...@hadoop.apache.org" ; 
"mapreduce-...@hadoop.apache.org"  
 Sent: Thursday, November 13, 2014 5:08 PM
 Subject: [VOTE] Release Apache Hadoop 2.6.0 
   
Folks,

I've created another release candidate (rc1) for hadoop-2.6.0 based on the 
feedback.

The RC is available at: http://people.apache.org/~acmurthy/hadoop-2.6.0-rc1
The RC tag in git is: release-2.6.0-rc1

The maven artifacts are available via repository.apache.org at 
https://repository.apache.org/content/repositories/orgapachehadoop-1013.

Please try the release and vote; the vote will run for the usual 5 days.

thanks,
Arun


-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.


   


Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-18 Thread Arun C Murthy
Tsuyoshi,

 I think you have to pass along -Pdist too… afaik that is how the Jenkins we 
use for building release artifacts operates.
 
 For now, I've marked HADOOP-11316 for inclusion into 2.6.1 if required.

thanks,
Arun

On Nov 18, 2014, at 7:26 AM, Tsuyoshi OZAWA  wrote:

> Hi,
> 
> I also found that a following command fails with hadoop-2.6.0-rc1-src.tar.gz:
> 
> $ mvn package -Pdocs -DskipTests -Dtar
> 
> I filed it as HADOOP-11316. We should fix it if possible. Or, should
> we fix it for 2.6.1?
> 
> Thanks,
> - Tsuyoshi
> 
> On Tue, Nov 18, 2014 at 3:04 PM, Tsuyoshi OZAWA
>  wrote:
>> Suresh, Tsz-Wo,
>> 
>> Thanks for your comments.
>> Could you check a comment by Masatake on HDFS-6833?
>> 
>> thanks,
>> - Tsuyoshi
>> 
>> On Tue, Nov 18, 2014 at 7:14 AM, Tsz Wo Sze  
>> wrote:
>>> I agree that HDFS-6833 is not a blocker.  It is not a problem for the 
>>> blocks with replication >= 3 and it is not a regression (please correct me 
>>> if I am wrong.)Tsz-Wo
>>> 
>>> On Monday, November 17, 2014 10:06 AM, Suresh Srinivas 
>>>  wrote:
>>> 
>>> 
>>> 
>>> Tsuyoshi, thanks for bringing up HDFS-6833. However, given it is a boundary
>>> condition (and should not cause issues when for files with replication
>>> factor 3), we should perhaps target this into 2.6.1 and not block this
>>> release. Thoughts?
>>> 
>>> On Mon, Nov 17, 2014 at 4:17 AM, Tsuyoshi OZAWA 
>>> wrote:
>>> 
 +0(non-binding)
 
 HDFS-6833 is critical issue for us - could you help us to merge it into
 2.6?
 
 Thanks,
 - Tsuyoshi
 
 On Sat, Nov 15, 2014 at 1:03 PM, Hitesh Shah  wrote:
> +1 (binding)
> 
> Built Hadoop from source, compiled Tez against the hadoop jars pushed to
 staging repo and ran a few example Tez jobs on a single node cluster.
> 
> — HItesh
> 
> 
> On Nov 13, 2014, at 3:08 PM, Arun C Murthy  wrote:
> 
>> Folks,
>> 
>> I've created another release candidate (rc1) for hadoop-2.6.0 based on
 the feedback.
>> 
>> The RC is available at:
 http://people.apache.org/~acmurthy/hadoop-2.6.0-rc1
>> The RC tag in git is: release-2.6.0-rc1
>> 
>> The maven artifacts are available via repository.apache.org at
 https://repository.apache.org/content/repositories/orgapachehadoop-1013.
>> 
>> Please try the release and vote; the vote will run for the usual 5 days.
>> 
>> thanks,
>> Arun
>> 
>> 
>> --
>> CONFIDENTIALITY NOTICE
>> NOTICE: This message is intended for the use of the individual or
 entity to
>> which it is addressed and may contain information that is confidential,
>> privileged and exempt from disclosure under applicable law. If the
 reader
>> of this message is not the intended recipient, you are hereby notified
 that
>> any printing, copying, dissemination, distribution, disclosure or
>> forwarding of this communication is strictly prohibited. If you have
>> received this communication in error, please contact the sender
 immediately
>> and delete it from your system. Thank You.
> 
 
 
 
 --
 - Tsuyoshi
 
>>> 
>>> 
>>> 
>>> --
>>> http://hortonworks.com/download/
>>> 
>>> --
>>> CONFIDENTIALITY NOTICE
>>> NOTICE: This message is intended for the use of the individual or entity to
>>> which it is addressed and may contain information that is confidential,
>>> privileged and exempt from disclosure under applicable law. If the reader
>>> of this message is not the intended recipient, you are hereby notified that
>>> any printing, copying, dissemination, distribution, disclosure or
>>> forwarding of this communication is strictly prohibited. If you have
>>> received this communication in error, please contact the sender immediately
>>> and delete it from your system. Thank You.
>>> 
>>> 
>>> 
>> 
>> 
>> 
>> --
>> - Tsuyoshi
> 
> 
> 
> -- 
> - Tsuyoshi

--
Arun C. Murthy
Hortonworks Inc.
http://hortonworks.com/hdp/



-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.


Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-18 Thread Tsuyoshi OZAWA
Hi,

I also found that a following command fails with hadoop-2.6.0-rc1-src.tar.gz:

$ mvn package -Pdocs -DskipTests -Dtar

I filed it as HADOOP-11316. We should fix it if possible. Or, should
we fix it for 2.6.1?

Thanks,
- Tsuyoshi

On Tue, Nov 18, 2014 at 3:04 PM, Tsuyoshi OZAWA
 wrote:
> Suresh, Tsz-Wo,
>
> Thanks for your comments.
> Could you check a comment by Masatake on HDFS-6833?
>
> thanks,
> - Tsuyoshi
>
> On Tue, Nov 18, 2014 at 7:14 AM, Tsz Wo Sze  
> wrote:
>> I agree that HDFS-6833 is not a blocker.  It is not a problem for the blocks 
>> with replication >= 3 and it is not a regression (please correct me if I am 
>> wrong.)Tsz-Wo
>>
>>  On Monday, November 17, 2014 10:06 AM, Suresh Srinivas 
>>  wrote:
>>
>>
>>
>>  Tsuyoshi, thanks for bringing up HDFS-6833. However, given it is a boundary
>> condition (and should not cause issues when for files with replication
>> factor 3), we should perhaps target this into 2.6.1 and not block this
>> release. Thoughts?
>>
>> On Mon, Nov 17, 2014 at 4:17 AM, Tsuyoshi OZAWA 
>> wrote:
>>
>>> +0(non-binding)
>>>
>>> HDFS-6833 is critical issue for us - could you help us to merge it into
>>> 2.6?
>>>
>>> Thanks,
>>> - Tsuyoshi
>>>
>>> On Sat, Nov 15, 2014 at 1:03 PM, Hitesh Shah  wrote:
>>> > +1 (binding)
>>> >
>>> > Built Hadoop from source, compiled Tez against the hadoop jars pushed to
>>> staging repo and ran a few example Tez jobs on a single node cluster.
>>> >
>>> > — HItesh
>>> >
>>> >
>>> > On Nov 13, 2014, at 3:08 PM, Arun C Murthy  wrote:
>>> >
>>> >> Folks,
>>> >>
>>> >> I've created another release candidate (rc1) for hadoop-2.6.0 based on
>>> the feedback.
>>> >>
>>> >> The RC is available at:
>>> http://people.apache.org/~acmurthy/hadoop-2.6.0-rc1
>>> >> The RC tag in git is: release-2.6.0-rc1
>>> >>
>>> >> The maven artifacts are available via repository.apache.org at
>>> https://repository.apache.org/content/repositories/orgapachehadoop-1013.
>>> >>
>>> >> Please try the release and vote; the vote will run for the usual 5 days.
>>> >>
>>> >> thanks,
>>> >> Arun
>>> >>
>>> >>
>>> >> --
>>> >> CONFIDENTIALITY NOTICE
>>> >> NOTICE: This message is intended for the use of the individual or
>>> entity to
>>> >> which it is addressed and may contain information that is confidential,
>>> >> privileged and exempt from disclosure under applicable law. If the
>>> reader
>>> >> of this message is not the intended recipient, you are hereby notified
>>> that
>>> >> any printing, copying, dissemination, distribution, disclosure or
>>> >> forwarding of this communication is strictly prohibited. If you have
>>> >> received this communication in error, please contact the sender
>>> immediately
>>> >> and delete it from your system. Thank You.
>>> >
>>>
>>>
>>>
>>> --
>>> - Tsuyoshi
>>>
>>
>>
>>
>> --
>> http://hortonworks.com/download/
>>
>> --
>> CONFIDENTIALITY NOTICE
>> NOTICE: This message is intended for the use of the individual or entity to
>> which it is addressed and may contain information that is confidential,
>> privileged and exempt from disclosure under applicable law. If the reader
>> of this message is not the intended recipient, you are hereby notified that
>> any printing, copying, dissemination, distribution, disclosure or
>> forwarding of this communication is strictly prohibited. If you have
>> received this communication in error, please contact the sender immediately
>> and delete it from your system. Thank You.
>>
>>
>>
>
>
>
> --
> - Tsuyoshi



-- 
- Tsuyoshi


Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-17 Thread Tsuyoshi OZAWA
Suresh, Tsz-Wo,

Thanks for your comments.
Could you check a comment by Masatake on HDFS-6833?

thanks,
- Tsuyoshi

On Tue, Nov 18, 2014 at 7:14 AM, Tsz Wo Sze  wrote:
> I agree that HDFS-6833 is not a blocker.  It is not a problem for the blocks 
> with replication >= 3 and it is not a regression (please correct me if I am 
> wrong.)Tsz-Wo
>
>  On Monday, November 17, 2014 10:06 AM, Suresh Srinivas 
>  wrote:
>
>
>
>  Tsuyoshi, thanks for bringing up HDFS-6833. However, given it is a boundary
> condition (and should not cause issues when for files with replication
> factor 3), we should perhaps target this into 2.6.1 and not block this
> release. Thoughts?
>
> On Mon, Nov 17, 2014 at 4:17 AM, Tsuyoshi OZAWA 
> wrote:
>
>> +0(non-binding)
>>
>> HDFS-6833 is critical issue for us - could you help us to merge it into
>> 2.6?
>>
>> Thanks,
>> - Tsuyoshi
>>
>> On Sat, Nov 15, 2014 at 1:03 PM, Hitesh Shah  wrote:
>> > +1 (binding)
>> >
>> > Built Hadoop from source, compiled Tez against the hadoop jars pushed to
>> staging repo and ran a few example Tez jobs on a single node cluster.
>> >
>> > — HItesh
>> >
>> >
>> > On Nov 13, 2014, at 3:08 PM, Arun C Murthy  wrote:
>> >
>> >> Folks,
>> >>
>> >> I've created another release candidate (rc1) for hadoop-2.6.0 based on
>> the feedback.
>> >>
>> >> The RC is available at:
>> http://people.apache.org/~acmurthy/hadoop-2.6.0-rc1
>> >> The RC tag in git is: release-2.6.0-rc1
>> >>
>> >> The maven artifacts are available via repository.apache.org at
>> https://repository.apache.org/content/repositories/orgapachehadoop-1013.
>> >>
>> >> Please try the release and vote; the vote will run for the usual 5 days.
>> >>
>> >> thanks,
>> >> Arun
>> >>
>> >>
>> >> --
>> >> CONFIDENTIALITY NOTICE
>> >> NOTICE: This message is intended for the use of the individual or
>> entity to
>> >> which it is addressed and may contain information that is confidential,
>> >> privileged and exempt from disclosure under applicable law. If the
>> reader
>> >> of this message is not the intended recipient, you are hereby notified
>> that
>> >> any printing, copying, dissemination, distribution, disclosure or
>> >> forwarding of this communication is strictly prohibited. If you have
>> >> received this communication in error, please contact the sender
>> immediately
>> >> and delete it from your system. Thank You.
>> >
>>
>>
>>
>> --
>> - Tsuyoshi
>>
>
>
>
> --
> http://hortonworks.com/download/
>
> --
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity to
> which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
>
>
>



-- 
- Tsuyoshi


Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-17 Thread Tsz Wo Sze
+1 (suppose using md5 is intentional.)
Verified md5 and ran a single node HA HDFS cluster for some time.  Everything 
worked great.
Regards,Tsz-Wo 

 On Monday, November 17, 2014 4:48 PM, Tsz Wo Sze  
wrote:
   
 

 Hi Arun,
Only md5 is provided but not mds?  Is it intentional?
Tsz-Wo 

 On Monday, November 17, 2014 2:14 PM, Tsz Wo Sze  
wrote:
   
 

 I agree that HDFS-6833 is not a blocker.  It is not a problem for the blocks 
with replication >= 3 and it is not a regression (please correct me if I am 
wrong.)Tsz-Wo 

 On Monday, November 17, 2014 10:06 AM, Suresh Srinivas 
 wrote:
   
 

 Tsuyoshi, thanks for bringing up HDFS-6833. However, given it is a boundary
condition (and should not cause issues when for files with replication
factor 3), we should perhaps target this into 2.6.1 and not block this
release. Thoughts?

On Mon, Nov 17, 2014 at 4:17 AM, Tsuyoshi OZAWA 
wrote:

> +0(non-binding)
>
> HDFS-6833 is critical issue for us - could you help us to merge it into
> 2.6?
>
> Thanks,
> - Tsuyoshi
>
> On Sat, Nov 15, 2014 at 1:03 PM, Hitesh Shah  wrote:
> > +1 (binding)
> >
> > Built Hadoop from source, compiled Tez against the hadoop jars pushed to
> staging repo and ran a few example Tez jobs on a single node cluster.
> >
> > — HItesh
> >
> >
> > On Nov 13, 2014, at 3:08 PM, Arun C Murthy  wrote:
> >
> >> Folks,
> >>
> >> I've created another release candidate (rc1) for hadoop-2.6.0 based on
> the feedback.
> >>
> >> The RC is available at:
> http://people.apache.org/~acmurthy/hadoop-2.6.0-rc1
> >> The RC tag in git is: release-2.6.0-rc1
> >>
> >> The maven artifacts are available via repository.apache.org at
> https://repository.apache.org/content/repositories/orgapachehadoop-1013.
> >>
> >> Please try the release and vote; the vote will run for the usual 5 days.
> >>
> >> thanks,
> >> Arun
> >>
> >>
> >> --
> >> CONFIDENTIALITY NOTICE
> >> NOTICE: This message is intended for the use of the individual or
> entity to
> >> which it is addressed and may contain information that is confidential,
> >> privileged and exempt from disclosure under applicable law. If the
> reader
> >> of this message is not the intended recipient, you are hereby notified
> that
> >> any printing, copying, dissemination, distribution, disclosure or
> >> forwarding of this communication is strictly prohibited. If you have
> >> received this communication in error, please contact the sender
> immediately
> >> and delete it from your system. Thank You.
> >
>
>
>
> --
> - Tsuyoshi
>



-- 
http://hortonworks.com/download/

-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.

 


 


 
   

RE: [VOTE] Release Apache Hadoop 2.6.0

2014-11-17 Thread Liu, Yi A
Sorry, my vote should be non-binding.

Regards,
Yi Liu


-Original Message-
From: Liu, Yi A [mailto:yi.a@intel.com] 
Sent: Tuesday, November 18, 2014 10:03 AM
To: hdfs-...@hadoop.apache.org; common-dev@hadoop.apache.org; 
yarn-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org
Subject: RE: [VOTE] Release Apache Hadoop 2.6.0 

+1 (non-binding)

- Built from source
- Setup a security cluster with 4 nodes, and verified various fs operations.
- Verified MapReduce examples in security mode.
- Verify HDFS encryption at rest in security mode.

Regards,
Yi Liu

-Original Message-
From: Arun C Murthy [mailto:a...@hortonworks.com] 
Sent: Friday, November 14, 2014 7:08 AM
To: common-dev@hadoop.apache.org; hdfs-...@hadoop.apache.org; 
yarn-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org
Subject: [VOTE] Release Apache Hadoop 2.6.0 

Folks,

I've created another release candidate (rc1) for hadoop-2.6.0 based on the 
feedback.

The RC is available at: http://people.apache.org/~acmurthy/hadoop-2.6.0-rc1
The RC tag in git is: release-2.6.0-rc1

The maven artifacts are available via repository.apache.org at 
https://repository.apache.org/content/repositories/orgapachehadoop-1013.

Please try the release and vote; the vote will run for the usual 5 days.

thanks,
Arun


--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader of 
this message is not the intended recipient, you are hereby notified that any 
printing, copying, dissemination, distribution, disclosure or forwarding of 
this communication is strictly prohibited. If you have received this 
communication in error, please contact the sender immediately and delete it 
from your system. Thank You.


RE: [VOTE] Release Apache Hadoop 2.6.0

2014-11-17 Thread Liu, Yi A
+1 (binding)

- Built from source
- Setup a security cluster with 4 nodes, and verified various fs operations.
- Verified MapReduce examples in security mode.
- Verify HDFS encryption at rest in security mode.

Regards,
Yi Liu

-Original Message-
From: Arun C Murthy [mailto:a...@hortonworks.com] 
Sent: Friday, November 14, 2014 7:08 AM
To: common-dev@hadoop.apache.org; hdfs-...@hadoop.apache.org; 
yarn-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org
Subject: [VOTE] Release Apache Hadoop 2.6.0 

Folks,

I've created another release candidate (rc1) for hadoop-2.6.0 based on the 
feedback.

The RC is available at: http://people.apache.org/~acmurthy/hadoop-2.6.0-rc1
The RC tag in git is: release-2.6.0-rc1

The maven artifacts are available via repository.apache.org at 
https://repository.apache.org/content/repositories/orgapachehadoop-1013.

Please try the release and vote; the vote will run for the usual 5 days.

thanks,
Arun


--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader of 
this message is not the intended recipient, you are hereby notified that any 
printing, copying, dissemination, distribution, disclosure or forwarding of 
this communication is strictly prohibited. If you have received this 
communication in error, please contact the sender immediately and delete it 
from your system. Thank You.


Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-17 Thread Tsz Wo Sze
Hi Arun,
Only md5 is provided but not mds?  Is it intentional?
Tsz-Wo 

 On Monday, November 17, 2014 2:14 PM, Tsz Wo Sze  
wrote:
   
 

 I agree that HDFS-6833 is not a blocker.  It is not a problem for the blocks 
with replication >= 3 and it is not a regression (please correct me if I am 
wrong.)Tsz-Wo 

 On Monday, November 17, 2014 10:06 AM, Suresh Srinivas 
 wrote:
   
 

 Tsuyoshi, thanks for bringing up HDFS-6833. However, given it is a boundary
condition (and should not cause issues when for files with replication
factor 3), we should perhaps target this into 2.6.1 and not block this
release. Thoughts?

On Mon, Nov 17, 2014 at 4:17 AM, Tsuyoshi OZAWA 
wrote:

> +0(non-binding)
>
> HDFS-6833 is critical issue for us - could you help us to merge it into
> 2.6?
>
> Thanks,
> - Tsuyoshi
>
> On Sat, Nov 15, 2014 at 1:03 PM, Hitesh Shah  wrote:
> > +1 (binding)
> >
> > Built Hadoop from source, compiled Tez against the hadoop jars pushed to
> staging repo and ran a few example Tez jobs on a single node cluster.
> >
> > — HItesh
> >
> >
> > On Nov 13, 2014, at 3:08 PM, Arun C Murthy  wrote:
> >
> >> Folks,
> >>
> >> I've created another release candidate (rc1) for hadoop-2.6.0 based on
> the feedback.
> >>
> >> The RC is available at:
> http://people.apache.org/~acmurthy/hadoop-2.6.0-rc1
> >> The RC tag in git is: release-2.6.0-rc1
> >>
> >> The maven artifacts are available via repository.apache.org at
> https://repository.apache.org/content/repositories/orgapachehadoop-1013.
> >>
> >> Please try the release and vote; the vote will run for the usual 5 days.
> >>
> >> thanks,
> >> Arun
> >>
> >>
> >> --
> >> CONFIDENTIALITY NOTICE
> >> NOTICE: This message is intended for the use of the individual or
> entity to
> >> which it is addressed and may contain information that is confidential,
> >> privileged and exempt from disclosure under applicable law. If the
> reader
> >> of this message is not the intended recipient, you are hereby notified
> that
> >> any printing, copying, dissemination, distribution, disclosure or
> >> forwarding of this communication is strictly prohibited. If you have
> >> received this communication in error, please contact the sender
> immediately
> >> and delete it from your system. Thank You.
> >
>
>
>
> --
> - Tsuyoshi
>



-- 
http://hortonworks.com/download/

-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.

 


 
   

Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-17 Thread Tsz Wo Sze
I agree that HDFS-6833 is not a blocker.  It is not a problem for the blocks 
with replication >= 3 and it is not a regression (please correct me if I am 
wrong.)Tsz-Wo 

 On Monday, November 17, 2014 10:06 AM, Suresh Srinivas 
 wrote:
   
 

 Tsuyoshi, thanks for bringing up HDFS-6833. However, given it is a boundary
condition (and should not cause issues when for files with replication
factor 3), we should perhaps target this into 2.6.1 and not block this
release. Thoughts?

On Mon, Nov 17, 2014 at 4:17 AM, Tsuyoshi OZAWA 
wrote:

> +0(non-binding)
>
> HDFS-6833 is critical issue for us - could you help us to merge it into
> 2.6?
>
> Thanks,
> - Tsuyoshi
>
> On Sat, Nov 15, 2014 at 1:03 PM, Hitesh Shah  wrote:
> > +1 (binding)
> >
> > Built Hadoop from source, compiled Tez against the hadoop jars pushed to
> staging repo and ran a few example Tez jobs on a single node cluster.
> >
> > — HItesh
> >
> >
> > On Nov 13, 2014, at 3:08 PM, Arun C Murthy  wrote:
> >
> >> Folks,
> >>
> >> I've created another release candidate (rc1) for hadoop-2.6.0 based on
> the feedback.
> >>
> >> The RC is available at:
> http://people.apache.org/~acmurthy/hadoop-2.6.0-rc1
> >> The RC tag in git is: release-2.6.0-rc1
> >>
> >> The maven artifacts are available via repository.apache.org at
> https://repository.apache.org/content/repositories/orgapachehadoop-1013.
> >>
> >> Please try the release and vote; the vote will run for the usual 5 days.
> >>
> >> thanks,
> >> Arun
> >>
> >>
> >> --
> >> CONFIDENTIALITY NOTICE
> >> NOTICE: This message is intended for the use of the individual or
> entity to
> >> which it is addressed and may contain information that is confidential,
> >> privileged and exempt from disclosure under applicable law. If the
> reader
> >> of this message is not the intended recipient, you are hereby notified
> that
> >> any printing, copying, dissemination, distribution, disclosure or
> >> forwarding of this communication is strictly prohibited. If you have
> >> received this communication in error, please contact the sender
> immediately
> >> and delete it from your system. Thank You.
> >
>
>
>
> --
> - Tsuyoshi
>



-- 
http://hortonworks.com/download/

-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.

 
   

Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-17 Thread Suresh Srinivas
+1 (binding)

Verified the signatures and hashes for both src and binary tars. Built from
the source, the binary distribution and the documentation. Started a single
node cluster and tested the following:
- Started HDFS cluster, verified the hdfs CLI commands such ls, copying
data back and forth, verified namenode webUI etc.
- Ran some tests such as sleep job, TestDFSIO, NNBench etc.

On Thu, Nov 13, 2014 at 3:08 PM, Arun C Murthy  wrote:

> Folks,
>
> I've created another release candidate (rc1) for hadoop-2.6.0 based on the
> feedback.
>
> The RC is available at:
> http://people.apache.org/~acmurthy/hadoop-2.6.0-rc1
> The RC tag in git is: release-2.6.0-rc1
>
> The maven artifacts are available via repository.apache.org at
> https://repository.apache.org/content/repositories/orgapachehadoop-1013.
>
> Please try the release and vote; the vote will run for the usual 5 days.
>
> thanks,
> Arun
>
>
> --
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity to
> which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
>



-- 
http://hortonworks.com/download/

-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.


Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-17 Thread Subramaniam V K
+1 (non-binding)

- Deployed single node cluster
- Verified reservation system works (YARN-1051) by making reservations and
submitting sample MR jobs against the reservations
- Verified move apps between capacity scheduler queues (YARN-2378)

Thanks,
Subru

On Mon, Nov 17, 2014 at 9:55 AM, Charles Lamb  wrote:

> I built from the src package, started a cluster, created an encryption
> zone and read/wrote data from/to it.
>
> +1 (non-binding)
>
> Charles
>
>


Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-17 Thread Yongjun Zhang
Hi Suresh,

I did review HDFS-6833 and the patch Shinichi provided a while back. It's
not really directly related to replication factor. The problem reported
there is, DirectoryScanner tries to register with NN blocks already
scheduled to be deleted as regular blocks, due to the delay in block
removal at DN side. This is wrong, and caused extra cycle/bandwidth and it
should not happen. And the patch tries to fix that.

I think it's a good fix to have, but probably targetting at 2.6.1 would be
fine. Given that the fix is still pending a committer's review, it will
take some time and we should push on that. I do hope the fix can get in as
soon as possible though.

Would you please share with us the timeframe for 2.6.1, and I hope the
schedule will work with Tsuyoshi.

Thanks.

--Yongjun


On Mon, Nov 17, 2014 at 10:03 AM, Suresh Srinivas 
wrote:

> Tsuyoshi, thanks for bringing up HDFS-6833. However, given it is a boundary
> condition (and should not cause issues when for files with replication
> factor 3), we should perhaps target this into 2.6.1 and not block this
> release. Thoughts?
>
> On Mon, Nov 17, 2014 at 4:17 AM, Tsuyoshi OZAWA 
> wrote:
>
> > +0(non-binding)
> >
> > HDFS-6833 is critical issue for us - could you help us to merge it into
> > 2.6?
> >
> > Thanks,
> > - Tsuyoshi
> >
> > On Sat, Nov 15, 2014 at 1:03 PM, Hitesh Shah  wrote:
> > > +1 (binding)
> > >
> > > Built Hadoop from source, compiled Tez against the hadoop jars pushed
> to
> > staging repo and ran a few example Tez jobs on a single node cluster.
> > >
> > > — HItesh
> > >
> > >
> > > On Nov 13, 2014, at 3:08 PM, Arun C Murthy 
> wrote:
> > >
> > >> Folks,
> > >>
> > >> I've created another release candidate (rc1) for hadoop-2.6.0 based on
> > the feedback.
> > >>
> > >> The RC is available at:
> > http://people.apache.org/~acmurthy/hadoop-2.6.0-rc1
> > >> The RC tag in git is: release-2.6.0-rc1
> > >>
> > >> The maven artifacts are available via repository.apache.org at
> > https://repository.apache.org/content/repositories/orgapachehadoop-1013.
> > >>
> > >> Please try the release and vote; the vote will run for the usual 5
> days.
> > >>
> > >> thanks,
> > >> Arun
> > >>
> > >>
> > >> --
> > >> CONFIDENTIALITY NOTICE
> > >> NOTICE: This message is intended for the use of the individual or
> > entity to
> > >> which it is addressed and may contain information that is
> confidential,
> > >> privileged and exempt from disclosure under applicable law. If the
> > reader
> > >> of this message is not the intended recipient, you are hereby notified
> > that
> > >> any printing, copying, dissemination, distribution, disclosure or
> > >> forwarding of this communication is strictly prohibited. If you have
> > >> received this communication in error, please contact the sender
> > immediately
> > >> and delete it from your system. Thank You.
> > >
> >
> >
> >
> > --
> > - Tsuyoshi
> >
>
>
>
> --
> http://hortonworks.com/download/
>
> --
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity to
> which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
>


Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-17 Thread Suresh Srinivas
Tsuyoshi, thanks for bringing up HDFS-6833. However, given it is a boundary
condition (and should not cause issues when for files with replication
factor 3), we should perhaps target this into 2.6.1 and not block this
release. Thoughts?

On Mon, Nov 17, 2014 at 4:17 AM, Tsuyoshi OZAWA 
wrote:

> +0(non-binding)
>
> HDFS-6833 is critical issue for us - could you help us to merge it into
> 2.6?
>
> Thanks,
> - Tsuyoshi
>
> On Sat, Nov 15, 2014 at 1:03 PM, Hitesh Shah  wrote:
> > +1 (binding)
> >
> > Built Hadoop from source, compiled Tez against the hadoop jars pushed to
> staging repo and ran a few example Tez jobs on a single node cluster.
> >
> > — HItesh
> >
> >
> > On Nov 13, 2014, at 3:08 PM, Arun C Murthy  wrote:
> >
> >> Folks,
> >>
> >> I've created another release candidate (rc1) for hadoop-2.6.0 based on
> the feedback.
> >>
> >> The RC is available at:
> http://people.apache.org/~acmurthy/hadoop-2.6.0-rc1
> >> The RC tag in git is: release-2.6.0-rc1
> >>
> >> The maven artifacts are available via repository.apache.org at
> https://repository.apache.org/content/repositories/orgapachehadoop-1013.
> >>
> >> Please try the release and vote; the vote will run for the usual 5 days.
> >>
> >> thanks,
> >> Arun
> >>
> >>
> >> --
> >> CONFIDENTIALITY NOTICE
> >> NOTICE: This message is intended for the use of the individual or
> entity to
> >> which it is addressed and may contain information that is confidential,
> >> privileged and exempt from disclosure under applicable law. If the
> reader
> >> of this message is not the intended recipient, you are hereby notified
> that
> >> any printing, copying, dissemination, distribution, disclosure or
> >> forwarding of this communication is strictly prohibited. If you have
> >> received this communication in error, please contact the sender
> immediately
> >> and delete it from your system. Thank You.
> >
>
>
>
> --
> - Tsuyoshi
>



-- 
http://hortonworks.com/download/

-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.


Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-17 Thread Charles Lamb
I built from the src package, started a cluster, created an encryption 
zone and read/wrote data from/to it.


+1 (non-binding)

Charles



Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-17 Thread Jason Lowe
+1 (binding)
- verified signatures and digests- verified late-arriving fixes for YARN-2846 
and MAPREDUCE-6156 were present
- built from source- deployed to a single-node cluster 
- ran some sample MapReduce jobs
Jason
  From: Arun C Murthy 
 To: "common-dev@hadoop.apache.org" ; 
"hdfs-...@hadoop.apache.org" ; 
"yarn-...@hadoop.apache.org" ; 
"mapreduce-...@hadoop.apache.org"  
 Sent: Thursday, November 13, 2014 5:08 PM
 Subject: [VOTE] Release Apache Hadoop 2.6.0 
   
Folks,

I've created another release candidate (rc1) for hadoop-2.6.0 based on the 
feedback.

The RC is available at: http://people.apache.org/~acmurthy/hadoop-2.6.0-rc1
The RC tag in git is: release-2.6.0-rc1

The maven artifacts are available via repository.apache.org at 
https://repository.apache.org/content/repositories/orgapachehadoop-1013.

Please try the release and vote; the vote will run for the usual 5 days.

thanks,
Arun


-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.


   

Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-17 Thread Mit Desai
+1 (non-binding)

+ download and compile source code
+ deployed on a pseudo cluster
+ successfully run sample MR jobs
+ verified checksum
Thanks,Mit Desai
 

 On Monday, November 17, 2014 6:19 AM, Tsuyoshi OZAWA 
 wrote:
   

 +0(non-binding)

HDFS-6833 is critical issue for us - could you help us to merge it into 2.6?

Thanks,
- Tsuyoshi

On Sat, Nov 15, 2014 at 1:03 PM, Hitesh Shah  wrote:
> +1 (binding)
>
> Built Hadoop from source, compiled Tez against the hadoop jars pushed to 
> staging repo and ran a few example Tez jobs on a single node cluster.
>
> — HItesh
>
>
> On Nov 13, 2014, at 3:08 PM, Arun C Murthy  wrote:
>
>> Folks,
>>
>> I've created another release candidate (rc1) for hadoop-2.6.0 based on the 
>> feedback.
>>
>> The RC is available at: http://people.apache.org/~acmurthy/hadoop-2.6.0-rc1
>> The RC tag in git is: release-2.6.0-rc1
>>
>> The maven artifacts are available via repository.apache.org at 
>> https://repository.apache.org/content/repositories/orgapachehadoop-1013.
>>
>> Please try the release and vote; the vote will run for the usual 5 days.
>>
>> thanks,
>> Arun
>>
>>
>> --
>> CONFIDENTIALITY NOTICE
>> NOTICE: This message is intended for the use of the individual or entity to
>> which it is addressed and may contain information that is confidential,
>> privileged and exempt from disclosure under applicable law. If the reader
>> of this message is not the intended recipient, you are hereby notified that
>> any printing, copying, dissemination, distribution, disclosure or
>> forwarding of this communication is strictly prohibited. If you have
>> received this communication in error, please contact the sender immediately
>> and delete it from your system. Thank You.
>



-- 
- Tsuyoshi

   

Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-17 Thread Tsuyoshi OZAWA
+0(non-binding)

HDFS-6833 is critical issue for us - could you help us to merge it into 2.6?

Thanks,
- Tsuyoshi

On Sat, Nov 15, 2014 at 1:03 PM, Hitesh Shah  wrote:
> +1 (binding)
>
> Built Hadoop from source, compiled Tez against the hadoop jars pushed to 
> staging repo and ran a few example Tez jobs on a single node cluster.
>
> — HItesh
>
>
> On Nov 13, 2014, at 3:08 PM, Arun C Murthy  wrote:
>
>> Folks,
>>
>> I've created another release candidate (rc1) for hadoop-2.6.0 based on the 
>> feedback.
>>
>> The RC is available at: http://people.apache.org/~acmurthy/hadoop-2.6.0-rc1
>> The RC tag in git is: release-2.6.0-rc1
>>
>> The maven artifacts are available via repository.apache.org at 
>> https://repository.apache.org/content/repositories/orgapachehadoop-1013.
>>
>> Please try the release and vote; the vote will run for the usual 5 days.
>>
>> thanks,
>> Arun
>>
>>
>> --
>> CONFIDENTIALITY NOTICE
>> NOTICE: This message is intended for the use of the individual or entity to
>> which it is addressed and may contain information that is confidential,
>> privileged and exempt from disclosure under applicable law. If the reader
>> of this message is not the intended recipient, you are hereby notified that
>> any printing, copying, dissemination, distribution, disclosure or
>> forwarding of this communication is strictly prohibited. If you have
>> received this communication in error, please contact the sender immediately
>> and delete it from your system. Thank You.
>



-- 
- Tsuyoshi


Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-14 Thread Hitesh Shah
+1 (binding)

Built Hadoop from source, compiled Tez against the hadoop jars pushed to 
staging repo and ran a few example Tez jobs on a single node cluster. 

— HItesh 


On Nov 13, 2014, at 3:08 PM, Arun C Murthy  wrote:

> Folks,
> 
> I've created another release candidate (rc1) for hadoop-2.6.0 based on the 
> feedback.
> 
> The RC is available at: http://people.apache.org/~acmurthy/hadoop-2.6.0-rc1
> The RC tag in git is: release-2.6.0-rc1
> 
> The maven artifacts are available via repository.apache.org at 
> https://repository.apache.org/content/repositories/orgapachehadoop-1013.
> 
> Please try the release and vote; the vote will run for the usual 5 days.
> 
> thanks,
> Arun
> 
> 
> -- 
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity to 
> which it is addressed and may contain information that is confidential, 
> privileged and exempt from disclosure under applicable law. If the reader 
> of this message is not the intended recipient, you are hereby notified that 
> any printing, copying, dissemination, distribution, disclosure or 
> forwarding of this communication is strictly prohibited. If you have 
> received this communication in error, please contact the sender immediately 
> and delete it from your system. Thank You.



Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-14 Thread Xiaoyu Yao
+1 (non-binding)

Successfully download the hadoop-2.6.0-rc1 source code, build and deploy a 
single node clusters with the following new HDFS features configured.
* HDFS-6581 (Memory Storage), 
* HDFS-6584 (Archival Storage & Storage Policy), 
* HDFS-6134 (KMS & HDFS at rest data encryption) 

I run hdfs/hadoop commands to validate the basic functionality of these 
features interop successfully.

Thanks,
-Xiaoyu

On Nov 14, 2014, at 4:26 PM, Jing Zhao  wrote:

> +1 (binding)
> 
> Verified checksums and signatures. Successfully deploy a cluster with
> NameNode HA setup and run some hdfs commands.
> 
> Thanks,
> -Jing
> 
> On Fri, Nov 14, 2014 at 3:58 PM, Chris Nauroth 
> wrote:
> 
>> +1 (binding)
>> 
>> - Verified checksums and signatures for source and binary tarballs.
>> - Started a pseudo-distributed HDFS cluster in secure mode with SSL.
>> - Tested various file system operations.
>> - Verified HDFS-2856, the new feature to run a secure DataNode without
>> requiring root.
>> - Verified HDFS-7385, the recent blocker related to incorrect ACLs
>> serialized to the edit log.
>> 
>> Thank you to Arun as release manager, and thank you to all of the
>> contributors for their hard work on this release.
>> 
>> Chris Nauroth
>> Hortonworks
>> http://hortonworks.com/
>> 
>> 
>> On Fri, Nov 14, 2014 at 10:57 AM, Yongjun Zhang 
>> wrote:
>> 
>>> Thanks Arun for leading the 2.6 release effort.
>>> 
>>> +1 (non-binding)
>>> 
>>> - Downloaded rc1 source and did build
>>> - Created two single-node clusters running 2.6
>>> - Ran sample mapreduce job
>>> - Ran distcp between two clusters
>>> 
>>> --Yongjun
>>> 
>>> 
>>> On Thu, Nov 13, 2014 at 3:08 PM, Arun C Murthy 
>>> wrote:
>>> 
 Folks,
 
 I've created another release candidate (rc1) for hadoop-2.6.0 based on
>>> the
 feedback.
 
 The RC is available at:
 http://people.apache.org/~acmurthy/hadoop-2.6.0-rc1
 The RC tag in git is: release-2.6.0-rc1
 
 The maven artifacts are available via repository.apache.org at
 
>> https://repository.apache.org/content/repositories/orgapachehadoop-1013.
 
 Please try the release and vote; the vote will run for the usual 5
>> days.
 
 thanks,
 Arun
 
 
 --
 CONFIDENTIALITY NOTICE
 NOTICE: This message is intended for the use of the individual or
>> entity
>>> to
 which it is addressed and may contain information that is confidential,
 privileged and exempt from disclosure under applicable law. If the
>> reader
 of this message is not the intended recipient, you are hereby notified
>>> that
 any printing, copying, dissemination, distribution, disclosure or
 forwarding of this communication is strictly prohibited. If you have
 received this communication in error, please contact the sender
>>> immediately
 and delete it from your system. Thank You.
 
>>> 
>> 
>> --
>> CONFIDENTIALITY NOTICE
>> NOTICE: This message is intended for the use of the individual or entity to
>> which it is addressed and may contain information that is confidential,
>> privileged and exempt from disclosure under applicable law. If the reader
>> of this message is not the intended recipient, you are hereby notified that
>> any printing, copying, dissemination, distribution, disclosure or
>> forwarding of this communication is strictly prohibited. If you have
>> received this communication in error, please contact the sender immediately
>> and delete it from your system. Thank You.
>> 
> 
> -- 
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity to 
> which it is addressed and may contain information that is confidential, 
> privileged and exempt from disclosure under applicable law. If the reader 
> of this message is not the intended recipient, you are hereby notified that 
> any printing, copying, dissemination, distribution, disclosure or 
> forwarding of this communication is strictly prohibited. If you have 
> received this communication in error, please contact the sender immediately 
> and delete it from your system. Thank You.


-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.


Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-14 Thread Jing Zhao
+1 (binding)

Verified checksums and signatures. Successfully deploy a cluster with
NameNode HA setup and run some hdfs commands.

Thanks,
-Jing

On Fri, Nov 14, 2014 at 3:58 PM, Chris Nauroth 
wrote:

> +1 (binding)
>
> - Verified checksums and signatures for source and binary tarballs.
> - Started a pseudo-distributed HDFS cluster in secure mode with SSL.
> - Tested various file system operations.
> - Verified HDFS-2856, the new feature to run a secure DataNode without
> requiring root.
> - Verified HDFS-7385, the recent blocker related to incorrect ACLs
> serialized to the edit log.
>
> Thank you to Arun as release manager, and thank you to all of the
> contributors for their hard work on this release.
>
> Chris Nauroth
> Hortonworks
> http://hortonworks.com/
>
>
> On Fri, Nov 14, 2014 at 10:57 AM, Yongjun Zhang 
> wrote:
>
> > Thanks Arun for leading the 2.6 release effort.
> >
> > +1 (non-binding)
> >
> > - Downloaded rc1 source and did build
> > - Created two single-node clusters running 2.6
> > - Ran sample mapreduce job
> > - Ran distcp between two clusters
> >
> > --Yongjun
> >
> >
> > On Thu, Nov 13, 2014 at 3:08 PM, Arun C Murthy 
> > wrote:
> >
> > > Folks,
> > >
> > > I've created another release candidate (rc1) for hadoop-2.6.0 based on
> > the
> > > feedback.
> > >
> > > The RC is available at:
> > > http://people.apache.org/~acmurthy/hadoop-2.6.0-rc1
> > > The RC tag in git is: release-2.6.0-rc1
> > >
> > > The maven artifacts are available via repository.apache.org at
> > >
> https://repository.apache.org/content/repositories/orgapachehadoop-1013.
> > >
> > > Please try the release and vote; the vote will run for the usual 5
> days.
> > >
> > > thanks,
> > > Arun
> > >
> > >
> > > --
> > > CONFIDENTIALITY NOTICE
> > > NOTICE: This message is intended for the use of the individual or
> entity
> > to
> > > which it is addressed and may contain information that is confidential,
> > > privileged and exempt from disclosure under applicable law. If the
> reader
> > > of this message is not the intended recipient, you are hereby notified
> > that
> > > any printing, copying, dissemination, distribution, disclosure or
> > > forwarding of this communication is strictly prohibited. If you have
> > > received this communication in error, please contact the sender
> > immediately
> > > and delete it from your system. Thank You.
> > >
> >
>
> --
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity to
> which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
>

-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.


Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-14 Thread Chris Nauroth
Hi Eric,

There was a second release candidate created (named rc1), and voting
started fresh in a new thread.  You might want to join in on that second
thread to make sure that your vote gets counted.  Thanks!

Chris Nauroth
Hortonworks
http://hortonworks.com/


On Fri, Nov 14, 2014 at 3:08 PM, Eric Payne 
wrote:

> +1
> I downloaded and built source. Started local cluster and ran wordcount,
> sleep, and simple streaming job.
>
> Also, I ran a distributed shell job which tested preserving containers
> across AM restart by setting the
> -keep_containers_across_application_attempts flag and killing the first AM
> once the containers start.
> Enabled the preemption feature and verified containers were preempted and
> queues were levelized.
> Ran unit tests for hadoop-yarn-server-resourcemanagerRan unit tests for
> hadoop-hdfs
>  Thank you,-Eric Payne
>
>
>   From: Arun C Murthy 
>  To: "common-dev@hadoop.apache.org" ; "
> hdfs-...@hadoop.apache.org" ; "
> yarn-...@hadoop.apache.org" ; "
> mapreduce-...@hadoop.apache.org" 
>  Sent: Monday, November 10, 2014 8:52 PM
>  Subject: [VOTE] Release Apache Hadoop 2.6.0
>
> Folks,
>
> I've created a release candidate (rc0) for hadoop-2.6.0 that I would like
> to see released.
>
> The RC is available at:
> http://people.apache.org/~acmurthy/hadoop-2.6.0-rc0
> The RC tag in git is: release-2.6.0-rc0
>
> The maven artifacts are available via repository.apache.org at
> https://repository.apache.org/content/repositories/orgapachehadoop-1012.
>
> Please try the release and vote; the vote will run for the usual 5 days.
>
> thanks,
> Arun
>
>
> --
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity to
> which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
>
>
>
>

-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.


Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-14 Thread Chris Nauroth
+1 (binding)

- Verified checksums and signatures for source and binary tarballs.
- Started a pseudo-distributed HDFS cluster in secure mode with SSL.
- Tested various file system operations.
- Verified HDFS-2856, the new feature to run a secure DataNode without
requiring root.
- Verified HDFS-7385, the recent blocker related to incorrect ACLs
serialized to the edit log.

Thank you to Arun as release manager, and thank you to all of the
contributors for their hard work on this release.

Chris Nauroth
Hortonworks
http://hortonworks.com/


On Fri, Nov 14, 2014 at 10:57 AM, Yongjun Zhang  wrote:

> Thanks Arun for leading the 2.6 release effort.
>
> +1 (non-binding)
>
> - Downloaded rc1 source and did build
> - Created two single-node clusters running 2.6
> - Ran sample mapreduce job
> - Ran distcp between two clusters
>
> --Yongjun
>
>
> On Thu, Nov 13, 2014 at 3:08 PM, Arun C Murthy 
> wrote:
>
> > Folks,
> >
> > I've created another release candidate (rc1) for hadoop-2.6.0 based on
> the
> > feedback.
> >
> > The RC is available at:
> > http://people.apache.org/~acmurthy/hadoop-2.6.0-rc1
> > The RC tag in git is: release-2.6.0-rc1
> >
> > The maven artifacts are available via repository.apache.org at
> > https://repository.apache.org/content/repositories/orgapachehadoop-1013.
> >
> > Please try the release and vote; the vote will run for the usual 5 days.
> >
> > thanks,
> > Arun
> >
> >
> > --
> > CONFIDENTIALITY NOTICE
> > NOTICE: This message is intended for the use of the individual or entity
> to
> > which it is addressed and may contain information that is confidential,
> > privileged and exempt from disclosure under applicable law. If the reader
> > of this message is not the intended recipient, you are hereby notified
> that
> > any printing, copying, dissemination, distribution, disclosure or
> > forwarding of this communication is strictly prohibited. If you have
> > received this communication in error, please contact the sender
> immediately
> > and delete it from your system. Thank You.
> >
>

-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.


Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-14 Thread Eric Payne
+1
I downloaded and built source. Started local cluster and ran wordcount, sleep, 
and simple streaming job.

Also, I ran a distributed shell job which tested preserving containers across 
AM restart by setting the -keep_containers_across_application_attempts flag and 
killing the first AM once the containers start.
Enabled the preemption feature and verified containers were preempted and 
queues were levelized.
Ran unit tests for hadoop-yarn-server-resourcemanagerRan unit tests for 
hadoop-hdfs
 Thank you,-Eric Payne

 
  From: Arun C Murthy 
 To: "common-dev@hadoop.apache.org" ; 
"hdfs-...@hadoop.apache.org" ; 
"yarn-...@hadoop.apache.org" ; 
"mapreduce-...@hadoop.apache.org"  
 Sent: Monday, November 10, 2014 8:52 PM
 Subject: [VOTE] Release Apache Hadoop 2.6.0
   
Folks,

I've created a release candidate (rc0) for hadoop-2.6.0 that I would like to 
see released.

The RC is available at: http://people.apache.org/~acmurthy/hadoop-2.6.0-rc0
The RC tag in git is: release-2.6.0-rc0

The maven artifacts are available via repository.apache.org at 
https://repository.apache.org/content/repositories/orgapachehadoop-1012.

Please try the release and vote; the vote will run for the usual 5 days.

thanks,
Arun


-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.


   


Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-14 Thread Yongjun Zhang
Thanks Arun for leading the 2.6 release effort.

+1 (non-binding)

- Downloaded rc1 source and did build
- Created two single-node clusters running 2.6
- Ran sample mapreduce job
- Ran distcp between two clusters

--Yongjun


On Thu, Nov 13, 2014 at 3:08 PM, Arun C Murthy  wrote:

> Folks,
>
> I've created another release candidate (rc1) for hadoop-2.6.0 based on the
> feedback.
>
> The RC is available at:
> http://people.apache.org/~acmurthy/hadoop-2.6.0-rc1
> The RC tag in git is: release-2.6.0-rc1
>
> The maven artifacts are available via repository.apache.org at
> https://repository.apache.org/content/repositories/orgapachehadoop-1013.
>
> Please try the release and vote; the vote will run for the usual 5 days.
>
> thanks,
> Arun
>
>
> --
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity to
> which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
>


Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-14 Thread Zhijie Shen
+1 (non-binding)

Replayed the verifications for rc0, and everything keeps working fine.

On Fri, Nov 14, 2014 at 9:21 AM, Chen He  wrote:

> +1 non-binding
>
> download and compile source code;
> setup single node cluster;
> successfully run sleep job;
>
> Regards!
>
> Chen
>
> On Fri, Nov 14, 2014 at 1:44 AM, Akira AJISAKA  >
> wrote:
>
> > Thanks Arun for creating another rc!
> >
> > +1 (non-binding)
> >
> > - patched Tez 0.5.2 pom to compile against 2.6.0-rc1
> > - patched Hive 0.14 pom to compile against 2.6.0-rc1
> > - run several Hive queries on Tez
> >
> > Thanks,
> > Akira
> >
> >
> > (11/14/14, 10:16), Wangda Tan wrote:
> >
> >> Thanks Arun!
> >>
> >> Have tried compile, deploy and configured a local cluster and can
> >> successfully execute a job with node labels.
> >> +1 (non-binding)
> >>
> >> Thanks,
> >> Wangda
> >>
> >> On Thu, Nov 13, 2014 at 3:39 PM, Ravi Prakash 
> wrote:
> >>
> >>  Thanks for the respin Arun!
> >>> I've verified all checksums, and tested that the
> DockerContainerExecutor
> >>> was able to launch jobs.
> >>>
> >>> I'm a +1 on the release
> >>>
> >>>
> >>>   On Thursday, November 13, 2014 3:09 PM, Arun C Murthy <
> >>> a...@hortonworks.com> wrote:
> >>>
> >>>
> >>>   Folks,
> >>>
> >>> I've created another release candidate (rc1) for hadoop-2.6.0 based on
> >>> the
> >>> feedback.
> >>>
> >>> The RC is available at:
> >>> http://people.apache.org/~acmurthy/hadoop-2.6.0-rc1
> >>> The RC tag in git is: release-2.6.0-rc1
> >>>
> >>> The maven artifacts are available via repository.apache.org at
> >>>
> https://repository.apache.org/content/repositories/orgapachehadoop-1013.
> >>>
> >>> Please try the release and vote; the vote will run for the usual 5
> days.
> >>>
> >>> thanks,
> >>> Arun
> >>>
> >>>
> >>> --
> >>> CONFIDENTIALITY NOTICE
> >>> NOTICE: This message is intended for the use of the individual or
> entity
> >>> to
> >>> which it is addressed and may contain information that is confidential,
> >>> privileged and exempt from disclosure under applicable law. If the
> reader
> >>> of this message is not the intended recipient, you are hereby notified
> >>> that
> >>> any printing, copying, dissemination, distribution, disclosure or
> >>> forwarding of this communication is strictly prohibited. If you have
> >>> received this communication in error, please contact the sender
> >>> immediately
> >>> and delete it from your system. Thank You.
> >>>
> >>>
> >>>
> >>>
> >>>
> >>
> >
>



-- 
Zhijie Shen
Hortonworks Inc.
http://hortonworks.com/

-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.


Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-14 Thread Steve Loughran
+1 binding

purged local m2 repos of org/apache/hadoop/*

rebuilt and reran slider unit and functional tests on OSX and windows,
triggered jenkins builds on Centos & debian. All passed.

On 13 November 2014 23:08, Arun C Murthy  wrote:

> Folks,
>
> I've created another release candidate (rc1) for hadoop-2.6.0 based on the
> feedback.
>
> The RC is available at:
> http://people.apache.org/~acmurthy/hadoop-2.6.0-rc1
> The RC tag in git is: release-2.6.0-rc1
>
> The maven artifacts are available via repository.apache.org at
> https://repository.apache.org/content/repositories/orgapachehadoop-1013.
>
> Please try the release and vote; the vote will run for the usual 5 days.
>
> thanks,
> Arun
>
>
> --
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity to
> which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
>

-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.


Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-14 Thread Chen He
+1 non-binding

download and compile source code;
setup single node cluster;
successfully run sleep job;

Regards!

Chen

On Fri, Nov 14, 2014 at 1:44 AM, Akira AJISAKA 
wrote:

> Thanks Arun for creating another rc!
>
> +1 (non-binding)
>
> - patched Tez 0.5.2 pom to compile against 2.6.0-rc1
> - patched Hive 0.14 pom to compile against 2.6.0-rc1
> - run several Hive queries on Tez
>
> Thanks,
> Akira
>
>
> (11/14/14, 10:16), Wangda Tan wrote:
>
>> Thanks Arun!
>>
>> Have tried compile, deploy and configured a local cluster and can
>> successfully execute a job with node labels.
>> +1 (non-binding)
>>
>> Thanks,
>> Wangda
>>
>> On Thu, Nov 13, 2014 at 3:39 PM, Ravi Prakash  wrote:
>>
>>  Thanks for the respin Arun!
>>> I've verified all checksums, and tested that the DockerContainerExecutor
>>> was able to launch jobs.
>>>
>>> I'm a +1 on the release
>>>
>>>
>>>   On Thursday, November 13, 2014 3:09 PM, Arun C Murthy <
>>> a...@hortonworks.com> wrote:
>>>
>>>
>>>   Folks,
>>>
>>> I've created another release candidate (rc1) for hadoop-2.6.0 based on
>>> the
>>> feedback.
>>>
>>> The RC is available at:
>>> http://people.apache.org/~acmurthy/hadoop-2.6.0-rc1
>>> The RC tag in git is: release-2.6.0-rc1
>>>
>>> The maven artifacts are available via repository.apache.org at
>>> https://repository.apache.org/content/repositories/orgapachehadoop-1013.
>>>
>>> Please try the release and vote; the vote will run for the usual 5 days.
>>>
>>> thanks,
>>> Arun
>>>
>>>
>>> --
>>> CONFIDENTIALITY NOTICE
>>> NOTICE: This message is intended for the use of the individual or entity
>>> to
>>> which it is addressed and may contain information that is confidential,
>>> privileged and exempt from disclosure under applicable law. If the reader
>>> of this message is not the intended recipient, you are hereby notified
>>> that
>>> any printing, copying, dissemination, distribution, disclosure or
>>> forwarding of this communication is strictly prohibited. If you have
>>> received this communication in error, please contact the sender
>>> immediately
>>> and delete it from your system. Thank You.
>>>
>>>
>>>
>>>
>>>
>>
>


Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-14 Thread Akira AJISAKA

Thanks Arun for creating another rc!

+1 (non-binding)

- patched Tez 0.5.2 pom to compile against 2.6.0-rc1
- patched Hive 0.14 pom to compile against 2.6.0-rc1
- run several Hive queries on Tez

Thanks,
Akira

(11/14/14, 10:16), Wangda Tan wrote:

Thanks Arun!

Have tried compile, deploy and configured a local cluster and can
successfully execute a job with node labels.
+1 (non-binding)

Thanks,
Wangda

On Thu, Nov 13, 2014 at 3:39 PM, Ravi Prakash  wrote:


Thanks for the respin Arun!
I've verified all checksums, and tested that the DockerContainerExecutor
was able to launch jobs.

I'm a +1 on the release


  On Thursday, November 13, 2014 3:09 PM, Arun C Murthy <
a...@hortonworks.com> wrote:


  Folks,

I've created another release candidate (rc1) for hadoop-2.6.0 based on the
feedback.

The RC is available at:
http://people.apache.org/~acmurthy/hadoop-2.6.0-rc1
The RC tag in git is: release-2.6.0-rc1

The maven artifacts are available via repository.apache.org at
https://repository.apache.org/content/repositories/orgapachehadoop-1013.

Please try the release and vote; the vote will run for the usual 5 days.

thanks,
Arun


--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.










Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-13 Thread Wangda Tan
Thanks Arun!

Have tried compile, deploy and configured a local cluster and can
successfully execute a job with node labels.
+1 (non-binding)

Thanks,
Wangda

On Thu, Nov 13, 2014 at 3:39 PM, Ravi Prakash  wrote:

> Thanks for the respin Arun!
> I've verified all checksums, and tested that the DockerContainerExecutor
> was able to launch jobs.
>
> I'm a +1 on the release
>
>
>  On Thursday, November 13, 2014 3:09 PM, Arun C Murthy <
> a...@hortonworks.com> wrote:
>
>
>  Folks,
>
> I've created another release candidate (rc1) for hadoop-2.6.0 based on the
> feedback.
>
> The RC is available at:
> http://people.apache.org/~acmurthy/hadoop-2.6.0-rc1
> The RC tag in git is: release-2.6.0-rc1
>
> The maven artifacts are available via repository.apache.org at
> https://repository.apache.org/content/repositories/orgapachehadoop-1013.
>
> Please try the release and vote; the vote will run for the usual 5 days.
>
> thanks,
> Arun
>
>
> --
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity to
> which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
>
>
>
>


RE: [VOTE] Release Apache Hadoop 2.6.0

2014-11-13 Thread Liu, Yi A
Thanks Chris for pushing it :)

Regards,
Yi Liu


-Original Message-
From: Chris Nauroth [mailto:cnaur...@hortonworks.com] 
Sent: Friday, November 14, 2014 4:52 AM
To: common-dev@hadoop.apache.org
Cc: yarn-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org; Ravi Prakash; 
hdfs-...@hadoop.apache.org
Subject: Re: [VOTE] Release Apache Hadoop 2.6.0

I have committed HDFS-7385 down through branch-2.6.0.  Thank you!

Chris Nauroth
Hortonworks
http://hortonworks.com/


On Thu, Nov 13, 2014 at 9:14 AM, Chris Nauroth 
wrote:

> I'm helping to expedite a complete, approved patch for HDFS-7385 now.
> Then, we can make a final decision on its inclusion in 2.6.0.  Thank 
> you for bringing it up, Yi.
>
> Chris Nauroth
> Hortonworks
> http://hortonworks.com/
>
>
> On Wed, Nov 12, 2014 at 7:31 PM, Liu, Yi A  wrote:
>
>> Arun, could you wait for HDFS-7385? It will cause issue of HDFS ACL 
>> and XAttrs in some case, the fix is very easy but I think the issue is 
>> critical.
>> I'm helping review it, and expect to commit today. Thanks.
>>
>> Regards,
>> Yi Liu
>>
>> -Original Message-
>> From: Arun C Murthy [mailto:a...@hortonworks.com]
>> Sent: Thursday, November 13, 2014 12:58 AM
>> To: yarn-...@hadoop.apache.org
>> Cc: mapreduce-...@hadoop.apache.org; Ravi Prakash; 
>> hdfs-...@hadoop.apache.org; common-dev@hadoop.apache.org
>> Subject: Re: [VOTE] Release Apache Hadoop 2.6.0
>>
>> Sounds good. I'll create an rc1. Thanks.
>>
>> Arun
>>
>> On Nov 11, 2014, at 2:06 PM, Robert Kanter  wrote:
>>
>> > Hi Arun,
>> >
>> > We were testing the RC and ran into a problem with the recent fixes 
>> > that were done for POODLE for Tomcat (HADOOP-11217 for KMS and
>> > HDFS-7274 for HttpFS).  Basically, in disabling SSLv3, we also 
>> > disabled SSLv2Hello, which is required for older clients (e.g. Java 
>> > 6 with openssl 0.9.8x) so they can't connect without it.  Just to 
>> > be clear, it does not mean SSLv2, which is insecure.  This also 
>> > affects
>> the MR shuffle in HADOOP-11243.
>> >
>> > The fix is super simple, so I think we should reopen these 3 JIRAs 
>> > and put in addendum patches and get them into 2.6.0.
>> >
>> > thanks
>> > - Robert
>> >
>> > On Tue, Nov 11, 2014 at 1:04 PM, Ravi Prakash 
>> wrote:
>> >
>> >> Hi Arun!
>> >> We are very close to completion on YARN-1964 (DockerContainerExecutor).
>> >> I'd also like HDFS-4882 to be checked in. Do you think these 
>> >> issues merit another RC?
>> >> ThanksRavi
>> >>
>> >>
>> >> On Tuesday, November 11, 2014 11:57 AM, Steve Loughran < 
>> >> ste...@hortonworks.com> wrote:
>> >>
>> >>
>> >> +1 binding
>> >>
>> >> -patched slider pom to build against 2.6.0
>> >>
>> >> -verified build did download, which it did at up to ~8Mbps. Faster 
>> >> than a local build.
>> >>
>> >> -full clean test runs on OS/X & Linux
>> >>
>> >>
>> >> Windows 2012:
>> >>
>> >> Same thing. I did have to first build my own set of the windows 
>> >> native binaries, by checking out branch-2.6.0; doing a native 
>> >> build, copying the binaries and then purging the local m2 
>> >> repository of hadoop artifacts to be confident I was building 
>> >> against. For anyone who wants those native libs they will be up on 
>> >> https://github.com/apache/incubator-slider/tree/develop/bin/window
>> >> s/
>> >> once it syncs with the ASF repos.
>> >>
>> >> afterwords: the tests worked!
>> >>
>> >>
>> >> On 11 November 2014 02:52, Arun C Murthy  wrote:
>> >>
>> >>> Folks,
>> >>>
>> >>> I've created a release candidate (rc0) for hadoop-2.6.0 that I 
>> >>> would like to see released.
>> >>>
>> >>> The RC is available at:
>> >>> http://people.apache.org/~acmurthy/hadoop-2.6.0-rc0
>> >>> The RC tag in git is: release-2.6.0-rc0
>> >>>
>> >>> The maven artifacts are available via repository.apache.org at
>> >>>
>> https://repository.apache.org/content/repositories/orgapachehadoop-1012.
>> >>>
>> >>> Please try the release and vote; the vote will run for the usual 
>> >>

Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-13 Thread Ravi Prakash
Thanks for the respin Arun!
I've verified all checksums, and tested that the DockerContainerExecutor was 
able to launch jobs.

I'm a +1 on the release
 

 On Thursday, November 13, 2014 3:09 PM, Arun C Murthy 
 wrote:
   

 Folks,

I've created another release candidate (rc1) for hadoop-2.6.0 based on the 
feedback.

The RC is available at: http://people.apache.org/~acmurthy/hadoop-2.6.0-rc1
The RC tag in git is: release-2.6.0-rc1

The maven artifacts are available via repository.apache.org at 
https://repository.apache.org/content/repositories/orgapachehadoop-1013.

Please try the release and vote; the vote will run for the usual 5 days.

thanks,
Arun


-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.




[VOTE] Release Apache Hadoop 2.6.0

2014-11-13 Thread Arun C Murthy
Folks,

I've created another release candidate (rc1) for hadoop-2.6.0 based on the 
feedback.

The RC is available at: http://people.apache.org/~acmurthy/hadoop-2.6.0-rc1
The RC tag in git is: release-2.6.0-rc1

The maven artifacts are available via repository.apache.org at 
https://repository.apache.org/content/repositories/orgapachehadoop-1013.

Please try the release and vote; the vote will run for the usual 5 days.

thanks,
Arun


-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.


Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-13 Thread Chris Nauroth
I have committed HDFS-7385 down through branch-2.6.0.  Thank you!

Chris Nauroth
Hortonworks
http://hortonworks.com/


On Thu, Nov 13, 2014 at 9:14 AM, Chris Nauroth 
wrote:

> I'm helping to expedite a complete, approved patch for HDFS-7385 now.
> Then, we can make a final decision on its inclusion in 2.6.0.  Thank you
> for bringing it up, Yi.
>
> Chris Nauroth
> Hortonworks
> http://hortonworks.com/
>
>
> On Wed, Nov 12, 2014 at 7:31 PM, Liu, Yi A  wrote:
>
>> Arun, could you wait for HDFS-7385? It will cause issue of HDFS ACL and
>> XAttrs in some case, the fix is very easy but I think the issue is critical.
>> I'm helping review it, and expect to commit today. Thanks.
>>
>> Regards,
>> Yi Liu
>>
>> -Original Message-
>> From: Arun C Murthy [mailto:a...@hortonworks.com]
>> Sent: Thursday, November 13, 2014 12:58 AM
>> To: yarn-...@hadoop.apache.org
>> Cc: mapreduce-...@hadoop.apache.org; Ravi Prakash;
>> hdfs-...@hadoop.apache.org; common-dev@hadoop.apache.org
>> Subject: Re: [VOTE] Release Apache Hadoop 2.6.0
>>
>> Sounds good. I'll create an rc1. Thanks.
>>
>> Arun
>>
>> On Nov 11, 2014, at 2:06 PM, Robert Kanter  wrote:
>>
>> > Hi Arun,
>> >
>> > We were testing the RC and ran into a problem with the recent fixes
>> > that were done for POODLE for Tomcat (HADOOP-11217 for KMS and
>> > HDFS-7274 for HttpFS).  Basically, in disabling SSLv3, we also
>> > disabled SSLv2Hello, which is required for older clients (e.g. Java 6
>> > with openssl 0.9.8x) so they can't connect without it.  Just to be
>> > clear, it does not mean SSLv2, which is insecure.  This also affects
>> the MR shuffle in HADOOP-11243.
>> >
>> > The fix is super simple, so I think we should reopen these 3 JIRAs and
>> > put in addendum patches and get them into 2.6.0.
>> >
>> > thanks
>> > - Robert
>> >
>> > On Tue, Nov 11, 2014 at 1:04 PM, Ravi Prakash 
>> wrote:
>> >
>> >> Hi Arun!
>> >> We are very close to completion on YARN-1964 (DockerContainerExecutor).
>> >> I'd also like HDFS-4882 to be checked in. Do you think these issues
>> >> merit another RC?
>> >> ThanksRavi
>> >>
>> >>
>> >> On Tuesday, November 11, 2014 11:57 AM, Steve Loughran <
>> >> ste...@hortonworks.com> wrote:
>> >>
>> >>
>> >> +1 binding
>> >>
>> >> -patched slider pom to build against 2.6.0
>> >>
>> >> -verified build did download, which it did at up to ~8Mbps. Faster
>> >> than a local build.
>> >>
>> >> -full clean test runs on OS/X & Linux
>> >>
>> >>
>> >> Windows 2012:
>> >>
>> >> Same thing. I did have to first build my own set of the windows
>> >> native binaries, by checking out branch-2.6.0; doing a native build,
>> >> copying the binaries and then purging the local m2 repository of
>> >> hadoop artifacts to be confident I was building against. For anyone
>> >> who wants those native libs they will be up on
>> >> https://github.com/apache/incubator-slider/tree/develop/bin/windows/
>> >> once it syncs with the ASF repos.
>> >>
>> >> afterwords: the tests worked!
>> >>
>> >>
>> >> On 11 November 2014 02:52, Arun C Murthy  wrote:
>> >>
>> >>> Folks,
>> >>>
>> >>> I've created a release candidate (rc0) for hadoop-2.6.0 that I would
>> >>> like to see released.
>> >>>
>> >>> The RC is available at:
>> >>> http://people.apache.org/~acmurthy/hadoop-2.6.0-rc0
>> >>> The RC tag in git is: release-2.6.0-rc0
>> >>>
>> >>> The maven artifacts are available via repository.apache.org at
>> >>>
>> https://repository.apache.org/content/repositories/orgapachehadoop-1012.
>> >>>
>> >>> Please try the release and vote; the vote will run for the usual 5
>> days.
>> >>>
>> >>> thanks,
>> >>> Arun
>> >>>
>> >>>
>> >>> --
>> >>> CONFIDENTIALITY NOTICE
>> >>> NOTICE: This message is intended for the use of the individual or
>> >>> entity
>> >> to
>> >>> which it is addressed and may contain information that is
>> &

Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-13 Thread Chris Nauroth
I'm helping to expedite a complete, approved patch for HDFS-7385 now.
Then, we can make a final decision on its inclusion in 2.6.0.  Thank you
for bringing it up, Yi.

Chris Nauroth
Hortonworks
http://hortonworks.com/


On Wed, Nov 12, 2014 at 7:31 PM, Liu, Yi A  wrote:

> Arun, could you wait for HDFS-7385? It will cause issue of HDFS ACL and
> XAttrs in some case, the fix is very easy but I think the issue is critical.
> I'm helping review it, and expect to commit today. Thanks.
>
> Regards,
> Yi Liu
>
> -Original Message-
> From: Arun C Murthy [mailto:a...@hortonworks.com]
> Sent: Thursday, November 13, 2014 12:58 AM
> To: yarn-...@hadoop.apache.org
> Cc: mapreduce-...@hadoop.apache.org; Ravi Prakash;
> hdfs-...@hadoop.apache.org; common-dev@hadoop.apache.org
> Subject: Re: [VOTE] Release Apache Hadoop 2.6.0
>
> Sounds good. I'll create an rc1. Thanks.
>
> Arun
>
> On Nov 11, 2014, at 2:06 PM, Robert Kanter  wrote:
>
> > Hi Arun,
> >
> > We were testing the RC and ran into a problem with the recent fixes
> > that were done for POODLE for Tomcat (HADOOP-11217 for KMS and
> > HDFS-7274 for HttpFS).  Basically, in disabling SSLv3, we also
> > disabled SSLv2Hello, which is required for older clients (e.g. Java 6
> > with openssl 0.9.8x) so they can't connect without it.  Just to be
> > clear, it does not mean SSLv2, which is insecure.  This also affects the
> MR shuffle in HADOOP-11243.
> >
> > The fix is super simple, so I think we should reopen these 3 JIRAs and
> > put in addendum patches and get them into 2.6.0.
> >
> > thanks
> > - Robert
> >
> > On Tue, Nov 11, 2014 at 1:04 PM, Ravi Prakash  wrote:
> >
> >> Hi Arun!
> >> We are very close to completion on YARN-1964 (DockerContainerExecutor).
> >> I'd also like HDFS-4882 to be checked in. Do you think these issues
> >> merit another RC?
> >> ThanksRavi
> >>
> >>
> >> On Tuesday, November 11, 2014 11:57 AM, Steve Loughran <
> >> ste...@hortonworks.com> wrote:
> >>
> >>
> >> +1 binding
> >>
> >> -patched slider pom to build against 2.6.0
> >>
> >> -verified build did download, which it did at up to ~8Mbps. Faster
> >> than a local build.
> >>
> >> -full clean test runs on OS/X & Linux
> >>
> >>
> >> Windows 2012:
> >>
> >> Same thing. I did have to first build my own set of the windows
> >> native binaries, by checking out branch-2.6.0; doing a native build,
> >> copying the binaries and then purging the local m2 repository of
> >> hadoop artifacts to be confident I was building against. For anyone
> >> who wants those native libs they will be up on
> >> https://github.com/apache/incubator-slider/tree/develop/bin/windows/
> >> once it syncs with the ASF repos.
> >>
> >> afterwords: the tests worked!
> >>
> >>
> >> On 11 November 2014 02:52, Arun C Murthy  wrote:
> >>
> >>> Folks,
> >>>
> >>> I've created a release candidate (rc0) for hadoop-2.6.0 that I would
> >>> like to see released.
> >>>
> >>> The RC is available at:
> >>> http://people.apache.org/~acmurthy/hadoop-2.6.0-rc0
> >>> The RC tag in git is: release-2.6.0-rc0
> >>>
> >>> The maven artifacts are available via repository.apache.org at
> >>>
> https://repository.apache.org/content/repositories/orgapachehadoop-1012.
> >>>
> >>> Please try the release and vote; the vote will run for the usual 5
> days.
> >>>
> >>> thanks,
> >>> Arun
> >>>
> >>>
> >>> --
> >>> CONFIDENTIALITY NOTICE
> >>> NOTICE: This message is intended for the use of the individual or
> >>> entity
> >> to
> >>> which it is addressed and may contain information that is
> >>> confidential, privileged and exempt from disclosure under applicable
> >>> law. If the reader of this message is not the intended recipient,
> >>> you are hereby notified
> >> that
> >>> any printing, copying, dissemination, distribution, disclosure or
> >>> forwarding of this communication is strictly prohibited. If you have
> >>> received this communication in error, please contact the sender
> >> immediately
> >>> and delete it from your system. Thank You.
> >>>
> >>
> >> --
> >> CONFIDENTIALIT

Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-13 Thread Jason Lowe
I just committed 2.6 blockes YARN-2846 and MAPREDUCE-6156 which should also be 
in the 2.6.0 rc1 build.
Jason
  From: Arun C Murthy 
 To: yarn-...@hadoop.apache.org 
Cc: mapreduce-...@hadoop.apache.org; Ravi Prakash ; 
"hdfs-...@hadoop.apache.org" ; 
"common-dev@hadoop.apache.org"  
 Sent: Wednesday, November 12, 2014 10:58 AM
 Subject: Re: [VOTE] Release Apache Hadoop 2.6.0
   
Sounds good. I'll create an rc1. Thanks.

Arun

On Nov 11, 2014, at 2:06 PM, Robert Kanter  wrote:

> Hi Arun,
> 
> We were testing the RC and ran into a problem with the recent fixes that
> were done for POODLE for Tomcat (HADOOP-11217 for KMS and HDFS-7274 for
> HttpFS).  Basically, in disabling SSLv3, we also disabled SSLv2Hello, which
> is required for older clients (e.g. Java 6 with openssl 0.9.8x) so they
> can't connect without it.  Just to be clear, it does not mean SSLv2, which
> is insecure.  This also affects the MR shuffle in HADOOP-11243.
> 
> The fix is super simple, so I think we should reopen these 3 JIRAs and put
> in addendum patches and get them into 2.6.0.
> 
> thanks
> - Robert
> 
> On Tue, Nov 11, 2014 at 1:04 PM, Ravi Prakash  wrote:
> 
>> Hi Arun!
>> We are very close to completion on YARN-1964 (DockerContainerExecutor).
>> I'd also like HDFS-4882 to be checked in. Do you think these issues merit
>> another RC?
>> ThanksRavi
>> 
>> 
>>    On Tuesday, November 11, 2014 11:57 AM, Steve Loughran <
>> ste...@hortonworks.com> wrote:
>> 
>> 
>> +1 binding
>> 
>> -patched slider pom to build against 2.6.0
>> 
>> -verified build did download, which it did at up to ~8Mbps. Faster than a
>> local build.
>> 
>> -full clean test runs on OS/X & Linux
>> 
>> 
>> Windows 2012:
>> 
>> Same thing. I did have to first build my own set of the windows native
>> binaries, by checking out branch-2.6.0; doing a native build, copying the
>> binaries and then purging the local m2 repository of hadoop artifacts to be
>> confident I was building against. For anyone who wants those native libs
>> they will be up on
>> https://github.com/apache/incubator-slider/tree/develop/bin/windows/ once
>> it syncs with the ASF repos.
>> 
>> afterwords: the tests worked!
>> 
>> 
>> On 11 November 2014 02:52, Arun C Murthy  wrote:
>> 
>>> Folks,
>>> 
>>> I've created a release candidate (rc0) for hadoop-2.6.0 that I would like
>>> to see released.
>>> 
>>> The RC is available at:
>>> http://people.apache.org/~acmurthy/hadoop-2.6.0-rc0
>>> The RC tag in git is: release-2.6.0-rc0
>>> 
>>> The maven artifacts are available via repository.apache.org at
>>> https://repository.apache.org/content/repositories/orgapachehadoop-1012.
>>> 
>>> Please try the release and vote; the vote will run for the usual 5 days.
>>> 
>>> thanks,
>>> Arun
>>> 
>>> 
>>> --
>>> CONFIDENTIALITY NOTICE
>>> NOTICE: This message is intended for the use of the individual or entity
>> to
>>> which it is addressed and may contain information that is confidential,
>>> privileged and exempt from disclosure under applicable law. If the reader
>>> of this message is not the intended recipient, you are hereby notified
>> that
>>> any printing, copying, dissemination, distribution, disclosure or
>>> forwarding of this communication is strictly prohibited. If you have
>>> received this communication in error, please contact the sender
>> immediately
>>> and delete it from your system. Thank You.
>>> 
>> 
>> --
>> CONFIDENTIALITY NOTICE
>> NOTICE: This message is intended for the use of the individual or entity to
>> which it is addressed and may contain information that is confidential,
>> privileged and exempt from disclosure under applicable law. If the reader
>> of this message is not the intended recipient, you are hereby notified that
>> any printing, copying, dissemination, distribution, disclosure or
>> forwarding of this communication is strictly prohibited. If you have
>> received this communication in error, please contact the sender immediately
>> and delete it from your system. Thank You.
>> 
>> 
>> 
>> 

--
Arun C. Murthy
Hortonworks Inc.
http://hortonworks.com/hdp/





-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.


  

RE: [VOTE] Release Apache Hadoop 2.6.0

2014-11-12 Thread Liu, Yi A
Arun, could you wait for HDFS-7385? It will cause issue of HDFS ACL and XAttrs 
in some case, the fix is very easy but I think the issue is critical. 
I'm helping review it, and expect to commit today. Thanks.

Regards,
Yi Liu

-Original Message-
From: Arun C Murthy [mailto:a...@hortonworks.com] 
Sent: Thursday, November 13, 2014 12:58 AM
To: yarn-...@hadoop.apache.org
Cc: mapreduce-...@hadoop.apache.org; Ravi Prakash; hdfs-...@hadoop.apache.org; 
common-dev@hadoop.apache.org
Subject: Re: [VOTE] Release Apache Hadoop 2.6.0

Sounds good. I'll create an rc1. Thanks.

Arun

On Nov 11, 2014, at 2:06 PM, Robert Kanter  wrote:

> Hi Arun,
> 
> We were testing the RC and ran into a problem with the recent fixes 
> that were done for POODLE for Tomcat (HADOOP-11217 for KMS and 
> HDFS-7274 for HttpFS).  Basically, in disabling SSLv3, we also 
> disabled SSLv2Hello, which is required for older clients (e.g. Java 6 
> with openssl 0.9.8x) so they can't connect without it.  Just to be 
> clear, it does not mean SSLv2, which is insecure.  This also affects the MR 
> shuffle in HADOOP-11243.
> 
> The fix is super simple, so I think we should reopen these 3 JIRAs and 
> put in addendum patches and get them into 2.6.0.
> 
> thanks
> - Robert
> 
> On Tue, Nov 11, 2014 at 1:04 PM, Ravi Prakash  wrote:
> 
>> Hi Arun!
>> We are very close to completion on YARN-1964 (DockerContainerExecutor).
>> I'd also like HDFS-4882 to be checked in. Do you think these issues 
>> merit another RC?
>> ThanksRavi
>> 
>> 
>> On Tuesday, November 11, 2014 11:57 AM, Steve Loughran < 
>> ste...@hortonworks.com> wrote:
>> 
>> 
>> +1 binding
>> 
>> -patched slider pom to build against 2.6.0
>> 
>> -verified build did download, which it did at up to ~8Mbps. Faster 
>> than a local build.
>> 
>> -full clean test runs on OS/X & Linux
>> 
>> 
>> Windows 2012:
>> 
>> Same thing. I did have to first build my own set of the windows 
>> native binaries, by checking out branch-2.6.0; doing a native build, 
>> copying the binaries and then purging the local m2 repository of 
>> hadoop artifacts to be confident I was building against. For anyone 
>> who wants those native libs they will be up on 
>> https://github.com/apache/incubator-slider/tree/develop/bin/windows/ 
>> once it syncs with the ASF repos.
>> 
>> afterwords: the tests worked!
>> 
>> 
>> On 11 November 2014 02:52, Arun C Murthy  wrote:
>> 
>>> Folks,
>>> 
>>> I've created a release candidate (rc0) for hadoop-2.6.0 that I would 
>>> like to see released.
>>> 
>>> The RC is available at:
>>> http://people.apache.org/~acmurthy/hadoop-2.6.0-rc0
>>> The RC tag in git is: release-2.6.0-rc0
>>> 
>>> The maven artifacts are available via repository.apache.org at 
>>> https://repository.apache.org/content/repositories/orgapachehadoop-1012.
>>> 
>>> Please try the release and vote; the vote will run for the usual 5 days.
>>> 
>>> thanks,
>>> Arun
>>> 
>>> 
>>> --
>>> CONFIDENTIALITY NOTICE
>>> NOTICE: This message is intended for the use of the individual or 
>>> entity
>> to
>>> which it is addressed and may contain information that is 
>>> confidential, privileged and exempt from disclosure under applicable 
>>> law. If the reader of this message is not the intended recipient, 
>>> you are hereby notified
>> that
>>> any printing, copying, dissemination, distribution, disclosure or 
>>> forwarding of this communication is strictly prohibited. If you have 
>>> received this communication in error, please contact the sender
>> immediately
>>> and delete it from your system. Thank You.
>>> 
>> 
>> --
>> CONFIDENTIALITY NOTICE
>> NOTICE: This message is intended for the use of the individual or 
>> entity to which it is addressed and may contain information that is 
>> confidential, privileged and exempt from disclosure under applicable 
>> law. If the reader of this message is not the intended recipient, you 
>> are hereby notified that any printing, copying, dissemination, 
>> distribution, disclosure or forwarding of this communication is 
>> strictly prohibited. If you have received this communication in 
>> error, please contact the sender immediately and delete it from your system. 
>> Thank You.
>> 
>> 
>> 
>> 

--
Arun C. Murthy
Hortonworks Inc.
http://hortonworks.com/hdp/



--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader of 
this message is not the intended recipient, you are hereby notified that any 
printing, copying, dissemination, distribution, disclosure or forwarding of 
this communication is strictly prohibited. If you have received this 
communication in error, please contact the sender immediately and delete it 
from your system. Thank You.


Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-12 Thread Arun C Murthy
Sounds good. I'll create an rc1. Thanks.

Arun

On Nov 11, 2014, at 2:06 PM, Robert Kanter  wrote:

> Hi Arun,
> 
> We were testing the RC and ran into a problem with the recent fixes that
> were done for POODLE for Tomcat (HADOOP-11217 for KMS and HDFS-7274 for
> HttpFS).  Basically, in disabling SSLv3, we also disabled SSLv2Hello, which
> is required for older clients (e.g. Java 6 with openssl 0.9.8x) so they
> can't connect without it.  Just to be clear, it does not mean SSLv2, which
> is insecure.  This also affects the MR shuffle in HADOOP-11243.
> 
> The fix is super simple, so I think we should reopen these 3 JIRAs and put
> in addendum patches and get them into 2.6.0.
> 
> thanks
> - Robert
> 
> On Tue, Nov 11, 2014 at 1:04 PM, Ravi Prakash  wrote:
> 
>> Hi Arun!
>> We are very close to completion on YARN-1964 (DockerContainerExecutor).
>> I'd also like HDFS-4882 to be checked in. Do you think these issues merit
>> another RC?
>> ThanksRavi
>> 
>> 
>> On Tuesday, November 11, 2014 11:57 AM, Steve Loughran <
>> ste...@hortonworks.com> wrote:
>> 
>> 
>> +1 binding
>> 
>> -patched slider pom to build against 2.6.0
>> 
>> -verified build did download, which it did at up to ~8Mbps. Faster than a
>> local build.
>> 
>> -full clean test runs on OS/X & Linux
>> 
>> 
>> Windows 2012:
>> 
>> Same thing. I did have to first build my own set of the windows native
>> binaries, by checking out branch-2.6.0; doing a native build, copying the
>> binaries and then purging the local m2 repository of hadoop artifacts to be
>> confident I was building against. For anyone who wants those native libs
>> they will be up on
>> https://github.com/apache/incubator-slider/tree/develop/bin/windows/ once
>> it syncs with the ASF repos.
>> 
>> afterwords: the tests worked!
>> 
>> 
>> On 11 November 2014 02:52, Arun C Murthy  wrote:
>> 
>>> Folks,
>>> 
>>> I've created a release candidate (rc0) for hadoop-2.6.0 that I would like
>>> to see released.
>>> 
>>> The RC is available at:
>>> http://people.apache.org/~acmurthy/hadoop-2.6.0-rc0
>>> The RC tag in git is: release-2.6.0-rc0
>>> 
>>> The maven artifacts are available via repository.apache.org at
>>> https://repository.apache.org/content/repositories/orgapachehadoop-1012.
>>> 
>>> Please try the release and vote; the vote will run for the usual 5 days.
>>> 
>>> thanks,
>>> Arun
>>> 
>>> 
>>> --
>>> CONFIDENTIALITY NOTICE
>>> NOTICE: This message is intended for the use of the individual or entity
>> to
>>> which it is addressed and may contain information that is confidential,
>>> privileged and exempt from disclosure under applicable law. If the reader
>>> of this message is not the intended recipient, you are hereby notified
>> that
>>> any printing, copying, dissemination, distribution, disclosure or
>>> forwarding of this communication is strictly prohibited. If you have
>>> received this communication in error, please contact the sender
>> immediately
>>> and delete it from your system. Thank You.
>>> 
>> 
>> --
>> CONFIDENTIALITY NOTICE
>> NOTICE: This message is intended for the use of the individual or entity to
>> which it is addressed and may contain information that is confidential,
>> privileged and exempt from disclosure under applicable law. If the reader
>> of this message is not the intended recipient, you are hereby notified that
>> any printing, copying, dissemination, distribution, disclosure or
>> forwarding of this communication is strictly prohibited. If you have
>> received this communication in error, please contact the sender immediately
>> and delete it from your system. Thank You.
>> 
>> 
>> 
>> 

--
Arun C. Murthy
Hortonworks Inc.
http://hortonworks.com/hdp/



-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.


Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-11 Thread Zhijie Shen
+1 (non-binding)

* Downloaded the source tar ball, and built binaries from it successfully.
* Ran DS apps and MR jobs with emitting timeline data enabled successfully.
* Verified the generic history information, DS-specific and MR-specific
metrics were available.
* Ran the timeline server in secure mode, delegation token and domain-based
ACLs worked properly.


On Tue, Nov 11, 2014 at 4:30 PM, Wei Yan  wrote:

>
> > On Nov 11, 2014, at 2:06 PM, Robert Kanter  wrote:
> >
> > Hi Arun,
> >
> > We were testing the RC and ran into a problem with the recent fixes that
> > were done for POODLE for Tomcat (HADOOP-11217 for KMS and HDFS-7274 for
> > HttpFS).  Basically, in disabling SSLv3, we also disabled SSLv2Hello,
> which
> > is required for older clients (e.g. Java 6 with openssl 0.9.8x) so they
> > can't connect without it.  Just to be clear, it does not mean SSLv2,
> which
> > is insecure.  This also affects the MR shuffle in HADOOP-11243.
>
> For HADOOP-11243, as the shuffle happens only between NMs, it’s ok to keep
> it only support TLS.
>
> >
> > The fix is super simple, so I think we should reopen these 3 JIRAs and
> put
> > in addendum patches and get them into 2.6.0.
> >
> > thanks
> > - Robert
> >
> > On Tue, Nov 11, 2014 at 1:04 PM, Ravi Prakash  wrote:
> >
> >> Hi Arun!
> >> We are very close to completion on YARN-1964 (DockerContainerExecutor).
> >> I'd also like HDFS-4882 to be checked in. Do you think these issues
> merit
> >> another RC?
> >> ThanksRavi
> >>
> >>
> >> On Tuesday, November 11, 2014 11:57 AM, Steve Loughran <
> >> ste...@hortonworks.com> wrote:
> >>
> >>
> >> +1 binding
> >>
> >> -patched slider pom to build against 2.6.0
> >>
> >> -verified build did download, which it did at up to ~8Mbps. Faster than
> a
> >> local build.
> >>
> >> -full clean test runs on OS/X & Linux
> >>
> >>
> >> Windows 2012:
> >>
> >> Same thing. I did have to first build my own set of the windows native
> >> binaries, by checking out branch-2.6.0; doing a native build, copying
> the
> >> binaries and then purging the local m2 repository of hadoop artifacts
> to be
> >> confident I was building against. For anyone who wants those native libs
> >> they will be up on
> >> https://github.com/apache/incubator-slider/tree/develop/bin/windows/
> once
> >> it syncs with the ASF repos.
> >>
> >> afterwords: the tests worked!
> >>
> >>
> >> On 11 November 2014 02:52, Arun C Murthy  wrote:
> >>
> >>> Folks,
> >>>
> >>> I've created a release candidate (rc0) for hadoop-2.6.0 that I would
> like
> >>> to see released.
> >>>
> >>> The RC is available at:
> >>> http://people.apache.org/~acmurthy/hadoop-2.6.0-rc0
> >>> The RC tag in git is: release-2.6.0-rc0
> >>>
> >>> The maven artifacts are available via repository.apache.org at
> >>>
> https://repository.apache.org/content/repositories/orgapachehadoop-1012.
> >>>
> >>> Please try the release and vote; the vote will run for the usual 5
> days.
> >>>
> >>> thanks,
> >>> Arun
> >>>
> >>>
> >>> --
> >>> CONFIDENTIALITY NOTICE
> >>> NOTICE: This message is intended for the use of the individual or
> entity
> >> to
> >>> which it is addressed and may contain information that is confidential,
> >>> privileged and exempt from disclosure under applicable law. If the
> reader
> >>> of this message is not the intended recipient, you are hereby notified
> >> that
> >>> any printing, copying, dissemination, distribution, disclosure or
> >>> forwarding of this communication is strictly prohibited. If you have
> >>> received this communication in error, please contact the sender
> >> immediately
> >>> and delete it from your system. Thank You.
> >>>
> >>
> >> --
> >> CONFIDENTIALITY NOTICE
> >> NOTICE: This message is intended for the use of the individual or
> entity to
> >> which it is addressed and may contain information that is confidential,
> >> privileged and exempt from disclosure under applicable law. If the
> reader
> >> of this message is not the intended recipient, you are hereby notified
> that
> >> any printing, copying, dissemination, distribution, disclosure or
> >> forwarding of this communication is strictly prohibited. If you have
> >> received this communication in error, please contact the sender
> immediately
> >> and delete it from your system. Thank You.
> >>
> >>
> >>
> >>
>
>


-- 
Zhijie Shen
Hortonworks Inc.
http://hortonworks.com/

-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.


Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-11 Thread Wangda Tan
Thanks Arun for creating the RC.

Tried to build and deploy it on a local distributed cluster, can
successfully run distributed shell job with node labels.
+1 (non-binding),

Thanks,
Wangda


On Tue, Nov 11, 2014 at 2:06 PM, Robert Kanter  wrote:

> Hi Arun,
>
> We were testing the RC and ran into a problem with the recent fixes that
> were done for POODLE for Tomcat (HADOOP-11217 for KMS and HDFS-7274 for
> HttpFS).  Basically, in disabling SSLv3, we also disabled SSLv2Hello, which
> is required for older clients (e.g. Java 6 with openssl 0.9.8x) so they
> can't connect without it.  Just to be clear, it does not mean SSLv2, which
> is insecure.  This also affects the MR shuffle in HADOOP-11243.
>
> The fix is super simple, so I think we should reopen these 3 JIRAs and put
> in addendum patches and get them into 2.6.0.
>
> thanks
> - Robert
>
> On Tue, Nov 11, 2014 at 1:04 PM, Ravi Prakash  wrote:
>
> > Hi Arun!
> > We are very close to completion on YARN-1964 (DockerContainerExecutor).
> > I'd also like HDFS-4882 to be checked in. Do you think these issues merit
> > another RC?
> > ThanksRavi
> >
> >
> >  On Tuesday, November 11, 2014 11:57 AM, Steve Loughran <
> > ste...@hortonworks.com> wrote:
> >
> >
> >  +1 binding
> >
> > -patched slider pom to build against 2.6.0
> >
> > -verified build did download, which it did at up to ~8Mbps. Faster than a
> > local build.
> >
> > -full clean test runs on OS/X & Linux
> >
> >
> > Windows 2012:
> >
> > Same thing. I did have to first build my own set of the windows native
> > binaries, by checking out branch-2.6.0; doing a native build, copying the
> > binaries and then purging the local m2 repository of hadoop artifacts to
> be
> > confident I was building against. For anyone who wants those native libs
> > they will be up on
> > https://github.com/apache/incubator-slider/tree/develop/bin/windows/
> once
> > it syncs with the ASF repos.
> >
> > afterwords: the tests worked!
> >
> >
> > On 11 November 2014 02:52, Arun C Murthy  wrote:
> >
> > > Folks,
> > >
> > > I've created a release candidate (rc0) for hadoop-2.6.0 that I would
> like
> > > to see released.
> > >
> > > The RC is available at:
> > > http://people.apache.org/~acmurthy/hadoop-2.6.0-rc0
> > > The RC tag in git is: release-2.6.0-rc0
> > >
> > > The maven artifacts are available via repository.apache.org at
> > >
> https://repository.apache.org/content/repositories/orgapachehadoop-1012.
> > >
> > > Please try the release and vote; the vote will run for the usual 5
> days.
> > >
> > > thanks,
> > > Arun
> > >
> > >
> > > --
> > > CONFIDENTIALITY NOTICE
> > > NOTICE: This message is intended for the use of the individual or
> entity
> > to
> > > which it is addressed and may contain information that is confidential,
> > > privileged and exempt from disclosure under applicable law. If the
> reader
> > > of this message is not the intended recipient, you are hereby notified
> > that
> > > any printing, copying, dissemination, distribution, disclosure or
> > > forwarding of this communication is strictly prohibited. If you have
> > > received this communication in error, please contact the sender
> > immediately
> > > and delete it from your system. Thank You.
> > >
> >
> > --
> > CONFIDENTIALITY NOTICE
> > NOTICE: This message is intended for the use of the individual or entity
> to
> > which it is addressed and may contain information that is confidential,
> > privileged and exempt from disclosure under applicable law. If the reader
> > of this message is not the intended recipient, you are hereby notified
> that
> > any printing, copying, dissemination, distribution, disclosure or
> > forwarding of this communication is strictly prohibited. If you have
> > received this communication in error, please contact the sender
> immediately
> > and delete it from your system. Thank You.
> >
> >
> >
> >
>


Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-11 Thread Robert Kanter
Hi Arun,

We were testing the RC and ran into a problem with the recent fixes that
were done for POODLE for Tomcat (HADOOP-11217 for KMS and HDFS-7274 for
HttpFS).  Basically, in disabling SSLv3, we also disabled SSLv2Hello, which
is required for older clients (e.g. Java 6 with openssl 0.9.8x) so they
can't connect without it.  Just to be clear, it does not mean SSLv2, which
is insecure.  This also affects the MR shuffle in HADOOP-11243.

The fix is super simple, so I think we should reopen these 3 JIRAs and put
in addendum patches and get them into 2.6.0.

thanks
- Robert

On Tue, Nov 11, 2014 at 1:04 PM, Ravi Prakash  wrote:

> Hi Arun!
> We are very close to completion on YARN-1964 (DockerContainerExecutor).
> I'd also like HDFS-4882 to be checked in. Do you think these issues merit
> another RC?
> ThanksRavi
>
>
>  On Tuesday, November 11, 2014 11:57 AM, Steve Loughran <
> ste...@hortonworks.com> wrote:
>
>
>  +1 binding
>
> -patched slider pom to build against 2.6.0
>
> -verified build did download, which it did at up to ~8Mbps. Faster than a
> local build.
>
> -full clean test runs on OS/X & Linux
>
>
> Windows 2012:
>
> Same thing. I did have to first build my own set of the windows native
> binaries, by checking out branch-2.6.0; doing a native build, copying the
> binaries and then purging the local m2 repository of hadoop artifacts to be
> confident I was building against. For anyone who wants those native libs
> they will be up on
> https://github.com/apache/incubator-slider/tree/develop/bin/windows/ once
> it syncs with the ASF repos.
>
> afterwords: the tests worked!
>
>
> On 11 November 2014 02:52, Arun C Murthy  wrote:
>
> > Folks,
> >
> > I've created a release candidate (rc0) for hadoop-2.6.0 that I would like
> > to see released.
> >
> > The RC is available at:
> > http://people.apache.org/~acmurthy/hadoop-2.6.0-rc0
> > The RC tag in git is: release-2.6.0-rc0
> >
> > The maven artifacts are available via repository.apache.org at
> > https://repository.apache.org/content/repositories/orgapachehadoop-1012.
> >
> > Please try the release and vote; the vote will run for the usual 5 days.
> >
> > thanks,
> > Arun
> >
> >
> > --
> > CONFIDENTIALITY NOTICE
> > NOTICE: This message is intended for the use of the individual or entity
> to
> > which it is addressed and may contain information that is confidential,
> > privileged and exempt from disclosure under applicable law. If the reader
> > of this message is not the intended recipient, you are hereby notified
> that
> > any printing, copying, dissemination, distribution, disclosure or
> > forwarding of this communication is strictly prohibited. If you have
> > received this communication in error, please contact the sender
> immediately
> > and delete it from your system. Thank You.
> >
>
> --
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity to
> which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
>
>
>
>


Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-11 Thread Ravi Prakash
Hi Arun!
We are very close to completion on YARN-1964 (DockerContainerExecutor). I'd 
also like HDFS-4882 to be checked in. Do you think these issues merit another 
RC?
ThanksRavi
 

 On Tuesday, November 11, 2014 11:57 AM, Steve Loughran 
 wrote:
   

 +1 binding

-patched slider pom to build against 2.6.0

-verified build did download, which it did at up to ~8Mbps. Faster than a
local build.

-full clean test runs on OS/X & Linux


Windows 2012:

Same thing. I did have to first build my own set of the windows native
binaries, by checking out branch-2.6.0; doing a native build, copying the
binaries and then purging the local m2 repository of hadoop artifacts to be
confident I was building against. For anyone who wants those native libs
they will be up on
https://github.com/apache/incubator-slider/tree/develop/bin/windows/ once
it syncs with the ASF repos.

afterwords: the tests worked!


On 11 November 2014 02:52, Arun C Murthy  wrote:

> Folks,
>
> I've created a release candidate (rc0) for hadoop-2.6.0 that I would like
> to see released.
>
> The RC is available at:
> http://people.apache.org/~acmurthy/hadoop-2.6.0-rc0
> The RC tag in git is: release-2.6.0-rc0
>
> The maven artifacts are available via repository.apache.org at
> https://repository.apache.org/content/repositories/orgapachehadoop-1012.
>
> Please try the release and vote; the vote will run for the usual 5 days.
>
> thanks,
> Arun
>
>
> --
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity to
> which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
>

-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.




Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-11 Thread Steve Loughran
+1 binding

-patched slider pom to build against 2.6.0

-verified build did download, which it did at up to ~8Mbps. Faster than a
local build.

-full clean test runs on OS/X & Linux


Windows 2012:

Same thing. I did have to first build my own set of the windows native
binaries, by checking out branch-2.6.0; doing a native build, copying the
binaries and then purging the local m2 repository of hadoop artifacts to be
confident I was building against. For anyone who wants those native libs
they will be up on
https://github.com/apache/incubator-slider/tree/develop/bin/windows/ once
it syncs with the ASF repos.

afterwords: the tests worked!


On 11 November 2014 02:52, Arun C Murthy  wrote:

> Folks,
>
> I've created a release candidate (rc0) for hadoop-2.6.0 that I would like
> to see released.
>
> The RC is available at:
> http://people.apache.org/~acmurthy/hadoop-2.6.0-rc0
> The RC tag in git is: release-2.6.0-rc0
>
> The maven artifacts are available via repository.apache.org at
> https://repository.apache.org/content/repositories/orgapachehadoop-1012.
>
> Please try the release and vote; the vote will run for the usual 5 days.
>
> thanks,
> Arun
>
>
> --
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity to
> which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
>

-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.


Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-10 Thread Arun Murthy
Duh!

$ chmod a+r *

Please try now. Thanks!

Arun


On Mon, Nov 10, 2014 at 7:06 PM, Tsuyoshi OZAWA 
wrote:

> Hi Arun,
>
> Could you confirm the link and permission to the files is correct? I
> got a following error:
>
>
> Forbidden
> You don't have permission to access
> /~acmurthy/hadoop-2.6.0-rc0/hadoop-2.6.0-src.tar.gz on this server.
>
> On Tue, Nov 11, 2014 at 11:52 AM, Arun C Murthy 
> wrote:
> > Folks,
> >
> > I've created a release candidate (rc0) for hadoop-2.6.0 that I would
> like to see released.
> >
> > The RC is available at:
> http://people.apache.org/~acmurthy/hadoop-2.6.0-rc0
> > The RC tag in git is: release-2.6.0-rc0
> >
> > The maven artifacts are available via repository.apache.org at
> https://repository.apache.org/content/repositories/orgapachehadoop-1012.
> >
> > Please try the release and vote; the vote will run for the usual 5 days.
> >
> > thanks,
> > Arun
> >
> >
> > --
> > CONFIDENTIALITY NOTICE
> > NOTICE: This message is intended for the use of the individual or entity
> to
> > which it is addressed and may contain information that is confidential,
> > privileged and exempt from disclosure under applicable law. If the reader
> > of this message is not the intended recipient, you are hereby notified
> that
> > any printing, copying, dissemination, distribution, disclosure or
> > forwarding of this communication is strictly prohibited. If you have
> > received this communication in error, please contact the sender
> immediately
> > and delete it from your system. Thank You.
>
>
>
> --
> - Tsuyoshi
>



-- 

--
Arun C. Murthy
Hortonworks Inc.
http://hortonworks.com/

-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.


Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-10 Thread Tsuyoshi OZAWA
Hi Arun,

Could you confirm the link and permission to the files is correct? I
got a following error:


Forbidden
You don't have permission to access
/~acmurthy/hadoop-2.6.0-rc0/hadoop-2.6.0-src.tar.gz on this server.

On Tue, Nov 11, 2014 at 11:52 AM, Arun C Murthy  wrote:
> Folks,
>
> I've created a release candidate (rc0) for hadoop-2.6.0 that I would like to 
> see released.
>
> The RC is available at: http://people.apache.org/~acmurthy/hadoop-2.6.0-rc0
> The RC tag in git is: release-2.6.0-rc0
>
> The maven artifacts are available via repository.apache.org at 
> https://repository.apache.org/content/repositories/orgapachehadoop-1012.
>
> Please try the release and vote; the vote will run for the usual 5 days.
>
> thanks,
> Arun
>
>
> --
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity to
> which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.



-- 
- Tsuyoshi


[VOTE] Release Apache Hadoop 2.6.0

2014-11-10 Thread Arun C Murthy
Folks,

I've created a release candidate (rc0) for hadoop-2.6.0 that I would like to 
see released.

The RC is available at: http://people.apache.org/~acmurthy/hadoop-2.6.0-rc0
The RC tag in git is: release-2.6.0-rc0

The maven artifacts are available via repository.apache.org at 
https://repository.apache.org/content/repositories/orgapachehadoop-1012.

Please try the release and vote; the vote will run for the usual 5 days.

thanks,
Arun


-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.