Re: [VOTE] Release Apache Hadoop 2.7.2 RC2

2016-01-19 Thread Akira AJISAKA

+1 (binding)

- Downloaded source tarball and binary tarball
- Verified signatures and checksums
- Compiled and built a single node cluster
- Compiled Hive 1.2.1 and Tez 0.7.0/0.8.1-alpha using Hadoop 2.7.2 pom 
successfully

- Ran some Hive on Tez/MRv2 queries successfully

Thanks,
Akira

On 1/20/16 11:10, Masatake Iwasaki wrote:

+1(non-binding)

- verified mds and signature of source and binary tarball
- built from source tarball with -Pnative on CentOS 7/OpenJDK 7
- built rpm by using bigtop, launched 3 nodes cluster, ran smoke test of
hdfs, mapreduce, yarn
- built rpm of hbase, hive, pig against 2.7.2-RC2, ran smoke test of
hive, pig

Thanks,
Masatake Iwasaki


On 1/15/16 13:57, Vinod Kumar Vavilapalli wrote:

Hi all,

I've created an updated release candidate RC2 for Apache Hadoop 2.7.2.

As discussed before, this is the next maintenance release to follow up
2.7.1.

The RC is available for validation at:
http://people.apache.org/~vinodkv/hadoop-2.7.2-RC2/

The RC tag in git is: release-2.7.2-RC2

The maven artifacts are available via repository.apache.org
 at
https://repository.apache.org/content/repositories/orgapachehadoop-1027 



The release-notes are inside the tar-balls at location
hadoop-common-project/hadoop-common/src/main/docs/releasenotes.html. I
hosted this at
http://people.apache.org/~vinodkv/hadoop-2.7.2-RC2/releasenotes.html

for your quick perusal.

As you may have noted,
  - I terminated the RC1 related voting thread after finding out that
we didn’t have a bunch of patches that are already in the released
2.6.3 version. After a brief discussion, we decided to keep the
parallel 2.6.x and 2.7.x releases incremental, see [4] for this
discussion.
  - The RC0 related voting thread got halted due to some critical
issues. It took a while again for getting all those blockers out of
the way. See the previous voting thread [3] for details.
  - Before RC0, an unusually long 2.6.3 release caused 2.7.2 to slip
by quite a bit. This release's related discussion threads are linked
below: [1] and [2].

Please try the release and vote; the vote will run for the usual 5 days.

Thanks,
Vinod

[1]: 2.7.2 release plan: http://markmail.org/message/oozq3gvd4nhzsaes

[2]: Planning Apache Hadoop 2.7.2
http://markmail.org/message/iktqss2qdeykgpqk

[3]: [VOTE] Release Apache Hadoop 2.7.2 RC0:
http://markmail.org/message/5txhvr2qdiqglrwc

[4] Retracted [VOTE] Release Apache Hadoop 2.7.2 RC1:
http://markmail.org/thread/n7ljbsnquihn3wlw






Re: [VOTE] Release Apache Hadoop 2.7.2 RC2

2016-01-19 Thread Masatake Iwasaki

+1(non-binding)

- verified mds and signature of source and binary tarball
- built from source tarball with -Pnative on CentOS 7/OpenJDK 7
- built rpm by using bigtop, launched 3 nodes cluster, ran smoke test of 
hdfs, mapreduce, yarn
- built rpm of hbase, hive, pig against 2.7.2-RC2, ran smoke test of 
hive, pig


Thanks,
Masatake Iwasaki


On 1/15/16 13:57, Vinod Kumar Vavilapalli wrote:

Hi all,

I've created an updated release candidate RC2 for Apache Hadoop 2.7.2.

As discussed before, this is the next maintenance release to follow up 2.7.1.

The RC is available for validation at: 
http://people.apache.org/~vinodkv/hadoop-2.7.2-RC2/

The RC tag in git is: release-2.7.2-RC2

The maven artifacts are available via repository.apache.org 
 at 
https://repository.apache.org/content/repositories/orgapachehadoop-1027 


The release-notes are inside the tar-balls at location 
hadoop-common-project/hadoop-common/src/main/docs/releasenotes.html. I hosted this at 
http://people.apache.org/~vinodkv/hadoop-2.7.2-RC2/releasenotes.html 
 for your 
quick perusal.

As you may have noted,
  - I terminated the RC1 related voting thread after finding out that we didn’t 
have a bunch of patches that are already in the released 2.6.3 version. After a 
brief discussion, we decided to keep the parallel 2.6.x and 2.7.x releases 
incremental, see [4] for this discussion.
  - The RC0 related voting thread got halted due to some critical issues. It 
took a while again for getting all those blockers out of the way. See the 
previous voting thread [3] for details.
  - Before RC0, an unusually long 2.6.3 release caused 2.7.2 to slip by quite a 
bit. This release's related discussion threads are linked below: [1] and [2].

Please try the release and vote; the vote will run for the usual 5 days.

Thanks,
Vinod

[1]: 2.7.2 release plan: http://markmail.org/message/oozq3gvd4nhzsaes 

[2]: Planning Apache Hadoop 2.7.2 http://markmail.org/message/iktqss2qdeykgpqk 

[3]: [VOTE] Release Apache Hadoop 2.7.2 RC0: 
http://markmail.org/message/5txhvr2qdiqglrwc 

[4] Retracted [VOTE] Release Apache Hadoop 2.7.2 RC1: 
http://markmail.org/thread/n7ljbsnquihn3wlw




Re: [VOTE] Release Apache Hadoop 2.7.2 RC2

2016-01-19 Thread Steve Loughran

> On 14 Jan 2016, at 20:57, Vinod Kumar Vavilapalli  wrote:
> 
> Hi all,
> 
> I've created an updated release candidate RC2 for Apache Hadoop 2.7.2.
> 
> As discussed before, this is the next maintenance release to follow up 2.7.1.
> 
> The RC is available for validation at: 
> http://people.apache.org/~vinodkv/hadoop-2.7.2-RC2/
> 
> The RC tag in git is: release-2.7.2-RC2
> 
> The maven artifacts are available via repository.apache.org 
>  at 
> https://repository.apache.org/content/repositories/orgapachehadoop-1027 
> 
> 
> The release-notes are inside the tar-balls at location 
> hadoop-common-project/hadoop-common/src/main/docs/releasenotes.html. I hosted 
> this at http://people.apache.org/~vinodkv/hadoop-2.7.2-RC2/releasenotes.html 
>  for 
> your quick perusal.
> 
> As you may have noted,
> - I terminated the RC1 related voting thread after finding out that we didn’t 
> have a bunch of patches that are already in the released 2.6.3 version. After 
> a brief discussion, we decided to keep the parallel 2.6.x and 2.7.x releases 
> incremental, see [4] for this discussion.
> - The RC0 related voting thread got halted due to some critical issues. It 
> took a while again for getting all those blockers out of the way. See the 
> previous voting thread [3] for details.
> - Before RC0, an unusually long 2.6.3 release caused 2.7.2 to slip by quite a 
> bit. This release's related discussion threads are linked below: [1] and [2].
> 
> Please try the release and vote; the vote will run for the usual 5 days.
> 
> 

+1 (binding)


OSX


-purge all 2.7.2 artifacts from my local maven repository
-in slider/ 
mvn test -Dhadoop.version=2.7.2 -Pprivate-repo 
-Dprivate.repo.url=https://repository.apache.org/content/repositories/orgapachehadoop-1027
 
All tests passed

Windows 
---

Build and test Hadoop on a Java 8 JVM, then rebuild and retest slider

-purge all 2.7.2 artifacts from my local maven repository
-check out hadoop trunk tag release-2.7.2-RC2
-mvn clean package -Pdist
 (note that I didn't have to skip the javadocs with -Dmaven.javadoc.skip; for 
the 2.6.2 release I did have to do that)
-purge all 2.7.2 artifacts from my local maven repository
-in slider/: 
  mvn test -Dhadoop.version=2.7.2 -Pprivate-repo 
-Dprivate.repo.url=https://repository.apache.org/content/repositories/orgapachehadoop-1027


-Steve






Jenkins build is back to normal : Hadoop-Common-trunk #2249

2016-01-19 Thread Apache Jenkins Server
See 



Re: [VOTE] Release Apache Hadoop 2.7.2 RC2

2016-01-19 Thread Xuan Gong
+1 (binding)
- Successfully built from source
- Deployed on a single node cluster
- Ran a simple MR job and a distributed Shell job successfully.


Thanks

Xuan Gong


> On Jan 19, 2016, at 3:30 PM, Jason Lowe  wrote:
> 
> That's reasonable, especially if we don't take nearly as long for 2.7.3.  
> Note that there are almost 50 JIRAs already committed to 2.7.3, so hopefully 
> we'll have a plan for that soon.
> +1 (binding) for 2.7.2 RC2.
> Jason
> 
> 
>  From: Vinod Kumar Vavilapalli 
> To: mapreduce-...@hadoop.apache.org; Jason Lowe  
> Cc: Hadoop Common ; 
> "hdfs-...@hadoop.apache.org" ; 
> "yarn-...@hadoop.apache.org" 
> Sent: Tuesday, January 19, 2016 5:25 PM
> Subject: Re: [VOTE] Release Apache Hadoop 2.7.2 RC2
> 
> The JIRA YARN-4610 links YARN-3434 as the one causing the breakage, and 
> YARN-3434 already exists in 2.7.1 itself. That categorizes the new issue as 
> an existing bug.
> If you agree with that sentiment, and given that there is a clear 
> work-around, in the interest of progress of 2.7.2 (we have spent > 2 months 
> on this now), I’d like to move forward.
> Please LMK what you think.
> Thanks+Vinod
> 
> 
> On Jan 19, 2016, at 3:13 PM, Jason Lowe  wrote:
> -1 (binding)
> We have been running a release derived from 2.7 on some of our clusters, and 
> we recently hit a bug where an application making large container requests 
> can drastically slow down container allocations for other users in the same 
> queue.  See YARN-4610 for details.  Since 
> yarn.scheduler.capacity.reservations-continue-look-all-nodes is on by 
> default, I think we should fix this.  If we decide to ship 2.7.2 without that 
> fix then the release notes should call out that JIRA and mention the 
> workaround of setting 
> yarn.scheduler.capacity.reservations-continue-look-all-nodes to false.
> Jason
> 
> 
>  From: Vinod Kumar Vavilapalli 
> To: Hadoop Common ; hdfs-...@hadoop.apache.org; 
> yarn-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org 
> Sent: Thursday, January 14, 2016 10:57 PM
> Subject: [VOTE] Release Apache Hadoop 2.7.2 RC2
> 
> Hi all,
> 
> I've created an updated release candidate RC2 for Apache Hadoop 2.7.2.
> 
> As discussed before, this is the next maintenance release to follow up 2.7.1.
> 
> The RC is available for validation at: 
> http://people.apache.org/~vinodkv/hadoop-2.7.2-RC2/
> 
> The RC tag in git is: release-2.7.2-RC2
> 
> The maven artifacts are available via repository.apache.org 
>  at 
> https://repository.apache.org/content/repositories/orgapachehadoop-1027 
> 
> 
> The release-notes are inside the tar-balls at location 
> hadoop-common-project/hadoop-common/src/main/docs/releasenotes.html. I hosted 
> this at http://people.apache.org/~vinodkv/hadoop-2.7.2-RC2/releasenotes.html 
>  for 
> your quick perusal.
> 
> As you may have noted,
> - I terminated the RC1 related voting thread after finding out that we didn’t 
> have a bunch of patches that are already in the released 2.6.3 version. After 
> a brief discussion, we decided to keep the parallel 2.6.x and 2.7.x releases 
> incremental, see [4] for this discussion.
> - The RC0 related voting thread got halted due to some critical issues. It 
> took a while again for getting all those blockers out of the way. See the 
> previous voting thread [3] for details.
> - Before RC0, an unusually long 2.6.3 release caused 2.7.2 to slip by quite a 
> bit. This release's related discussion threads are linked below: [1] and [2].
> 
> Please try the release and vote; the vote will run for the usual 5 days.
> 
> Thanks,
> Vinod
> 
> [1]: 2.7.2 release plan: http://markmail.org/message/oozq3gvd4nhzsaes 
> 
> [2]: Planning Apache Hadoop 2.7.2 
> http://markmail.org/message/iktqss2qdeykgpqk 
> 
> [3]: [VOTE] Release Apache Hadoop 2.7.2 RC0: 
> http://markmail.org/message/5txhvr2qdiqglrwc 
> 
> [4] Retracted [VOTE] Release Apache Hadoop 2.7.2 RC1: 
> http://markmail.org/thread/n7ljbsnquihn3wlw
> 
> 
> 
> 
> 



Re: [VOTE] Release Apache Hadoop 2.7.2 RC2

2016-01-19 Thread Jason Lowe
That's reasonable, especially if we don't take nearly as long for 2.7.3.  Note 
that there are almost 50 JIRAs already committed to 2.7.3, so hopefully we'll 
have a plan for that soon.
+1 (binding) for 2.7.2 RC2.
Jason


  From: Vinod Kumar Vavilapalli 
 To: mapreduce-...@hadoop.apache.org; Jason Lowe  
Cc: Hadoop Common ; "hdfs-...@hadoop.apache.org" 
; "yarn-...@hadoop.apache.org" 

 Sent: Tuesday, January 19, 2016 5:25 PM
 Subject: Re: [VOTE] Release Apache Hadoop 2.7.2 RC2
   
The JIRA YARN-4610 links YARN-3434 as the one causing the breakage, and 
YARN-3434 already exists in 2.7.1 itself. That categorizes the new issue as an 
existing bug.
If you agree with that sentiment, and given that there is a clear work-around, 
in the interest of progress of 2.7.2 (we have spent > 2 months on this now), 
I’d like to move forward.
Please LMK what you think.
Thanks+Vinod


On Jan 19, 2016, at 3:13 PM, Jason Lowe  wrote:
-1 (binding)
We have been running a release derived from 2.7 on some of our clusters, and we 
recently hit a bug where an application making large container requests can 
drastically slow down container allocations for other users in the same queue.  
See YARN-4610 for details.  Since 
yarn.scheduler.capacity.reservations-continue-look-all-nodes is on by default, 
I think we should fix this.  If we decide to ship 2.7.2 without that fix then 
the release notes should call out that JIRA and mention the workaround of 
setting yarn.scheduler.capacity.reservations-continue-look-all-nodes to false.
Jason


  From: Vinod Kumar Vavilapalli 
 To: Hadoop Common ; hdfs-...@hadoop.apache.org; 
yarn-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org 
 Sent: Thursday, January 14, 2016 10:57 PM
 Subject: [VOTE] Release Apache Hadoop 2.7.2 RC2

Hi all,

I've created an updated release candidate RC2 for Apache Hadoop 2.7.2.

As discussed before, this is the next maintenance release to follow up 2.7.1.

The RC is available for validation at: 
http://people.apache.org/~vinodkv/hadoop-2.7.2-RC2/

The RC tag in git is: release-2.7.2-RC2

The maven artifacts are available via repository.apache.org 
 at 
https://repository.apache.org/content/repositories/orgapachehadoop-1027 


The release-notes are inside the tar-balls at location 
hadoop-common-project/hadoop-common/src/main/docs/releasenotes.html. I hosted 
this at http://people.apache.org/~vinodkv/hadoop-2.7.2-RC2/releasenotes.html 
 for your 
quick perusal.

As you may have noted,
 - I terminated the RC1 related voting thread after finding out that we didn’t 
have a bunch of patches that are already in the released 2.6.3 version. After a 
brief discussion, we decided to keep the parallel 2.6.x and 2.7.x releases 
incremental, see [4] for this discussion.
 - The RC0 related voting thread got halted due to some critical issues. It 
took a while again for getting all those blockers out of the way. See the 
previous voting thread [3] for details.
 - Before RC0, an unusually long 2.6.3 release caused 2.7.2 to slip by quite a 
bit. This release's related discussion threads are linked below: [1] and [2].

Please try the release and vote; the vote will run for the usual 5 days.

Thanks,
Vinod

[1]: 2.7.2 release plan: http://markmail.org/message/oozq3gvd4nhzsaes 

[2]: Planning Apache Hadoop 2.7.2 http://markmail.org/message/iktqss2qdeykgpqk 

[3]: [VOTE] Release Apache Hadoop 2.7.2 RC0: 
http://markmail.org/message/5txhvr2qdiqglrwc 

[4] Retracted [VOTE] Release Apache Hadoop 2.7.2 RC1: 
http://markmail.org/thread/n7ljbsnquihn3wlw





  

Re: [VOTE] Release Apache Hadoop 2.7.2 RC2

2016-01-19 Thread Vinod Kumar Vavilapalli
The JIRA YARN-4610 links YARN-3434 
 as the one causing the 
breakage, and YARN-3434 already exists in 2.7.1 itself. That categorizes the 
new issue as an existing bug.

If you agree with that sentiment, and given that there is a clear work-around, 
in the interest of progress of 2.7.2 (we have spent > 2 months on this now), 
I’d like to move forward.

Please LMK what you think.

Thanks
+Vinod


> On Jan 19, 2016, at 3:13 PM, Jason Lowe  wrote:
> 
> -1 (binding)
> We have been running a release derived from 2.7 on some of our clusters, and 
> we recently hit a bug where an application making large container requests 
> can drastically slow down container allocations for other users in the same 
> queue.  See YARN-4610 for details.  Since 
> yarn.scheduler.capacity.reservations-continue-look-all-nodes is on by 
> default, I think we should fix this.  If we decide to ship 2.7.2 without that 
> fix then the release notes should call out that JIRA and mention the 
> workaround of setting 
> yarn.scheduler.capacity.reservations-continue-look-all-nodes to false.
> Jason
> 
> 
>  From: Vinod Kumar Vavilapalli 
> To: Hadoop Common ; hdfs-...@hadoop.apache.org; 
> yarn-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org 
> Sent: Thursday, January 14, 2016 10:57 PM
> Subject: [VOTE] Release Apache Hadoop 2.7.2 RC2
> 
> Hi all,
> 
> I've created an updated release candidate RC2 for Apache Hadoop 2.7.2.
> 
> As discussed before, this is the next maintenance release to follow up 2.7.1.
> 
> The RC is available for validation at: 
> http://people.apache.org/~vinodkv/hadoop-2.7.2-RC2/
> 
> The RC tag in git is: release-2.7.2-RC2
> 
> The maven artifacts are available via repository.apache.org 
>  at 
> https://repository.apache.org/content/repositories/orgapachehadoop-1027 
> 
> 
> The release-notes are inside the tar-balls at location 
> hadoop-common-project/hadoop-common/src/main/docs/releasenotes.html. I hosted 
> this at http://people.apache.org/~vinodkv/hadoop-2.7.2-RC2/releasenotes.html 
>  for 
> your quick perusal.
> 
> As you may have noted,
> - I terminated the RC1 related voting thread after finding out that we didn’t 
> have a bunch of patches that are already in the released 2.6.3 version. After 
> a brief discussion, we decided to keep the parallel 2.6.x and 2.7.x releases 
> incremental, see [4] for this discussion.
> - The RC0 related voting thread got halted due to some critical issues. It 
> took a while again for getting all those blockers out of the way. See the 
> previous voting thread [3] for details.
> - Before RC0, an unusually long 2.6.3 release caused 2.7.2 to slip by quite a 
> bit. This release's related discussion threads are linked below: [1] and [2].
> 
> Please try the release and vote; the vote will run for the usual 5 days.
> 
> Thanks,
> Vinod
> 
> [1]: 2.7.2 release plan: http://markmail.org/message/oozq3gvd4nhzsaes 
> 
> [2]: Planning Apache Hadoop 2.7.2 
> http://markmail.org/message/iktqss2qdeykgpqk 
> 
> [3]: [VOTE] Release Apache Hadoop 2.7.2 RC0: 
> http://markmail.org/message/5txhvr2qdiqglrwc 
> 
> [4] Retracted [VOTE] Release Apache Hadoop 2.7.2 RC1: 
> http://markmail.org/thread/n7ljbsnquihn3wlw
> 



[jira] [Resolved] (HADOOP-10372) Deprecate S3 implementation.

2016-01-19 Thread Allen Wittenauer (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-10372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Allen Wittenauer resolved HADOOP-10372.
---
Resolution: Duplicate

Closing this as a dupe.

> Deprecate S3 implementation.
> 
>
> Key: HADOOP-10372
> URL: https://issues.apache.org/jira/browse/HADOOP-10372
> Project: Hadoop Common
>  Issue Type: Bug
>  Components: fs/s3
>Reporter: Amandeep Khurana
>Priority: Minor
>
> We encourage users to use the S3N implementation. We should consider 
> deprecating the older S3 implementation to avoid confusion down the road.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


Re: [VOTE] Release Apache Hadoop 2.7.2 RC2

2016-01-19 Thread Jason Lowe
-1 (binding)
We have been running a release derived from 2.7 on some of our clusters, and we 
recently hit a bug where an application making large container requests can 
drastically slow down container allocations for other users in the same queue.  
See YARN-4610 for details.  Since 
yarn.scheduler.capacity.reservations-continue-look-all-nodes is on by default, 
I think we should fix this.  If we decide to ship 2.7.2 without that fix then 
the release notes should call out that JIRA and mention the workaround of 
setting yarn.scheduler.capacity.reservations-continue-look-all-nodes to false.
Jason


  From: Vinod Kumar Vavilapalli 
 To: Hadoop Common ; hdfs-...@hadoop.apache.org; 
yarn-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org 
 Sent: Thursday, January 14, 2016 10:57 PM
 Subject: [VOTE] Release Apache Hadoop 2.7.2 RC2
   
Hi all,

I've created an updated release candidate RC2 for Apache Hadoop 2.7.2.

As discussed before, this is the next maintenance release to follow up 2.7.1.

The RC is available for validation at: 
http://people.apache.org/~vinodkv/hadoop-2.7.2-RC2/

The RC tag in git is: release-2.7.2-RC2

The maven artifacts are available via repository.apache.org 
 at 
https://repository.apache.org/content/repositories/orgapachehadoop-1027 


The release-notes are inside the tar-balls at location 
hadoop-common-project/hadoop-common/src/main/docs/releasenotes.html. I hosted 
this at http://people.apache.org/~vinodkv/hadoop-2.7.2-RC2/releasenotes.html 
 for your 
quick perusal.

As you may have noted,
 - I terminated the RC1 related voting thread after finding out that we didn’t 
have a bunch of patches that are already in the released 2.6.3 version. After a 
brief discussion, we decided to keep the parallel 2.6.x and 2.7.x releases 
incremental, see [4] for this discussion.
 - The RC0 related voting thread got halted due to some critical issues. It 
took a while again for getting all those blockers out of the way. See the 
previous voting thread [3] for details.
 - Before RC0, an unusually long 2.6.3 release caused 2.7.2 to slip by quite a 
bit. This release's related discussion threads are linked below: [1] and [2].

Please try the release and vote; the vote will run for the usual 5 days.

Thanks,
Vinod

[1]: 2.7.2 release plan: http://markmail.org/message/oozq3gvd4nhzsaes 

[2]: Planning Apache Hadoop 2.7.2 http://markmail.org/message/iktqss2qdeykgpqk 

[3]: [VOTE] Release Apache Hadoop 2.7.2 RC0: 
http://markmail.org/message/5txhvr2qdiqglrwc 

[4] Retracted [VOTE] Release Apache Hadoop 2.7.2 RC1: 
http://markmail.org/thread/n7ljbsnquihn3wlw

  

Build failed in Jenkins: Hadoop-common-trunk-Java8 #948

2016-01-19 Thread Apache Jenkins Server
See 

Changes:

[wangda] HADOOP-12356. Fix computing CPU usage statistics on Windows. (Inigo

[raviprak] HADOOP-12696. Add tests for S3FileSystem Contract. Contributed by 
Matt

--
[...truncated 5597 lines...]
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.197 sec - in 
org.apache.hadoop.fs.contract.rawlocal.TestRawLocalContractUnderlyingFileBehavior
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.fs.contract.rawlocal.TestRawlocalContractCreate
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.843 sec - in 
org.apache.hadoop.fs.contract.rawlocal.TestRawlocalContractCreate
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.fs.contract.ftp.TestFTPContractCreate
Tests run: 6, Failures: 0, Errors: 0, Skipped: 6, Time elapsed: 0.459 sec - in 
org.apache.hadoop.fs.contract.ftp.TestFTPContractCreate
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.fs.contract.ftp.TestFTPContractDelete
Tests run: 8, Failures: 0, Errors: 0, Skipped: 8, Time elapsed: 0.569 sec - in 
org.apache.hadoop.fs.contract.ftp.TestFTPContractDelete
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.fs.contract.ftp.TestFTPContractRename
Tests run: 6, Failures: 0, Errors: 0, Skipped: 6, Time elapsed: 0.563 sec - in 
org.apache.hadoop.fs.contract.ftp.TestFTPContractRename
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.fs.contract.ftp.TestFTPContractMkdir
Tests run: 5, Failures: 0, Errors: 0, Skipped: 5, Time elapsed: 0.525 sec - in 
org.apache.hadoop.fs.contract.ftp.TestFTPContractMkdir
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.fs.contract.ftp.TestFTPContractOpen
Tests run: 6, Failures: 0, Errors: 0, Skipped: 6, Time elapsed: 0.529 sec - in 
org.apache.hadoop.fs.contract.ftp.TestFTPContractOpen
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.fs.contract.localfs.TestLocalFSContractAppend
Tests run: 5, Failures: 0, Errors: 0, Skipped: 5, Time elapsed: 0.743 sec - in 
org.apache.hadoop.fs.contract.localfs.TestLocalFSContractAppend
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.fs.contract.localfs.TestLocalFSContractGetFileStatus
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.669 sec - in 
org.apache.hadoop.fs.contract.localfs.TestLocalFSContractGetFileStatus
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.fs.contract.localfs.TestLocalFSContractOpen
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.838 sec - in 
org.apache.hadoop.fs.contract.localfs.TestLocalFSContractOpen
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.fs.contract.localfs.TestLocalFSContractLoaded
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.631 sec - in 
org.apache.hadoop.fs.contract.localfs.TestLocalFSContractLoaded
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.fs.contract.localfs.TestLocalFSContractDelete
Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.818 sec - in 
org.apache.hadoop.fs.contract.localfs.TestLocalFSContractDelete
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.fs.contract.localfs.TestLocalFSContractMkdir
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.772 sec - in 
org.apache.hadoop.fs.contract.localfs.TestLocalFSContractMkdir
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.fs.contract.localfs.TestLocalFSContractRename
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.73 sec - in 
org.apache.hadoop.fs.contract.localfs.TestLocalFSContractRename
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.fs.contract.localfs.TestLocalFSContractCreate
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.841 sec - in 
org.apache.hadoop.fs.contract.localfs.TestLocalFSContractCreate
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed i

Re: [VOTE] Release Apache Hadoop 2.7.2 RC2

2016-01-19 Thread Eric Payne
+1 (non-binding)

- Downloaded and built the source

- Installed on 3-node, non-secured cluster
- Ran 2 jobs, one in preemptable queue and one not. Containers were preempted 
until the app in the non-preemptable queue was balanced with the app running in 
the preemptable queue, and then preemption stopped, as expected.

- Labelled 1 queue (of 3) and ran jobs on labelled queue. All containers 
(including AM) ran on labelled nodes, as expected. One minor issue is that when 
the job was running on the labelled queue, it ran fine but the cluster 
scheduler web UI showed a blank status bar for that queue in the "Application 
Queues" section.
- Tested to make sure application data is preserved in the generic application 
history server when the AM crashes during startup (e.g., exceeds max splits).

-Eric Payne




From: Vinod Kumar Vavilapalli 
To: Hadoop Common ; hdfs-...@hadoop.apache.org; 
yarn-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org 
Sent: Thursday, January 14, 2016 10:57 PM
Subject: [VOTE] Release Apache Hadoop 2.7.2 RC2


Hi all,

I've created an updated release candidate RC2 for Apache Hadoop 2.7.2.

As discussed before, this is the next maintenance release to follow up 2.7.1.

The RC is available for validation at: 
http://people.apache.org/~vinodkv/hadoop-2.7.2-RC2/

The RC tag in git is: release-2.7.2-RC2

The maven artifacts are available via repository.apache.org 
 at 
https://repository.apache.org/content/repositories/orgapachehadoop-1027 


The release-notes are inside the tar-balls at location 
hadoop-common-project/hadoop-common/src/main/docs/releasenotes.html. I hosted 
this at http://people.apache.org/~vinodkv/hadoop-2.7.2-RC2/releasenotes.html 
 for your 
quick perusal.

As you may have noted,
- I terminated the RC1 related voting thread after finding out that we didn’t 
have a bunch of patches that are already in the released 2.6.3 version. After a 
brief discussion, we decided to keep the parallel 2.6.x and 2.7.x releases 
incremental, see [4] for this discussion.
- The RC0 related voting thread got halted due to some critical issues. It took 
a while again for getting all those blockers out of the way. See the previous 
voting thread [3] for details.
- Before RC0, an unusually long 2.6.3 release caused 2.7.2 to slip by quite a 
bit. This release's related discussion threads are linked below: [1] and [2].

Please try the release and vote; the vote will run for the usual 5 days.

Thanks,
Vinod

[1]: 2.7.2 release plan: http://markmail.org/message/oozq3gvd4nhzsaes 

[2]: Planning Apache Hadoop 2.7.2 http://markmail.org/message/iktqss2qdeykgpqk 

[3]: [VOTE] Release Apache Hadoop 2.7.2 RC0: 
http://markmail.org/message/5txhvr2qdiqglrwc 

[4] Retracted [VOTE] Release Apache Hadoop 2.7.2 RC1: 
http://markmail.org/thread/n7ljbsnquihn3wlw


Re: [VOTE] Release Apache Hadoop 2.7.2 RC2

2016-01-19 Thread Chang Li
Thanks Vinod and Junping!
+1(non-binding)
-built and deployed on linux and mac successfully
-ran MR jobs successfully
-verified UIs work

Best,
Chang

On Mon, Jan 18, 2016 at 11:46 PM, Arpit Agarwal 
wrote:

> +1 (binding)
>
> - verified signatures
> - Installed pseudo-cluster from binary distribution and ran example
> MapReduce jobs
> - Built from sources and reran tests on pseudo-cluster
>
>
>
>
> On 1/14/16, 8:57 PM, "Vinod Kumar Vavilapalli"  wrote:
>
> >Hi all,
> >
> >I've created an updated release candidate RC2 for Apache Hadoop 2.7.2.
> >
> >As discussed before, this is the next maintenance release to follow up
> 2.7.1.
> >
> >The RC is available for validation at:
> http://people.apache.org/~vinodkv/hadoop-2.7.2-RC2/
> >
> >The RC tag in git is: release-2.7.2-RC2
> >
> >The maven artifacts are available via repository.apache.org <
> http://repository.apache.org/> at
> https://repository.apache.org/content/repositories/orgapachehadoop-1027 <
> https://repository.apache.org/content/repositories/orgapachehadoop-1027>
> >
> >The release-notes are inside the tar-balls at location
> hadoop-common-project/hadoop-common/src/main/docs/releasenotes.html. I
> hosted this at
> http://people.apache.org/~vinodkv/hadoop-2.7.2-RC2/releasenotes.html <
> http://people.apache.org/~vinodkv/hadoop-2.7.2-RC1/releasenotes.html> for
> your quick perusal.
> >
> >As you may have noted,
> > - I terminated the RC1 related voting thread after finding out that we
> didn’t have a bunch of patches that are already in the released 2.6.3
> version. After a brief discussion, we decided to keep the parallel 2.6.x
> and 2.7.x releases incremental, see [4] for this discussion.
> > - The RC0 related voting thread got halted due to some critical issues.
> It took a while again for getting all those blockers out of the way. See
> the previous voting thread [3] for details.
> > - Before RC0, an unusually long 2.6.3 release caused 2.7.2 to slip by
> quite a bit. This release's related discussion threads are linked below:
> [1] and [2].
> >
> >Please try the release and vote; the vote will run for the usual 5 days.
> >
> >Thanks,
> >Vinod
> >
> >[1]: 2.7.2 release plan: http://markmail.org/message/oozq3gvd4nhzsaes <
> http://markmail.org/message/oozq3gvd4nhzsaes>
> >[2]: Planning Apache Hadoop 2.7.2
> http://markmail.org/message/iktqss2qdeykgpqk <
> http://markmail.org/message/iktqss2qdeykgpqk>
> >[3]: [VOTE] Release Apache Hadoop 2.7.2 RC0:
> http://markmail.org/message/5txhvr2qdiqglrwc <
> http://markmail.org/message/5txhvr2qdiqglrwc>
> >[4] Retracted [VOTE] Release Apache Hadoop 2.7.2 RC1:
> http://markmail.org/thread/n7ljbsnquihn3wlw
>


[GitHub] hadoop pull request: Creating updated branch for Hadoop-6671

2016-01-19 Thread make5020
GitHub user make5020 opened a pull request:

https://github.com/apache/hadoop/pull/69

Creating updated branch for Hadoop-6671

git-svn-id: 
https://svn.apache.org/repos/asf/hadoop/common/branches/HADOOP-6671-2@956573 
13f79535-47bb-0310-9956-ffa450edef68

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/apache/hadoop HADOOP-6671-2

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/hadoop/pull/69.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #69


commit 3415f9569cce3d5811e95dba2ce21682d8b485f2
Author: Giridharan Kesavan 
Date:   2010-06-21T13:20:01Z

Creating updated branch for Hadoop-6671

git-svn-id: 
https://svn.apache.org/repos/asf/hadoop/common/branches/HADOOP-6671-2@956573 
13f79535-47bb-0310-9956-ffa450edef68




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---