Re: [VOTE] Release Apache Hadoop 2.7.2 RC1

2015-12-21 Thread Wangda Tan 
+1 (binding)

- Build & deploy single-node Hadoop from source code
- Add/Remove node labels to queues/nodes
- Run distributed shell commanding using default/specified node labels

Thanks,
Wangda


On Mon, Dec 21, 2015 at 9:58 AM, Masatake Iwasaki <
iwasak...@oss.nttdata.co.jp> wrote:

> +1(non-binding)
>
> - verified mds and signature of source and binary tarball
> - started 3 node cluster and ran example jobs such as wordcount and
> terasort
> - built from source tarball with -Pnative on CentOS 7 and OpenJDK 7
> - built site documentation and skimmed the contents
>
> Thanks,
> Masatake Iwasaki
>
>
>
> On 12/17/15 11:49, Vinod Kumar Vavilapalli wrote:
>
>> Hi all,
>>
>> I've created a release candidate RC1 for Apache Hadoop 2.7.2.
>>
>> As discussed before, this is the next maintenance release to follow up
>> 2.7.1.
>>
>> The RC is available for validation at:
>> http://people.apache.org/~vinodkv/hadoop-2.7.2-RC1/ <
>> http://people.apache.org/~vinodkv/hadoop-2.7.2-RC1/>
>>
>> The RC tag in git is: release-2.7.2-RC1
>>
>> The maven artifacts are available via repository.apache.org <
>> http://repository.apache.org/> at
>> https://repository.apache.org/content/repositories/orgapachehadoop-1026/
>> > >
>>
>> The release-notes are inside the tar-balls at location
>> hadoop-common-project/hadoop-common/src/main/docs/releasenotes.html. I
>> hosted this at
>> http://people.apache.org/~vinodkv/hadoop-2.7.2-RC1/releasenotes.html for
>> quick perusal.
>>
>> As you may have noted,
>>   - The RC0 related voting thread got halted due to some critical issues.
>> It took a while again for getting all those blockers out of the way. See
>> the previous voting thread [3] for details.
>>   - Before RC0, an unusually long 2.6.3 release caused 2.7.2 to slip by
>> quite a bit. This release's related discussion threads are linked below:
>> [1] and [2].
>>
>> Please try the release and vote; the vote will run for the usual 5 days.
>>
>> Thanks,
>> Vinod
>>
>> [1]: 2.7.2 release plan: http://markmail.org/message/oozq3gvd4nhzsaes <
>> http://markmail.org/message/oozq3gvd4nhzsaes>
>> [2]: Planning Apache Hadoop 2.7.2
>> http://markmail.org/message/iktqss2qdeykgpqk <
>> http://markmail.org/message/iktqss2qdeykgpqk>
>> [3]: [VOTE] Release Apache Hadoop 2.7.2 RC0:
>> http://markmail.org/message/5txhvr2qdiqglrwc
>>
>>
>>
>

Jenkins build is back to normal : Hadoop-common-trunk-Java8 #843

2015-12-21 Thread Apache Jenkins Server 
See

Build failed in Jenkins: Hadoop-Common-trunk #2139

2015-12-21 Thread Apache Jenkins Server 
See 

Changes:

[wangda] YARN-4454. NM to nodelabel mapping going wrong after RM restart. (Bibin

[wangda] YARN-4290. Add -showDetails option to YARN Nodes CLI to print all nodes

--
[...truncated 5413 lines...]
Running org.apache.hadoop.security.TestUserFromEnv
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.861 sec - in 
org.apache.hadoop.security.TestUserFromEnv
Running org.apache.hadoop.security.TestGroupsCaching
Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.01 sec - in 
org.apache.hadoop.security.TestGroupsCaching
Running org.apache.hadoop.security.ssl.TestSSLFactory
Tests run: 15, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.924 sec - in 
org.apache.hadoop.security.ssl.TestSSLFactory
Running org.apache.hadoop.security.ssl.TestReloadingX509TrustManager
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.887 sec - in 
org.apache.hadoop.security.ssl.TestReloadingX509TrustManager
Running org.apache.hadoop.security.TestUGILoginFromKeytab
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.034 sec - in 
org.apache.hadoop.security.TestUGILoginFromKeytab
Running org.apache.hadoop.security.TestUserGroupInformation
Tests run: 34, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.788 sec - in 
org.apache.hadoop.security.TestUserGroupInformation
Running org.apache.hadoop.security.TestUGIWithExternalKdc
Tests run: 1, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 0.079 sec - in 
org.apache.hadoop.security.TestUGIWithExternalKdc
Running org.apache.hadoop.security.http.TestCrossOriginFilter
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.468 sec - in 
org.apache.hadoop.security.http.TestCrossOriginFilter
Running org.apache.hadoop.security.TestProxyUserFromEnv
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.603 sec - in 
org.apache.hadoop.security.TestProxyUserFromEnv
Running org.apache.hadoop.security.authorize.TestProxyUsers
Tests run: 17, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.055 sec - in 
org.apache.hadoop.security.authorize.TestProxyUsers
Running org.apache.hadoop.security.authorize.TestProxyServers
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.484 sec - in 
org.apache.hadoop.security.authorize.TestProxyServers
Running org.apache.hadoop.security.authorize.TestServiceAuthorization
Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.408 sec - in 
org.apache.hadoop.security.authorize.TestServiceAuthorization
Running org.apache.hadoop.security.authorize.TestAccessControlList
Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.051 sec - in 
org.apache.hadoop.security.authorize.TestAccessControlList
Running org.apache.hadoop.security.alias.TestCredShell
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.824 sec - in 
org.apache.hadoop.security.alias.TestCredShell
Running org.apache.hadoop.security.alias.TestCredentialProviderFactory
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.746 sec - in 
org.apache.hadoop.security.alias.TestCredentialProviderFactory
Running org.apache.hadoop.security.alias.TestCredentialProvider
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.124 sec - in 
org.apache.hadoop.security.alias.TestCredentialProvider
Running org.apache.hadoop.security.TestAuthenticationFilter
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.059 sec - in 
org.apache.hadoop.security.TestAuthenticationFilter
Running org.apache.hadoop.security.TestLdapGroupsMapping
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.513 sec - in 
org.apache.hadoop.security.TestLdapGroupsMapping
Running org.apache.hadoop.security.token.TestToken
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.689 sec - in 
org.apache.hadoop.security.token.TestToken
Running org.apache.hadoop.security.token.delegation.TestDelegationToken
Tests run: 15, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 31.682 sec - 
in org.apache.hadoop.security.token.delegation.TestDelegationToken
Running 
org.apache.hadoop.security.token.delegation.web.TestDelegationTokenAuthenticationHandlerWithMocks
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.562 sec - in 
org.apache.hadoop.security.token.delegation.web.TestDelegationTokenAuthenticationHandlerWithMocks
Running 
org.apache.hadoop.security.token.delegation.web.TestDelegationTokenManager
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.909 sec - in 
org.apache.hadoop.security.token.delegation.web.TestDelegationTokenManager
Running org.apache.hadoop.security.token.delegation.web.TestWebDelegationToken
Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.574 sec - 
in org.apache.hadoop.security.token.delegation.web.TestWebDelegationToken
Running

Re: [VOTE] Release Apache Hadoop 2.7.2 RC1

2015-12-21 Thread Chen He 
+1 (non-binding)

deploy to a 2-node cluster
run loadgen and wc without problem


Kindly ask a silly question, why we separate 2.6.x from 2.7.x?

On Mon, Dec 21, 2015 at 11:51 AM, Wangda Tan  wrote:

> +1 (binding)
>
> - Build & deploy single-node Hadoop from source code
> - Add/Remove node labels to queues/nodes
> - Run distributed shell commanding using default/specified node labels
>
> Thanks,
> Wangda
>
>
> On Mon, Dec 21, 2015 at 9:58 AM, Masatake Iwasaki <
> iwasak...@oss.nttdata.co.jp> wrote:
>
> > +1(non-binding)
> >
> > - verified mds and signature of source and binary tarball
> > - started 3 node cluster and ran example jobs such as wordcount and
> > terasort
> > - built from source tarball with -Pnative on CentOS 7 and OpenJDK 7
> > - built site documentation and skimmed the contents
> >
> > Thanks,
> > Masatake Iwasaki
> >
> >
> >
> > On 12/17/15 11:49, Vinod Kumar Vavilapalli wrote:
> >
> >> Hi all,
> >>
> >> I've created a release candidate RC1 for Apache Hadoop 2.7.2.
> >>
> >> As discussed before, this is the next maintenance release to follow up
> >> 2.7.1.
> >>
> >> The RC is available for validation at:
> >> http://people.apache.org/~vinodkv/hadoop-2.7.2-RC1/ <
> >> http://people.apache.org/~vinodkv/hadoop-2.7.2-RC1/>
> >>
> >> The RC tag in git is: release-2.7.2-RC1
> >>
> >> The maven artifacts are available via repository.apache.org <
> >> http://repository.apache.org/> at
> >>
> https://repository.apache.org/content/repositories/orgapachehadoop-1026/
> >> <
> https://repository.apache.org/content/repositories/orgapachehadoop-1026/
> >> >
> >>
> >> The release-notes are inside the tar-balls at location
> >> hadoop-common-project/hadoop-common/src/main/docs/releasenotes.html. I
> >> hosted this at
> >> http://people.apache.org/~vinodkv/hadoop-2.7.2-RC1/releasenotes.html
> for
> >> quick perusal.
> >>
> >> As you may have noted,
> >>   - The RC0 related voting thread got halted due to some critical
> issues.
> >> It took a while again for getting all those blockers out of the way. See
> >> the previous voting thread [3] for details.
> >>   - Before RC0, an unusually long 2.6.3 release caused 2.7.2 to slip by
> >> quite a bit. This release's related discussion threads are linked below:
> >> [1] and [2].
> >>
> >> Please try the release and vote; the vote will run for the usual 5 days.
> >>
> >> Thanks,
> >> Vinod
> >>
> >> [1]: 2.7.2 release plan: http://markmail.org/message/oozq3gvd4nhzsaes <
> >> http://markmail.org/message/oozq3gvd4nhzsaes>
> >> [2]: Planning Apache Hadoop 2.7.2
> >> http://markmail.org/message/iktqss2qdeykgpqk <
> >> http://markmail.org/message/iktqss2qdeykgpqk>
> >> [3]: [VOTE] Release Apache Hadoop 2.7.2 RC0:
> >> http://markmail.org/message/5txhvr2qdiqglrwc
> >>
> >>
> >>
> >
>

[jira] [Created] (HADOOP-12663) Remove Hard-Coded Values From FileSystem.java

2015-12-21 Thread BELUGA BEHR (JIRA) 
BELUGA BEHR created HADOOP-12663:


 Summary: Remove Hard-Coded Values From FileSystem.java
 Key: HADOOP-12663
 URL: https://issues.apache.org/jira/browse/HADOOP-12663
 Project: Hadoop Common
  Issue Type: Improvement
  Components: fs
Affects Versions: 2.7.1
Reporter: BELUGA BEHR
Priority: Trivial


Within FileSystem.java, there is one instance where the global variables 
"CommonConfigurationKeysPublic.IO_FILE_BUFFER_SIZE_KEY" and 
"CommonConfigurationKeysPublic.IO_FILE_BUFFER_SIZE_DEFAULT" were being used, 
but in all other instances, their literal values were being used.

Please find attached a patch to remove use of literal values and instead 
replace them with references to the global variables.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (HADOOP-12664) UGI auto-renewer does not verify kinit availability during initialization

2015-12-21 Thread Arpit Agarwal (JIRA) 
Arpit Agarwal created HADOOP-12664:
--

 Summary: UGI auto-renewer does not verify kinit availability 
during initialization
 Key: HADOOP-12664
 URL: https://issues.apache.org/jira/browse/HADOOP-12664
 Project: Hadoop Common
  Issue Type: Improvement
Reporter: Arpit Agarwal
Priority: Minor


UGI auto-renewer does not verify that {{hadoop.kerberos.kinit.command}} is in 
the path during initialization. If not available, the auto-renewal thread will 
hit an error during TGT renewal. We recently saw a case where it manifests as 
transient errors during client program execution which can be hard to track 
down without UGI logging.

It seems like {{kinit}} availability should be verified during initialization 
to make the behavior more predictable.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: [VOTE] Release Apache Hadoop 2.7.2 RC1

2015-12-21 Thread Xuan Gong 
+1 (binding)

Thanks

Xuan Gong

> On Dec 21, 2015, at 4:25 PM, Chen He  wrote:
> 
> +1 (non-binding)
> 
> deploy to a 2-node cluster
> run loadgen and wc without problem
> 
> 
> Kindly ask a silly question, why we separate 2.6.x from 2.7.x?
> 
> On Mon, Dec 21, 2015 at 11:51 AM, Wangda Tan  wrote:
> 
>> +1 (binding)
>> 
>> - Build & deploy single-node Hadoop from source code
>> - Add/Remove node labels to queues/nodes
>> - Run distributed shell commanding using default/specified node labels
>> 
>> Thanks,
>> Wangda
>> 
>> 
>> On Mon, Dec 21, 2015 at 9:58 AM, Masatake Iwasaki <
>> iwasak...@oss.nttdata.co.jp> wrote:
>> 
>>> +1(non-binding)
>>> 
>>> - verified mds and signature of source and binary tarball
>>> - started 3 node cluster and ran example jobs such as wordcount and
>>> terasort
>>> - built from source tarball with -Pnative on CentOS 7 and OpenJDK 7
>>> - built site documentation and skimmed the contents
>>> 
>>> Thanks,
>>> Masatake Iwasaki
>>> 
>>> 
>>> 
>>> On 12/17/15 11:49, Vinod Kumar Vavilapalli wrote:
>>> 
 Hi all,
 
 I've created a release candidate RC1 for Apache Hadoop 2.7.2.
 
 As discussed before, this is the next maintenance release to follow up
 2.7.1.
 
 The RC is available for validation at:
 http://people.apache.org/~vinodkv/hadoop-2.7.2-RC1/ <
 http://people.apache.org/~vinodkv/hadoop-2.7.2-RC1/>
 
 The RC tag in git is: release-2.7.2-RC1
 
 The maven artifacts are available via repository.apache.org <
 http://repository.apache.org/> at
 
>> https://repository.apache.org/content/repositories/orgapachehadoop-1026/
 <
>> https://repository.apache.org/content/repositories/orgapachehadoop-1026/
> 
 
 The release-notes are inside the tar-balls at location
 hadoop-common-project/hadoop-common/src/main/docs/releasenotes.html. I
 hosted this at
 http://people.apache.org/~vinodkv/hadoop-2.7.2-RC1/releasenotes.html
>> for
 quick perusal.
 
 As you may have noted,
  - The RC0 related voting thread got halted due to some critical
>> issues.
 It took a while again for getting all those blockers out of the way. See
 the previous voting thread [3] for details.
  - Before RC0, an unusually long 2.6.3 release caused 2.7.2 to slip by
 quite a bit. This release's related discussion threads are linked below:
 [1] and [2].
 
 Please try the release and vote; the vote will run for the usual 5 days.
 
 Thanks,
 Vinod
 
 [1]: 2.7.2 release plan: http://markmail.org/message/oozq3gvd4nhzsaes <
 http://markmail.org/message/oozq3gvd4nhzsaes>
 [2]: Planning Apache Hadoop 2.7.2
 http://markmail.org/message/iktqss2qdeykgpqk <
 http://markmail.org/message/iktqss2qdeykgpqk>
 [3]: [VOTE] Release Apache Hadoop 2.7.2 RC0:
 http://markmail.org/message/5txhvr2qdiqglrwc
 
 
 
>>> 
>>

Build failed in Jenkins: Hadoop-common-trunk-Java8 #842

2015-12-21 Thread Apache Jenkins Server 
See 

Changes:

[aajisaka] HDFS-9505. HDFS Architecture documentation needs to be refreshed.

[aajisaka] Move HDFS-8914 from 2.8.0 to 2.7.3 in CHANGES.txt.

--
[...truncated 5809 lines...]
Tests run: 25, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.397 sec - in 
org.apache.hadoop.io.file.tfile.TestTFileLzoCodecsByteArrays
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.io.file.tfile.TestTFileLzoCodecsStreams
Tests run: 19, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.378 sec - in 
org.apache.hadoop.io.file.tfile.TestTFileLzoCodecsStreams
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.io.file.tfile.TestTFileUnsortedByteArrays
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.822 sec - in 
org.apache.hadoop.io.file.tfile.TestTFileUnsortedByteArrays
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.io.file.tfile.TestTFileStreams
Tests run: 19, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.376 sec - in 
org.apache.hadoop.io.file.tfile.TestTFileStreams
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.io.file.tfile.TestTFile
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.201 sec - in 
org.apache.hadoop.io.file.tfile.TestTFile
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running 
org.apache.hadoop.io.file.tfile.TestTFileNoneCodecsJClassComparatorByteArrays
Tests run: 25, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.284 sec - in 
org.apache.hadoop.io.file.tfile.TestTFileNoneCodecsJClassComparatorByteArrays
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.io.file.tfile.TestTFileJClassComparatorByteArrays
Tests run: 25, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.205 sec - in 
org.apache.hadoop.io.file.tfile.TestTFileJClassComparatorByteArrays
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.io.file.tfile.TestTFileNoneCodecsStreams
Tests run: 19, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.414 sec - in 
org.apache.hadoop.io.file.tfile.TestTFileNoneCodecsStreams
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.io.file.tfile.TestTFileSplit
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.262 sec - in 
org.apache.hadoop.io.file.tfile.TestTFileSplit
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.io.file.tfile.TestTFileComparator2
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.08 sec - in 
org.apache.hadoop.io.file.tfile.TestTFileComparator2
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.io.file.tfile.TestTFileNoneCodecsByteArrays
Tests run: 25, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.301 sec - in 
org.apache.hadoop.io.file.tfile.TestTFileNoneCodecsByteArrays
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.io.file.tfile.TestTFileByteArrays
Tests run: 25, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.188 sec - in 
org.apache.hadoop.io.file.tfile.TestTFileByteArrays
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.io.file.tfile.TestTFileSeqFileComparison
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.681 sec - in 
org.apache.hadoop.io.file.tfile.TestTFileSeqFileComparison
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.io.file.tfile.TestVLong
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.515 sec - in 
org.apache.hadoop.io.file.tfile.TestVLong
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.io.TestTextNonUTF8
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.21 sec - in 
org.apache.hadoop.io.TestTextNonUTF8
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.io.TestArrayWritable
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.198 sec - in 
org.apache.hadoop.io.TestArrayWritable
Java HotSpot(TM) 64-Bit Server VM warning:

Re: [VOTE] Release Apache Hadoop 2.7.2 RC1

2015-12-21 Thread Sunil Govind 
+1 (Non Binding)

* Built tar ball from source and deployed
* Ran few MR Jobs successfully. Also tested preemption, node labels sanity
scenarios including  HA.
* Verified RM Web UI and ran few REST queries. Seems fine.
* CLI commands related to refresh are also working fine.

Thanks and Regards
Sunil G


On Mon, Dec 21, 2015 at 5:41 PM Naganarasimha G R (Naga) <
garlanaganarasi...@huawei.com> wrote:

> +1 (Non binding)
>
> * Release notes and CHANGES.txt looked fine
> * Verified md5 checksums for both source and binary tar balls
> * Ran `mvn apache-rat:check` on source tarball, passed
> * Installed pseudo cluster
> * Did some basic filesystem operations
> * Ran a grep, sleepjob, word count successfully
> * Verified the jobs RM, job history server and ATS Web ui's successfully
> * Verified some RM REST apis
> * Verified basic admin operations of Node Labels.
>
> Regards,
>  +Naga
> 
> From: Akira AJISAKA [ajisa...@oss.nttdata.co.jp]
> Sent: Monday, December 21, 2015 14:29
> To: common-dev@hadoop.apache.org; mapreduce-...@hadoop.apache.org;
> hdfs-...@hadoop.apache.org; yarn-...@hadoop.apache.org
> Subject: Re: [VOTE] Release Apache Hadoop 2.7.2 RC1
>
> +1 (binding)
>
> - Downloaded source tarball
> - Verified signatures and checksums
> - Compiled and built a single node cluster
> - Confirmed commons-collections is upgraded to 3.2.2
> - Compiled Hive 1.2.1 and Tez 0.7.0/0.8.1-alpha using Hadoop 2.7.2 pom
> successfully
> - Ran some Hive on Tez/MRv2 queries successfully
>
> On 12/19/15 02:24, Jason Lowe wrote:
> > +1 (binding)
> > - Verified signatures and digests- Spot checked CHANGES.txt files-
> Successfully performed a native build from source- Deployed to a single
> node cluster and ran sample jobs
> > We have been running with the fix for YARN-4354 on two of our clusters
> for some time with no issues, so I feel confident that prior blocker is now
> fixed.
> > Jason
> >
> >
> >From: Vinod Kumar Vavilapalli 
> >   To: Hadoop Common ;
> hdfs-...@hadoop.apache.org; yarn-...@hadoop.apache.org;
> mapreduce-...@hadoop.apache.org
> > Cc: Vinod Kumar Vavilapalli 
> >   Sent: Wednesday, December 16, 2015 8:49 PM
> >   Subject: [VOTE] Release Apache Hadoop 2.7.2 RC1
> >
> > Hi all,
> >
> > I've created a release candidate RC1 for Apache Hadoop 2.7.2.
> >
> > As discussed before, this is the next maintenance release to follow up
> 2.7.1.
> >
> > The RC is available for validation at:
> http://people.apache.org/~vinodkv/hadoop-2.7.2-RC1/ <
> http://people.apache.org/~vinodkv/hadoop-2.7.2-RC1/>
> >
> > The RC tag in git is: release-2.7.2-RC1
> >
> > The maven artifacts are available via repository.apache.org <
> http://repository.apache.org/> at
> https://repository.apache.org/content/repositories/orgapachehadoop-1026/ <
> https://repository.apache.org/content/repositories/orgapachehadoop-1026/>
> >
> > The release-notes are inside the tar-balls at location
> hadoop-common-project/hadoop-common/src/main/docs/releasenotes.html. I
> hosted this at
> http://people.apache.org/~vinodkv/hadoop-2.7.2-RC1/releasenotes.html for
> quick perusal.
> >
> > As you may have noted,
> >   - The RC0 related voting thread got halted due to some critical
> issues. It took a while again for getting all those blockers out of the
> way. See the previous voting thread [3] for details.
> >   - Before RC0, an unusually long 2.6.3 release caused 2.7.2 to slip by
> quite a bit. This release's related discussion threads are linked below:
> [1] and [2].
> >
> > Please try the release and vote; the vote will run for the usual 5 days.
> >
> > Thanks,
> > Vinod
> >
> > [1]: 2.7.2 release plan: http://markmail.org/message/oozq3gvd4nhzsaes <
> http://markmail.org/message/oozq3gvd4nhzsaes>
> > [2]: Planning Apache Hadoop 2.7.2
> http://markmail.org/message/iktqss2qdeykgpqk <
> http://markmail.org/message/iktqss2qdeykgpqk>
> > [3]: [VOTE] Release Apache Hadoop 2.7.2 RC0:
> http://markmail.org/message/5txhvr2qdiqglrwc
> >
> >
> >
> >
>
>

Re: Highlighting communication on releases

2015-12-21 Thread Junping Du 
Thanks Karthik to bring up the topic. Comparing with small enhancement on email 
distribution for release/branch news, I think a more important thing is to make 
our community (contributor & committer) to be more aware on ongoing 
releases/branches.

I can see two improvements could be helpful here:
  - Beside email thread, we can have a central place (like wiki page: 
HowToContribute/HowToCommit) to keep updating the commit instructions/details 
for each releasing/unreleased branches by release manager.
   Following is a quick example:
   /***
   prior to 2.6: closed to commit
   ...
   2.6.4: commit to trunk, branch-2 and branch-2.6
   2.7.2: commit to trunk, branch-2, branch-2.7 and branch-2.7.2 (assume RC
hasn't been out which is not true today.)
   2.8: commit to trunk, branch-2 and branch-2.8
   2.9: commit to trunk and branch-2
   ...
   ***/
   Both contributor and committer can keep an eye on it.

  - Add a tools in post-commit to check if fix version is match with commits
landing on related branches. If not, send notifications to patch contributor, 
committer (and
may be release manager also) to correct it asap.

Thoughts?

Thanks,

Junping


From: Karthik Kambatla 
Sent: Monday, December 21, 2015 4:59 AM
To: common-dev@hadoop.apache.org; hdfs-...@hadoop.apache.org; 
yarn-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org
Subject: Highlighting communication on releases

Hi folks

In the last few months, we have been shipping multiple releases -
maintenance and minor - elevating the quality and purpose of our releases.

With the increase in releases and related communication, I wonder if we
need to highlight release-related communication in some way. Otherwise, it
is easy to miss the details in the plethora of emails on dev lists. For
instance, it appears committers might have missed the detail that
branch-2.8 was cut.

A couple of options I see:

   1. Tag release-related emails with [RELEASE] or some other appropriate
   tag.
   2. Separate mailing list for release specific information. May be, this
   list could be used for other project-level topics as well. common-dev@
   has been overloaded for both common-specific and project-level discussions.
   Also, folks wouldn't have to email all -dev@lists.

Would like to hear others' thoughts on the matter.

Karthik

Re: [VOTE] Release Apache Hadoop 2.7.2 RC1

2015-12-21 Thread Arpit Agarwal 
Thanks for putting together this release Vinod.

+1 (binding)

 - Verified signatures
 - Started pseudo-cluster with binary distribution, verified git commit ID
 - Built sources, deployed pseudo-cluster and ran example map reduce jobs, 
DistributedShell, HDFS commands.


PS: Extra file hadoop-2.7.2-RC1-src.tar.gz.md5?





On 12/16/15, 6:49 PM, "Vinod Kumar Vavilapalli"  wrote:

>Hi all,
>
>I've created a release candidate RC1 for Apache Hadoop 2.7.2.
>
>As discussed before, this is the next maintenance release to follow up 2.7.1.
>
>The RC is available for validation at: 
>http://people.apache.org/~vinodkv/hadoop-2.7.2-RC1/ 
>
>
>The RC tag in git is: release-2.7.2-RC1
>
>The maven artifacts are available via repository.apache.org 
> at 
>https://repository.apache.org/content/repositories/orgapachehadoop-1026/ 
>
>
>The release-notes are inside the tar-balls at location 
>hadoop-common-project/hadoop-common/src/main/docs/releasenotes.html. I hosted 
>this at http://people.apache.org/~vinodkv/hadoop-2.7.2-RC1/releasenotes.html 
>for quick perusal.
>
>As you may have noted,
> - The RC0 related voting thread got halted due to some critical issues. It 
> took a while again for getting all those blockers out of the way. See the 
> previous voting thread [3] for details.
> - Before RC0, an unusually long 2.6.3 release caused 2.7.2 to slip by quite a 
> bit. This release's related discussion threads are linked below: [1] and [2].
>
>Please try the release and vote; the vote will run for the usual 5 days.
>
>Thanks,
>Vinod
>
>[1]: 2.7.2 release plan: http://markmail.org/message/oozq3gvd4nhzsaes 
>
>[2]: Planning Apache Hadoop 2.7.2 http://markmail.org/message/iktqss2qdeykgpqk 
>
>[3]: [VOTE] Release Apache Hadoop 2.7.2 RC0: 
>http://markmail.org/message/5txhvr2qdiqglrwc
>

Build failed in Jenkins: Hadoop-Common-trunk #2140

2015-12-21 Thread Apache Jenkins Server 
See 

Changes:

[cnauroth] YARN-3458. CPU resource monitoring in Windows. Contributed by Inigo

--
[...truncated 3875 lines...]
Generating 

Building index for all classes...
Generating 

Generating 

Generating 

Generating 

Generating 

[INFO] Building jar: 

[INFO] 
[INFO] 
[INFO] Building Apache Hadoop MiniKDC 3.0.0-SNAPSHOT
[INFO] 
[INFO] 
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ hadoop-minikdc ---
[INFO] Deleting 

[INFO] 
[INFO] --- findbugs-maven-plugin:3.0.0:findbugs (default-cli) @ hadoop-minikdc 
---
[INFO] 
[INFO] --- maven-checkstyle-plugin:2.15:checkstyle (default-cli) @ 
hadoop-minikdc ---
[INFO] There are 9 errors reported by Checkstyle 6.6 with 
checkstyle/checkstyle.xml ruleset.
[WARNING] Unable to locate Source XRef to link to - DISABLED
[INFO] 
[INFO] --- maven-antrun-plugin:1.7:run (create-testdirs) @ hadoop-minikdc ---
[INFO] Executing tasks

main:
[mkdir] Created dir: 

[INFO] Executed tasks
[INFO] 
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ 
hadoop-minikdc ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ hadoop-minikdc 
---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 2 source files to 

[INFO] 
[INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ 
hadoop-minikdc ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory 

[INFO] 
[INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ 
hadoop-minikdc ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 2 source files to 

[INFO] 
[INFO] --- maven-surefire-plugin:2.17:test (default-test) @ hadoop-minikdc ---
[INFO] Surefire report directory: 


---
 T E S T S
---

---
 T E S T S
---
Running org.apache.hadoop.minikdc.TestMiniKdc
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.995 sec - in 
org.apache.hadoop.minikdc.TestMiniKdc
Running org.apache.hadoop.minikdc.TestChangeOrgNameAndDomain
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.461 sec - in 
org.apache.hadoop.minikdc.TestChangeOrgNameAndDomain

Results :

Tests run: 6, Failures: 0, Errors: 0, Skipped: 0

[INFO] 
[INFO] --- maven-jar-plugin:2.5:jar (default-jar) @ hadoop-minikdc ---
[INFO] Building jar: 

[INFO] 
[INFO] --- maven-source-plugin:2.3:jar-no-fork (hadoop-java-sources) @ 
hadoop-minikdc ---
[INFO] Building jar: 

[INFO] 
[INFO] --- maven-source-plugin:2.3:test-jar-no-fork (hadoop-java-sources) @ 
hadoop-minikdc ---
[INFO] Building jar:

[jira] [Created] (HADOOP-12665) Document hadoop.security.token.service.use_ip

2015-12-21 Thread Arpit Agarwal (JIRA) 
Arpit Agarwal created HADOOP-12665:
--

 Summary: Document hadoop.security.token.service.use_ip
 Key: HADOOP-12665
 URL: https://issues.apache.org/jira/browse/HADOOP-12665
 Project: Hadoop Common
  Issue Type: Improvement
  Components: documentation
Affects Versions: 2.8.0
Reporter: Arpit Agarwal


{{hadoop.security.token.service.use_ip}} is not documented in 2.x/trunk.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

RE: [VOTE] Release Apache Hadoop 2.7.2 RC1

2015-12-21 Thread Rohith Sharma K S 
+1(non-binding)
-Built from source and deployed in 3 node cluster
-Tested with combination of RMRestart/RM HA/RM work preserving restart/NM work 
preserving restart modes.
-Ran MR and distributed shell sample applications.
-Verified signature and md5 of binary

Thanks & Regards
Rohith Sharma K S


-Original Message-
From: Tsuyoshi Ozawa [mailto:oz...@apache.org] 
Sent: 22 December 2015 09:04
To: common-dev@hadoop.apache.org
Cc: yarn-...@hadoop.apache.org; hdfs-...@hadoop.apache.org; 
mapreduce-...@hadoop.apache.org; Vinod Kumar Vavilapalli
Subject: Re: [VOTE] Release Apache Hadoop 2.7.2 RC1

+1

- downloaded src and bin tar balls and verified signatures.
- built Tez and Spark with 2.7.2 artifacts and JDK7.
- ran tests of Tez with 2.7.2 artifacts, it passed.

FYI: YARN-4348, reported by Jian, is one of critical issues of 2.7.2 
release.It's better to release 2.7.3 as soon as possible after this release.

Thanks,
- Tsuyoshi

On Tue, Dec 22, 2015 at 4:51 AM, Wangda Tan  wrote:
> +1 (binding)
>
> - Build & deploy single-node Hadoop from source code
> - Add/Remove node labels to queues/nodes
> - Run distributed shell commanding using default/specified node labels
>
> Thanks,
> Wangda
>
>
> On Mon, Dec 21, 2015 at 9:58 AM, Masatake Iwasaki < 
> iwasak...@oss.nttdata.co.jp> wrote:
>
>> +1(non-binding)
>>
>> - verified mds and signature of source and binary tarball
>> - started 3 node cluster and ran example jobs such as wordcount and 
>> terasort
>> - built from source tarball with -Pnative on CentOS 7 and OpenJDK 7
>> - built site documentation and skimmed the contents
>>
>> Thanks,
>> Masatake Iwasaki
>>
>>
>>
>> On 12/17/15 11:49, Vinod Kumar Vavilapalli wrote:
>>
>>> Hi all,
>>>
>>> I've created a release candidate RC1 for Apache Hadoop 2.7.2.
>>>
>>> As discussed before, this is the next maintenance release to follow 
>>> up 2.7.1.
>>>
>>> The RC is available for validation at:
>>> http://people.apache.org/~vinodkv/hadoop-2.7.2-RC1/ < 
>>> http://people.apache.org/~vinodkv/hadoop-2.7.2-RC1/>
>>>
>>> The RC tag in git is: release-2.7.2-RC1
>>>
>>> The maven artifacts are available via repository.apache.org < 
>>> http://repository.apache.org/> at 
>>> https://repository.apache.org/content/repositories/orgapachehadoop-1
>>> 026/ 
>>> >> 1026/
>>> >
>>>
>>> The release-notes are inside the tar-balls at location 
>>> hadoop-common-project/hadoop-common/src/main/docs/releasenotes.html. 
>>> I hosted this at 
>>> http://people.apache.org/~vinodkv/hadoop-2.7.2-RC1/releasenotes.html 
>>> for quick perusal.
>>>
>>> As you may have noted,
>>>   - The RC0 related voting thread got halted due to some critical issues.
>>> It took a while again for getting all those blockers out of the way. 
>>> See the previous voting thread [3] for details.
>>>   - Before RC0, an unusually long 2.6.3 release caused 2.7.2 to slip 
>>> by quite a bit. This release's related discussion threads are linked below:
>>> [1] and [2].
>>>
>>> Please try the release and vote; the vote will run for the usual 5 days.
>>>
>>> Thanks,
>>> Vinod
>>>
>>> [1]: 2.7.2 release plan: 
>>> http://markmail.org/message/oozq3gvd4nhzsaes < 
>>> http://markmail.org/message/oozq3gvd4nhzsaes>
>>> [2]: Planning Apache Hadoop 2.7.2
>>> http://markmail.org/message/iktqss2qdeykgpqk < 
>>> http://markmail.org/message/iktqss2qdeykgpqk>
>>> [3]: [VOTE] Release Apache Hadoop 2.7.2 RC0:
>>> http://markmail.org/message/5txhvr2qdiqglrwc
>>>
>>>
>>>
>>

Re: [VOTE] Release Apache Hadoop 2.7.2 RC1

2015-12-21 Thread Chen He 
I see, thank you for the reply, Mr. Tsuyoshi Ozawa

Regards

Chen

Chen He@Oracle from Samsung Mega
On Dec 21, 2015 7:35 PM, "Tsuyoshi Ozawa"  wrote:

> Hi Chen,
>
> > Kindly ask a silly question, why we separate 2.6.x from 2.7.x?
>
> 2.6.x is the last release which supports JDK6.
>
> Thanks,
> - Tsuyoshi
>
> On Tue, Dec 22, 2015 at 9:25 AM, Chen He  wrote:
> > +1 (non-binding)
> >
> > deploy to a 2-node cluster
> > run loadgen and wc without problem
> >
> >
> > Kindly ask a silly question, why we separate 2.6.x from 2.7.x?
> >
> > On Mon, Dec 21, 2015 at 11:51 AM, Wangda Tan 
> wrote:
> >
> >> +1 (binding)
> >>
> >> - Build & deploy single-node Hadoop from source code
> >> - Add/Remove node labels to queues/nodes
> >> - Run distributed shell commanding using default/specified node labels
> >>
> >> Thanks,
> >> Wangda
> >>
> >>
> >> On Mon, Dec 21, 2015 at 9:58 AM, Masatake Iwasaki <
> >> iwasak...@oss.nttdata.co.jp> wrote:
> >>
> >> > +1(non-binding)
> >> >
> >> > - verified mds and signature of source and binary tarball
> >> > - started 3 node cluster and ran example jobs such as wordcount and
> >> > terasort
> >> > - built from source tarball with -Pnative on CentOS 7 and OpenJDK 7
> >> > - built site documentation and skimmed the contents
> >> >
> >> > Thanks,
> >> > Masatake Iwasaki
> >> >
> >> >
> >> >
> >> > On 12/17/15 11:49, Vinod Kumar Vavilapalli wrote:
> >> >
> >> >> Hi all,
> >> >>
> >> >> I've created a release candidate RC1 for Apache Hadoop 2.7.2.
> >> >>
> >> >> As discussed before, this is the next maintenance release to follow
> up
> >> >> 2.7.1.
> >> >>
> >> >> The RC is available for validation at:
> >> >> http://people.apache.org/~vinodkv/hadoop-2.7.2-RC1/ <
> >> >> http://people.apache.org/~vinodkv/hadoop-2.7.2-RC1/>
> >> >>
> >> >> The RC tag in git is: release-2.7.2-RC1
> >> >>
> >> >> The maven artifacts are available via repository.apache.org <
> >> >> http://repository.apache.org/> at
> >> >>
> >>
> https://repository.apache.org/content/repositories/orgapachehadoop-1026/
> >> >> <
> >>
> https://repository.apache.org/content/repositories/orgapachehadoop-1026/
> >> >> >
> >> >>
> >> >> The release-notes are inside the tar-balls at location
> >> >> hadoop-common-project/hadoop-common/src/main/docs/releasenotes.html.
> I
> >> >> hosted this at
> >> >> http://people.apache.org/~vinodkv/hadoop-2.7.2-RC1/releasenotes.html
> >> for
> >> >> quick perusal.
> >> >>
> >> >> As you may have noted,
> >> >>   - The RC0 related voting thread got halted due to some critical
> >> issues.
> >> >> It took a while again for getting all those blockers out of the way.
> See
> >> >> the previous voting thread [3] for details.
> >> >>   - Before RC0, an unusually long 2.6.3 release caused 2.7.2 to slip
> by
> >> >> quite a bit. This release's related discussion threads are linked
> below:
> >> >> [1] and [2].
> >> >>
> >> >> Please try the release and vote; the vote will run for the usual 5
> days.
> >> >>
> >> >> Thanks,
> >> >> Vinod
> >> >>
> >> >> [1]: 2.7.2 release plan:
> http://markmail.org/message/oozq3gvd4nhzsaes <
> >> >> http://markmail.org/message/oozq3gvd4nhzsaes>
> >> >> [2]: Planning Apache Hadoop 2.7.2
> >> >> http://markmail.org/message/iktqss2qdeykgpqk <
> >> >> http://markmail.org/message/iktqss2qdeykgpqk>
> >> >> [3]: [VOTE] Release Apache Hadoop 2.7.2 RC0:
> >> >> http://markmail.org/message/5txhvr2qdiqglrwc
> >> >>
> >> >>
> >> >>
> >> >
> >>
>

Re: [VOTE] Release Apache Hadoop 2.7.2 RC1

2015-12-21 Thread Tsuyoshi Ozawa 
Hi Chen,

> Kindly ask a silly question, why we separate 2.6.x from 2.7.x?

2.6.x is the last release which supports JDK6.

Thanks,
- Tsuyoshi

On Tue, Dec 22, 2015 at 9:25 AM, Chen He  wrote:
> +1 (non-binding)
>
> deploy to a 2-node cluster
> run loadgen and wc without problem
>
>
> Kindly ask a silly question, why we separate 2.6.x from 2.7.x?
>
> On Mon, Dec 21, 2015 at 11:51 AM, Wangda Tan  wrote:
>
>> +1 (binding)
>>
>> - Build & deploy single-node Hadoop from source code
>> - Add/Remove node labels to queues/nodes
>> - Run distributed shell commanding using default/specified node labels
>>
>> Thanks,
>> Wangda
>>
>>
>> On Mon, Dec 21, 2015 at 9:58 AM, Masatake Iwasaki <
>> iwasak...@oss.nttdata.co.jp> wrote:
>>
>> > +1(non-binding)
>> >
>> > - verified mds and signature of source and binary tarball
>> > - started 3 node cluster and ran example jobs such as wordcount and
>> > terasort
>> > - built from source tarball with -Pnative on CentOS 7 and OpenJDK 7
>> > - built site documentation and skimmed the contents
>> >
>> > Thanks,
>> > Masatake Iwasaki
>> >
>> >
>> >
>> > On 12/17/15 11:49, Vinod Kumar Vavilapalli wrote:
>> >
>> >> Hi all,
>> >>
>> >> I've created a release candidate RC1 for Apache Hadoop 2.7.2.
>> >>
>> >> As discussed before, this is the next maintenance release to follow up
>> >> 2.7.1.
>> >>
>> >> The RC is available for validation at:
>> >> http://people.apache.org/~vinodkv/hadoop-2.7.2-RC1/ <
>> >> http://people.apache.org/~vinodkv/hadoop-2.7.2-RC1/>
>> >>
>> >> The RC tag in git is: release-2.7.2-RC1
>> >>
>> >> The maven artifacts are available via repository.apache.org <
>> >> http://repository.apache.org/> at
>> >>
>> https://repository.apache.org/content/repositories/orgapachehadoop-1026/
>> >> <
>> https://repository.apache.org/content/repositories/orgapachehadoop-1026/
>> >> >
>> >>
>> >> The release-notes are inside the tar-balls at location
>> >> hadoop-common-project/hadoop-common/src/main/docs/releasenotes.html. I
>> >> hosted this at
>> >> http://people.apache.org/~vinodkv/hadoop-2.7.2-RC1/releasenotes.html
>> for
>> >> quick perusal.
>> >>
>> >> As you may have noted,
>> >>   - The RC0 related voting thread got halted due to some critical
>> issues.
>> >> It took a while again for getting all those blockers out of the way. See
>> >> the previous voting thread [3] for details.
>> >>   - Before RC0, an unusually long 2.6.3 release caused 2.7.2 to slip by
>> >> quite a bit. This release's related discussion threads are linked below:
>> >> [1] and [2].
>> >>
>> >> Please try the release and vote; the vote will run for the usual 5 days.
>> >>
>> >> Thanks,
>> >> Vinod
>> >>
>> >> [1]: 2.7.2 release plan: http://markmail.org/message/oozq3gvd4nhzsaes <
>> >> http://markmail.org/message/oozq3gvd4nhzsaes>
>> >> [2]: Planning Apache Hadoop 2.7.2
>> >> http://markmail.org/message/iktqss2qdeykgpqk <
>> >> http://markmail.org/message/iktqss2qdeykgpqk>
>> >> [3]: [VOTE] Release Apache Hadoop 2.7.2 RC0:
>> >> http://markmail.org/message/5txhvr2qdiqglrwc
>> >>
>> >>
>> >>
>> >
>>

Re: [VOTE] Release Apache Hadoop 2.7.2 RC1

2015-12-21 Thread Tsuyoshi Ozawa 
+1

- downloaded src and bin tar balls and verified signatures.
- built Tez and Spark with 2.7.2 artifacts and JDK7.
- ran tests of Tez with 2.7.2 artifacts, it passed.

FYI: YARN-4348, reported by Jian, is one of critical issues of 2.7.2
release.It's better to release 2.7.3 as soon as possible after this
release.

Thanks,
- Tsuyoshi

On Tue, Dec 22, 2015 at 4:51 AM, Wangda Tan  wrote:
> +1 (binding)
>
> - Build & deploy single-node Hadoop from source code
> - Add/Remove node labels to queues/nodes
> - Run distributed shell commanding using default/specified node labels
>
> Thanks,
> Wangda
>
>
> On Mon, Dec 21, 2015 at 9:58 AM, Masatake Iwasaki <
> iwasak...@oss.nttdata.co.jp> wrote:
>
>> +1(non-binding)
>>
>> - verified mds and signature of source and binary tarball
>> - started 3 node cluster and ran example jobs such as wordcount and
>> terasort
>> - built from source tarball with -Pnative on CentOS 7 and OpenJDK 7
>> - built site documentation and skimmed the contents
>>
>> Thanks,
>> Masatake Iwasaki
>>
>>
>>
>> On 12/17/15 11:49, Vinod Kumar Vavilapalli wrote:
>>
>>> Hi all,
>>>
>>> I've created a release candidate RC1 for Apache Hadoop 2.7.2.
>>>
>>> As discussed before, this is the next maintenance release to follow up
>>> 2.7.1.
>>>
>>> The RC is available for validation at:
>>> http://people.apache.org/~vinodkv/hadoop-2.7.2-RC1/ <
>>> http://people.apache.org/~vinodkv/hadoop-2.7.2-RC1/>
>>>
>>> The RC tag in git is: release-2.7.2-RC1
>>>
>>> The maven artifacts are available via repository.apache.org <
>>> http://repository.apache.org/> at
>>> https://repository.apache.org/content/repositories/orgapachehadoop-1026/
>>> >> >
>>>
>>> The release-notes are inside the tar-balls at location
>>> hadoop-common-project/hadoop-common/src/main/docs/releasenotes.html. I
>>> hosted this at
>>> http://people.apache.org/~vinodkv/hadoop-2.7.2-RC1/releasenotes.html for
>>> quick perusal.
>>>
>>> As you may have noted,
>>>   - The RC0 related voting thread got halted due to some critical issues.
>>> It took a while again for getting all those blockers out of the way. See
>>> the previous voting thread [3] for details.
>>>   - Before RC0, an unusually long 2.6.3 release caused 2.7.2 to slip by
>>> quite a bit. This release's related discussion threads are linked below:
>>> [1] and [2].
>>>
>>> Please try the release and vote; the vote will run for the usual 5 days.
>>>
>>> Thanks,
>>> Vinod
>>>
>>> [1]: 2.7.2 release plan: http://markmail.org/message/oozq3gvd4nhzsaes <
>>> http://markmail.org/message/oozq3gvd4nhzsaes>
>>> [2]: Planning Apache Hadoop 2.7.2
>>> http://markmail.org/message/iktqss2qdeykgpqk <
>>> http://markmail.org/message/iktqss2qdeykgpqk>
>>> [3]: [VOTE] Release Apache Hadoop 2.7.2 RC0:
>>> http://markmail.org/message/5txhvr2qdiqglrwc
>>>
>>>
>>>
>>

Re: [VOTE] Release Apache Hadoop 2.7.2 RC1

2015-12-21 Thread Akira AJISAKA 

+1 (binding)

- Downloaded source tarball
- Verified signatures and checksums
- Compiled and built a single node cluster
- Confirmed commons-collections is upgraded to 3.2.2
- Compiled Hive 1.2.1 and Tez 0.7.0/0.8.1-alpha using Hadoop 2.7.2 pom 
successfully

- Ran some Hive on Tez/MRv2 queries successfully

On 12/19/15 02:24, Jason Lowe wrote:

+1 (binding)
- Verified signatures and digests- Spot checked CHANGES.txt files- Successfully 
performed a native build from source- Deployed to a single node cluster and ran 
sample jobs
We have been running with the fix for YARN-4354 on two of our clusters for some 
time with no issues, so I feel confident that prior blocker is now fixed.
Jason


   From: Vinod Kumar Vavilapalli 
  To: Hadoop Common ; hdfs-...@hadoop.apache.org; 
yarn-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org
Cc: Vinod Kumar Vavilapalli 
  Sent: Wednesday, December 16, 2015 8:49 PM
  Subject: [VOTE] Release Apache Hadoop 2.7.2 RC1

Hi all,

I've created a release candidate RC1 for Apache Hadoop 2.7.2.

As discussed before, this is the next maintenance release to follow up 2.7.1.

The RC is available for validation at: 
http://people.apache.org/~vinodkv/hadoop-2.7.2-RC1/ 


The RC tag in git is: release-2.7.2-RC1

The maven artifacts are available via repository.apache.org 
 at 
https://repository.apache.org/content/repositories/orgapachehadoop-1026/ 


The release-notes are inside the tar-balls at location 
hadoop-common-project/hadoop-common/src/main/docs/releasenotes.html. I hosted 
this at http://people.apache.org/~vinodkv/hadoop-2.7.2-RC1/releasenotes.html 
for quick perusal.

As you may have noted,
  - The RC0 related voting thread got halted due to some critical issues. It 
took a while again for getting all those blockers out of the way. See the 
previous voting thread [3] for details.
  - Before RC0, an unusually long 2.6.3 release caused 2.7.2 to slip by quite a 
bit. This release's related discussion threads are linked below: [1] and [2].

Please try the release and vote; the vote will run for the usual 5 days.

Thanks,
Vinod

[1]: 2.7.2 release plan: http://markmail.org/message/oozq3gvd4nhzsaes 

[2]: Planning Apache Hadoop 2.7.2 http://markmail.org/message/iktqss2qdeykgpqk 

[3]: [VOTE] Release Apache Hadoop 2.7.2 RC0: 
http://markmail.org/message/5txhvr2qdiqglrwc

Build failed in Jenkins: Hadoop-common-trunk-Java8 #845

2015-12-21 Thread Apache Jenkins Server 
See 

Changes:

[zhz] HDFS-9580. TestComputeInvalidateWork#testDatanodeReRegistration failed

[Arun Suresh] YARN-4477. FairScheduler: Handle condition which can result in an

[szetszwo] HDFS-9575. Use byte array for internal block indices in a striped 
block.

--
[...truncated 9637 lines...]
[WARNING] ^
[WARNING] 
:54:
 warning: no @param for xdr
[WARNING] public static XDR writeMountList(XDR xdr, int xid, List 
mounts) {
[WARNING] ^
[WARNING] 
:54:
 warning: no @param for xid
[WARNING] public static XDR writeMountList(XDR xdr, int xid, List 
mounts) {
[WARNING] ^
[WARNING] 
:54:
 warning: no @param for mounts
[WARNING] public static XDR writeMountList(XDR xdr, int xid, List 
mounts) {
[WARNING] ^
[WARNING] 
:54:
 warning: no @return
[WARNING] public static XDR writeMountList(XDR xdr, int xid, List 
mounts) {
[WARNING] ^
[WARNING] 
:66:
 warning: no @param for xdr
[WARNING] public static XDR writeExportList(XDR xdr, int xid, List 
exports,
[WARNING] ^
[WARNING] 
:66:
 warning: no @param for xid
[WARNING] public static XDR writeExportList(XDR xdr, int xid, List 
exports,
[WARNING] ^
[WARNING] 
:66:
 warning: no @param for exports
[WARNING] public static XDR writeExportList(XDR xdr, int xid, List 
exports,
[WARNING] ^
[WARNING] 
:66:
 warning: no @param for hostMatcher
[WARNING] public static XDR writeExportList(XDR xdr, int xid, List 
exports,
[WARNING] ^
[WARNING] 
:66:
 warning: no @return
[WARNING] public static XDR writeExportList(XDR xdr, int xid, List 
exports,
[WARNING] ^
[WARNING] 
:176:
 warning: no @return
[WARNING] public String[] getHostGroupList() {
[WARNING] ^
[WARNING] 
:58:
 warning: no @return
[WARNING] public long getMilliSeconds() {
[WARNING] ^
[WARNING] 
:44:
 warning: no @param for xdr
[WARNING] public abstract void serialize(XDR xdr);
[WARNING] ^
[WARNING] 
:49:
 warning: no @param for v
[WARNING] public FileHandle(long v) {
[WARNING] ^
[WARNING] 
:80:
 warning: no @param for value
[WARNING] public static NFSPROC3 fromValue(int value) {
[WARNING] ^
[WARNING] 
:30:
 warning: no @return
[WARNING] public NFS3Response nullProcedure();
[WARNING] ^
[WARNING] 
:33:
 warning: no @param for xdr
[WARNING] public NFS3Response getattr(XDR xdr, RpcInfo info);
[WARNING] ^
[WARNING] 
:33:
 warning: no @param for info
[WARNING] public NFS3Response getattr(XDR xdr, RpcInfo info);

Re: [VOTE] Release Apache Hadoop 2.7.2 RC1

2015-12-21 Thread Kihwal Lee 
+1 (binding)- Verified the signature/digest.
- I've built the dist tree with the native support from the source.- Brought up 
a single node cluster and ran a set of basic tests.

 

  From: Vinod Kumar Vavilapalli 
 To: Hadoop Common ; hdfs-...@hadoop.apache.org; 
yarn-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org 
Cc: Vinod Kumar Vavilapalli 
 Sent: Wednesday, December 16, 2015 8:49 PM
 Subject: [VOTE] Release Apache Hadoop 2.7.2 RC1
   
Hi all,

I've created a release candidate RC1 for Apache Hadoop 2.7.2.

As discussed before, this is the next maintenance release to follow up 2.7.1.

The RC is available for validation at: 
http://people.apache.org/~vinodkv/hadoop-2.7.2-RC1/ 


The RC tag in git is: release-2.7.2-RC1

The maven artifacts are available via repository.apache.org 
 at 
https://repository.apache.org/content/repositories/orgapachehadoop-1026/ 


The release-notes are inside the tar-balls at location 
hadoop-common-project/hadoop-common/src/main/docs/releasenotes.html. I hosted 
this at http://people.apache.org/~vinodkv/hadoop-2.7.2-RC1/releasenotes.html 
for quick perusal.

As you may have noted,
 - The RC0 related voting thread got halted due to some critical issues. It 
took a while again for getting all those blockers out of the way. See the 
previous voting thread [3] for details.
 - Before RC0, an unusually long 2.6.3 release caused 2.7.2 to slip by quite a 
bit. This release's related discussion threads are linked below: [1] and [2].

Please try the release and vote; the vote will run for the usual 5 days.

Thanks,
Vinod

[1]: 2.7.2 release plan: http://markmail.org/message/oozq3gvd4nhzsaes 

[2]: Planning Apache Hadoop 2.7.2 http://markmail.org/message/iktqss2qdeykgpqk 

[3]: [VOTE] Release Apache Hadoop 2.7.2 RC0: 
http://markmail.org/message/5txhvr2qdiqglrwc