Jenkins build is back to normal : Hadoop-common-trunk-Java8 #1456

See - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org

Build failed in Jenkins: Hadoop-Common-trunk #2744

See Changes: [zhz] HDFS-10172. hdfs erasurecode command should remove the redundant -usage [cnauroth] HADOOP-12801. Suppress obsolete S3FileSystem tests. Contributed by Chris [ozawa] HADOOP-10694. Remove synchronized input

Build failed in Jenkins: Hadoop-common-trunk-Java8 #1455

See Changes: [zhz] HDFS-10172. hdfs erasurecode command should remove the redundant -usage [cnauroth] HADOOP-12801. Suppress obsolete S3FileSystem tests. Contributed by Chris --

[jira] [Created] (HADOOP-13128) Manage Hadoop RPC resource usage via resource coupon

Xiaoyu Yao created HADOOP-13128: --- Summary: Manage Hadoop RPC resource usage via resource coupon Key: HADOOP-13128 URL: https://issues.apache.org/jira/browse/HADOOP-13128 Project: Hadoop Common

Re: [DISCUSS] Treating LimitedPrivate({"MapReduce"}) as Public APIs for YARN applications

Thanks for explaining, Chris. I generally agree that UserGroupInformation should be annotated as Public rather than LimitedPrivate, although you guys have more context than I do. However, I do think it's important that we clarify that we can break public APIs across a major version transition

[jira] [Created] (HADOOP-13127) Correctly cache delegation tokens in KMSClientProvider

Xiao Chen created HADOOP-13127: -- Summary: Correctly cache delegation tokens in KMSClientProvider Key: HADOOP-13127 URL: https://issues.apache.org/jira/browse/HADOOP-13127 Project: Hadoop Common

[jira] [Resolved] (HADOOP-7738) Document incompatible API changes between 0.20.20x and 0.23.0 release

[ https://issues.apache.org/jira/browse/HADOOP-7738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli resolved HADOOP-7738. - Resolution: Won't Fix This is obviously too late to do. We keep moving

Build failed in Jenkins: Hadoop-Common-trunk #2743

See Changes: [stevel] HADOOP-12751. While using kerberos Hadoop incorrectly assumes names with [stevel] HADOOP-12982 Document missing S3A and S3 properties. (Wei-Chiu Chuang [epayne] YARN-4768. getAvailablePhysicalMemorySize can

Build failed in Jenkins: Hadoop-common-trunk-Java8 #1454

See Changes: [stevel] HADOOP-12751. While using kerberos Hadoop incorrectly assumes names with [stevel] HADOOP-12982 Document missing S3A and S3 properties. (Wei-Chiu Chuang [epayne] YARN-4768.

Re: [DISCUSS] Treating LimitedPrivate({"MapReduce"}) as Public APIs for YARN applications

Yes, I agree with you Andrew. Sorry, I should clarify my prior response. I didn't mean to imply a blind s/LimitedPrivate/Public/g across the whole codebase. Instead, I'm +1 for the intent of HADOOP-10776: a transition to Public for UserGroupInformation, and by extension the related parts of

Re: [DISCUSS] Treating LimitedPrivate({"MapReduce"}) as Public APIs for YARN applications

Why don't we address these on a case-by-case basis, changing the annotations on these key classes to Public? LimitedPrivate{"YARN applications"} is the same thing as Public. This way we don't need to add special exceptions to our compatibility policy. Keeps it simple. Best, Andrew On Tue, May

Re: [DISCUSS] Treating LimitedPrivate({"MapReduce"}) as Public APIs for YARN applications

+1 for transitioning from LimitedPrivate to Public. I view this as an extension of the need for UserGroupInformation and related APIs to be Public. Regardless of the original intent behind LimitedPrivate, these are de facto public now, because there is no viable alternative for applications that

Re: [DISCUSS] Set minimum version of Hadoop 3 to JDK8 (HADOOP-11858)

+1 On Tue, May 10, 2016 at 12:36 PM, Ravi Prakash wrote: > +1. Thanks for driving this Akira > > On Tue, May 10, 2016 at 10:25 AM, Tsuyoshi Ozawa wrote: > > > > Before cutting 3.0.0-alpha RC, I'd like to drop JDK7 support in trunk. > > > > Sounds good.

Build failed in Jenkins: Hadoop-Common-trunk #2742

See Changes: [cmccabe] HDFS-10377. CacheReplicationMonitor shutdown log message should use INFO -- [...truncated 5157 lines...] Running org.apache.hadoop.security.TestKDiagNoKDC Running

[jira] [Reopened] (HADOOP-10980) TestActiveStandbyElector fails occasionally in trunk

[ https://issues.apache.org/jira/browse/HADOOP-10980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger reopened HADOOP-10980: -- Assignee: Eric Badger This test failed for me locally when I was running a separate

Re: [DISCUSS] Merge Jersey upgrade(HADOOP-9613) to trunk

+1. Awesome effort Tsuyoshi. This has been blocking compression on the wire too. On Tue, May 10, 2016 at 11:24 AM, Colin McCabe wrote: > +1 for updating this in trunk. Thanks, Tsuyoshi Ozawa. > > cheers, > Colin > > On Mon, May 9, 2016, at 12:12, Tsuyoshi Ozawa wrote: > >

Re: [DISCUSS] Set minimum version of Hadoop 3 to JDK8 (HADOOP-11858)

+1. Thanks for driving this Akira On Tue, May 10, 2016 at 10:25 AM, Tsuyoshi Ozawa wrote: > > Before cutting 3.0.0-alpha RC, I'd like to drop JDK7 support in trunk. > > Sounds good. To do so, we need to check the blockers of 3.0.0-alpha > RC, especially upgrading all

Jenkins build is back to normal : Hadoop-common-trunk-Java8 #1453

See - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org

Re: [DISCUSS] Treating LimitedPrivate({"MapReduce"}) as Public APIs for YARN applications

On Tue, May 10, 2016, at 11:34, Hitesh Shah wrote: > There seems to be some incorrect assumptions on why the application had > an issue. For rolling upgrade deployments, the application bundles the > client-side jars that it was compiled against and uses them in its > classpath and expects to be

Re: 7 build nodes are down

Did INFRA have any information on this? best, On Fri, May 6, 2016, at 15:14, Allen Wittenauer wrote: > > Anyone know why? > > - > To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org > For additional commands,

Re: [DISCUSS] Treating LimitedPrivate({"MapReduce"}) as Public APIs for YARN applications

There seems to be some incorrect assumptions on why the application had an issue. For rolling upgrade deployments, the application bundles the client-side jars that it was compiled against and uses them in its classpath and expects to be able to communicate with upgraded servers. Given that

Re: [DISCUSS] Merge Jersey upgrade(HADOOP-9613) to trunk

+1 for updating this in trunk. Thanks, Tsuyoshi Ozawa. cheers, Colin On Mon, May 9, 2016, at 12:12, Tsuyoshi Ozawa wrote: > Hi developers, > > We’ve worked on upgrading jersey(HADOOP-9613) for a years. It's > essential change to support complication with JDK8. It’s almost there. > > One

[jira] [Created] (HADOOP-13126) Add Brotli compression codec

Ryan Blue created HADOOP-13126: -- Summary: Add Brotli compression codec Key: HADOOP-13126 URL: https://issues.apache.org/jira/browse/HADOOP-13126 Project: Hadoop Common Issue Type: Improvement

[jira] [Created] (HADOOP-13125) FS Contract tests don't report FS initialization errors well

Steve Loughran created HADOOP-13125: --- Summary: FS Contract tests don't report FS initialization errors well Key: HADOOP-13125 URL: https://issues.apache.org/jira/browse/HADOOP-13125 Project: Hadoop

Re: [DISCUSS] Set minimum version of Hadoop 3 to JDK8 (HADOOP-11858)

> Before cutting 3.0.0-alpha RC, I'd like to drop JDK7 support in trunk. Sounds good. To do so, we need to check the blockers of 3.0.0-alpha RC, especially upgrading all dependencies which use refractions at first. Thanks, - Tsuyoshi On Tue, May 10, 2016 at 8:32 AM, Akira AJISAKA

Build failed in Jenkins: Hadoop-Common-trunk #2741

See Changes: [epayne] MAPREDUCE-6678. Allow ShuffleHandler readahead without drop-behind. [jlowe] MAPREDUCE-6684. High contention on scanning of user directory under [aajisaka] HADOOP-13118. Fix IOUtils#cleanup and

Build failed in Jenkins: Hadoop-common-trunk-Java8 #1452

See Changes: [epayne] MAPREDUCE-6678. Allow ShuffleHandler readahead without drop-behind. [jlowe] MAPREDUCE-6684. High contention on scanning of user directory under -- [...truncated

Re: [DISCUSS] Treating LimitedPrivate({"MapReduce"}) as Public APIs for YARN applications

> On May 10, 2016, at 8:37 AM, Hitesh Shah wrote: > > There have been various discussions on various JIRAs where upstream projects > such as YARN apps ( Tez, Slider, etc ) are called out for using the above > so-called Private APIs. A lot of YARN applications that have been

Re: [DISCUSS] Set minimum version of Hadoop 3 to JDK8 (HADOOP-11858)

> On May 10, 2016, at 8:32 AM, Akira AJISAKA wrote: > > Hi developers, > > Before cutting 3.0.0-alpha RC, I'd like to drop JDK7 support in trunk. +1 yes please. > One concern I think is, when the minimum version is set to JDK8, we need to > configure

[DISCUSS] Treating LimitedPrivate({"MapReduce"}) as Public APIs for YARN applications

There have been various discussions on various JIRAs where upstream projects such as YARN apps ( Tez, Slider, etc ) are called out for using the above so-called Private APIs. A lot of YARN applications that have been built out have picked up various bits and pieces of implementation from

[DISCUSS] Set minimum version of Hadoop 3 to JDK8 (HADOOP-11858)

Hi developers, Before cutting 3.0.0-alpha RC, I'd like to drop JDK7 support in trunk. Given this is a critical change, I'm thinking we should get the consensus first. One concern I think is, when the minimum version is set to JDK8, we need to configure Jenkins to disable multi JDK test only

Re: [DISCUSS] Merge Jersey upgrade(HADOOP-9613) to trunk

+1 agreed. > On May 9, 2016, at 2:13 PM, Akira AJISAKA wrote: > > +1 for marking HADOOP-9613 as incompatible change and upgrading the version > in trunk. > > Thanks, > Akira > > On 5/9/16 12:12, Tsuyoshi Ozawa wrote: >> Hi developers, >> >> We’ve worked on

[jira] [Created] (HADOOP-13124) Support weights/priority for user in Faircallqueue

Ravi Teja Ch N V created HADOOP-13124: - Summary: Support weights/priority for user in Faircallqueue Key: HADOOP-13124 URL: https://issues.apache.org/jira/browse/HADOOP-13124 Project: Hadoop Common

Build failed in Jenkins: Hadoop-Common-trunk #2740

See Changes: [vinodkv] YARN-4842. Fixed "yarn logs" command to guess (and thus not require) the -- [...truncated 3846 lines...] Generating

Build failed in Jenkins: Hadoop-common-trunk-Java8 #1451

See Changes: [vinodkv] YARN-4842. Fixed "yarn logs" command to guess (and thus not require) the -- [...truncated 3873 lines...] [INFO] [INFO] ---