Apache Hadoop qbt Report: branch2+JDK7 on Linux/x86

2017-11-22 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/47/ [Nov 20, 2017 4:01:50 PM] (bibinchundatt) YARN-7489. ConcurrentModificationException in RMAppImpl#getRMAppMetrics. [Nov 20, 2017 7:01:15 PM] (bibinchundatt) YARN-7525. Incorrect query parameters in

[jira] [Created] (HADOOP-15064) hadoop-common 3.0.0-beta1 exposes a dependency on slf4j-log4j12

2017-11-22 Thread PJ Fanning (JIRA)
PJ Fanning created HADOOP-15064: --- Summary: hadoop-common 3.0.0-beta1 exposes a dependency on slf4j-log4j12 Key: HADOOP-15064 URL: https://issues.apache.org/jira/browse/HADOOP-15064 Project: Hadoop

[jira] [Resolved] (HADOOP-13478) Aliyun OSS phase I: some preparation and improvements before release

2017-11-22 Thread Genmao Yu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Genmao Yu resolved HADOOP-13478. Resolution: Done > Aliyun OSS phase I: some preparation and improvements before release >

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2017-11-22 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/601/ [Nov 21, 2017 5:09:16 PM] (haibochen) YARN-7531. ResourceRequest.equal does not check [Nov 21, 2017 6:33:34 PM] (yufei) YARN-7513. Remove the scheduler lock in FSAppAttempt.getWeight() [Nov 22, 2017

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

2017-11-22 Thread Konstantin Shvachko
Thanks for the links, Arun. I see I missed this part. Glad the decision was conscious. Thanks for the release. --Konstantin On Wed, Nov 22, 2017 at 11:39 AM, Arun Suresh wrote: > Hello Konstantin > > We actually did discuss a bit about this: >

Re: Apache Hadoop 2.8.3 Release Plan

2017-11-22 Thread Junping Du
Thanks Konstantin and Weiwei for calling attention. These two HDFS issues looks to be important to be fixed which are on my radar now. I will hold on RC cut until we figure them out. Thanks, Junping From: Weiwei Yang Sent: Tuesday,

[jira] [Created] (HADOOP-15068) cancelToken and renewToken should use shortUserName consistently

2017-11-22 Thread Vihang Karajgaonkar (JIRA)
Vihang Karajgaonkar created HADOOP-15068: Summary: cancelToken and renewToken should use shortUserName consistently Key: HADOOP-15068 URL: https://issues.apache.org/jira/browse/HADOOP-15068

[jira] [Resolved] (HADOOP-14381) S3AUtils.translateException to map 503 reponse to => throttling failure

2017-11-22 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-14381. - Resolution: Fixed Fix Version/s: 3.1.0 Fixed in HADOOP-13786; inconsistent s3

[jira] [Resolved] (HADOOP-14303) Review retry logic on all S3 SDK calls, implement where needed

2017-11-22 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-14303. - Resolution: Fixed Fix Version/s: 3.1.0 Fixed in HADOOP-13786, with * Java 8

[jira] [Created] (HADOOP-15065) Make mapreduce specific GenericOptionsParser arguments optional

2017-11-22 Thread Elek, Marton (JIRA)
Elek, Marton created HADOOP-15065: - Summary: Make mapreduce specific GenericOptionsParser arguments optional Key: HADOOP-15065 URL: https://issues.apache.org/jira/browse/HADOOP-15065 Project: Hadoop

[jira] [Resolved] (HADOOP-13664) S3AInputStream to use a retry policy on read failures

2017-11-22 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-13664. - Resolution: Duplicate Assignee: Steve Loughran Fix Version/s: 3.1.0

[jira] [Resolved] (HADOOP-13205) S3A to support custom retry policies; failfast on unknown host

2017-11-22 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-13205. - Resolution: Fixed Fix Version/s: 3.1.0 Fixed in HADOOP-13786 > S3A to support

[jira] [Resolved] (HADOOP-13811) s3a: getFileStatus fails with com.amazonaws.AmazonClientException: Failed to sanitize XML document destined for handler class

2017-11-22 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-13811. - Resolution: Fixed Assignee: Steve Loughran Fix Version/s: 3.1.0 Fixed

[jira] [Resolved] (HADOOP-14161) Failed to rename file in S3A during FileOutputFormat commitTask

2017-11-22 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-14161. - Resolution: Won't Fix Fix Version/s: 3.1.0 I'm closing this as a WONTFIX because

[jira] [Created] (HADOOP-15066) Spurious error stopping secure datanode

2017-11-22 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HADOOP-15066: -- Summary: Spurious error stopping secure datanode Key: HADOOP-15066 URL: https://issues.apache.org/jira/browse/HADOOP-15066 Project: Hadoop Common Issue

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

2017-11-22 Thread Konstantin Shvachko
Hey guys, I don't think this has been discussed, pardon if it was. As it stands today hadoop 2.9.0 is marked as stable release. Isn't that deceptive for users? Not to diminish the quality and not to understate the effort, which was huge and very much appreciated. But it is the first in the

Re: [VOTE] Release Apache Hadoop 3.0.0 RC0

2017-11-22 Thread Brahma Reddy Battula
bq. (a) The behavior of this command. Clearly, it will conflict with the MapReduce JHS - only one of them can be started on the same node. Yes,Since the PID file will be same. This problem will not present in branch-2.9 + as pid file will be suffix with mapred(for JHS)

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

2017-11-22 Thread Arun Suresh
Hello Konstantin We actually did discuss a bit about this: https://www.mail-archive.com/yarn-dev@hadoop.apache.org/msg28407.html https://www.mail-archive.com/yarn-dev@hadoop.apache.org/msg28403.html We finally decided to add the following disclaimer on the release page (

[jira] [Created] (HADOOP-15067) GC time percentage reported in JvmMetrics should be a gauge, not counter

2017-11-22 Thread Misha Dmitriev (JIRA)
Misha Dmitriev created HADOOP-15067: --- Summary: GC time percentage reported in JvmMetrics should be a gauge, not counter Key: HADOOP-15067 URL: https://issues.apache.org/jira/browse/HADOOP-15067