[jira] [Created] (HADOOP-14825) Über-JIRA: S3Guard Phase II

Steve Loughran created HADOOP-14825: --- Summary: Über-JIRA: S3Guard Phase II Key: HADOOP-14825 URL: https://issues.apache.org/jira/browse/HADOOP-14825 Project: Hadoop Common Issue Type:

[jira] [Resolved] (HADOOP-14810) S3Guard: handle provisioning failure through backoff & retry (& metrics)

[ https://issues.apache.org/jira/browse/HADOOP-14810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-14810. - Resolution: Duplicate Duplicate of HADOOP-13761; closing as such and pasting stack

Re: [VOTE] Merge HADOOP-13345 (S3Guard feature branch)

On 25 Aug 2017, at 20:22, Aaron Fabbri > wrote: Thank you everyone for reviewing and voting on the S3Guard feature branch merge. It looks like the Vote was a success. We have six binding +1's (Steve Loughran, Sean Mackrory, Mingliang Liu, Sanjay

[jira] [Resolved] (HADOOP-14801) s3guard diff demand creates a new table

[ https://issues.apache.org/jira/browse/HADOOP-14801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-14801. - Resolution: Duplicate Target Version/s: 3.1.0 (was: HADOOP-13345) > s3guard

[jira] [Resolved] (HADOOP-14800) eliminate double stack trace on some s3guard CLI failures

[ https://issues.apache.org/jira/browse/HADOOP-14800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-14800. - Resolution: Duplicate > eliminate double stack trace on some s3guard CLI failures >

[jira] [Resolved] (HADOOP-13345) S3Guard: Improved Consistency for S3A

[ https://issues.apache.org/jira/browse/HADOOP-13345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-13345. - Resolution: Fixed Fix Version/s: 3.0.0-beta1 Closing as fixed. I've added some

YARN javadoc failures Re: [DISCUSS] Branches and versions for Hadoop 3

> On Aug 28, 2017, at 9:58 AM, Allen Wittenauer > wrote: > The automation only goes so far. At least while investigating Yetus > bugs, I've seen more than enough blatant and purposeful ignored errors and > warnings that I'm not convinced it will be

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/510/ [Aug 31, 2017 9:23:17 AM] (yqlin) HDFS-12317. HDFS metrics render error in the page of Github. Contributed [Aug 31, 2017 1:12:01 PM] (sunilg) YARN-7116. CapacityScheduler Web UI: Queue's AM usage is

[jira] [Resolved] (HADOOP-14012) Handled dynamo exceptions in translateException

[ https://issues.apache.org/jira/browse/HADOOP-14012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-14012. - Resolution: Duplicate Marking as a duplicate of HADOOP-13761; that's where this work

[jira] [Created] (HADOOP-14826) reviewS3 docs prior to 3.0-beta-1

Steve Loughran created HADOOP-14826: --- Summary: reviewS3 docs prior to 3.0-beta-1 Key: HADOOP-14826 URL: https://issues.apache.org/jira/browse/HADOOP-14826 Project: Hadoop Common Issue

Re: Apache Hadoop 2.8.2 Release Plan

One thing we need to consider is HADOOP-14439: regression: secret stripping from S3x URIs breaks some downstream code Hadoop 2.8 has a best-effort attempt to strip out secrets from the toString() value of an s3a or s3n path where someone has embedded them in the URI; this has caused problems

Re: Apache Hadoop 2.8.2 Release Plan

If we do "fix" this in 2.8.2 we should seriously consider not doing so in 3.0. This is a very poor practice. I can see an argument for backward compatibility in 2.8.x line though. On Fri, Sep 1, 2017 at 1:41 PM, Steve Loughran wrote: > One thing we need to consider is >

Heads up: branch-3.0 has been cut, commit here for 3.0.0-beta1

Hi folks, I've proceeded with the plan from our earlier thread and cut branch-3.0. The branches and maven versions are now set as follows: trunk: 3.1.0-SNAPSHOT branch-3.0: 3.0.0-beta1-SNAPSHOT branch-2's are still the same. This means if you want to commit something for beta1, commit it to

[jira] [Created] (HADOOP-14828) RetryUpToMaximumTimeWithFixedSleep is not bounded by maximum time

Jonathan Hung created HADOOP-14828: -- Summary: RetryUpToMaximumTimeWithFixedSleep is not bounded by maximum time Key: HADOOP-14828 URL: https://issues.apache.org/jira/browse/HADOOP-14828 Project:

[jira] [Created] (HADOOP-14827) Allow StopWatch to accept a Timer parameter for tests

Erik Krogen created HADOOP-14827: Summary: Allow StopWatch to accept a Timer parameter for tests Key: HADOOP-14827 URL: https://issues.apache.org/jira/browse/HADOOP-14827 Project: Hadoop Common

Re: Apache Hadoop 2.8.2 Release Plan

This issue (HADOOP-14439) is out of my radar given it is marked as Minor priority. If my understanding is correct, here is a trade-off between security and backward compatibility. IMO, priority of security is generally higher than backward compatibility especially 2.8.0 is still non-production

2017-09-01 Hadoop 3 release status update

https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+3+release+status+updates 2017-09-01 We're two weeks out from beta1, focus is on blocker burndown. Highlights: - S3Guard merged! - TSv2 alpha2 merged! - branch-3.0 has been cut after discussion on dev lists. Red flags: - 10

Re: [DISCUSS] Branches and versions for Hadoop 3

Hi folks, We've landed two of our beta1 features, S3Guard and TSv2, into trunk. Jian just sent out the vote for our remaining beta1 feature, YARN native services, but I think it's time to branch to unblock the resource profiles merge to 3.1. I'll cut just branch-3.0 for now, since we don't have

[jira] [Created] (HADOOP-14829) Path should support colon

Yuliya Feldman created HADOOP-14829: --- Summary: Path should support colon Key: HADOOP-14829 URL: https://issues.apache.org/jira/browse/HADOOP-14829 Project: Hadoop Common Issue Type:

Re: [VOTE] Merge yarn-native-services branch into trunk

+1 (non-binding) On 9/1/17, 11:58 AM, "Billie Rinaldi" wrote: >+1 (non-binding) > >On Thu, Aug 31, 2017 at 8:33 PM, Jian He wrote: > >> Hi All, >> >> I would like to call a vote for merging yarn-native-services to trunk. >>The >> vote will run

Re: [VOTE] Merge yarn-native-services branch into trunk

+1 (Binding), I tried to use YARN service assembly before to run different kinds of jobs (for example, distributed Tensorflow), it is really easy for end user to run jobs on YARN. Thanks to the whole team for the great job! Best, Wangda On Fri, Sep 1, 2017 at 3:33 PM, Gour Saha

[jira] [Created] (HADOOP-14830) Write some non-Docker-based instructions on how to build on Mac OS X

Allen Wittenauer created HADOOP-14830: - Summary: Write some non-Docker-based instructions on how to build on Mac OS X Key: HADOOP-14830 URL: https://issues.apache.org/jira/browse/HADOOP-14830

Re: [VOTE] Merge yarn-native-services branch into trunk

+1 (non-binding) On Thu, Aug 31, 2017 at 8:33 PM, Jian He wrote: > Hi All, > > I would like to call a vote for merging yarn-native-services to trunk. The > vote will run for 7 days as usual. > > At a high level, the following are the key feautres implemented. > -

Re: Apache Hadoop 2.8.2 Release Plan

HADOOP-14814 get committed and HADOOP-9747 get push out to 2.8.3, so we are clean on blocker/critical issues now. I finish practice of going through JACC report and no more incompatible public API changes get found between 2.8.2 and 2.7.4. Also I check commit history and fixed 10+ commits which