[jira] [Updated] (HADOOP-13933) Add haadmin -getAllServiceState option to get the HA state of all the NameNodes/ResourceManagers

2017-01-09 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-13933: --- Target Version/s: 2.9.0 Issue Type: New Feature (was: Improvement)

[jira] [Commented] (HADOOP-13961) mvn install fails on trunk

2017-01-09 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15814029#comment-15814029 ] John Zhuge commented on HADOOP-13961: - [~sjlee0] Couldn't find out a better approach than patch 001,

[jira] [Commented] (HADOOP-13962) Update ADLS SDK to 2.1.4

2017-01-09 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15813937#comment-15813937 ] John Zhuge commented on HADOOP-13962: - I don't think so. [~ASikaria], could you comment? Should

[jira] [Updated] (HADOOP-13961) mvn install fails on trunk

2017-01-09 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HADOOP-13961: Status: In Progress (was: Patch Available) > mvn install fails on trunk >

[jira] [Commented] (HADOOP-13961) mvn install fails on trunk

2017-01-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15813682#comment-15813682 ] Hadoop QA commented on HADOOP-13961: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-13433) Race in UGI.reloginFromKeytab

2017-01-09 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15813669#comment-15813669 ] Duo Zhang commented on HADOOP-13433: {quote} Have you deployed this fix on your clusters? {quote}

[jira] [Commented] (HADOOP-13961) mvn install fails on trunk

2017-01-09 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15813663#comment-15813663 ] John Zhuge commented on HADOOP-13961: - That is what I thought initially. Maybe hadoop-hdfs pom

[jira] [Commented] (HADOOP-13885) Implement getLinkTarget for ViewFileSystem

2017-01-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15813606#comment-15813606 ] Hudson commented on HADOOP-13885: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11094 (See

[jira] [Commented] (HADOOP-13961) mvn install fails on trunk

2017-01-09 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15813597#comment-15813597 ] Sangjin Lee commented on HADOOP-13961: -- Thanks for the patch [~jzhuge]! Quick question: now that

[jira] [Updated] (HADOOP-13961) mvn install fails on trunk

2017-01-09 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HADOOP-13961: Status: Patch Available (was: In Progress) > mvn install fails on trunk >

[jira] [Updated] (HADOOP-13961) mvn install fails on trunk

2017-01-09 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HADOOP-13961: Attachment: HADOOP-13961.001.patch Patch 001 * Restore the {{maven-jar-plugin}} sections removed

[jira] [Updated] (HADOOP-13885) Implement getLinkTarget for ViewFileSystem

2017-01-09 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HADOOP-13885: - Resolution: Fixed Fix Version/s: 3.0.0-alpha2 Status: Resolved (was: Patch

[jira] [Work started] (HADOOP-13961) mvn install fails on trunk

2017-01-09 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HADOOP-13961 started by John Zhuge. --- > mvn install fails on trunk > -- > >

[jira] [Updated] (HADOOP-12946) Ensure one JVMPauseMonitor thread per JVM

2017-01-09 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HADOOP-12946: Resolution: Won't Fix Status: Resolved (was: Patch Available) Opt for HADOOP-12908. >

[jira] [Updated] (HADOOP-12855) Add option to disable JVMPauseMonitor across services

2017-01-09 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HADOOP-12855: Resolution: Won't Fix Status: Resolved (was: Patch Available) Opt for HADOOP-12908. >

[jira] [Commented] (HADOOP-13589) S3Guard: Allow execution of all S3A integration tests with S3Guard enabled.

2017-01-09 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15813374#comment-15813374 ] Mingliang Liu commented on HADOOP-13589: I like this patch. {code:title=s3guard.md} 282 run

[jira] [Commented] (HADOOP-13908) S3Guard: Existing tables may not be initialized correctly in DynamoDBMetadataStore

2017-01-09 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15813310#comment-15813310 ] Mingliang Liu commented on HADOOP-13908: Thanks [~cnauroth], [~ste...@apache.org] and

[jira] [Commented] (HADOOP-13589) S3Guard: Allow execution of all S3A integration tests with S3Guard enabled.

2017-01-09 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15813303#comment-15813303 ] Aaron Fabbri commented on HADOOP-13589: --- This looks awesome [~ste...@apache.org]. One minor nit:

[jira] [Updated] (HADOOP-13908) S3Guard: Existing tables may not be initialized correctly in DynamoDBMetadataStore

2017-01-09 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HADOOP-13908: --- Resolution: Fixed Fix Version/s: HADOOP-13345 Status: Resolved (was:

[jira] [Commented] (HADOOP-13650) S3Guard: Provide command line tools to manipulate metadata store.

2017-01-09 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15813296#comment-15813296 ] Lei (Eddy) Xu commented on HADOOP-13650: Hi, [~cnauroth]. I am working on rebase it and

[jira] [Commented] (HADOOP-13914) s3guard: improve S3AFileStatus#isEmptyDirectory handling

2017-01-09 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15813283#comment-15813283 ] Aaron Fabbri commented on HADOOP-13914: --- Ok, thanks for clarifying. Enjoy your break! > s3guard:

[jira] [Updated] (HADOOP-13952) tools dependency hooks are throwing errors

2017-01-09 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HADOOP-13952: - Priority: Critical (was: Blocker) I'm downgrading this from a Blocker since there's currently

[jira] [Commented] (HADOOP-13914) s3guard: improve S3AFileStatus#isEmptyDirectory handling

2017-01-09 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15813276#comment-15813276 ] Mingliang Liu commented on HADOOP-13914: Thanks. I saw the doc, it's very helpful. Yeah,

[jira] [Commented] (HADOOP-13953) Make FTPFileSystem's data connection mode and transfer mode configurable

2017-01-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15813267#comment-15813267 ] Hudson commented on HADOOP-13953: - FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #11092 (See

[jira] [Commented] (HADOOP-13914) s3guard: improve S3AFileStatus#isEmptyDirectory handling

2017-01-09 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15813249#comment-15813249 ] Aaron Fabbri commented on HADOOP-13914: --- Thanks for uploading an RFC patch [~liuml07]. Did you

[jira] [Updated] (HADOOP-10584) ActiveStandbyElector goes down if ZK quorum become unavailable

2017-01-09 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated HADOOP-10584: -- Assignee: (was: Karthik Kambatla) > ActiveStandbyElector goes down if ZK quorum

[jira] [Commented] (HADOOP-13336) S3A to support per-bucket configuration

2017-01-09 Thread Larry McCay (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15813225#comment-15813225 ] Larry McCay commented on HADOOP-13336: -- [~ste...@apache.org] - Ahhh - I missed the constant names

[jira] [Commented] (HADOOP-13914) s3guard: improve S3AFileStatus#isEmptyDirectory handling

2017-01-09 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15813216#comment-15813216 ] Aaron Fabbri commented on HADOOP-13914: --- Thanks [~ste...@apache.org]. I'm not sure I'm parsing

[jira] [Commented] (HADOOP-13876) S3Guard: better support for multi-bucket access including read-only

2017-01-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15813187#comment-15813187 ] Hadoop QA commented on HADOOP-13876: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Comment Edited] (HADOOP-13114) DistCp should have option to compress data on write

2017-01-09 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15813083#comment-15813083 ] Ravi Prakash edited comment on HADOOP-13114 at 1/9/17 11:20 PM: Here's a

[jira] [Commented] (HADOOP-13114) DistCp should have option to compress data on write

2017-01-09 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15813177#comment-15813177 ] Ravi Prakash commented on HADOOP-13114: --- Thanks for your comment Koji! I guess it'd be useful for

[jira] [Commented] (HADOOP-13114) DistCp should have option to compress data on write

2017-01-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15813173#comment-15813173 ] Hadoop QA commented on HADOOP-13114: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HADOOP-13914) s3guard: improve S3AFileStatus#isEmptyDirectory handling

2017-01-09 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-13914: --- Attachment: HADOOP-13914-HADOOP-13345.000.patch I upload the v0 patch for discussion. >

[jira] [Commented] (HADOOP-13952) tools dependency hooks are throwing errors

2017-01-09 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15813130#comment-15813130 ] Allen Wittenauer commented on HADOOP-13952: --- bq. jasper-compiler is a test-scoped dependency,

[jira] [Updated] (HADOOP-13876) S3Guard: better support for multi-bucket access including read-only

2017-01-09 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-13876: --- Status: Patch Available (was: Open) > S3Guard: better support for multi-bucket access

[jira] [Updated] (HADOOP-13876) S3Guard: better support for multi-bucket access including read-only

2017-01-09 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-13876: --- Attachment: HADOOP-13876-HADOOP-13345.000.patch For the goals of this JIRA, the v0 patch is

[jira] [Commented] (HADOOP-13589) S3Guard: Allow execution of all S3A integration tests with S3Guard enabled.

2017-01-09 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15813087#comment-15813087 ] Chris Nauroth commented on HADOOP-13589: This looks great. Thanks for picking it up. I tested

[jira] [Updated] (HADOOP-13114) DistCp should have option to compress data on write

2017-01-09 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash updated HADOOP-13114: -- Attachment: HADOOP-13114.06.patch Here's rebase of the patch from Suraj and Yongjun. To try

[jira] [Updated] (HADOOP-12664) UGI auto-renewer does not verify kinit availability during initialization

2017-01-09 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated HADOOP-12664: Status: Open (was: Patch Available) > UGI auto-renewer does not verify kinit availability during

[jira] [Updated] (HADOOP-13964) Remove vestigal templates directories creation

2017-01-09 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HADOOP-13964: -- Hadoop Flags: Incompatible change Release Note: This patch removes

[jira] [Updated] (HADOOP-13964) Remove vestigal templates directories creation

2017-01-09 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HADOOP-13964: -- Attachment: HADOOP-13964.00.patch -00: * initial patch > Remove vestigal templates

[jira] [Updated] (HADOOP-13964) Remove vestigal templates directories creation

2017-01-09 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HADOOP-13964: -- Summary: Remove vestigal templates directories creation (was: Remove vestigal

[jira] [Work started] (HADOOP-13964) Remove vestigal templates directories creation

2017-01-09 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HADOOP-13964 started by Allen Wittenauer. - > Remove vestigal templates directories creation >

[jira] [Commented] (HADOOP-13908) S3Guard: Existing tables may not be initialized correctly in DynamoDBMetadataStore

2017-01-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15813010#comment-15813010 ] Hadoop QA commented on HADOOP-13908: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-13336) S3A to support per-bucket configuration

2017-01-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15812979#comment-15812979 ] Hadoop QA commented on HADOOP-13336: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-13908) S3Guard: Existing tables may not be initialized correctly in DynamoDBMetadataStore

2017-01-09 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15812974#comment-15812974 ] Mingliang Liu commented on HADOOP-13908: This is a good test report as the failures are to be

[jira] [Updated] (HADOOP-13908) S3Guard: Existing tables may not be initialized correctly in DynamoDBMetadataStore

2017-01-09 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-13908: --- Attachment: HADOOP-13908-HADOOP-13345.006.patch The v6 patch rebases from feature branch

[jira] [Created] (HADOOP-13964) Remove vestigal template directory creation

2017-01-09 Thread Allen Wittenauer (JIRA)
Allen Wittenauer created HADOOP-13964: - Summary: Remove vestigal template directory creation Key: HADOOP-13964 URL: https://issues.apache.org/jira/browse/HADOOP-13964 Project: Hadoop Common

[jira] [Updated] (HADOOP-13336) S3A to support per-bucket configuration

2017-01-09 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13336: Attachment: HADOOP-13336-HADOOP-13345-008.patch HADOOP-13336 patch 008: permit bucket

[jira] [Updated] (HADOOP-13336) S3A to support per-bucket configuration

2017-01-09 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13336: Status: Patch Available (was: Open) tested, s3a ireland > S3A to support per-bucket

[jira] [Commented] (HADOOP-13963) /bin/bash is hard coded in some of the scripts

2017-01-09 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15812696#comment-15812696 ] Miklos Szegedi commented on HADOOP-13963: - This bug was opened based on the discussion with

[jira] [Created] (HADOOP-13963) /bin/bash is hard coded in some of the scripts

2017-01-09 Thread Miklos Szegedi (JIRA)
Miklos Szegedi created HADOOP-13963: --- Summary: /bin/bash is hard coded in some of the scripts Key: HADOOP-13963 URL: https://issues.apache.org/jira/browse/HADOOP-13963 Project: Hadoop Common

[jira] [Comment Edited] (HADOOP-13959) S3guard: replace dynamo.describe() call in init with more efficient query

2017-01-09 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15812667#comment-15812667 ] Mingliang Liu edited comment on HADOOP-13959 at 1/9/17 7:51 PM: +1 for

[jira] [Commented] (HADOOP-13959) S3guard: replace dynamo.describe() call in init with more efficient query

2017-01-09 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15812667#comment-15812667 ] Mingliang Liu commented on HADOOP-13959: +1 for the proposal. Thanks [~ste...@apache.org] for

[jira] [Commented] (HADOOP-12664) UGI auto-renewer does not verify kinit availability during initialization

2017-01-09 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15812650#comment-15812650 ] Ray Chiang commented on HADOOP-12664: - I'm pretty agnostic with respect to whatever solution we end

[jira] [Commented] (HADOOP-13960) Initialize DynamoDBMetadataStore without associated S3AFileSystem

2017-01-09 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15812647#comment-15812647 ] Mingliang Liu commented on HADOOP-13960: Thanks [~eddyxu] for discussion, review and commit!

[jira] [Updated] (HADOOP-13336) S3A to support per-bucket configuration

2017-01-09 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13336: Status: Open (was: Patch Available) > S3A to support per-bucket configuration >

[jira] [Commented] (HADOOP-13929) ADLS should not check in contract-test-options.xml

2017-01-09 Thread Vishwajeet Dusane (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15812531#comment-15812531 ] Vishwajeet Dusane commented on HADOOP-13929: [~jzhuge] and [~cnauroth] - Thanks a lot for

[jira] [Commented] (HADOOP-13336) S3A to support per-bucket configuration

2017-01-09 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15812523#comment-15812523 ] Steve Loughran commented on HADOOP-13336: - Larrrt there's a scan for a forbidden prefix

[jira] [Commented] (HADOOP-13650) S3Guard: Provide command line tools to manipulate metadata store.

2017-01-09 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15812476#comment-15812476 ] Chris Nauroth commented on HADOOP-13650: [~eddyxu], it looks like this patch needs a rebase.

[jira] [Commented] (HADOOP-13929) ADLS should not check in contract-test-options.xml

2017-01-09 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15812470#comment-15812470 ] Chris Nauroth commented on HADOOP-13929: [~jzhuge], there are a lot of nice clean-ups here.

[jira] [Commented] (HADOOP-13946) Document how HDFS updates timestamps in the FS spec; compare with object stores

2017-01-09 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15812450#comment-15812450 ] Chris Nauroth commented on HADOOP-13946: bq. creation time? That of mkdir()? I think I'm

[jira] [Commented] (HADOOP-13908) S3Guard: Existing tables may not be initialized correctly in DynamoDBMetadataStore

2017-01-09 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15812406#comment-15812406 ] Chris Nauroth commented on HADOOP-13908: [~liuml07], it looks like we'll need to rebase this

[jira] [Commented] (HADOOP-13336) S3A to support per-bucket configuration

2017-01-09 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15812397#comment-15812397 ] Chris Nauroth commented on HADOOP-13336: I'm in favor of the approach, and there are already

[jira] [Commented] (HADOOP-13336) S3A to support per-bucket configuration

2017-01-09 Thread Larry McCay (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15812375#comment-15812375 ] Larry McCay commented on HADOOP-13336: -- Hi [~ste...@apache.org] - This looks like a good approach

[jira] [Comment Edited] (HADOOP-13961) mvn install fails on trunk

2017-01-09 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15810772#comment-15810772 ] John Zhuge edited comment on HADOOP-13961 at 1/9/17 5:44 PM: - Reverting

[jira] [Commented] (HADOOP-13961) mvn install fails on trunk

2017-01-09 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15812362#comment-15812362 ] John Zhuge commented on HADOOP-13961: - Thanks [~sjlee0]. I have reproduced the issue with just {{mvn

[jira] [Assigned] (HADOOP-13961) mvn install fails on trunk

2017-01-09 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge reassigned HADOOP-13961: --- Assignee: John Zhuge > mvn install fails on trunk > -- > >

[jira] [Updated] (HADOOP-13589) S3Guard: Allow execution of all S3A integration tests with S3Guard enabled.

2017-01-09 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13589: Attachment: HADOOP-13589-HADOOP-13345-001.patch Patch 001 Adds profiles: s3guard, dynamo

[jira] [Commented] (HADOOP-13786) Add S3Guard committer for zero-rename commits to consistent S3 endpoints

2017-01-09 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15812342#comment-15812342 ] Steve Loughran commented on HADOOP-13786: - Making this standalone, giving title but making clear

[jira] [Commented] (HADOOP-13433) Race in UGI.reloginFromKeytab

2017-01-09 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15812310#comment-15812310 ] stack commented on HADOOP-13433: Should the test case be integrated into the patch [~Apache9]? Have you

[jira] [Commented] (HADOOP-13961) mvn install fails on trunk

2017-01-09 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15812263#comment-15812263 ] Sangjin Lee commented on HADOOP-13961: -- I don't know about the hadoop-common issue [~jzhuge] is

[jira] [Commented] (HADOOP-13961) mvn install fails on trunk

2017-01-09 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15812239#comment-15812239 ] Allen Wittenauer commented on HADOOP-13961: --- Note that the Hadoop-trunk-Commit is having

[jira] [Commented] (HADOOP-13961) mvn install fails on trunk

2017-01-09 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15812235#comment-15812235 ] Allen Wittenauer commented on HADOOP-13961: --- That's a normal failure due to the weird way the

[jira] [Commented] (HADOOP-13962) Update ADLS SDK to 2.1.4

2017-01-09 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15812231#comment-15812231 ] Steve Loughran commented on HADOOP-13962: - does this change any dependencies? > Update ADLS SDK

[jira] [Created] (HADOOP-13962) Update ADLS SDK to 2.1.4

2017-01-09 Thread John Zhuge (JIRA)
John Zhuge created HADOOP-13962: --- Summary: Update ADLS SDK to 2.1.4 Key: HADOOP-13962 URL: https://issues.apache.org/jira/browse/HADOOP-13962 Project: Hadoop Common Issue Type: Improvement

[jira] [Comment Edited] (HADOOP-13961) mvn install fails on trunk

2017-01-09 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15810772#comment-15810772 ] John Zhuge edited comment on HADOOP-13961 at 1/9/17 4:03 PM: - Reverting

[jira] [Commented] (HADOOP-13903) KMS does not provide any useful debug information

2017-01-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15812007#comment-15812007 ] Hadoop QA commented on HADOOP-13903: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Work started] (HADOOP-13589) S3Guard: Allow execution of all S3A integration tests with S3Guard enabled.

2017-01-09 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HADOOP-13589 started by Steve Loughran. --- > S3Guard: Allow execution of all S3A integration tests with S3Guard

[jira] [Commented] (HADOOP-13805) UGI.getCurrentUser() fails if user does not have a keytab associated

2017-01-09 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15811981#comment-15811981 ] Alejandro Abdelnur commented on HADOOP-13805: - [~xiaochen], Unless I'm missing something, I

[jira] [Commented] (HADOOP-13345) S3Guard: Improved Consistency for S3A

2017-01-09 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15811874#comment-15811874 ] Steve Loughran commented on HADOOP-13345: - -1 to anything working with user:pass in URIs. IT's

[jira] [Updated] (HADOOP-13786) Add S3Guard committer for zero-rename commits to consistent S3 endpoints

2017-01-09 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13786: Summary: Add S3Guard committer for zero-rename commits to consistent S3 endpoints (was:

[jira] [Updated] (HADOOP-13786) add output committer which uses s3guard for consistent commits to S3

2017-01-09 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13786: Issue Type: Bug (was: Sub-task) Parent: (was: HADOOP-13345) > add output

[jira] [Commented] (HADOOP-13912) S3a Multipart Committer (avoid rename)

2017-01-09 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15811840#comment-15811840 ] Steve Loughran commented on HADOOP-13912: - We need a name for this? S3guard committer? I know

[jira] [Updated] (HADOOP-13903) KMS does not provide any useful debug information

2017-01-09 Thread Tristan Stevens (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tristan Stevens updated HADOOP-13903: - Attachment: HADOOP-13903-6.patch > KMS does not provide any useful debug information >

[jira] [Commented] (HADOOP-13876) S3Guard: better support for multi-bucket access including read-only

2017-01-09 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15811816#comment-15811816 ] Steve Loughran commented on HADOOP-13876: - This will also surface on a {{-Dscale}} test run, as

[jira] [Commented] (HADOOP-13336) S3A to support per-bucket configuration

2017-01-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15811795#comment-15811795 ] Hadoop QA commented on HADOOP-13336: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-13903) KMS does not provide any useful debug information

2017-01-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15811775#comment-15811775 ] Hadoop QA commented on HADOOP-13903: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HADOOP-13903) KMS does not provide any useful debug information

2017-01-09 Thread Tristan Stevens (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tristan Stevens updated HADOOP-13903: - Attachment: HADOOP-13903-branch2.7-6.patch HADOOP-13903-6.patch Updated

[jira] [Updated] (HADOOP-13336) S3A to support per-bucket configuration

2017-01-09 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13336: Status: Patch Available (was: Open) > S3A to support per-bucket configuration >

[jira] [Updated] (HADOOP-13336) S3A to support per-bucket configuration

2017-01-09 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13336: Attachment: HADOOP-13336-007.patch Patch 007: latest test fixes, including the checkstyle

[jira] [Updated] (HADOOP-13336) S3A to support per-bucket configuration

2017-01-09 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13336: Status: Open (was: Patch Available) cancelling patch; trunk branch was 1 commit behind

[jira] [Commented] (HADOOP-13336) S3A to support per-bucket configuration

2017-01-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15811713#comment-15811713 ] Hadoop QA commented on HADOOP-13336: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-11487) FileNotFound on distcp to s3n/s3a due to creation inconsistency

2017-01-09 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15811707#comment-15811707 ] Steve Loughran commented on HADOOP-11487: - Linking to HADOOP-13950, as it may be a lower cost

[jira] [Updated] (HADOOP-13336) S3A to support per-bucket configuration

2017-01-09 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13336: Status: Patch Available (was: Open) > S3A to support per-bucket configuration >

[jira] [Updated] (HADOOP-13336) S3A to support per-bucket configuration

2017-01-09 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13336: Status: Open (was: Patch Available) > S3A to support per-bucket configuration >

[jira] [Updated] (HADOOP-13336) S3A to support per-bucket configuration

2017-01-09 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13336: Attachment: HADOOP-13336-006.patch Patch 006 against trunk. Main diff is in testing, plus

[jira] [Updated] (HADOOP-13960) Initialize DynamoDBMetadataStore without associated S3AFileSystem

2017-01-09 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HADOOP-13960: --- Resolution: Fixed Fix Version/s: HADOOP-13345 Status: Resolved (was: