[jira] [Updated] (HADOOP-12971) FileSystemShell doc should explain relative path

2016-05-13 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HADOOP-12971: Attachment: HADOOP-12971.001.patch > FileSystemShell doc should explain relative path >

[jira] [Updated] (HADOOP-12971) FileSystemShell doc should explain relative path

2016-05-13 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HADOOP-12971: Status: Patch Available (was: Open) > FileSystemShell doc should explain relative path >

[jira] [Updated] (HADOOP-13127) Correctly cache delegation tokens in KMSClientProvider

2016-05-13 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HADOOP-13127: --- Status: Open (was: Patch Available) > Correctly cache delegation tokens in KMSClientProvider >

[jira] [Updated] (HADOOP-12868) Fix hadoop-openstack undeclared and unused dependencies

2016-05-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HADOOP-12868: - Summary: Fix hadoop-openstack undeclared and unused dependencies (was: hadoop-openstack's pom

[jira] [Updated] (HADOOP-12868) hadoop-openstack's pom has missing and unused dependencies

2016-05-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HADOOP-12868: - Priority: Major (was: Blocker) > hadoop-openstack's pom has missing and unused dependencies >

[jira] [Commented] (HADOOP-6208) Block loss in S3FS due to S3 inconsistency on file rename

2016-05-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-6208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15282565#comment-15282565 ] Steve Loughran commented on HADOOP-6208: I'm going to close this as a WONTFIX due to the imminent

[jira] [Resolved] (HADOOP-6208) Block loss in S3FS due to S3 inconsistency on file rename

2016-05-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-6208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-6208. Resolution: Won't Fix > Block loss in S3FS due to S3 inconsistency on file rename >

[jira] [Commented] (HADOOP-12079) Make 'X-Newest' header a configurable

2016-05-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15282570#comment-15282570 ] Steve Loughran commented on HADOOP-12079: - couple of comments here # can a lower case option go

[jira] [Commented] (HADOOP-13113) Enable parallel test execution for hadoop-aws.

2016-05-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15282571#comment-15282571 ] Steve Loughran commented on HADOOP-13113: - LGTM +1 > Enable parallel test execution for

[jira] [Commented] (HADOOP-13140) GlobalStorageStatistics should check null FileSystem scheme to avoid NPE

2016-05-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15282579#comment-15282579 ] Steve Loughran commented on HADOOP-13140: - It's probably something just done in tests. Why not

[jira] [Commented] (HADOOP-13139) Branch-2: S3a to use thread pool that blocks clients

2016-05-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15282538#comment-15282538 ] Steve Loughran commented on HADOOP-13139: - I suspect I've just broken your patch with the User

[jira] [Updated] (HADOOP-13114) DistCp should have option to compress data on write

2016-05-13 Thread Suraj Nayak (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suraj Nayak updated HADOOP-13114: - Attachment: HADOOP-13114-trunk_2016-05-12-1.patch > DistCp should have option to compress data

[jira] [Updated] (HADOOP-13114) DistCp should have option to compress data on write

2016-05-13 Thread Suraj Nayak (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suraj Nayak updated HADOOP-13114: - Attachment: (was: HADOOP-13114-trunk_2016-05-12-1.patch) > DistCp should have option to

[jira] [Updated] (HADOOP-13113) Enable parallel test execution for hadoop-aws.

2016-05-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13113: Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch

[jira] [Commented] (HADOOP-11873) Include disk read/write time in FileSystem.Statistics

2016-05-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15282629#comment-15282629 ] Steve Loughran commented on HADOOP-11873: - This could be implemented as a FilterFileSystem; it

[jira] [Commented] (HADOOP-12878) Impersonate hosts in s3a for better data locality handling

2016-05-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15282631#comment-15282631 ] Steve Loughran commented on HADOOP-12878: - Link to the azure code here:

[jira] [Updated] (HADOOP-11601) Enhance FS spec & tests to mandate FileStatus.getBlocksize() >0 for non-empty files

2016-05-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-11601: Status: Patch Available (was: Open) > Enhance FS spec & tests to mandate

[jira] [Updated] (HADOOP-11601) Enhance FS spec & tests to mandate FileStatus.getBlocksize() >0 for non-empty files

2016-05-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-11601: Attachment: HADOOP-11601-002.patch synced with trunk > Enhance FS spec & tests to

[jira] [Updated] (HADOOP-11601) Enhance FS spec & tests to mandate FileStatus.getBlocksize() >0 for non-empty files

2016-05-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-11601: Status: Open (was: Patch Available) > Enhance FS spec & tests to mandate

[jira] [Updated] (HADOOP-11180) Change log message "token.Token: Cannot find class for token kind kms-dt" to debug

2016-05-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HADOOP-11180: - Summary: Change log message "token.Token: Cannot find class for token kind kms-dt" to debug

[jira] [Updated] (HADOOP-11180) Change log message "token.Token: Cannot find class for token kind kms-dt" to debug

2016-05-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HADOOP-11180: - Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch

[jira] [Updated] (HADOOP-12868) Fix hadoop-openstack undeclared and unused dependencies

2016-05-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HADOOP-12868: - Assignee: Masatake Iwasaki > Fix hadoop-openstack undeclared and unused dependencies >

[jira] [Resolved] (HADOOP-12868) Fix hadoop-openstack undeclared and unused dependencies

2016-05-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang resolved HADOOP-12868. -- Resolution: Fixed Fix Version/s: 2.8.0 Target Version/s: (was: ) Committed

[jira] [Commented] (HADOOP-12868) hadoop-openstack's pom has missing and unused dependencies

2016-05-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15282466#comment-15282466 ] Andrew Wang commented on HADOOP-12868: -- LGTM +1 then, thanks for working on this [~iwasakims]. >

[jira] [Updated] (HADOOP-13132) LoadBalancingKMSClientProvider ClassCastException on AuthenticationException

2016-05-13 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HADOOP-13132: - Attachment: HADOOP-13132.001.patch > LoadBalancingKMSClientProvider ClassCastException

[jira] [Updated] (HADOOP-13139) Branch-2: S3a to use thread pool that blocks clients

2016-05-13 Thread Pieter Reuse (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pieter Reuse updated HADOOP-13139: -- Attachment: HADOOP-13139-branch-2.002.patch Uploaded patch 002: changed patch w.r.t.

[jira] [Commented] (HADOOP-13059) S3a over-reacts to potentially transient network problems in its init() logic

2016-05-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15282679#comment-15282679 ] Steve Loughran commented on HADOOP-13059: - If the exception raised is an

[jira] [Updated] (HADOOP-13139) Branch-2: S3a to use thread pool that blocks clients

2016-05-13 Thread Pieter Reuse (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pieter Reuse updated HADOOP-13139: -- Status: Patch Available (was: In Progress) > Branch-2: S3a to use thread pool that blocks

[jira] [Updated] (HADOOP-12291) Add support for nested groups in LdapGroupsMapping

2016-05-13 Thread Esther Kundin (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Esther Kundin updated HADOOP-12291: --- Attachment: HADOOP-12291.006.patch > Add support for nested groups in LdapGroupsMapping >

[jira] [Updated] (HADOOP-12291) Add support for nested groups in LdapGroupsMapping

2016-05-13 Thread Esther Kundin (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Esther Kundin updated HADOOP-12291: --- Status: Patch Available (was: In Progress) > Add support for nested groups in

[jira] [Created] (HADOOP-13143) harden S3AFileSystem.copyFromLocalFile()

2016-05-13 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-13143: --- Summary: harden S3AFileSystem.copyFromLocalFile() Key: HADOOP-13143 URL: https://issues.apache.org/jira/browse/HADOOP-13143 Project: Hadoop Common

[jira] [Updated] (HADOOP-12291) Add support for nested groups in LdapGroupsMapping

2016-05-13 Thread Esther Kundin (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Esther Kundin updated HADOOP-12291: --- Status: In Progress (was: Patch Available) > Add support for nested groups in

[jira] [Commented] (HADOOP-12971) FileSystemShell doc should explain relative path

2016-05-13 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15282820#comment-15282820 ] Sangjin Lee commented on HADOOP-12971: -- +1 overall | Vote | Subsystem | Runtime | Comment

[jira] [Assigned] (HADOOP-13130) s3a failures can surface as RTEs, not IOEs

2016-05-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reassigned HADOOP-13130: --- Assignee: Steve Loughran > s3a failures can surface as RTEs, not IOEs >

[jira] [Commented] (HADOOP-12971) FileSystemShell doc should explain relative path

2016-05-13 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15282821#comment-15282821 ] Sangjin Lee commented on HADOOP-12971: -- +1. Will commit it today. > FileSystemShell doc should

[jira] [Commented] (HADOOP-13130) s3a failures can surface as RTEs, not IOEs

2016-05-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15282766#comment-15282766 ] Steve Loughran commented on HADOOP-13130: - One aspect of this is that I've managed to create a

[jira] [Updated] (HADOOP-12971) FileSystemShell doc should explain relative path

2016-05-13 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated HADOOP-12971: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.9.0

[jira] [Updated] (HADOOP-13139) Branch-2: S3a to use thread pool that blocks clients

2016-05-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HADOOP-13139: - Fix Version/s: (was: 2.8.0) Fix version shouldn't be set until the patch is committed.

[jira] [Updated] (HADOOP-11505) Various native parts use bswap incorrectly and unportably

2016-05-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HADOOP-11505: - Target Version/s: 3.0.0-alpha1 Fix Version/s: (was: 3.0.0-alpha1) > Various native

[jira] [Commented] (HADOOP-13139) Branch-2: S3a to use thread pool that blocks clients

2016-05-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15282893#comment-15282893 ] Andrew Wang commented on HADOOP-13139: -- Given this is an incompatible change we're targeting for

[jira] [Updated] (HADOOP-13145) In DistCp, prevent unnecessary getFileStatus call when not preserving metadata.

2016-05-13 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HADOOP-13145: --- Attachment: HADOOP-13145.001.patch The attached v001 patch avoids the unnecessary

[jira] [Commented] (HADOOP-13140) GlobalStorageStatistics should check null FileSystem scheme to avoid NPE

2016-05-13 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15283289#comment-15283289 ] Mingliang Liu commented on HADOOP-13140: Thanks [~ste...@apache.org] and [~arpitagarwal] for

[jira] [Commented] (HADOOP-13083) The number of javadocs warnings is limited to 100

2016-05-13 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15283105#comment-15283105 ] Li Lu commented on HADOOP-13083: +1. Will commit shortly. > The number of javadocs warnings is limited

[jira] [Updated] (HADOOP-10942) Globbing optimizations and regression fix

2016-05-13 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HADOOP-10942: -- Resolution: Fixed Status: Resolved (was: Patch Available) The

[jira] [Comment Edited] (HADOOP-10942) Globbing optimizations and regression fix

2016-05-13 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15283108#comment-15283108 ] Colin Patrick McCabe edited comment on HADOOP-10942 at 5/13/16 8:31 PM:

[jira] [Updated] (HADOOP-13145) In DistCp, prevent unnecessary getFileStatus call when not preserving metadata.

2016-05-13 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HADOOP-13145: --- Status: Patch Available (was: Open) > In DistCp, prevent unnecessary getFileStatus call

[jira] [Updated] (HADOOP-13083) The number of javadocs warnings is limited to 100

2016-05-13 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated HADOOP-13083: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha1 2.8.0

[jira] [Commented] (HADOOP-13083) The number of javadocs warnings is limited to 100

2016-05-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15283142#comment-15283142 ] Hudson commented on HADOOP-13083: - FAILURE: Integrated in Hadoop-trunk-Commit #9761 (See

[jira] [Created] (HADOOP-13144) Enhancing IPC client throughput via multiple connections per user

2016-05-13 Thread Jason Kace (JIRA)
Jason Kace created HADOOP-13144: --- Summary: Enhancing IPC client throughput via multiple connections per user Key: HADOOP-13144 URL: https://issues.apache.org/jira/browse/HADOOP-13144 Project: Hadoop

[jira] [Updated] (HADOOP-13146) Refactor RetryInvocationHandler

2016-05-13 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HADOOP-13146: - Status: Patch Available (was: Open) > Refactor RetryInvocationHandler >

[jira] [Commented] (HADOOP-13146) Refactor RetryInvocationHandler

2016-05-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15283375#comment-15283375 ] Hadoop QA commented on HADOOP-13146: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-12666) Support Microsoft Azure Data Lake - as a file system in Hadoop

2016-05-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15283385#comment-15283385 ] Hadoop QA commented on HADOOP-12666: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-13146) Refactor RetryInvocationHandler

2016-05-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15283396#comment-15283396 ] Hadoop QA commented on HADOOP-13146: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-12723) S3A: Add ability to plug in any AWSCredentialsProvider

2016-05-13 Thread Steven Wong (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15283416#comment-15283416 ] Steven Wong commented on HADOOP-12723: -- The new Checkstyle warning "Missing package-info.java file"

[jira] [Created] (HADOOP-13146) Refactor RetryInvocationHandler

2016-05-13 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HADOOP-13146: Summary: Refactor RetryInvocationHandler Key: HADOOP-13146 URL: https://issues.apache.org/jira/browse/HADOOP-13146 Project: Hadoop Common

[jira] [Updated] (HADOOP-13146) Refactor RetryInvocationHandler

2016-05-13 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HADOOP-13146: - Attachment: c13146_20160513.patch c13146_20160513.patch: 1st patch. > Refactor

[jira] [Updated] (HADOOP-13146) Refactor RetryInvocationHandler

2016-05-13 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HADOOP-13146: - Attachment: c13146_20160513b.patch c13146_20160513b.patch: sync'ed with trunk.

[jira] [Updated] (HADOOP-13035) Add states INITING and STARTING to YARN Service model to cover in-transition states.

2016-05-13 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated HADOOP-13035: -- Status: Open (was: Patch Available) > Add states INITING and STARTING to YARN

[jira] [Commented] (HADOOP-13145) In DistCp, prevent unnecessary getFileStatus call when not preserving metadata.

2016-05-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15283302#comment-15283302 ] Hadoop QA commented on HADOOP-13145: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-12893) Verify LICENSE.txt and NOTICE.txt

2016-05-13 Thread Sean Busbey (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15283312#comment-15283312 ] Sean Busbey commented on HADOOP-12893: -- {quote} My understanding is LICENSE / NOTICE of binary

[jira] [Updated] (HADOOP-12666) Support Microsoft Azure Data Lake - as a file system in Hadoop

2016-05-13 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HADOOP-12666: --- Attachment: HADOOP-12666-012.patch CachedRefreshTokenBasedAccessTokenProvider - Since the

[jira] [Updated] (HADOOP-12723) S3A: Add ability to plug in any AWSCredentialsProvider

2016-05-13 Thread Steven Wong (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Wong updated HADOOP-12723: - Attachment: HADOOP-12723.3.patch Rebasing the patch. Also, fix two toString calls inside

[jira] [Comment Edited] (HADOOP-13140) GlobalStorageStatistics should check null FileSystem scheme to avoid NPE

2016-05-13 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15283061#comment-15283061 ] Arpit Agarwal edited comment on HADOOP-13140 at 5/13/16 9:40 PM: - Yes as

[jira] [Commented] (HADOOP-12723) S3A: Add ability to plug in any AWSCredentialsProvider

2016-05-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15283232#comment-15283232 ] Hadoop QA commented on HADOOP-12723: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-11487) FileNotFound on distcp to s3n/s3a due to creation inconsistency

2016-05-13 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15283275#comment-15283275 ] Chris Nauroth commented on HADOOP-11487: I just attached a patch to HADOOP-13145 to prevent this

[jira] [Commented] (HADOOP-12893) Verify LICENSE.txt and NOTICE.txt

2016-05-13 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15283241#comment-15283241 ] Wangda Tan commented on HADOOP-12893: - [~xiaochen], [~andrew.wang] and [~ajisakaa], thanks a lot

[jira] [Commented] (HADOOP-13144) Enhancing IPC client throughput via multiple connections per user

2016-05-13 Thread Jason Kace (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15283247#comment-15283247 ] Jason Kace commented on HADOOP-13144: - One solution is to allow each user + remote address to

[jira] [Commented] (HADOOP-12893) Verify LICENSE.txt and NOTICE.txt

2016-05-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15283260#comment-15283260 ] Andrew Wang commented on HADOOP-12893: -- In the L we say whether something applies to the binary or

[jira] [Created] (HADOOP-13145) In DistCp, prevent unnecessary getFileStatus call when not preserving metadata.

2016-05-13 Thread Chris Nauroth (JIRA)
Chris Nauroth created HADOOP-13145: -- Summary: In DistCp, prevent unnecessary getFileStatus call when not preserving metadata. Key: HADOOP-13145 URL: https://issues.apache.org/jira/browse/HADOOP-13145

[jira] [Commented] (HADOOP-13139) Branch-2: S3a to use thread pool that blocks clients

2016-05-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15282989#comment-15282989 ] Steve Loughran commented on HADOOP-13139: - do you think maybe putting it in as a deprecated key

[jira] [Updated] (HADOOP-13130) s3a failures can surface as RTEs, not IOEs

2016-05-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13130: Attachment: HADOOP-13130-001.patch Amazon S3, service and client exceptions are caught

[jira] [Commented] (HADOOP-13130) s3a failures can surface as RTEs, not IOEs

2016-05-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15282954#comment-15282954 ] Steve Loughran commented on HADOOP-13130: - I forgot to mention: patch 001 does make a couple of

[jira] [Updated] (HADOOP-13130) s3a failures can surface as RTEs, not IOEs

2016-05-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13130: Target Version/s: 2.8.0 Status: Patch Available (was: Open) > s3a failures

[jira] [Commented] (HADOOP-12893) Verify LICENSE.txt and NOTICE.txt

2016-05-13 Thread Sean Busbey (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15283060#comment-15283060 ] Sean Busbey commented on HADOOP-12893: -- An important note: it looks like y'all are planning on a

[jira] [Commented] (HADOOP-13140) GlobalStorageStatistics should check null FileSystem scheme to avoid NPE

2016-05-13 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15283061#comment-15283061 ] Arpit Agarwal commented on HADOOP-13140: Yes I think it's better to have a special statistics

[jira] [Commented] (HADOOP-13139) Branch-2: S3a to use thread pool that blocks clients

2016-05-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15282995#comment-15282995 ] Andrew Wang commented on HADOOP-13139: -- Possibly, but I thought deprecated keys forwarded to a new

[jira] [Commented] (HADOOP-13105) Support timeouts in LDAP queries in LdapGroupsMapping.

2016-05-13 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15283007#comment-15283007 ] Chris Nauroth commented on HADOOP-13105: [~liuml07], thank you for the patch. # I agree with

[jira] [Updated] (HADOOP-12893) Verify LICENSE.txt and NOTICE.txt

2016-05-13 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HADOOP-12893: --- Attachment: HADOOP-12893.01.patch Thanks [~wangda] for offering help! I was blocked by jira...

[jira] [Commented] (HADOOP-13114) DistCp should have option to compress data on write

2016-05-13 Thread Suraj Nayak (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15283079#comment-15283079 ] Suraj Nayak commented on HADOOP-13114: -- JIRA was not accepting comments when I uploaded the latest

[jira] [Commented] (HADOOP-12718) Incorrect error message by fs -put local dir without permission

2016-05-13 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15283082#comment-15283082 ] Chris Nauroth commented on HADOOP-12718: I'm considering reverting this patch for a few reasons.

[jira] [Commented] (HADOOP-13130) s3a failures can surface as RTEs, not IOEs

2016-05-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15283094#comment-15283094 ] Hadoop QA commented on HADOOP-13130: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-13138) Unable to append to a SequenceFile with Compression.NONE.

2016-05-13 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15283096#comment-15283096 ] Chris Nauroth commented on HADOOP-13138: [~vinayrpet], thank you for the patch. This looks good