[jira] [Created] (HADOOP-15138) CLONE - Executing the command 'hdfs -Dhadoop.security.credential.provider.path=file1.jceks,file2.jceks' fails if permission is denied to some files

2017-12-21 Thread Fan (JIRA)
Fan created HADOOP-15138: Summary: CLONE - Executing the command 'hdfs -Dhadoop.security.credential.provider.path=file1.jceks,file2.jceks' fails if permission is denied to some files Key: HADOOP-15138 URL:

[jira] [Resolved] (HADOOP-15138) CLONE - Executing the command 'hdfs -Dhadoop.security.credential.provider.path=file1.jceks,file2.jceks' fails if permission is denied to some files

2017-12-21 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-15138. - Resolution: Duplicate Closing this as a duplicate of the original, which is the same

[jira] [Commented] (HADOOP-15086) NativeAzureFileSystem file rename is not atomic

2017-12-21 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16299897#comment-16299897 ] Steve Loughran commented on HADOOP-15086: - Production code LGTM. Tests need a bit of tuning to

[jira] [Commented] (HADOOP-14178) Move Mockito up to version 2.x

2017-12-21 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16299864#comment-16299864 ] genericqa commented on HADOOP-14178: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-15136) Typo in rename spec pseudocode

2017-12-21 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16299866#comment-16299866 ] Steve Loughran commented on HADOOP-15136: - yes, you are right. Fancy submitting a patch? > Typo

[jira] [Comment Edited] (HADOOP-15124) Slow FileSystem.Statistics counters implementation

2017-12-21 Thread Igor Dvorzhak (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16300770#comment-16300770 ] Igor Dvorzhak edited comment on HADOOP-15124 at 12/22/17 6:15 AM: -- I

[jira] [Comment Edited] (HADOOP-15124) Slow FileSystem.Statistics counters implementation

2017-12-21 Thread Igor Dvorzhak (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16300770#comment-16300770 ] Igor Dvorzhak edited comment on HADOOP-15124 at 12/22/17 3:08 AM: -- I

[jira] [Commented] (HADOOP-15121) Encounter NullPointerException when using DecayRpcScheduler

2017-12-21 Thread Tao Jie (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16301035#comment-16301035 ] Tao Jie commented on HADOOP-15121: -- [~ajayydv] [~brahmareddy] [~anu] would you mind giving the latest

[jira] [Updated] (HADOOP-15114) Add closeStreams(...) to IOUtils

2017-12-21 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HADOOP-15114: Attachment: HADOOP-15114.003.patch [~arpitagarwal], thanks for review. Added additional call to

[jira] [Assigned] (HADOOP-15139) [Umbrella] Improvements and fixes for Hadoop shaded client work

2017-12-21 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham reassigned HADOOP-15139: --- Assignee: Bharat Viswanadham > [Umbrella] Improvements and fixes for

[jira] [Commented] (HADOOP-15093) Deprecation of yarn.resourcemanager.zk-address is undocumented

2017-12-21 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16300659#comment-16300659 ] Arpit Agarwal commented on HADOOP-15093: bq. Additionally, the Configuration base class doesn't

[jira] [Commented] (HADOOP-15114) Add closeStreams(...) to IOUtils

2017-12-21 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16300772#comment-16300772 ] genericqa commented on HADOOP-15114: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-14959) DelegationTokenAuthenticator.authenticate() to wrap network exceptions

2017-12-21 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16300792#comment-16300792 ] Arpit Agarwal commented on HADOOP-14959: bq. What do other people who understand UGI have to say

[jira] [Comment Edited] (HADOOP-15124) Slow FileSystem.Statistics counters implementation

2017-12-21 Thread Igor Dvorzhak (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16300770#comment-16300770 ] Igor Dvorzhak edited comment on HADOOP-15124 at 12/22/17 2:30 AM: -- I

[jira] [Comment Edited] (HADOOP-15124) Slow FileSystem.Statistics counters implementation

2017-12-21 Thread Igor Dvorzhak (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16300770#comment-16300770 ] Igor Dvorzhak edited comment on HADOOP-15124 at 12/22/17 2:30 AM: -- I

[jira] [Comment Edited] (HADOOP-15124) Slow FileSystem.Statistics counters implementation

2017-12-21 Thread Igor Dvorzhak (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16300770#comment-16300770 ] Igor Dvorzhak edited comment on HADOOP-15124 at 12/22/17 2:29 AM: -- I

[jira] [Updated] (HADOOP-15114) Add closeStreams(...) to IOUtils

2017-12-21 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HADOOP-15114: Attachment: HADOOP-15114.004.patch [~arpitagarwal], thanks for suggestion. In patch v4, throwing

[jira] [Commented] (HADOOP-15114) Add closeStreams(...) to IOUtils

2017-12-21 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16300758#comment-16300758 ] genericqa commented on HADOOP-15114: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HADOOP-15137) ClassNotFoundException: org.apache.hadoop.yarn.server.api.DistributedSchedulingAMProtocol when using hadoop-client-minicluster

2017-12-21 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HADOOP-15137: Issue Type: Sub-task (was: Bug) Parent: HADOOP-15139 >

[jira] [Commented] (HADOOP-15137) ClassNotFoundException: org.apache.hadoop.yarn.server.api.DistributedSchedulingAMProtocol when using hadoop-client-minicluster

2017-12-21 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16300576#comment-16300576 ] Junping Du commented on HADOOP-15137: - Thanks [~bharatviswa] for providing a patch. Looks like

[jira] [Commented] (HADOOP-15114) Add closeStreams(...) to IOUtils

2017-12-21 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16300663#comment-16300663 ] Arpit Agarwal commented on HADOOP-15114: v2 patch lgtm. I think Steve also wanted a test-case

[jira] [Commented] (HADOOP-15114) Add closeStreams(...) to IOUtils

2017-12-21 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16300710#comment-16300710 ] Arpit Agarwal commented on HADOOP-15114: Ajay, sorry I have one more comment I forgot to mention

[jira] [Commented] (HADOOP-15124) Slow FileSystem.Statistics counters implementation

2017-12-21 Thread Igor Dvorzhak (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16300770#comment-16300770 ] Igor Dvorzhak commented on HADOOP-15124: I have added a draft implementation of a property that

[jira] [Created] (HADOOP-15139) [Umbrella] Improvements and fixes for Hadoop shaded client work

2017-12-21 Thread Junping Du (JIRA)
Junping Du created HADOOP-15139: --- Summary: [Umbrella] Improvements and fixes for Hadoop shaded client work Key: HADOOP-15139 URL: https://issues.apache.org/jira/browse/HADOOP-15139 Project: Hadoop

[jira] [Commented] (HADOOP-15114) Add closeStreams(...) to IOUtils

2017-12-21 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16300718#comment-16300718 ] Arpit Agarwal commented on HADOOP-15114: +1 pending Jenkins. Will hold off committing for a bit

[jira] [Commented] (HADOOP-15113) NPE in S3A getFileStatus: null instrumentation on using closed instance

2017-12-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16300111#comment-16300111 ] Hudson commented on HADOOP-15113: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13415 (See

[jira] [Commented] (HADOOP-15033) Use java.util.zip.CRC32C for Java 9 and above

2017-12-21 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16300145#comment-16300145 ] genericqa commented on HADOOP-15033: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HADOOP-15113) NPE in S3A getFileStatus: null instrumentation on using closed instance

2017-12-21 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15113: Resolution: Fixed Fix Version/s: 3.1.0 Status: Resolved (was: Patch

[jira] [Commented] (HADOOP-13282) S3 blob etags to be made visible in status/getFileChecksum() calls

2017-12-21 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16300112#comment-16300112 ] Steve Loughran commented on HADOOP-13282: - I think that checksum preservation is all about HDFS,

[jira] [Commented] (HADOOP-15033) Use java.util.zip.CRC32C for Java 9 and above

2017-12-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16300132#comment-16300132 ] ASF GitHub Bot commented on HADOOP-15033: - Github user dchuyko commented on the issue:

[jira] [Commented] (HADOOP-15124) Slow FileSystem.Statistics counters implementation

2017-12-21 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16300035#comment-16300035 ] Steve Loughran commented on HADOOP-15124: - +yes, a speedup for 3.1/3.0 would work as it'd need

[jira] [Updated] (HADOOP-14707) AbstractContractDistCpTest to test attr preservation with -p, verify blobstores downgrade

2017-12-21 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14707: Attachment: HADOOP-14707-002.patch Patch 002, significant mission creep as the

[jira] [Updated] (HADOOP-13282) S3 blob etags to be made visible in S3A status/getFileChecksum() calls

2017-12-21 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13282: Summary: S3 blob etags to be made visible in S3A status/getFileChecksum() calls (was: S3

[jira] [Updated] (HADOOP-15033) Use java.util.zip.CRC32C for Java 9 and above

2017-12-21 Thread Dmitry Chuyko (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmitry Chuyko updated HADOOP-15033: --- Attachment: HADOOP-15033.005.patch Attached HADOOP-15033.005.patch > Use

[jira] [Updated] (HADOOP-13282) S3 blob etags to be made visible in S3A status/getFileChecksum() calls

2017-12-21 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13282: Resolution: Fixed Fix Version/s: 3.1.0 Status: Resolved (was: Patch

[jira] [Commented] (HADOOP-15086) NativeAzureFileSystem file rename is not atomic

2017-12-21 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16300551#comment-16300551 ] genericqa commented on HADOOP-15086: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-13282) S3 blob etags to be made visible in S3A status/getFileChecksum() calls

2017-12-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16300160#comment-16300160 ] Hudson commented on HADOOP-13282: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13416 (See

[jira] [Commented] (HADOOP-15033) Use java.util.zip.CRC32C for Java 9 and above

2017-12-21 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16300159#comment-16300159 ] genericqa commented on HADOOP-15033: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HADOOP-15033) Use java.util.zip.CRC32C for Java 9 and above

2017-12-21 Thread Dmitry Chuyko (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmitry Chuyko updated HADOOP-15033: --- Attachment: HADOOP-15033.005.diff > Use java.util.zip.CRC32C for Java 9 and above >

[jira] [Commented] (HADOOP-15033) Use java.util.zip.CRC32C for Java 9 and above

2017-12-21 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16300221#comment-16300221 ] genericqa commented on HADOOP-15033: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HADOOP-15033) Use java.util.zip.CRC32C for Java 9 and above

2017-12-21 Thread Dmitry Chuyko (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmitry Chuyko updated HADOOP-15033: --- Attachment: HADOOP-15033.005.diff > Use java.util.zip.CRC32C for Java 9 and above >

[jira] [Commented] (HADOOP-15113) NPE in S3A getFileStatus: null instrumentation on using closed instance

2017-12-21 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16299876#comment-16299876 ] Steve Loughran commented on HADOOP-15113: - thanks. The one thing weaker in volatile is not using

[jira] [Commented] (HADOOP-15136) Typo in rename spec pseudocode

2017-12-21 Thread Rae Marks (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16300369#comment-16300369 ] Rae Marks commented on HADOOP-15136: Sure, I'll get on that. Thanks! > Typo in rename spec

[jira] [Assigned] (HADOOP-12897) KerberosAuthenticator.authenticate to include URL on IO failures

2017-12-21 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar reassigned HADOOP-12897: --- Assignee: Ajay Kumar > KerberosAuthenticator.authenticate to include URL on IO failures >

[jira] [Comment Edited] (HADOOP-15114) Add closeStreams(...) to IOUtils

2017-12-21 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16299198#comment-16299198 ] Ajay Kumar edited comment on HADOOP-15114 at 12/21/17 6:55 PM: --- Test

[jira] [Commented] (HADOOP-14943) Add common getFileBlockLocations() emulation for object stores, including S3A

2017-12-21 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16300243#comment-16300243 ] Steve Loughran commented on HADOOP-14943: - [~iyonger]: what do you mean by "compute host list"?

[jira] [Updated] (HADOOP-15086) NativeAzureFileSystem file rename is not atomic

2017-12-21 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Marquardt updated HADOOP-15086: -- Affects Version/s: (was: 2.7.3) Target Version/s: 2.7.5, 3.0.0-beta1, 2.9.0

[jira] [Updated] (HADOOP-15086) NativeAzureFileSystem file rename is not atomic

2017-12-21 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Marquardt updated HADOOP-15086: -- Attachment: HADOOP-15086-002.patch Attaching HADOOP-15086-002.patch. Steve, this