[jira] [Updated] (HADOOP-14052) Fix dead link in KMS document

2017-03-08 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HADOOP-14052: Resolution: Fixed Fix Version/s: 3.0.0-alpha3 Status: Resolved (was: Patch

[jira] [Commented] (HADOOP-13759) Split SFTP FileSystem into its own artifact

2017-03-08 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15902624#comment-15902624 ] Yuanbo Liu commented on HADOOP-13759: - [~andrew.wang] Thanks for your response. {quote} So we could

[jira] [Commented] (HADOOP-14052) Fix dead link in KMS document

2017-03-08 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15902623#comment-15902623 ] John Zhuge commented on HADOOP-14052: - +1 LGTM. Verified the patch. Will commit shortly. > Fix dead

[jira] [Commented] (HADOOP-14123) Remove misplaced ADL service provider config file for FileSystem

2017-03-08 Thread Vishwajeet Dusane (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15902590#comment-15902590 ] Vishwajeet Dusane commented on HADOOP-14123: +1 LGTM > Remove misplaced ADL service

[jira] [Updated] (HADOOP-14123) Remove misplaced ADL service provider config file for FileSystem

2017-03-08 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HADOOP-14123: Issue Type: Sub-task (was: Improvement) Parent: HADOOP-14112 > Remove misplaced ADL

[jira] [Commented] (HADOOP-14123) Remove misplaced ADL service provider config file for FileSystem

2017-03-08 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15902585#comment-15902585 ] John Zhuge commented on HADOOP-14123: - Could anyone do a quick review? Very straightforward. >

[jira] [Commented] (HADOOP-14153) ADL module has messed doc structure

2017-03-08 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15902584#comment-15902584 ] John Zhuge commented on HADOOP-14153: - +1 LGTM. Thanks for switching to toc, which would have made

[jira] [Commented] (HADOOP-14165) Add S3Guard.dirListingUnion in S3AFileSystem#listFiles, listLocatedStatus

2017-03-08 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15902574#comment-15902574 ] Aaron Fabbri commented on HADOOP-14165: --- Dupe of HADOOP-13926? > Add S3Guard.dirListingUnion in

[jira] [Commented] (HADOOP-14122) Add ADLS to hadoop-cloud-storage-project

2017-03-08 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15902567#comment-15902567 ] John Zhuge commented on HADOOP-14122: - Thanks [~cnauroth] for the info ! > Add ADLS to

[jira] [Created] (HADOOP-14166) Reset the DecayRpcScheduler AvgResponseTime metric to zero when queue is not used

2017-03-08 Thread Surendra Singh Lilhore (JIRA)
Surendra Singh Lilhore created HADOOP-14166: --- Summary: Reset the DecayRpcScheduler AvgResponseTime metric to zero when queue is not used Key: HADOOP-14166 URL:

[jira] [Commented] (HADOOP-14030) PreCommit TestKDiag failure

2017-03-08 Thread Steven Rand (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15902534#comment-15902534 ] Steven Rand commented on HADOOP-14030: -- Also seeing this in HADOOP-14062. > PreCommit TestKDiag

[jira] [Commented] (HADOOP-14062) ApplicationMasterProtocolPBClientImpl.allocate fails with EOFException when RPC privacy is enabled

2017-03-08 Thread Steven Rand (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15902526#comment-15902526 ] Steven Rand commented on HADOOP-14062: -- It looks like HADOOP-14030 strikes again. Should I

[jira] [Reopened] (HADOOP-13037) Refactor Azure Data Lake Store as an independent FileSystem

2017-03-08 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas reopened HADOOP-13037: Reopening for backport to branch-2. Talked to [~djp], and will backport to branch-2.8 if

[jira] [Commented] (HADOOP-14104) Client should always ask namenode for kms provider path.

2017-03-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15902453#comment-15902453 ] Hadoop QA commented on HADOOP-14104: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-14062) ApplicationMasterProtocolPBClientImpl.allocate fails with EOFException when RPC privacy is enabled

2017-03-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15902404#comment-15902404 ] Hadoop QA commented on HADOOP-14062: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-14038) Rename ADLS credential properties

2017-03-08 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15902309#comment-15902309 ] John Zhuge commented on HADOOP-14038: - [~vishwajeet.dusane] Patch 004 has the following pieces: *

[jira] [Commented] (HADOOP-14104) Client should always ask namenode for kms provider path.

2017-03-08 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15902283#comment-15902283 ] Yongjun Zhang commented on HADOOP-14104: HI [~rushabh.shah], We need a solution soon, so I hope

[jira] [Updated] (HADOOP-14104) Client should always ask namenode for kms provider path.

2017-03-08 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HADOOP-14104: --- Attachment: HADOOP-14104-trunk-v3.patch > Client should always ask namenode for kms

[jira] [Updated] (HADOOP-14062) ApplicationMasterProtocolPBClientImpl.allocate fails with EOFException when RPC privacy is enabled

2017-03-08 Thread Steven Rand (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Rand updated HADOOP-14062: - Status: Patch Available (was: Reopened) > ApplicationMasterProtocolPBClientImpl.allocate fails

[jira] [Updated] (HADOOP-14062) ApplicationMasterProtocolPBClientImpl.allocate fails with EOFException when RPC privacy is enabled

2017-03-08 Thread Steven Rand (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Rand updated HADOOP-14062: - Attachment: HADOOP-14062.004.patch Attaching a new patch for trunk. >

[jira] [Commented] (HADOOP-13914) s3guard: improve S3AFileStatus#isEmptyDirectory handling

2017-03-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15902254#comment-15902254 ] Hadoop QA commented on HADOOP-13914: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Assigned] (HADOOP-13925) S3Guard: NPE when table is already populated in dynamodb and user specifies "fs.s3a.s3guard.ddb.table.create=false"

2017-03-08 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu reassigned HADOOP-13925: -- Assignee: Mingliang Liu > S3Guard: NPE when table is already populated in dynamodb

[jira] [Resolved] (HADOOP-14076) Allow Configuration to be persisted given path to file

2017-03-08 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved HADOOP-14076. - Resolution: Later This can be done client side. > Allow Configuration to be persisted given path to

[jira] [Commented] (HADOOP-14154) Set isAuthoritative flag when creating DirListingMetadata in DynamoDBMetaStore

2017-03-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15902213#comment-15902213 ] Hadoop QA commented on HADOOP-14154: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-13786) Add S3Guard committer for zero-rename commits to consistent S3 endpoints

2017-03-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15902203#comment-15902203 ] Hadoop QA commented on HADOOP-13786: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Created] (HADOOP-14165) Add S3Guard.dirListingUnion in S3AFileSystem#listFiles, listLocatedStatus

2017-03-08 Thread Rajesh Balamohan (JIRA)
Rajesh Balamohan created HADOOP-14165: - Summary: Add S3Guard.dirListingUnion in S3AFileSystem#listFiles, listLocatedStatus Key: HADOOP-14165 URL: https://issues.apache.org/jira/browse/HADOOP-14165

[jira] [Commented] (HADOOP-14154) Set isAuthoritative flag when creating DirListingMetadata in DynamoDBMetaStore

2017-03-08 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15902191#comment-15902191 ] Aaron Fabbri commented on HADOOP-14154: --- Hi [~rajesh.balamohan]. Thanks for the patch. This is

[jira] [Updated] (HADOOP-14154) Set isAuthoritative flag when creating DirListingMetadata in DynamoDBMetaStore

2017-03-08 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HADOOP-14154: -- Attachment: HADOOP-14154-HADOOP-13345.002.patch Fixing checkstyle issues. > Set

[jira] [Updated] (HADOOP-14150) Implement getHomeDirectory() method in NativeAzureFileSystem

2017-03-08 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey updated HADOOP-14150: -- Reporter: Namit Maheshwari (was: Santhosh G Nayak) > Implement

[jira] [Commented] (HADOOP-14052) Fix dead link in KMS document

2017-03-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15902185#comment-15902185 ] Hadoop QA commented on HADOOP-14052: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-14145) Ensure GenericOptionParser is used for S3Guard CLI

2017-03-08 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15902179#comment-15902179 ] Aaron Fabbri commented on HADOOP-14145: --- I'm ok with punting on automated testing of

[jira] [Updated] (HADOOP-14052) Fix dead link in KMS document

2017-03-08 Thread Christina Vu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Christina Vu updated HADOOP-14052: -- Status: Patch Available (was: Open) > Fix dead link in KMS document >

[jira] [Updated] (HADOOP-14052) Fix dead link in KMS document

2017-03-08 Thread Christina Vu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Christina Vu updated HADOOP-14052: -- Attachment: HADOOP-14052.001.patch Only took 2-3 weeks but it's completed :-) > Fix dead

[jira] [Updated] (HADOOP-13914) s3guard: improve S3AFileStatus#isEmptyDirectory handling

2017-03-08 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Fabbri updated HADOOP-13914: -- Attachment: HADOOP-13914-HADOOP-13345.007.patch Attaching v7 patch. Same as v6 except

[jira] [Updated] (HADOOP-13786) Add S3Guard committer for zero-rename commits to consistent S3 endpoints

2017-03-08 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13786: Attachment: HADOOP-13786-HADOOP-13345-009.patch Patch 009; pulling in Ryan's netflix

[jira] [Updated] (HADOOP-13786) Add S3Guard committer for zero-rename commits to consistent S3 endpoints

2017-03-08 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13786: Status: Patch Available (was: Open) > Add S3Guard committer for zero-rename commits to

[jira] [Commented] (HADOOP-13786) Add S3Guard committer for zero-rename commits to consistent S3 endpoints

2017-03-08 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15902045#comment-15902045 ] Steve Loughran commented on HADOOP-13786: - Ryan, I think you'll find this is inextricably linked

[jira] [Commented] (HADOOP-14062) ApplicationMasterProtocolPBClientImpl.allocate fails with EOFException when RPC privacy is enabled

2017-03-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15902034#comment-15902034 ] Hudson commented on HADOOP-14062: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11374 (See

[jira] [Commented] (HADOOP-14062) ApplicationMasterProtocolPBClientImpl.allocate fails with EOFException when RPC privacy is enabled

2017-03-08 Thread Steven Rand (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15902008#comment-15902008 ] Steven Rand commented on HADOOP-14062: -- Yes, will do, hopefully by the end of today. >

[jira] [Reopened] (HADOOP-14062) ApplicationMasterProtocolPBClientImpl.allocate fails with EOFException when RPC privacy is enabled

2017-03-08 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He reopened HADOOP-14062: -- > ApplicationMasterProtocolPBClientImpl.allocate fails with EOFException when > RPC privacy is enabled >

[jira] [Commented] (HADOOP-14062) ApplicationMasterProtocolPBClientImpl.allocate fails with EOFException when RPC privacy is enabled

2017-03-08 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15901991#comment-15901991 ] Jian He commented on HADOOP-14062: -- [~manojg], thanks for reporting the issue. sorry for the troubles.

[jira] [Commented] (HADOOP-14062) ApplicationMasterProtocolPBClientImpl.allocate fails with EOFException when RPC privacy is enabled

2017-03-08 Thread Steven Rand (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15901942#comment-15901942 ] Steven Rand commented on HADOOP-14062: -- Yes, it looks like the changes in YARN-6218 conflict with

[jira] [Updated] (HADOOP-13606) swift FS to add a service load metadata file

2017-03-08 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HADOOP-13606: Resolution: Fixed Fix Version/s: (was: 3.0.0-alpha2) (was:

[jira] [Commented] (HADOOP-13689) Do not attach javadoc and sources jars during non-dist build

2017-03-08 Thread eddie luo (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15901909#comment-15901909 ] eddie luo commented on HADOOP-13689: I didn't open a JIRA for this issue. Yes, i fixed this error

[jira] [Updated] (HADOOP-14027) Implicitly creating DynamoDB table ignores endpoint config

2017-03-08 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14027: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HADOOP-13345

[jira] [Created] (HADOOP-14164) Update the skin of maven-site during doc generation

2017-03-08 Thread Elek, Marton (JIRA)
Elek, Marton created HADOOP-14164: - Summary: Update the skin of maven-site during doc generation Key: HADOOP-14164 URL: https://issues.apache.org/jira/browse/HADOOP-14164 Project: Hadoop Common

[jira] [Commented] (HADOOP-14062) ApplicationMasterProtocolPBClientImpl.allocate fails with EOFException when RPC privacy is enabled

2017-03-08 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15901870#comment-15901870 ] Manoj Govindassamy commented on HADOOP-14062: - [~Steven Rand]/[~jianhe], Can you please

[jira] [Created] (HADOOP-14163) Refactor existing hadoop site to use more usable static website generator

2017-03-08 Thread Elek, Marton (JIRA)
Elek, Marton created HADOOP-14163: - Summary: Refactor existing hadoop site to use more usable static website generator Key: HADOOP-14163 URL: https://issues.apache.org/jira/browse/HADOOP-14163

[jira] [Created] (HADOOP-14162) Improve release scripts to automate missing steps

2017-03-08 Thread Elek, Marton (JIRA)
Elek, Marton created HADOOP-14162: - Summary: Improve release scripts to automate missing steps Key: HADOOP-14162 URL: https://issues.apache.org/jira/browse/HADOOP-14162 Project: Hadoop Common

[jira] [Comment Edited] (HADOOP-14161) Failed to rename S3AFileStatus

2017-03-08 Thread Luke Miner (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15901815#comment-15901815 ] Luke Miner edited comment on HADOOP-14161 at 3/8/17 7:29 PM: -

[jira] [Commented] (HADOOP-14062) ApplicationMasterProtocolPBClientImpl.allocate fails with EOFException when RPC privacy is enabled

2017-03-08 Thread Steven Rand (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15901826#comment-15901826 ] Steven Rand commented on HADOOP-14062: -- Thanks [~jianhe] for reviewing! >

[jira] [Updated] (HADOOP-14161) Failed to rename S3AFileStatus

2017-03-08 Thread Luke Miner (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Miner updated HADOOP-14161: Description: I'm getting non deterministic rename errors while writing to S3 using spark and

[jira] [Commented] (HADOOP-14161) Failed to rename S3AFileStatus

2017-03-08 Thread Luke Miner (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15901815#comment-15901815 ] Luke Miner commented on HADOOP-14161: - [~ste...@apache.org] FYI. Incidentally, we're trying to move

[jira] [Created] (HADOOP-14161) Failed to rename S3AFileStatus

2017-03-08 Thread Luke Miner (JIRA)
Luke Miner created HADOOP-14161: --- Summary: Failed to rename S3AFileStatus Key: HADOOP-14161 URL: https://issues.apache.org/jira/browse/HADOOP-14161 Project: Hadoop Common Issue Type: Bug

[jira] [Updated] (HADOOP-14062) ApplicationMasterProtocolPBClientImpl.allocate fails with EOFException when RPC privacy is enabled

2017-03-08 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated HADOOP-14062: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha3

[jira] [Commented] (HADOOP-14062) ApplicationMasterProtocolPBClientImpl.allocate fails with EOFException when RPC privacy is enabled

2017-03-08 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15901792#comment-15901792 ] Jian He commented on HADOOP-14062: -- I committed to trunk, branch-2, branch-2.8, branch-2.8.0 Thanks

[jira] [Assigned] (HADOOP-14062) ApplicationMasterProtocolPBClientImpl.allocate fails with EOFException when RPC privacy is enabled

2017-03-08 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He reassigned HADOOP-14062: Assignee: Steven Rand > ApplicationMasterProtocolPBClientImpl.allocate fails with EOFException

[jira] [Commented] (HADOOP-14062) ApplicationMasterProtocolPBClientImpl.allocate fails with EOFException when RPC privacy is enabled

2017-03-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15901774#comment-15901774 ] Hudson commented on HADOOP-14062: - FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #11373 (See

[jira] [Created] (HADOOP-14160) Create dev-support scripts to do the bulk jira update required by the release process

2017-03-08 Thread Elek, Marton (JIRA)
Elek, Marton created HADOOP-14160: - Summary: Create dev-support scripts to do the bulk jira update required by the release process Key: HADOOP-14160 URL: https://issues.apache.org/jira/browse/HADOOP-14160

[jira] [Commented] (HADOOP-13606) swift FS to add a service load metadata file

2017-03-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15901730#comment-15901730 ] Hudson commented on HADOOP-13606: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11372 (See

[jira] [Commented] (HADOOP-13926) S3Guard: Improve listLocatedStatus and listFiles

2017-03-08 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15901676#comment-15901676 ] Steve Loughran commented on HADOOP-13926: - Just removed HADOOP-14000 as a dependency; instead

[jira] [Commented] (HADOOP-14000) s3guard metadata stores to support millons of children

2017-03-08 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15901669#comment-15901669 ] Steve Loughran commented on HADOOP-14000: - HADOOP-14159 covers changes into Hadoop's APIs and

[jira] [Created] (HADOOP-14159) Add some Java-8 friendly way to work with RemoteIterable, especially listings

2017-03-08 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-14159: --- Summary: Add some Java-8 friendly way to work with RemoteIterable, especially listings Key: HADOOP-14159 URL: https://issues.apache.org/jira/browse/HADOOP-14159

[jira] [Commented] (HADOOP-13786) Add S3Guard committer for zero-rename commits to consistent S3 endpoints

2017-03-08 Thread Ryan Blue (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15901663#comment-15901663 ] Ryan Blue commented on HADOOP-13786: Thanks for doing so much to get this in! Let me know when it is

[jira] [Commented] (HADOOP-13759) Split SFTP FileSystem into its own artifact

2017-03-08 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15901543#comment-15901543 ] Andrew Wang commented on HADOOP-13759: -- At Cloudera, we've stopped using SSH fencing. We had only a

[jira] [Commented] (HADOOP-13998) initial s3guard preview

2017-03-08 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15901524#comment-15901524 ] Steve Loughran commented on HADOOP-13998: - Add: review key hashing so that we are confident it

[jira] [Commented] (HADOOP-14153) ADL module has messed doc structure

2017-03-08 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15901483#comment-15901483 ] Mingliang Liu commented on HADOOP-14153: Thanks for the review. {quote} By the way, does index

[jira] [Updated] (HADOOP-14156) Grammar error in the ConfTest.java

2017-03-08 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-14156: --- Status: Patch Available (was: Open) > Grammar error in the ConfTest.java >

[jira] [Commented] (HADOOP-14145) Ensure GenericOptionParser is used for S3Guard CLI

2017-03-08 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15901455#comment-15901455 ] Sean Mackrory commented on HADOOP-14145: Filed HADOOP-14158. > Ensure GenericOptionParser is

[jira] [Created] (HADOOP-14158) Possible for modified configuration to leak into metadatastore in S3GuardTool

2017-03-08 Thread Sean Mackrory (JIRA)
Sean Mackrory created HADOOP-14158: -- Summary: Possible for modified configuration to leak into metadatastore in S3GuardTool Key: HADOOP-14158 URL: https://issues.apache.org/jira/browse/HADOOP-14158

[jira] [Comment Edited] (HADOOP-14027) Implicitly creating DynamoDB table ignores endpoint config

2017-03-08 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15901400#comment-15901400 ] Sean Mackrory edited comment on HADOOP-14027 at 3/8/17 3:39 PM:

[jira] [Commented] (HADOOP-14027) Implicitly creating DynamoDB table ignores endpoint config

2017-03-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15901441#comment-15901441 ] Hadoop QA commented on HADOOP-14027: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HADOOP-14027) Implicitly creating DynamoDB table ignores endpoint config

2017-03-08 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Mackrory updated HADOOP-14027: --- Attachment: HADOOP-14027-HADOOP-13345.002.patch Attaching a patch incorporating

[jira] [Commented] (HADOOP-14145) Ensure GenericOptionParser is used for S3Guard CLI

2017-03-08 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15901375#comment-15901375 ] Sean Mackrory commented on HADOOP-14145: So all of my attempts at automated testing of this

[jira] [Commented] (HADOOP-14157) FsUrlStreamHandlerFactory "Illegal character in path" parsing file URL on Windows

2017-03-08 Thread Simon Scott (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15901380#comment-15901380 ] Simon Scott commented on HADOOP-14157: -- I have debugged this issue and believe I have a good

[jira] [Created] (HADOOP-14157) FsUrlStreamHandlerFactory "Illegal character in path" parsing file URL on Windows

2017-03-08 Thread Simon Scott (JIRA)
Simon Scott created HADOOP-14157: Summary: FsUrlStreamHandlerFactory "Illegal character in path" parsing file URL on Windows Key: HADOOP-14157 URL: https://issues.apache.org/jira/browse/HADOOP-14157

[jira] [Commented] (HADOOP-14038) Rename ADLS credential properties

2017-03-08 Thread Vishwajeet Dusane (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15901354#comment-15901354 ] Vishwajeet Dusane commented on HADOOP-14038: [~jzhuge] & [~ste...@apache.org] Should we

[jira] [Commented] (HADOOP-14153) ADL module has messed doc structure

2017-03-08 Thread Vishwajeet Dusane (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15901224#comment-15901224 ] Vishwajeet Dusane commented on HADOOP-14153: [~liuml07] Thanks you for modifying the

[jira] [Commented] (HADOOP-13759) Split SFTP FileSystem into its own artifact

2017-03-08 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15901142#comment-15901142 ] Yuanbo Liu commented on HADOOP-13759: - [~ste...@apache.org] Thanks for your response. {quote} The

[jira] [Commented] (HADOOP-14156) Grammar error in the ConfTest.java

2017-03-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15901127#comment-15901127 ] ASF GitHub Bot commented on HADOOP-14156: - Github user adyatlov commented on the issue:

[jira] [Created] (HADOOP-14156) Grammar error in the ConfTest.java

2017-03-08 Thread Andrey Dyatlov (JIRA)
Andrey Dyatlov created HADOOP-14156: --- Summary: Grammar error in the ConfTest.java Key: HADOOP-14156 URL: https://issues.apache.org/jira/browse/HADOOP-14156 Project: Hadoop Common Issue

[jira] [Commented] (HADOOP-13759) Split SFTP FileSystem into its own artifact

2017-03-08 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15901103#comment-15901103 ] Steve Loughran commented on HADOOP-13759: - This JIRA can cover both, just change the title to

[jira] [Commented] (HADOOP-13606) swift FS to add a service load metadata file

2017-03-08 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15901100#comment-15901100 ] Steve Loughran commented on HADOOP-13606: - +1 for the rollback > swift FS to add a service load

[jira] [Commented] (HADOOP-13786) Add S3Guard committer for zero-rename commits to consistent S3 endpoints

2017-03-08 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15901043#comment-15901043 ] Steve Loughran commented on HADOOP-13786: - Thanks! I'll share what I've done with it soon, which

[jira] [Commented] (HADOOP-14152) Operation not authorized in swift unit test

2017-03-08 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15901039#comment-15901039 ] Steve Loughran commented on HADOOP-14152: - implies token renewal isn't handled > Operation not

[jira] [Commented] (HADOOP-14151) Swift treats 0-len file as directory

2017-03-08 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15901038#comment-15901038 ] Steve Loughran commented on HADOOP-14151: - # it's a duplicate of an existing issue; I think you

[jira] [Commented] (HADOOP-14155) KerberosName.replaceParameters() may throw java.lang.ArrayIndexOutOfBoundsException

2017-03-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15901034#comment-15901034 ] Hadoop QA commented on HADOOP-14155: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-14146) KerberosAuthenticationHandler should authenticate with SPN in AP-REQ

2017-03-08 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15900989#comment-15900989 ] Kai Zheng commented on HADOOP-14146: Hi [~daryn], Pretty smart and impressive the way you thought

[jira] [Updated] (HADOOP-14155) KerberosName.replaceParameters() may throw java.lang.ArrayIndexOutOfBoundsException

2017-03-08 Thread Dazhuang Su (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dazhuang Su updated HADOOP-14155: - Status: Patch Available (was: Open) > KerberosName.replaceParameters() may throw >

[jira] [Updated] (HADOOP-14155) KerberosName.replaceParameters() may throw java.lang.ArrayIndexOutOfBoundsException

2017-03-08 Thread Dazhuang Su (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dazhuang Su updated HADOOP-14155: - Attachment: HADOOP-14155.patch > KerberosName.replaceParameters() may throw >

[jira] [Created] (HADOOP-14155) KerberosName.replaceParameters() may throw java.lang.ArrayIndexOutOfBoundsException

2017-03-08 Thread Dazhuang Su (JIRA)
Dazhuang Su created HADOOP-14155: Summary: KerberosName.replaceParameters() may throw java.lang.ArrayIndexOutOfBoundsException Key: HADOOP-14155 URL: https://issues.apache.org/jira/browse/HADOOP-14155

[jira] [Commented] (HADOOP-13759) Split SFTP FileSystem into its own artifact

2017-03-08 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15900945#comment-15900945 ] Yuanbo Liu commented on HADOOP-13759: - Sorry for the late response. [~andrew.wang] We cannot get rid