[jira] [Updated] (HADOOP-13606) swift FS to add a service load metadata file

2017-03-07 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HADOOP-13606: Target Version/s: 3.0.0-alpha3 Status: Patch Available (was: Reopened) > swift FS

[jira] [Updated] (HADOOP-13606) swift FS to add a service load metadata file

2017-03-07 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HADOOP-13606: Attachment: unit_test_results_for_HADOOP-13606.002 HADOOP-13606.002.patch Patch

[jira] [Commented] (HADOOP-14154) Set isAuthoritative flag when creating DirListingMetadata in DynamoDBMetaStore

2017-03-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15900797#comment-15900797 ] Hadoop QA commented on HADOOP-14154: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HADOOP-14154) Set isAuthoritative flag when creating DirListingMetadata in DynamoDBMetaStore

2017-03-07 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HADOOP-14154: -- Status: Patch Available (was: Open) > Set isAuthoritative flag when creating

[jira] [Updated] (HADOOP-14154) Set isAuthoritative flag when creating DirListingMetadata in DynamoDBMetaStore

2017-03-07 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HADOOP-14154: -- Attachment: HADOOP-14154-HADOOP-13345.001.patch > Set isAuthoritative flag when

[jira] [Commented] (HADOOP-13914) s3guard: improve S3AFileStatus#isEmptyDirectory handling

2017-03-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15900623#comment-15900623 ] Hadoop QA commented on HADOOP-13914: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Created] (HADOOP-14154) Set isAuthoritative flag when creating DirListingMetadata in DynamoDBMetaStore

2017-03-07 Thread Rajesh Balamohan (JIRA)
Rajesh Balamohan created HADOOP-14154: - Summary: Set isAuthoritative flag when creating DirListingMetadata in DynamoDBMetaStore Key: HADOOP-14154 URL: https://issues.apache.org/jira/browse/HADOOP-14154

[jira] [Comment Edited] (HADOOP-13914) s3guard: improve S3AFileStatus#isEmptyDirectory handling

2017-03-07 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15900523#comment-15900523 ] Aaron Fabbri edited comment on HADOOP-13914 at 3/8/17 1:26 AM: --- Attaching

[jira] [Updated] (HADOOP-13914) s3guard: improve S3AFileStatus#isEmptyDirectory handling

2017-03-07 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Fabbri updated HADOOP-13914: -- Attachment: HADOOP-13914-HADOOP-13345.006.patch Attaching v6 patch. Changes from v5: - Use

[jira] [Updated] (HADOOP-14150) Implement getHomeDirectory() method in NativeAzureFileSystem

2017-03-07 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14150: --- Priority: Critical (was: Major) > Implement getHomeDirectory() method in

[jira] [Commented] (HADOOP-14153) ADL module has messed doc structure

2017-03-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15900491#comment-15900491 ] Hadoop QA commented on HADOOP-14153: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-14062) ApplicationMasterProtocolPBClientImpl.allocate fails with EOFException when RPC privacy is enabled

2017-03-07 Thread Steven Rand (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15900470#comment-15900470 ] Steven Rand commented on HADOOP-14062: -- Looks like tests are also broken with the dummy patch? >

[jira] [Updated] (HADOOP-14153) ADL module has messed doc structure

2017-03-07 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14153: --- Description: RT > ADL module has messed doc structure > ---

[jira] [Commented] (HADOOP-14153) ADL module has messed doc structure

2017-03-07 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15900459#comment-15900459 ] Mingliang Liu commented on HADOOP-14153: Ping [~ajisakaa] and [~ste...@apache.org]. > ADL

[jira] [Updated] (HADOOP-14153) ADL module has messed doc structure

2017-03-07 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14153: --- Labels: documentaion (was: ) > ADL module has messed doc structure >

[jira] [Updated] (HADOOP-14153) ADL module has messed doc structure

2017-03-07 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14153: --- Status: Patch Available (was: Open) > ADL module has messed doc structure >

[jira] [Updated] (HADOOP-14153) ADL module has messed doc structure

2017-03-07 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14153: --- Attachment: HADOOP-14153.000.patch The v0 patch honors the original outline of the doc. >

[jira] [Updated] (HADOOP-14153) ADL module has messed doc structure

2017-03-07 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14153: --- Issue Type: Sub-task (was: Bug) Parent: HADOOP-14112 > ADL module has messed doc

[jira] [Created] (HADOOP-14153) ADL module has messed doc structure

2017-03-07 Thread Mingliang Liu (JIRA)
Mingliang Liu created HADOOP-14153: -- Summary: ADL module has messed doc structure Key: HADOOP-14153 URL: https://issues.apache.org/jira/browse/HADOOP-14153 Project: Hadoop Common Issue

[jira] [Comment Edited] (HADOOP-13946) Document how HDFS updates timestamps in the FS spec; compare with object stores

2017-03-07 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15900403#comment-15900403 ] Mingliang Liu edited comment on HADOOP-13946 at 3/7/17 11:46 PM: - Chris'

[jira] [Updated] (HADOOP-13946) Document how HDFS updates timestamps in the FS spec; compare with object stores

2017-03-07 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-13946: --- Attachment: Screen Shot 2017-03-07 at 3.44.43 PM.png Chris' comment makes sense to me. I

[jira] [Commented] (HADOOP-14150) Implement getHomeDirectory() method in NativeAzureFileSystem

2017-03-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15900388#comment-15900388 ] Hudson commented on HADOOP-14150: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11368 (See

[jira] [Updated] (HADOOP-13946) Document how HDFS updates timestamps in the FS spec; compare with object stores

2017-03-07 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-13946: --- Attachment: HADOOP-13946-005.patch > Document how HDFS updates timestamps in the FS spec;

[jira] [Updated] (HADOOP-14150) Implement getHomeDirectory() method in NativeAzureFileSystem

2017-03-07 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14150: --- Resolution: Fixed Target Version/s: 3.0.0-alpha2, 2.9.0 (was: 2.9.0,

[jira] [Updated] (HADOOP-14150) Implement getHomeDirectory() method in NativeAzureFileSystem

2017-03-07 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14150: --- Fix Version/s: 3.0.0-alpha3 2.9.0 > Implement getHomeDirectory() method

[jira] [Updated] (HADOOP-14150) Implement getHomeDirectory() method in NativeAzureFileSystem

2017-03-07 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14150: --- Target Version/s: 2.9.0, 3.0.0-alpha3 (was: 2.9.0, 3.0.0-alpha2) > Implement

[jira] [Commented] (HADOOP-14150) Implement getHomeDirectory() method in NativeAzureFileSystem

2017-03-07 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15900330#comment-15900330 ] Mingliang Liu commented on HADOOP-14150: +1 pending on Jenkins. > Implement getHomeDirectory()

[jira] [Updated] (HADOOP-14150) Implement getHomeDirectory() method in NativeAzureFileSystem

2017-03-07 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14150: --- Target Version/s: 3.0.0-alpha2, 2.9.0 (was: 2.9.0, 3.0.0-alpha2) Hadoop Flags:

[jira] [Commented] (HADOOP-14150) Implement getHomeDirectory() method in NativeAzureFileSystem

2017-03-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15900331#comment-15900331 ] Hadoop QA commented on HADOOP-14150: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HADOOP-13786) Add S3Guard committer for zero-rename commits to consistent S3 endpoints

2017-03-07 Thread Ryan Blue (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Blue updated HADOOP-13786: --- Attachment: s3committer-master.zip I'm attaching the S3 committer code to show intent to

[jira] [Commented] (HADOOP-14150) Implement getHomeDirectory() method in NativeAzureFileSystem

2017-03-07 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15900303#comment-15900303 ] Mingliang Liu commented on HADOOP-14150: Submitting the patch to trigger pre-commit run and also

[jira] [Updated] (HADOOP-14150) Implement getHomeDirectory() method in NativeAzureFileSystem

2017-03-07 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14150: --- Target Version/s: 3.0.0-alpha2, 2.9.0 (was: 2.9.0) Status: Patch Available

[jira] [Commented] (HADOOP-14027) Implicitly creating DynamoDB table ignores endpoint config

2017-03-07 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15900295#comment-15900295 ] Mingliang Liu commented on HADOOP-14027: The patch looks good to me. +1 Nits: # So the behavior

[jira] [Commented] (HADOOP-14152) Operation not authorized in swift unit test

2017-03-07 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15900250#comment-15900250 ] John Zhuge commented on HADOOP-14152: - I suspect the access token expired in about an hour and was

[jira] [Created] (HADOOP-14152) Operation not authorized in swift unit test

2017-03-07 Thread John Zhuge (JIRA)
John Zhuge created HADOOP-14152: --- Summary: Operation not authorized in swift unit test Key: HADOOP-14152 URL: https://issues.apache.org/jira/browse/HADOOP-14152 Project: Hadoop Common Issue

[jira] [Commented] (HADOOP-11794) distcp can copy blocks in parallel

2017-03-07 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15900237#comment-15900237 ] Yongjun Zhang commented on HADOOP-11794: Thanks for being interested [~zshao], Wonder if you

[jira] [Created] (HADOOP-14151) Swift treats 0-len file as directory

2017-03-07 Thread John Zhuge (JIRA)
John Zhuge created HADOOP-14151: --- Summary: Swift treats 0-len file as directory Key: HADOOP-14151 URL: https://issues.apache.org/jira/browse/HADOOP-14151 Project: Hadoop Common Issue Type: Bug

[jira] [Commented] (HADOOP-13805) UGI.getCurrentUser() fails if user does not have a keytab associated

2017-03-07 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15900196#comment-15900196 ] Alejandro Abdelnur commented on HADOOP-13805: - Hi [~daryn], The exception we were hitting

[jira] [Commented] (HADOOP-14027) Implicitly creating DynamoDB table ignores endpoint config

2017-03-07 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15900167#comment-15900167 ] Sean Mackrory commented on HADOOP-14027: {quote}To be clear, this patch fixes the tests that

[jira] [Commented] (HADOOP-13914) s3guard: improve S3AFileStatus#isEmptyDirectory handling

2017-03-07 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15900130#comment-15900130 ] Aaron Fabbri commented on HADOOP-13914: --- Yes [~rajesh.balamohan], I just noticed that too. Good

[jira] [Commented] (HADOOP-11794) distcp can copy blocks in parallel

2017-03-07 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15899989#comment-15899989 ] Zheng Shao commented on HADOOP-11794: - [~yzhangal] Can you provide a github link to make review

[jira] [Commented] (HADOOP-14104) Client should always ask namenode for kms provider path.

2017-03-07 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15899833#comment-15899833 ] Yongjun Zhang commented on HADOOP-14104: HI [~rushabh.shah], Thanks again for your updated

[jira] [Commented] (HADOOP-9749) Remove synchronization for UGI.getCurrentUser

2017-03-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-9749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15899775#comment-15899775 ] Hadoop QA commented on HADOOP-9749: --- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HADOOP-13926) S3Guard: Improve listLocatedStatus and listFiles

2017-03-07 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15899684#comment-15899684 ] Steve Loughran commented on HADOOP-13926: - Looking at this some more, I'm happy with the

[jira] [Updated] (HADOOP-13926) S3Guard: Improve listLocatedStatus and listFiles

2017-03-07 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13926: Summary: S3Guard: Improve listLocatedStatus and listFiles (was: S3Guard: Improve

[jira] [Assigned] (HADOOP-13926) S3Guard: Improve listLocatedStatus and listLocatedStatus

2017-03-07 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reassigned HADOOP-13926: --- Assignee: Steve Loughran > S3Guard: Improve listLocatedStatus and

[jira] [Commented] (HADOOP-14145) Ensure GenericOptionParser is used for S3Guard CLI

2017-03-07 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15899674#comment-15899674 ] Sean Mackrory commented on HADOOP-14145: In addition to all existing S3 tests, I did the

[jira] [Updated] (HADOOP-9749) Remove synchronization for UGI.getCurrentUser

2017-03-07 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-9749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HADOOP-9749: Attachment: HADOOP-9749.trunk.2.patch Updated stale patch to account for contextual changes. >

[jira] [Commented] (HADOOP-14146) KerberosAuthenticationHandler should authenticate with SPN in AP-REQ

2017-03-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15899576#comment-15899576 ] Hadoop QA commented on HADOOP-14146: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-13836) Securing Hadoop RPC using SSL

2017-03-07 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15899515#comment-15899515 ] Daryn Sharp commented on HADOOP-13836: -- I think the suggested course of action is good. Any luck

[jira] [Updated] (HADOOP-14146) KerberosAuthenticationHandler should authenticate with SPN in AP-REQ

2017-03-07 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HADOOP-14146: - Attachment: HADOOP-14146.1.patch Fix findbugs and style warnings. Other failures caused by

[jira] [Commented] (HADOOP-13946) Document how HDFS updates timestamps in the FS spec; compare with object stores

2017-03-07 Thread Thomas Demoor (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15899437#comment-15899437 ] Thomas Demoor commented on HADOOP-13946: my previous remarks have been addressed. didn't find

[jira] [Commented] (HADOOP-13914) s3guard: improve S3AFileStatus#isEmptyDirectory handling

2017-03-07 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898949#comment-15898949 ] Rajesh Balamohan commented on HADOOP-13914: --- {noformat} S3AFileStatus innerGetFileStatus(final