[jira] [Updated] (HADOOP-14150) Implement getHomeDirectory() method in NativeAzureFileSystem

2017-03-07 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14150: --- Resolution: Fixed Target Version/s: 3.0.0-alpha2, 2.9.0 (was: 2.9.0,

[jira] [Updated] (HADOOP-14150) Implement getHomeDirectory() method in NativeAzureFileSystem

2017-03-07 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14150: --- Fix Version/s: 3.0.0-alpha3 2.9.0 > Implement getHomeDirectory() method

[jira] [Updated] (HADOOP-14150) Implement getHomeDirectory() method in NativeAzureFileSystem

2017-03-07 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14150: --- Target Version/s: 2.9.0, 3.0.0-alpha3 (was: 2.9.0, 3.0.0-alpha2) > Implement

[jira] [Commented] (HADOOP-14150) Implement getHomeDirectory() method in NativeAzureFileSystem

2017-03-07 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15900330#comment-15900330 ] Mingliang Liu commented on HADOOP-14150: +1 pending on Jenkins. > Implement getHomeDirectory()

[jira] [Updated] (HADOOP-14150) Implement getHomeDirectory() method in NativeAzureFileSystem

2017-03-07 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14150: --- Target Version/s: 3.0.0-alpha2, 2.9.0 (was: 2.9.0, 3.0.0-alpha2) Hadoop Flags:

[jira] [Commented] (HADOOP-14150) Implement getHomeDirectory() method in NativeAzureFileSystem

2017-03-07 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15900303#comment-15900303 ] Mingliang Liu commented on HADOOP-14150: Submitting the patch to trigger pre-commit run and also

[jira] [Updated] (HADOOP-14150) Implement getHomeDirectory() method in NativeAzureFileSystem

2017-03-07 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14150: --- Target Version/s: 3.0.0-alpha2, 2.9.0 (was: 2.9.0) Status: Patch Available

[jira] [Commented] (HADOOP-14027) Implicitly creating DynamoDB table ignores endpoint config

2017-03-07 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15900295#comment-15900295 ] Mingliang Liu commented on HADOOP-14027: The patch looks good to me. +1 Nits: # So the behavior

[jira] [Updated] (HADOOP-14048) REDO operation of WASB#AtomicRename should create placeholder blob for destination folder

2017-03-06 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14048: --- Priority: Critical (was: Major) > REDO operation of WASB#AtomicRename should create

[jira] [Updated] (HADOOP-14048) REDO operation of WASB#AtomicRename of folder should create placeholder blob for destination folder

2017-03-06 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14048: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha3

[jira] [Updated] (HADOOP-14048) REDO operation of WASB#AtomicRename should create placeholder blob for destination folder

2017-03-06 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14048: --- Summary: REDO operation of WASB#AtomicRename should create placeholder blob for destination

[jira] [Updated] (HADOOP-14048) REDO operation of WASB#AtomicRename of folder should create placeholder blob for destination folder

2017-03-06 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14048: --- Summary: REDO operation of WASB#AtomicRename of folder should create placeholder blob for

[jira] [Commented] (HADOOP-13914) s3guard: improve S3AFileStatus#isEmptyDirectory handling

2017-03-03 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15895426#comment-15895426 ] Mingliang Liu commented on HADOOP-13914: Thanks [~fabbri], this is really good improvement. I

[jira] [Updated] (HADOOP-13930) Azure: Add Authorization support to WASB

2017-03-03 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-13930: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha3

[jira] [Commented] (HADOOP-13945) Azure: Add Kerberos and Delegation token support to WASB client.

2017-03-03 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15895319#comment-15895319 ] Mingliang Liu commented on HADOOP-13945: As there are a lot of shared code to [HADOOP-13930],

[jira] [Comment Edited] (HADOOP-13945) Azure: Add Kerberos and Delegation token support to WASB client.

2017-03-03 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15895301#comment-15895301 ] Mingliang Liu edited comment on HADOOP-13945 at 3/4/17 12:28 AM: - Patch

[jira] [Commented] (HADOOP-13945) Azure: Add Kerberos and Delegation token support to WASB client.

2017-03-03 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15895301#comment-15895301 ] Mingliang Liu commented on HADOOP-13945: Patch looks good to me overall. For a few places using

[jira] [Updated] (HADOOP-14129) ITestS3ACredentialsInURL sometimes fails

2017-03-03 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14129: --- Resolution: Fixed Status: Resolved (was: Patch Available) Committed to feature

[jira] [Commented] (HADOOP-14129) ITestS3ACredentialsInURL sometimes fails

2017-03-03 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15895196#comment-15895196 ] Mingliang Liu commented on HADOOP-14129: [~fabbri] is your vote valid for v5 patch as well?

[jira] [Commented] (HADOOP-13946) Document how HDFS updates timestamps in the FS spec; compare with object stores

2017-03-03 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15895191#comment-15895191 ] Mingliang Liu commented on HADOOP-13946: I'm +1 on the v4 patch. I'll hold on commit for 5 days

[jira] [Commented] (HADOOP-14027) Implicitly creating DynamoDB table ignores endpoint config

2017-03-03 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15895112#comment-15895112 ] Mingliang Liu commented on HADOOP-14027: [~mackrorysd] the problem this JIRA track may have been

[jira] [Commented] (HADOOP-14023) S3Guard: DynamoDBMetadataStore logs nonsense region

2017-03-03 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15895107#comment-15895107 ] Mingliang Liu commented on HADOOP-14023: [~mackrorysd] can you confirm that the problem is gone

[jira] [Commented] (HADOOP-14135) Remove URI parameter in AWSCredentialProvider constructors

2017-03-03 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15895103#comment-15895103 ] Mingliang Liu commented on HADOOP-14135: Thanks [~mackrorysd] for your review. Yes it will

[jira] [Commented] (HADOOP-14094) Rethink S3GuardTool options

2017-03-03 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15895064#comment-15895064 ] Mingliang Liu commented on HADOOP-14094: {quote} it seemed like every Tool was executed by a

[jira] [Commented] (HADOOP-13945) Azure: Add Kerberos and Delegation token support to WASB client.

2017-03-03 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15894913#comment-15894913 ] Mingliang Liu commented on HADOOP-13945: YARN UI module is definitely not related so I'll

[jira] [Commented] (HADOOP-14094) Rethink S3GuardTool options

2017-03-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15893553#comment-15893553 ] Mingliang Liu commented on HADOOP-14094: The v4 patch looks good to me overall. I'm wondering

[jira] [Commented] (HADOOP-14135) Remove URI parameter in AWSCredentialProvider constructors

2017-03-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15893538#comment-15893538 ] Mingliang Liu commented on HADOOP-14135: Checkstyle warnings are false positive: we have to make

[jira] [Updated] (HADOOP-14135) Remove URI parameter in AWSCredentialProvider constructors

2017-03-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14135: --- Attachment: HADOOP-14135.003.patch {code} $ mvn -Dit.test='ITestS3A*' -Dtest=none -Dscale

[jira] [Updated] (HADOOP-14135) Remove URI parameter in AWSCredentialProvider constructors

2017-03-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14135: --- Attachment: HADOOP-14135.002.patch > Remove URI parameter in AWSCredentialProvider

[jira] [Commented] (HADOOP-14135) Remove URI parameter in AWSCredentialProvider constructors

2017-03-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15893327#comment-15893327 ] Mingliang Liu commented on HADOOP-14135: Ping [~mackrorysd] for review. Thanks, > Remove URI

[jira] [Updated] (HADOOP-14135) Remove URI parameter in AWSCredentialProvider constructors

2017-03-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14135: --- Attachment: HADOOP-14135.001.patch Thanks Steve. You're right we should be very careful

[jira] [Updated] (HADOOP-14129) ITestS3ACredentialsInURL sometimes fails

2017-03-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14129: --- Attachment: HADOOP-14129-HADOOP-13345.005.patch @Steve I think the configuration are

[jira] [Commented] (HADOOP-14129) ITestS3ACredentialsInURL sometimes fails

2017-03-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15893205#comment-15893205 ] Mingliang Liu commented on HADOOP-14129: Thanks [~fabbri] for your review. I believe not. I'll

[jira] [Updated] (HADOOP-14129) ITestS3ACredentialsInURL sometimes fails

2017-03-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14129: --- Attachment: HADOOP-14129-HADOOP-13345.004.patch > ITestS3ACredentialsInURL sometimes fails

[jira] [Commented] (HADOOP-14138) Remove S3A ref from META-INF service discovery, rely on existing core-default entry

2017-03-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15892955#comment-15892955 ] Mingliang Liu commented on HADOOP-14138: +1 > Remove S3A ref from META-INF service discovery,

[jira] [Updated] (HADOOP-14129) ITestS3ACredentialsInURL sometimes fails

2017-03-01 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14129: --- Attachment: HADOOP-14129-HADOOP-13345.003.patch Attaching v3 patch. I tested and never see

[jira] [Updated] (HADOOP-14129) ITestS3ACredentialsInURL sometimes fails

2017-03-01 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14129: --- Status: Patch Available (was: Reopened) > ITestS3ACredentialsInURL sometimes fails >

[jira] [Reopened] (HADOOP-14129) ITestS3ACredentialsInURL sometimes fails

2017-03-01 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu reopened HADOOP-14129: > ITestS3ACredentialsInURL sometimes fails > > >

[jira] [Updated] (HADOOP-14130) Simplify DynamoDBClientFactory for creating Amazon DynamoDB clients

2017-02-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14130: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HADOOP-13345

[jira] [Commented] (HADOOP-14129) ITestS3ACredentialsInURL sometimes fails

2017-02-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15889313#comment-15889313 ] Mingliang Liu commented on HADOOP-14129: I just re-produced the same error... {code} Tests run:

[jira] [Commented] (HADOOP-14036) S3Guard: intermittent duplicate item keys failure

2017-02-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15889266#comment-15889266 ] Mingliang Liu commented on HADOOP-14036: {quote} Maybe the code that makes sure path ancestors

[jira] [Commented] (HADOOP-14135) Remove URI parameter in AWSCredentialProvider constructors

2017-02-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15889092#comment-15889092 ] Mingliang Liu commented on HADOOP-14135: Tested against use-west-1 region. {code} $ mvn

[jira] [Updated] (HADOOP-14135) Remove URI parameter in AWSCredentialProvider constructors

2017-02-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14135: --- Target Version/s: 3.0.0-alpha2, 2.8.0 (was: 2.8.0, 3.0.0-alpha2) Status:

[jira] [Updated] (HADOOP-14135) Remove URI parameter in AWSCredentialProvider constructors

2017-02-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14135: --- Attachment: HADOOP-14135.000.patch > Remove URI parameter in AWSCredentialProvider

[jira] [Updated] (HADOOP-14135) Remove URI parameter in AWSCredentialProvider constructors

2017-02-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14135: --- Fix Version/s: (was: 2.8.0) > Remove URI parameter in AWSCredentialProvider

[jira] [Created] (HADOOP-14135) Remove URI parameter in AWSCredentialProvider constructors

2017-02-28 Thread Mingliang Liu (JIRA)
Mingliang Liu created HADOOP-14135: -- Summary: Remove URI parameter in AWSCredentialProvider constructors Key: HADOOP-14135 URL: https://issues.apache.org/jira/browse/HADOOP-14135 Project: Hadoop

[jira] [Updated] (HADOOP-14135) Remove URI parameter in AWSCredentialProvider constructors

2017-02-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14135: --- Target Version/s: 3.0.0-alpha2 > Remove URI parameter in AWSCredentialProvider constructors

[jira] [Updated] (HADOOP-14135) Remove URI parameter in AWSCredentialProvider constructors

2017-02-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14135: --- Target Version/s: 3.0.0-alpha2, 2.8.0 (was: 3.0.0-alpha2) > Remove URI parameter in

[jira] [Updated] (HADOOP-14129) ITestS3ACredentialsInURL sometimes fails

2017-02-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14129: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HADOOP-13345

[jira] [Commented] (HADOOP-14129) ITestS3ACredentialsInURL sometimes fails

2017-02-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1599#comment-1599 ] Mingliang Liu commented on HADOOP-14129: +1 on v2 patch. Committed to feature branch. Thanks for

[jira] [Commented] (HADOOP-14130) Simplify DynamoDBClientFactory for creating Amazon DynamoDB clients

2017-02-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1576#comment-1576 ] Mingliang Liu commented on HADOOP-14130: {quote} I think that's likely to happen with DynamoDB

[jira] [Updated] (HADOOP-14130) Simplify DynamoDBClientFactory for creating Amazon DynamoDB clients

2017-02-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14130: --- Description: So, we are using deprecated {{AmazonDynamoDBClient}} class to create a

[jira] [Comment Edited] (HADOOP-14130) Simplify DynamoDBClientFactory for creating Amazon DynamoDB clients

2017-02-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15887310#comment-15887310 ] Mingliang Liu edited comment on HADOOP-14130 at 2/28/17 5:51 AM: - For v0

[jira] [Comment Edited] (HADOOP-14130) Simplify DynamoDBClientFactory for creating Amazon DynamoDB clients

2017-02-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15887310#comment-15887310 ] Mingliang Liu edited comment on HADOOP-14130 at 2/28/17 5:50 AM: - For v0

[jira] [Updated] (HADOOP-14130) Simplify DynamoDBClientFactory for creating Amazon DynamoDB clients

2017-02-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14130: --- Attachment: HADOOP-14130-HADOOP-13345.001.patch > Simplify DynamoDBClientFactory for

[jira] [Commented] (HADOOP-13914) s3guard: improve S3AFileStatus#isEmptyDirectory handling

2017-02-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15887312#comment-15887312 ] Mingliang Liu commented on HADOOP-13914: Thanks [~fabbri]! I'll review this week. > s3guard:

[jira] [Comment Edited] (HADOOP-14130) Simplify DynamoDBClientFactory for creating Amazon DynamoDB clients

2017-02-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15887310#comment-15887310 ] Mingliang Liu edited comment on HADOOP-14130 at 2/28/17 5:35 AM: - For v1

[jira] [Commented] (HADOOP-14130) Simplify DynamoDBClientFactory for creating Amazon DynamoDB clients

2017-02-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15887310#comment-15887310 ] Mingliang Liu commented on HADOOP-14130: I tested against us-west-2 using {{cmvn

[jira] [Updated] (HADOOP-14130) Simplify DynamoDBClientFactory for creating Amazon DynamoDB clients

2017-02-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14130: --- Attachment: HADOOP-14130-HADOOP-13345.000.patch > Simplify DynamoDBClientFactory for

[jira] [Updated] (HADOOP-14130) Simplify DynamoDBClientFactory for creating Amazon DynamoDB clients

2017-02-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14130: --- Status: Patch Available (was: Open) > Simplify DynamoDBClientFactory for creating Amazon

[jira] [Commented] (HADOOP-14090) Allow users to specify region for DynamoDB table instead of endpoint

2017-02-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15887305#comment-15887305 ] Mingliang Liu commented on HADOOP-14090: Sorry for late chime in. I'm thinking about this again

[jira] [Created] (HADOOP-14130) Simplify DynamoDBClientFactory for creating Amazon DynamoDB clients

2017-02-27 Thread Mingliang Liu (JIRA)
Mingliang Liu created HADOOP-14130: -- Summary: Simplify DynamoDBClientFactory for creating Amazon DynamoDB clients Key: HADOOP-14130 URL: https://issues.apache.org/jira/browse/HADOOP-14130 Project:

[jira] [Commented] (HADOOP-13252) Tune S3A provider plugin mechanism

2017-02-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886967#comment-15886967 ] Mingliang Liu commented on HADOOP-13252: {code} 294 /** 295* Create an AWS

[jira] [Updated] (HADOOP-14129) ITestS3ACredentialsInURL sometimes fails

2017-02-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14129: --- Affects Version/s: HADOOP-13345 Target Version/s: HADOOP-13345 >

[jira] [Commented] (HADOOP-14129) ITestS3ACredentialsInURL sometimes fails

2017-02-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886765#comment-15886765 ] Mingliang Liu commented on HADOOP-14129: It fails to me as well. I +1 to fix it by assuming no

[jira] [Commented] (HADOOP-14106) Fix deprecated FileSystem inefficient calls in test

2017-02-24 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15883967#comment-15883967 ] Mingliang Liu commented on HADOOP-14106: This can be a uber jira to track all changes in

[jira] [Assigned] (HADOOP-14106) Fix deprecated FileSystem inefficient calls in test

2017-02-24 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu reassigned HADOOP-14106: -- Assignee: Yiqun Lin Summary: Fix deprecated FileSystem inefficient calls in test

[jira] [Resolved] (HADOOP-13994) explicitly declare the commons-lang3 dependency as 3.4

2017-02-24 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu resolved HADOOP-13994. Resolution: Fixed > explicitly declare the commons-lang3 dependency as 3.4 >

[jira] [Reopened] (HADOOP-13994) explicitly declare the commons-lang3 dependency as 3.4

2017-02-24 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu reopened HADOOP-13994: > explicitly declare the commons-lang3 dependency as 3.4 >

[jira] [Commented] (HADOOP-14028) S3A block output streams don't delete temporary files in multipart uploads

2017-02-24 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15883395#comment-15883395 ] Mingliang Liu commented on HADOOP-14028: {quote} IOUtilsClient#cleanup() because its in the

[jira] [Updated] (HADOOP-14036) S3Guard: intermittent duplicate item keys failure

2017-02-24 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14036: --- Affects Version/s: HADOOP-13345 > S3Guard: intermittent duplicate item keys failure >

[jira] [Assigned] (HADOOP-14036) S3Guard: intermittent duplicate item keys failure

2017-02-24 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu reassigned HADOOP-14036: -- Assignee: Mingliang Liu Assigned this to me. I'll have a look at this as I'm seeing

[jira] [Updated] (HADOOP-14110) In S3AFileSystem, make getAmazonClient() package private; export getBucketLocation()

2017-02-24 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14110: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HADOOP-13345

[jira] [Updated] (HADOOP-14110) In S3AFileSystem, make getAmazonClient() package private; export getBucketLocation()

2017-02-24 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14110: --- Summary: In S3AFileSystem, make getAmazonClient() package private; export

[jira] [Commented] (HADOOP-14110) mark S3AFileSystem.getAmazonClient package private, export getBucketLocation(fs.getBucket());

2017-02-24 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15883347#comment-15883347 ] Mingliang Liu commented on HADOOP-14110: I have to admit it was me who made it public. The JIRA

[jira] [Resolved] (HADOOP-14091) AbstractFileSystem implementaion for 'wasbs' scheme

2017-02-23 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu resolved HADOOP-14091. Resolution: Fixed Sure, but let's track in our private channel. This is for community

[jira] [Commented] (HADOOP-14028) S3A block output streams don't delete temporary files in multipart uploads

2017-02-23 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15881629#comment-15881629 ] Mingliang Liu commented on HADOOP-14028: +1 I learned a lot from the threads here: how to debug

[jira] [Commented] (HADOOP-14113) review ADL Docs

2017-02-23 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15881474#comment-15881474 ] Mingliang Liu commented on HADOOP-14113: This format is clearer and user friendly. Only text

[jira] [Comment Edited] (HADOOP-13994) explicitly declare the commons-lang3 dependency as 3.4

2017-02-23 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15881411#comment-15881411 ] Mingliang Liu edited comment on HADOOP-13994 at 2/23/17 10:24 PM: --

[jira] [Commented] (HADOOP-13994) explicitly declare the commons-lang3 dependency as 3.4

2017-02-23 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15881411#comment-15881411 ] Mingliang Liu commented on HADOOP-13994: Sorry [~ste...@apache.org] I missed this point when I

[jira] [Updated] (HADOOP-14091) AbstractFileSystem implementaion for 'wasbs' scheme

2017-02-23 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14091: --- Resolution: Fixed Fix Version/s: 3.0.0-alpha3 2.8.0

[jira] [Updated] (HADOOP-13321) Deprecate FileSystem APIs that promote inefficient call patterns.

2017-02-23 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-13321: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha3

[jira] [Updated] (HADOOP-14112) Über-jira ADL Phase I: Stabilization

2017-02-23 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14112: --- Target Version/s: 3.0.0-alpha3 Component/s: (was: fs/azure)

[jira] [Commented] (HADOOP-14028) S3A block output streams don't delete temporary files in multipart uploads

2017-02-23 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15880770#comment-15880770 ] Mingliang Liu commented on HADOOP-14028: Will do a review this week. Any more reviews will be

[jira] [Updated] (HADOOP-14091) AbstractFileSystem implementaion for 'wasbs' scheme

2017-02-23 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14091: --- Target Version/s: 2.8.0, 3.0.0-alpha3 (was: 2.9.0, 3.0.0-alpha3) > AbstractFileSystem

[jira] [Commented] (HADOOP-13321) Deprecate FileSystem APIs that promote inefficient call patterns.

2017-02-22 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15879616#comment-15879616 ] Mingliang Liu commented on HADOOP-13321: Steve do you need another review? > Deprecate

[jira] [Commented] (HADOOP-14091) AbstractFileSystem implementaion for 'wasbs' scheme

2017-02-22 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15879560#comment-15879560 ] Mingliang Liu commented on HADOOP-14091: I also added you as the Hadoop Common project

[jira] [Updated] (HADOOP-14091) AbstractFileSystem implementaion for 'wasbs' scheme

2017-02-22 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14091: --- Target Version/s: 2.9.0, 3.0.0-alpha3 +1 pending on Jenkins. Which Hadoop version are we

[jira] [Updated] (HADOOP-14091) AbstractFileSystem implementaion for 'wasbs' scheme

2017-02-22 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14091: --- Assignee: Varada Hemeswari Hadoop Flags: Reviewed Status: Patch Available

[jira] [Created] (HADOOP-14107) ITestS3GuardListConsistency fails intermittently

2017-02-22 Thread Mingliang Liu (JIRA)
Mingliang Liu created HADOOP-14107: -- Summary: ITestS3GuardListConsistency fails intermittently Key: HADOOP-14107 URL: https://issues.apache.org/jira/browse/HADOOP-14107 Project: Hadoop Common

[jira] [Commented] (HADOOP-13321) Deprecate FileSystem APIs that promote inefficient call patterns.

2017-02-22 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15879420#comment-15879420 ] Mingliang Liu commented on HADOOP-13321: Thanks Steve! I filed [HADOOP-14106] for tracking the

[jira] [Updated] (HADOOP-14106) Fix deprecated FileSystem inefficient calls in unit test

2017-02-22 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14106: --- Target Version/s: 3.0.0-alpha3 Component/s: test > Fix deprecated FileSystem

[jira] [Created] (HADOOP-14106) Fix deprecated FileSystem inefficient calls in unit test

2017-02-22 Thread Mingliang Liu (JIRA)
Mingliang Liu created HADOOP-14106: -- Summary: Fix deprecated FileSystem inefficient calls in unit test Key: HADOOP-14106 URL: https://issues.apache.org/jira/browse/HADOOP-14106 Project: Hadoop Common

[jira] [Updated] (HADOOP-13321) Deprecate FileSystem APIs that promote inefficient call patterns.

2017-02-22 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-13321: --- Attachment: HADOOP-13321.004.patch > Deprecate FileSystem APIs that promote inefficient

[jira] [Updated] (HADOOP-14102) Relax error message assertion in S3A test ITestS3AEncryptionSSEC

2017-02-22 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14102: --- Summary: Relax error message assertion in S3A test ITestS3AEncryptionSSEC (was: Relax

[jira] [Updated] (HADOOP-14102) Relax error message assertion in S3A test ITestS3AEncryptionSSEC::testCreateFileAndReadWithDifferentEncryptionKey

2017-02-22 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14102: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha3

[jira] [Updated] (HADOOP-14102) Relax error message assertion in S3A test ITestS3AEncryptionSSEC::testCreateFileAndReadWithDifferentEncryptionKey

2017-02-22 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14102: --- Issue Type: Sub-task (was: Test) Parent: HADOOP-13204 > Relax error message

[jira] [Commented] (HADOOP-13345) S3Guard: Improved Consistency for S3A

2017-02-22 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15879382#comment-15879382 ] Mingliang Liu commented on HADOOP-13345: Thanks [~ste...@apache.org] for testing and commenting

[jira] [Commented] (HADOOP-14102) Relax error message assertion in S3A test ITestS3AEncryptionSSEC::testCreateFileAndReadWithDifferentEncryptionKey

2017-02-21 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15877298#comment-15877298 ] Mingliang Liu commented on HADOOP-14102: Ping [~eddyxu] and [~ste...@apache.org]. > Relax error

[jira] [Updated] (HADOOP-14099) Split s3 testing documentation out into its own file

2017-02-21 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14099: --- Attachment: HADOOP-14099-branch-2.003.patch > Split s3 testing documentation out into its

<    4   5   6   7   8   9   10   11   12   13   >