[jira] [Commented] (HADOOP-13914) s3guard: improve S3AFileStatus#isEmptyDirectory handling

2017-02-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15887482#comment-15887482 ] Hadoop QA commented on HADOOP-13914: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-14130) Simplify DynamoDBClientFactory for creating Amazon DynamoDB clients

2017-02-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15887473#comment-15887473 ] Hadoop QA commented on HADOOP-14130: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HADOOP-14131) kms.sh fails to set kms.log.dir

2017-02-27 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HADOOP-14131: Description: {{kms.sh start}} creates the erroneous dir {{$\{kms.log.dir\}}} on the current dir.

[jira] [Updated] (HADOOP-14131) kms.sh fails to set kms.log.dir

2017-02-27 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HADOOP-14131: Summary: kms.sh fails to set kms.log.dir (was: kms.sh create erroneous dir) > kms.sh fails to

[jira] [Created] (HADOOP-14131) kms.sh create erroneous dir

2017-02-27 Thread John Zhuge (JIRA)
John Zhuge created HADOOP-14131: --- Summary: kms.sh create erroneous dir Key: HADOOP-14131 URL: https://issues.apache.org/jira/browse/HADOOP-14131 Project: Hadoop Common Issue Type: Bug

[jira] [Updated] (HADOOP-13914) s3guard: improve S3AFileStatus#isEmptyDirectory handling

2017-02-27 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Fabbri updated HADOOP-13914: -- Status: Patch Available (was: Open) Tested in US-West-2: All unit and integration tests

[jira] [Updated] (HADOOP-13914) s3guard: improve S3AFileStatus#isEmptyDirectory handling

2017-02-27 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Fabbri updated HADOOP-13914: -- Attachment: HADOOP-13914-HADOOP-13345.003.patch Attaching v3 patch. - Also fixes

[jira] [Commented] (HADOOP-14130) Simplify DynamoDBClientFactory for creating Amazon DynamoDB clients

2017-02-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15887344#comment-15887344 ] Hadoop QA commented on HADOOP-14130: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Comment Edited] (HADOOP-14130) Simplify DynamoDBClientFactory for creating Amazon DynamoDB clients

2017-02-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15887310#comment-15887310 ] Mingliang Liu edited comment on HADOOP-14130 at 2/28/17 5:51 AM: - For v0

[jira] [Comment Edited] (HADOOP-14130) Simplify DynamoDBClientFactory for creating Amazon DynamoDB clients

2017-02-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15887310#comment-15887310 ] Mingliang Liu edited comment on HADOOP-14130 at 2/28/17 5:50 AM: - For v0

[jira] [Updated] (HADOOP-14130) Simplify DynamoDBClientFactory for creating Amazon DynamoDB clients

2017-02-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14130: --- Attachment: HADOOP-14130-HADOOP-13345.001.patch > Simplify DynamoDBClientFactory for

[jira] [Commented] (HADOOP-13914) s3guard: improve S3AFileStatus#isEmptyDirectory handling

2017-02-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15887312#comment-15887312 ] Mingliang Liu commented on HADOOP-13914: Thanks [~fabbri]! I'll review this week. > s3guard:

[jira] [Comment Edited] (HADOOP-14130) Simplify DynamoDBClientFactory for creating Amazon DynamoDB clients

2017-02-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15887310#comment-15887310 ] Mingliang Liu edited comment on HADOOP-14130 at 2/28/17 5:35 AM: - For v1

[jira] [Commented] (HADOOP-14130) Simplify DynamoDBClientFactory for creating Amazon DynamoDB clients

2017-02-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15887310#comment-15887310 ] Mingliang Liu commented on HADOOP-14130: I tested against us-west-2 using {{cmvn

[jira] [Updated] (HADOOP-14130) Simplify DynamoDBClientFactory for creating Amazon DynamoDB clients

2017-02-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14130: --- Attachment: HADOOP-14130-HADOOP-13345.000.patch > Simplify DynamoDBClientFactory for

[jira] [Updated] (HADOOP-14130) Simplify DynamoDBClientFactory for creating Amazon DynamoDB clients

2017-02-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14130: --- Status: Patch Available (was: Open) > Simplify DynamoDBClientFactory for creating Amazon

[jira] [Commented] (HADOOP-14090) Allow users to specify region for DynamoDB table instead of endpoint

2017-02-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15887305#comment-15887305 ] Mingliang Liu commented on HADOOP-14090: Sorry for late chime in. I'm thinking about this again

[jira] [Created] (HADOOP-14130) Simplify DynamoDBClientFactory for creating Amazon DynamoDB clients

2017-02-27 Thread Mingliang Liu (JIRA)
Mingliang Liu created HADOOP-14130: -- Summary: Simplify DynamoDBClientFactory for creating Amazon DynamoDB clients Key: HADOOP-14130 URL: https://issues.apache.org/jira/browse/HADOOP-14130 Project:

[jira] [Commented] (HADOOP-14118) move jets3t into a dependency on hadoop-aws JAR

2017-02-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15887288#comment-15887288 ] Hudson commented on HADOOP-14118: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11315 (See

[jira] [Commented] (HADOOP-14127) Add log4j configuration to enable logging in hadoop-distcp's tests

2017-02-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15887287#comment-15887287 ] Hudson commented on HADOOP-14127: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11315 (See

[jira] [Updated] (HADOOP-14118) move jets3t into a dependency on hadoop-aws JAR

2017-02-27 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-14118: --- Resolution: Fixed Fix Version/s: 3.0.0-alpha3 Status: Resolved (was:

[jira] [Updated] (HADOOP-14127) Add log4j configuration to enable logging in hadoop-distcp's tests

2017-02-27 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HADOOP-14127: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha3

[jira] [Commented] (HADOOP-14127) Add log4j configuration to enable logging in hadoop-distcp's tests

2017-02-27 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15887243#comment-15887243 ] Yongjun Zhang commented on HADOOP-14127: Thanks [~xiaochen]. +1, will commit shortly. > Add

[jira] [Commented] (HADOOP-14104) Client should always ask namenode for kms provider path.

2017-02-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15887193#comment-15887193 ] Hadoop QA commented on HADOOP-14104: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-14083) KMS should support old SSL clients

2017-02-27 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15887132#comment-15887132 ] John Zhuge commented on HADOOP-14083: - Thanks [~eddyxu] and [~xiaochen] for the review and commit.

[jira] [Updated] (HADOOP-14083) KMS should support old SSL clients

2017-02-27 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HADOOP-14083: Target Version/s: 2.9.0 (was: 2.8.0, 2.7.4, 2.6.6) > KMS should support old SSL clients >

[jira] [Commented] (HADOOP-13914) s3guard: improve S3AFileStatus#isEmptyDirectory handling

2017-02-27 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15887120#comment-15887120 ] Aaron Fabbri commented on HADOOP-13914: --- Currently running tests on a second version of this

[jira] [Commented] (HADOOP-13866) Upgrade netty-all to 4.1.1.Final

2017-02-27 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15887115#comment-15887115 ] Andrew Wang commented on HADOOP-13866: -- We don't need to debate whether this is source

[jira] [Assigned] (HADOOP-13914) s3guard: improve S3AFileStatus#isEmptyDirectory handling

2017-02-27 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Fabbri reassigned HADOOP-13914: - Assignee: Aaron Fabbri (was: Mingliang Liu) > s3guard: improve

[jira] [Commented] (HADOOP-14104) Client should always ask namenode for kms provider path.

2017-02-27 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15887103#comment-15887103 ] Andrew Wang commented on HADOOP-14104: -- Thanks for working on this Rushabh, patch looks pretty

[jira] [Updated] (HADOOP-14083) KMS should support old SSL clients

2017-02-27 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HADOOP-14083: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.9.0 Status:

[jira] [Commented] (HADOOP-13866) Upgrade netty-all to 4.1.1.Final

2017-02-27 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15887061#comment-15887061 ] Junping Du commented on HADOOP-13866: - bq. As we discussed earlier, this is an incompatible change.

[jira] [Commented] (HADOOP-13866) Upgrade netty-all to 4.1.1.Final

2017-02-27 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886997#comment-15886997 ] Andrew Wang commented on HADOOP-13866: -- As we discussed earlier, this is an incompatible change.

[jira] [Commented] (HADOOP-13866) Upgrade netty-all to 4.1.1.Final

2017-02-27 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886982#comment-15886982 ] Junping Du commented on HADOOP-13866: - Thanks [~yuzhih...@gmail.com] for doing more investigations.

[jira] [Commented] (HADOOP-13252) Tune S3A provider plugin mechanism

2017-02-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886967#comment-15886967 ] Mingliang Liu commented on HADOOP-13252: {code} 294 /** 295* Create an AWS

[jira] [Updated] (HADOOP-13914) s3guard: improve S3AFileStatus#isEmptyDirectory handling

2017-02-27 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Fabbri updated HADOOP-13914: -- Attachment: HADOOP-13914-HADOOP-13345.002.patch Attaching initial patch of my solution for

[jira] [Updated] (HADOOP-14104) Client should always ask namenode for kms provider path.

2017-02-27 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HADOOP-14104: Attachment: HADOOP-14104-trunk-v1.patch Attached a new patch which removed PB boolean.

[jira] [Comment Edited] (HADOOP-14104) Client should always ask namenode for kms provider path.

2017-02-27 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886820#comment-15886820 ] Rushabh S Shah edited comment on HADOOP-14104 at 2/28/17 12:07 AM: ---

[jira] [Updated] (HADOOP-14104) Client should always ask namenode for kms provider path.

2017-02-27 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HADOOP-14104: Status: Patch Available (was: Open) > Client should always ask namenode for kms provider

[jira] [Updated] (HADOOP-14129) ITestS3ACredentialsInURL sometimes fails

2017-02-27 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Mackrory updated HADOOP-14129: --- Attachment: HADOOP-14129-HADOOP-13345.001.patch Attaching a patch that does just that. I've

[jira] [Updated] (HADOOP-14104) Client should always ask namenode for kms provider path.

2017-02-27 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HADOOP-14104: Issue Type: Improvement (was: Bug) > Client should always ask namenode for kms provider

[jira] [Commented] (HADOOP-14125) s3guard tool tests aren't isolated; can't run in parallel

2017-02-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886766#comment-15886766 ] Hadoop QA commented on HADOOP-14125: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HADOOP-14129) ITestS3ACredentialsInURL sometimes fails

2017-02-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14129: --- Affects Version/s: HADOOP-13345 Target Version/s: HADOOP-13345 >

[jira] [Commented] (HADOOP-14129) ITestS3ACredentialsInURL sometimes fails

2017-02-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886765#comment-15886765 ] Mingliang Liu commented on HADOOP-14129: It fails to me as well. I +1 to fix it by assuming no

[jira] [Comment Edited] (HADOOP-14124) S3AFileSystem silently deletes "fake" directories when writing a file.

2017-02-27 Thread Joel Baranick (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886734#comment-15886734 ] Joel Baranick edited comment on HADOOP-14124 at 2/27/17 11:27 PM: -- Hey

[jira] [Comment Edited] (HADOOP-14124) S3AFileSystem silently deletes "fake" directories when writing a file.

2017-02-27 Thread Joel Baranick (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886734#comment-15886734 ] Joel Baranick edited comment on HADOOP-14124 at 2/27/17 11:23 PM: -- Hey

[jira] [Comment Edited] (HADOOP-14124) S3AFileSystem silently deletes "fake" directories when writing a file.

2017-02-27 Thread Joel Baranick (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886734#comment-15886734 ] Joel Baranick edited comment on HADOOP-14124 at 2/27/17 11:22 PM: -- Hey

[jira] [Comment Edited] (HADOOP-14124) S3AFileSystem silently deletes "fake" directories when writing a file.

2017-02-27 Thread Joel Baranick (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886734#comment-15886734 ] Joel Baranick edited comment on HADOOP-14124 at 2/27/17 11:20 PM: -- Hey

[jira] [Commented] (HADOOP-14124) S3AFileSystem silently deletes "fake" directories when writing a file.

2017-02-27 Thread Joel Baranick (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886734#comment-15886734 ] Joel Baranick commented on HADOOP-14124: Hey Steve, Thanks for the info. I read the Hadoop

[jira] [Updated] (HADOOP-14124) S3AFileSystem silently deletes "fake" directories when writing a file.

2017-02-27 Thread Joel Baranick (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Baranick updated HADOOP-14124: --- Affects Version/s: 2.6.0 > S3AFileSystem silently deletes "fake" directories when writing a

[jira] [Commented] (HADOOP-14128) ChecksumFs should override rename with overwrite flag

2017-02-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886733#comment-15886733 ] Hadoop QA commented on HADOOP-14128: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-12556) KafkaSink jar files are created but not copied to target dist

2017-02-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886728#comment-15886728 ] Hadoop QA commented on HADOOP-12556: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Created] (HADOOP-14129) ITestS3ACredentialsInURL sometimes fails

2017-02-27 Thread Sean Mackrory (JIRA)
Sean Mackrory created HADOOP-14129: -- Summary: ITestS3ACredentialsInURL sometimes fails Key: HADOOP-14129 URL: https://issues.apache.org/jira/browse/HADOOP-14129 Project: Hadoop Common Issue

[jira] [Updated] (HADOOP-14125) s3guard tool tests aren't isolated; can't run in parallel

2017-02-27 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Mackrory updated HADOOP-14125: --- Attachment: HADOOP-14125-HADOOP-13345.001.patch Attaching a patch that works with

[jira] [Updated] (HADOOP-14125) s3guard tool tests aren't isolated; can't run in parallel

2017-02-27 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Mackrory updated HADOOP-14125: --- Status: Patch Available (was: Open) > s3guard tool tests aren't isolated; can't run in

[jira] [Commented] (HADOOP-12556) KafkaSink jar files are created but not copied to target dist

2017-02-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886700#comment-15886700 ] Hadoop QA commented on HADOOP-12556: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HADOOP-14128) ChecksumFs should override rename with overwrite flag

2017-02-27 Thread Mathieu Chataigner (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mathieu Chataigner updated HADOOP-14128: Status: Open (was: Patch Available) > ChecksumFs should override rename with

[jira] [Updated] (HADOOP-14128) ChecksumFs should override rename with overwrite flag

2017-02-27 Thread Mathieu Chataigner (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mathieu Chataigner updated HADOOP-14128: Status: Patch Available (was: Open) > ChecksumFs should override rename with

[jira] [Updated] (HADOOP-14128) ChecksumFs should override rename with overwrite flag

2017-02-27 Thread Mathieu Chataigner (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mathieu Chataigner updated HADOOP-14128: Attachment: HADOOP-14128.001.patch > ChecksumFs should override rename with

[jira] [Updated] (HADOOP-14128) ChecksumFs should override rename with overwrite flag

2017-02-27 Thread Mathieu Chataigner (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mathieu Chataigner updated HADOOP-14128: Status: Patch Available (was: Open) > ChecksumFs should override rename with

[jira] [Updated] (HADOOP-14128) ChecksumFs should override rename with overwrite flag

2017-02-27 Thread Mathieu Chataigner (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mathieu Chataigner updated HADOOP-14128: Description: When I call FileContext.rename(src, dst, Options.Rename.OVERWRITE)

[jira] [Updated] (HADOOP-14128) ChecksumFs should override rename with overwrite flag

2017-02-27 Thread Mathieu Chataigner (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mathieu Chataigner updated HADOOP-14128: Description: When I call `FileContext.rename(src, dst, Options.Rename.OVERWRITE)`

[jira] [Created] (HADOOP-14128) ChecksumFs should override rename with overwrite flag

2017-02-27 Thread Mathieu Chataigner (JIRA)
Mathieu Chataigner created HADOOP-14128: --- Summary: ChecksumFs should override rename with overwrite flag Key: HADOOP-14128 URL: https://issues.apache.org/jira/browse/HADOOP-14128 Project: Hadoop

[jira] [Commented] (HADOOP-14127) Add log4j configuration to enable logging in hadoop-distcp's tests

2017-02-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886527#comment-15886527 ] Hadoop QA commented on HADOOP-14127: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Comment Edited] (HADOOP-13866) Upgrade netty-all to 4.1.1.Final

2017-02-27 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886035#comment-15886035 ] Ted Yu edited comment on HADOOP-13866 at 2/27/17 8:28 PM: -- Checked

[jira] [Updated] (HADOOP-14127) Add log4j configuration to enable logging in hadoop-distcp's tests

2017-02-27 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HADOOP-14127: --- Status: Patch Available (was: Open) > Add log4j configuration to enable logging in hadoop-distcp's

[jira] [Updated] (HADOOP-14127) Add log4j configuration to enable logging in hadoop-distcp's tests

2017-02-27 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HADOOP-14127: --- Attachment: HADOOP-14127.01.patch > Add log4j configuration to enable logging in hadoop-distcp's

[jira] [Created] (HADOOP-14127) Add log4j configuration to enable logging in hadoop-distcp's tests

2017-02-27 Thread Xiao Chen (JIRA)
Xiao Chen created HADOOP-14127: -- Summary: Add log4j configuration to enable logging in hadoop-distcp's tests Key: HADOOP-14127 URL: https://issues.apache.org/jira/browse/HADOOP-14127 Project: Hadoop

[jira] [Commented] (HADOOP-14086) Improve DistCp Speed for small files

2017-02-27 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886349#comment-15886349 ] Steve Loughran commented on HADOOP-14086: - nothing, yet, I'm just scared about what could be

[jira] [Commented] (HADOOP-14126) remove jackson, joda and other transient aws SDK dependencies from hadoop-aws

2017-02-27 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886196#comment-15886196 ] Steve Loughran commented on HADOOP-14126: - omitting jackson doesn't seem to cause problems, as

[jira] [Created] (HADOOP-14126) remove jackson, joda and other transient aws SDK dependencies from hadoop-aws

2017-02-27 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-14126: --- Summary: remove jackson, joda and other transient aws SDK dependencies from hadoop-aws Key: HADOOP-14126 URL: https://issues.apache.org/jira/browse/HADOOP-14126

[jira] [Commented] (HADOOP-14126) remove jackson, joda and other transient aws SDK dependencies from hadoop-aws

2017-02-27 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886183#comment-15886183 ] Steve Loughran commented on HADOOP-14126: - we may need to make some of the declarations test

[jira] [Commented] (HADOOP-14086) Improve DistCp Speed for small files

2017-02-27 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886105#comment-15886105 ] Erik Krogen commented on HADOOP-14086: -- [~zhz] currently there are multiple calls made for each

[jira] [Comment Edited] (HADOOP-14086) Improve DistCp Speed for small files

2017-02-27 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886105#comment-15886105 ] Erik Krogen edited comment on HADOOP-14086 at 2/27/17 4:51 PM: --- [~zhz]

[jira] [Commented] (HADOOP-13866) Upgrade netty-all to 4.1.1.Final

2017-02-27 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886035#comment-15886035 ] Ted Yu commented on HADOOP-13866: - Not sure how long we can get consensus w.r.t. pulling in this change

[jira] [Updated] (HADOOP-14125) s3guard tool tests aren't isolated; can't run in parallel

2017-02-27 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14125: Description: The {{S3GuardToolTestBase}} don't parallelize and break other tests. This

[jira] [Assigned] (HADOOP-14125) s3guard tool tests aren't isolated; can't run in parallel

2017-02-27 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reassigned HADOOP-14125: --- Assignee: Sean Mackrory Sean, I'm assigning to you so you can get more familiar

[jira] [Commented] (HADOOP-14125) s3guard tool tests aren't isolated; can't run in parallel

2017-02-27 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15885842#comment-15885842 ] Steve Loughran commented on HADOOP-14125: - Stack showing problems. I actually think the cause of

[jira] [Created] (HADOOP-14125) s3guard tool tests aren't isolated; can't run in parallel

2017-02-27 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-14125: --- Summary: s3guard tool tests aren't isolated; can't run in parallel Key: HADOOP-14125 URL: https://issues.apache.org/jira/browse/HADOOP-14125 Project: Hadoop

[jira] [Commented] (HADOOP-14123) Make AdlFileSystem a service provider for FileSystem

2017-02-27 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15885616#comment-15885616 ] Steve Loughran commented on HADOOP-14123: - LGTM +1 > Make AdlFileSystem a service provider for

[jira] [Updated] (HADOOP-14112) Über-jira adl:// Azure Data Lake Phase I: Stabilization

2017-02-27 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14112: Description: Uber JIRA to track things needed for Azure Data Lake to be considered stable

[jira] [Updated] (HADOOP-14112) Über-jira adl:// Azure Data Lake Phase I: Stabilization

2017-02-27 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14112: Description: Uber JIRA to track things needed for Azure Data Lake to be considered stable

[jira] [Updated] (HADOOP-14112) Über-jira adl:// Azure Data Lake Phase I: Stabilization

2017-02-27 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14112: Summary: Über-jira adl:// Azure Data Lake Phase I: Stabilization (was: Über-jira ADL

[jira] [Commented] (HADOOP-14112) Über-jira ADL Phase I: Stabilization

2017-02-27 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15885609#comment-15885609 ] Steve Loughran commented on HADOOP-14112: - yes, let me change the title > Über-jira ADL Phase

[jira] [Commented] (HADOOP-14124) S3AFileSystem silently deletes "fake" directories when writing a file.

2017-02-27 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15885572#comment-15885572 ] Steve Loughran commented on HADOOP-14124: - Here's why: when doing earlier directory scanning

[jira] [Commented] (HADOOP-14119) Remove unused imports from GzipCodec.java

2017-02-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15885556#comment-15885556 ] Hudson commented on HADOOP-14119: - FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #11312 (See

[jira] [Resolved] (HADOOP-13834) use JUnit categories for s3a scale tests and others

2017-02-27 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-13834. - Resolution: Won't Fix > use JUnit categories for s3a scale tests and others >

[jira] [Commented] (HADOOP-13834) use JUnit categories for s3a scale tests and others

2017-02-27 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15885554#comment-15885554 ] Steve Loughran commented on HADOOP-13834: - Not sure is its that more elegant; at least from

[jira] [Updated] (HADOOP-14119) Remove unused imports from GzipCodec.java

2017-02-27 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HADOOP-14119: --- Target Version/s: 2.9.0, 3.0.0-alpha3 (was: 2.9.0, 3.0.0-alpha2) > Remove unused imports from

[jira] [Updated] (HADOOP-14119) Remove unused imports from GzipCodec.java

2017-02-27 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HADOOP-14119: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha3

[jira] [Commented] (HADOOP-14118) move jets3t into a dependency on hadoop-aws JAR

2017-02-27 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15885543#comment-15885543 ] Akira Ajisaka commented on HADOOP-14118: bq. did you do one here? If not, as its a special case,

[jira] [Updated] (HADOOP-14124) S3AFileSystem silently deletes "fake" directories when writing a file.

2017-02-27 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14124: Affects Version/s: (was: 2.6.0) Component/s: fs/s3 fs

[jira] [Commented] (HADOOP-14112) Über-jira ADL Phase I: Stabilization

2017-02-27 Thread Lars Francke (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15885488#comment-15885488 ] Lars Francke commented on HADOOP-14112: --- Is ADL = Azure Data Lake? > Über-jira ADL Phase I:

[jira] [Commented] (HADOOP-14038) Rename ADLS credential properties

2017-02-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15885386#comment-15885386 ] Hadoop QA commented on HADOOP-14038: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||