[jira] [Commented] (HADOOP-13252) add logging of what's going on in s3 auth to help debug problems

2016-06-09 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15323376#comment-15323376 ] Chris Nauroth commented on HADOOP-13252: There really isn't very much code to

[jira] [Commented] (HADOOP-13252) add logging of what's going on in s3 auth to help debug problems

2016-06-09 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15323261#comment-15323261 ] Chris Nauroth commented on HADOOP-13252: One thing that's helpful, and works now without code

[jira] [Commented] (HADOOP-13240) TestAclCommands.testSetfaclValidations fail

2016-06-08 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15321357#comment-15321357 ] Chris Nauroth commented on HADOOP-13240: I've tried multiple branches and multiple dev

[jira] [Commented] (HADOOP-13237) s3a initialization against public bucket fails if caller lacks any credentials

2016-06-08 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15320068#comment-15320068 ] Chris Nauroth commented on HADOOP-13237: I have completed a successful parallel test run against

[jira] [Commented] (HADOOP-13241) document s3a better

2016-06-08 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15320067#comment-15320067 ] Chris Nauroth commented on HADOOP-13241: Steve, thank you for doing this. This is very helpful

[jira] [Updated] (HADOOP-13237) s3a initialization against public bucket fails if caller lacks any credentials

2016-06-07 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HADOOP-13237: --- Attachment: HADOOP-13237-branch-2.002.patch Here is patch 002 for branch-2. I'm currently

[jira] [Updated] (HADOOP-13237) s3a initialization against public bucket fails if caller lacks any credentials

2016-06-07 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HADOOP-13237: --- Status: Patch Available (was: Reopened) > s3a initialization against public bucket fails

[jira] [Commented] (HADOOP-13240) TestAclCommands.testSetfaclValidations fail

2016-06-07 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15319576#comment-15319576 ] Chris Nauroth commented on HADOOP-13240: [~jzhuge], I noticed you assigned this issue to

[jira] [Commented] (HADOOP-13223) winutils.exe is a bug nexus and should be killed with an axe.

2016-06-07 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15319513#comment-15319513 ] Chris Nauroth commented on HADOOP-13223: bq. It's not clear to me why a DLL would be less prone

[jira] [Commented] (HADOOP-13203) S3a: Consider reducing the number of connection aborts by setting correct length in s3 request

2016-06-07 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15317922#comment-15317922 ] Chris Nauroth commented on HADOOP-13203: Rajesh, thank you for patch 003. That addresses my

[jira] [Commented] (HADOOP-13242) Authenticate to Azure Data Lake using client ID and keys

2016-06-06 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15317442#comment-15317442 ] Chris Nauroth commented on HADOOP-13242: [~ASikaria], thank you for the patch. I tried a full

[jira] [Updated] (HADOOP-12875) [Azure Data Lake] Support for contract test and unit test cases

2016-06-06 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HADOOP-12875: --- Hadoop Flags: Reviewed +1 for patch 004, pending a pre-commit run after commit of

[jira] [Updated] (HADOOP-12666) Support Microsoft Azure Data Lake - as a file system in Hadoop

2016-06-06 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HADOOP-12666: --- Hadoop Flags: Reviewed At this point, I am +1 for patch 016. I completed a successful full

[jira] [Updated] (HADOOP-12875) [Azure Data Lake] Support for contract test and unit test cases

2016-06-06 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HADOOP-12875: --- Status: Open (was: Patch Available) I am canceling this patch until its pre-requisites are

[jira] [Updated] (HADOOP-13242) Authenticate to Azure Data Lake using client ID and keys

2016-06-06 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HADOOP-13242: --- Status: Open (was: Patch Available) I am canceling this patch until its pre-requisites are

[jira] [Commented] (HADOOP-13240) TestAclCommands.testSetfaclValidations fail

2016-06-06 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15317406#comment-15317406 ] Chris Nauroth commented on HADOOP-13240: I am not able to repro this test failure. I tried the

[jira] [Moved] (HADOOP-13242) Authenticate to Azure Data Lake using client ID and keys

2016-06-06 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth moved HDFS-10462 to HADOOP-13242: --- Component/s: (was: hdfs-client) fs/azure

[jira] [Updated] (HADOOP-13237) s3a initialization against public bucket fails if caller lacks any credentials

2016-06-06 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HADOOP-13237: --- Attachment: HADOOP-13237.001.patch Hello [~ste...@apache.org]. I got curious about this,

[jira] [Updated] (HADOOP-13237) s3a initialization against public bucket fails if caller lacks any credentials

2016-06-06 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HADOOP-13237: --- Assignee: Chris Nauroth (was: Steve Loughran) Priority: Minor (was: Major) > s3a

[jira] [Reopened] (HADOOP-13237) s3a initialization against public bucket fails if caller lacks any credentials

2016-06-06 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth reopened HADOOP-13237: > s3a initialization against public bucket fails if caller lacks any credentials >

[jira] [Updated] (HADOOP-13105) Support timeouts in LDAP queries in LdapGroupsMapping.

2016-06-03 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HADOOP-13105: --- Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch

[jira] [Updated] (HADOOP-12718) Incorrect error message by fs -put local dir without permission

2016-06-03 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HADOOP-12718: --- Target Version/s: 2.8.0 Priority: Blocker (was: Minor) Hadoop Flags:

[jira] [Reopened] (HADOOP-12718) Incorrect error message by fs -put local dir without permission

2016-06-03 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth reopened HADOOP-12718: I'm going to reopen the issue now and attach a patch to do the revert. This is just the

[jira] [Updated] (HADOOP-12718) Incorrect error message by fs -put local dir without permission

2016-06-03 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HADOOP-12718: --- Attachment: HADOOP-12718.004.patch > Incorrect error message by fs -put local dir without

[jira] [Updated] (HADOOP-12718) Incorrect error message by fs -put local dir without permission

2016-06-03 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HADOOP-12718: --- Status: Patch Available (was: Reopened) > Incorrect error message by fs -put local dir

[jira] [Updated] (HADOOP-13105) Support timeouts in LDAP queries in LdapGroupsMapping.

2016-06-03 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HADOOP-13105: --- Affects Version/s: (was: 3.0.0-alpha1) Target Version/s: 2.8.0 Hadoop

[jira] [Commented] (HADOOP-13105) Support timeouts in LDAP queries in LdapGroupsMapping.

2016-06-03 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15314974#comment-15314974 ] Chris Nauroth commented on HADOOP-13105: [~liuml07], patch 003 looks good. I just have one more

[jira] [Commented] (HADOOP-13203) S3a: Consider reducing the number of connection aborts by setting correct length in s3 request

2016-06-03 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15314915#comment-15314915 ] Chris Nauroth commented on HADOOP-13203: # The comment "In case this is set to contentLength,

[jira] [Commented] (HADOOP-13237) s3a initialization against public bucket fails if caller lacks any credentials

2016-06-03 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15314812#comment-15314812 ] Chris Nauroth commented on HADOOP-13237: This looks to me like {{AnonymousAWSCredentials}} is

[jira] [Commented] (HADOOP-13203) S3a: Consider reducing the number of connection aborts by setting correct length in s3 request

2016-06-03 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15314402#comment-15314402 ] Chris Nauroth commented on HADOOP-13203: Rajesh, thank you for the further explanation. Sorry

[jira] [Updated] (HADOOP-13171) Add StorageStatistics to S3A; instrument some more operations

2016-06-03 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HADOOP-13171: --- Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch

[jira] [Commented] (HADOOP-12709) Deprecate s3:// in branch-2,; cut from trunk

2016-06-03 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15314330#comment-15314330 ] Chris Nauroth commented on HADOOP-12709: Once again, the failure in {{TestDNS}} is unrelated.

[jira] [Updated] (HADOOP-13203) S3a: Consider reducing the number of connection aborts by setting correct length in s3 request

2016-06-02 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HADOOP-13203: --- Status: Patch Available (was: Open) > S3a: Consider reducing the number of connection

[jira] [Commented] (HADOOP-13203) S3a: Consider reducing the number of connection aborts by setting correct length in s3 request

2016-06-02 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15313239#comment-15313239 ] Chris Nauroth commented on HADOOP-13203: Rajesh, thank you for the patch. I have to apologize.

[jira] [Commented] (HADOOP-13105) Support timeouts in LDAP queries in LdapGroupsMapping.

2016-06-02 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15313164#comment-15313164 ] Chris Nauroth commented on HADOOP-13105: The testing approach looks good to me. Here are a few

[jira] [Commented] (HADOOP-12709) Deprecate s3:// in branch-2,; cut from trunk

2016-06-02 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15313160#comment-15313160 ] Chris Nauroth commented on HADOOP-12709: Also, I did a full hadoop-aws test run in parallel mode

[jira] [Commented] (HADOOP-12709) Deprecate s3:// in branch-2,; cut from trunk

2016-06-02 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15313158#comment-15313158 ] Chris Nauroth commented on HADOOP-12709: +1 for patch 005, pending pre-commit. I'll hold off

[jira] [Commented] (HADOOP-12709) Deprecate s3:// in branch-2,; cut from trunk

2016-06-02 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15313026#comment-15313026 ] Chris Nauroth commented on HADOOP-12709: The patch looks good to me too. I don't have any

[jira] [Commented] (HADOOP-13171) Add StorageStatistics to S3A; instrument some more operations

2016-06-02 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15313002#comment-15313002 ] Chris Nauroth commented on HADOOP-13171: Also, I have completed successful parallel test runs

[jira] [Commented] (HADOOP-13231) Isolate test path used by a few S3A tests for more reliable parallel execution.

2016-06-02 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15312999#comment-15312999 ] Chris Nauroth commented on HADOOP-13231: That's really odd. It looks like the parts were

[jira] [Updated] (HADOOP-13171) Add StorageStatistics to S3A; instrument some more operations

2016-06-02 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HADOOP-13171: --- Attachment: HADOOP-13171-branch-2.8-017.patch Unfortunately, this cannot go to branch-2.8

[jira] [Updated] (HADOOP-13171) Add StorageStatistics to S3A; instrument some more operations

2016-06-02 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HADOOP-13171: --- +1 for patch 016 on trunk. I'll commit these. > Add StorageStatistics to S3A; instrument some

[jira] [Commented] (HADOOP-13171) Add StorageStatistics to S3A; instrument some more operations

2016-06-02 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15312636#comment-15312636 ] Chris Nauroth commented on HADOOP-13171: +1 for patch 015 on branch-2. I repeated a successful

[jira] [Commented] (HADOOP-13230) s3a's use of fake empty directory blobs does not interoperate with other s3 tools

2016-06-02 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15312509#comment-15312509 ] Chris Nauroth commented on HADOOP-13230: I think something has been lost in the conversation on

[jira] [Commented] (HADOOP-13171) Add StorageStatistics to S3A; instrument some more operations

2016-06-01 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15311241#comment-15311241 ] Chris Nauroth commented on HADOOP-13171: [~ste...@apache.org], sorry, I just realized this needs

[jira] [Updated] (HADOOP-13131) Add tests to verify that S3A supports SSE-S3 encryption

2016-06-01 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HADOOP-13131: --- Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch

[jira] [Updated] (HADOOP-13171) Add StorageStatistics to S3A; instrument some more operations

2016-06-01 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HADOOP-13171: --- Hadoop Flags: Reviewed +1 for patch 014 on trunk. I'll wait for a pre-commit run before

[jira] [Commented] (HADOOP-13231) Isolate test path used by a few S3A tests for more reliable parallel execution.

2016-06-01 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15311189#comment-15311189 ] Chris Nauroth commented on HADOOP-13231: {{TestS3A}} uses a path of /tests3afc, without

[jira] [Created] (HADOOP-13231) Isolate test path used by a few S3A tests for more reliable parallel execution.

2016-06-01 Thread Chris Nauroth (JIRA)
Chris Nauroth created HADOOP-13231: -- Summary: Isolate test path used by a few S3A tests for more reliable parallel execution. Key: HADOOP-13231 URL: https://issues.apache.org/jira/browse/HADOOP-13231

[jira] [Updated] (HADOOP-13131) Add tests to verify that S3A supports SSE-S3 encryption

2016-06-01 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HADOOP-13131: --- Hadoop Flags: Reviewed +1 for patch 008 on both trunk and branch-2. I verified all tests

[jira] [Commented] (HADOOP-13223) winutils.exe is a bug nexus and should be killed with an axe.

2016-06-01 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15310735#comment-15310735 ] Chris Nauroth commented on HADOOP-13223: bq. I think that moving functions to a DLL could

[jira] [Commented] (HADOOP-13171) Add StorageStatistics to S3A; instrument some more operations

2016-06-01 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15310505#comment-15310505 ] Chris Nauroth commented on HADOOP-13171: +1 for patch 013 on branch-2. > Add StorageStatistics

[jira] [Commented] (HADOOP-13219) NameNode Rpc Reader Thread crash, and cluster hang.

2016-05-31 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15308929#comment-15308929 ] Chris Nauroth commented on HADOOP-13219: Do you happen to know what kind of exception it was

[jira] [Commented] (HADOOP-13171) Add StorageStatistics to S3A; instrument some more operations

2016-05-31 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15308798#comment-15308798 ] Chris Nauroth commented on HADOOP-13171: Steve, thank you for patch 012. Tests are passing for

[jira] [Updated] (HADOOP-13193) Upgrade to Apache Yetus 0.3.0

2016-05-27 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HADOOP-13193: --- Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch

[jira] [Updated] (HADOOP-13193) Upgrade to Apache Yetus 0.3.0

2016-05-27 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HADOOP-13193: --- Hadoop Flags: Reviewed +1, based on my prior testing and +1 of the Yetus 0.3.0 release

[jira] [Commented] (HADOOP-12756) Incorporate Aliyun OSS file system implementation

2016-05-27 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15303649#comment-15303649 ] Chris Nauroth commented on HADOOP-12756: bq. I thought the new module could also follow the used

[jira] [Commented] (HADOOP-12756) Incorporate Aliyun OSS file system implementation

2016-05-26 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15303561#comment-15303561 ] Chris Nauroth commented on HADOOP-12756: The situation is similar to the testing challenges we

[jira] [Commented] (HADOOP-13171) Add StorageStatistics to S3A; instrument some more operations

2016-05-26 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15303230#comment-15303230 ] Chris Nauroth commented on HADOOP-13171: The new stats are very thorough. The refactoring of

[jira] [Commented] (HADOOP-13131) Add tests to verify that S3A supports SSE-S3 encryption

2016-05-26 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15303022#comment-15303022 ] Chris Nauroth commented on HADOOP-13131: One more thing: consider adding a JUnit {{Timeout}} to

[jira] [Commented] (HADOOP-13131) Add tests to verify that S3A supports SSE-S3 encryption

2016-05-26 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15302937#comment-15302937 ] Chris Nauroth commented on HADOOP-13131: Oh, I see now that HADOOP-13171 is refactoring

[jira] [Commented] (HADOOP-13131) Add tests to verify that S3A supports SSE-S3 encryption

2016-05-26 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15302902#comment-15302902 ] Chris Nauroth commented on HADOOP-13131: Patch v007 looks good. Thank you, Steve. I had a

[jira] [Resolved] (HADOOP-4109) FileSystem support for posix truncate method

2016-05-26 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth resolved HADOOP-4109. --- Resolution: Duplicate Truncate has been implemented, tracked in HDFS-3107. > FileSystem

[jira] [Commented] (HADOOP-12910) Add new FileSystem API to support asynchronous method calls

2016-05-25 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15301546#comment-15301546 ] Chris Nauroth commented on HADOOP-12910: Hello [~stack]. I'm very curious to learn more about

[jira] [Updated] (HADOOP-13203) S3a: Consider reducing the number of connection aborts by setting correct length in s3 request

2016-05-25 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HADOOP-13203: --- Assignee: Rajesh Balamohan > S3a: Consider reducing the number of connection aborts by

[jira] [Commented] (HADOOP-13195) hadoop-azure: page blob append support

2016-05-23 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15296582#comment-15296582 ] Chris Nauroth commented on HADOOP-13195: [~dchickabasapa], would you please watch this issue and

[jira] [Commented] (HADOOP-13130) s3a failures can surface as RTEs, not IOEs

2016-05-21 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15295117#comment-15295117 ] Chris Nauroth commented on HADOOP-13130: Excellent, thank you for this patch Steve. > s3a

[jira] [Updated] (HADOOP-13130) s3a failures can surface as RTEs, not IOEs

2016-05-20 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HADOOP-13130: --- Hadoop Flags: Reviewed +1 for patch 016. I completed a successful parallel full test run

[jira] [Commented] (HADOOP-13105) Support timeouts in LDAP queries in LdapGroupsMapping.

2016-05-20 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15293915#comment-15293915 ] Chris Nauroth commented on HADOOP-13105: [~liuml07], do you think hadoop-minikdc is helpful at

[jira] [Commented] (HADOOP-12718) Incorrect error message by fs -put local dir without permission

2016-05-20 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15293895#comment-15293895 ] Chris Nauroth commented on HADOOP-12718: I'd like to proceed with this plan: # Revert the patch

[jira] [Updated] (HADOOP-13145) In DistCp, prevent unnecessary getFileStatus call when not preserving metadata.

2016-05-20 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HADOOP-13145: --- Attachment: HADOOP-13145-branch-2.8.004.patch Steve, thank you for catching the branch-2.8

[jira] [Updated] (HADOOP-13145) In DistCp, prevent unnecessary getFileStatus call when not preserving metadata.

2016-05-20 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HADOOP-13145: --- Status: Patch Available (was: Reopened) > In DistCp, prevent unnecessary getFileStatus

[jira] [Moved] (HADOOP-13188) S3A file-create should throw error rather than overwrite directories

2016-05-20 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth moved HDFS-10442 to HADOOP-13188: --- Key: HADOOP-13188 (was: HDFS-10442) Project: Hadoop Common

[jira] [Updated] (HADOOP-13179) ToolRunner is not thread-safe because commons-cli OptionBuilder is not thread-safe

2016-05-20 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HADOOP-13179: --- Summary: ToolRunner is not thread-safe because commons-cli OptionBuilder is not thread-safe

[jira] [Commented] (HADOOP-13130) s3a failures can surface as RTEs, not IOEs

2016-05-20 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15292847#comment-15292847 ] Chris Nauroth commented on HADOOP-13130: Patch 012 looks good. Thanks for digging out more

[jira] [Updated] (HADOOP-13145) In DistCp, prevent unnecessary getFileStatus call when not preserving metadata.

2016-05-20 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HADOOP-13145: --- Attachment: HADOOP-13145-branch-2.004.patch I'm attaching patch v004. * Removed redundant

[jira] [Updated] (HADOOP-13183) S3A proxy tests fail after httpclient/httpcore upgrade.

2016-05-19 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HADOOP-13183: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status:

[jira] [Updated] (HADOOP-13179) TooRunner is not thread-safe because commons-cli OptionBuilder is not thread-safe

2016-05-19 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HADOOP-13179: --- Fix Version/s: (was: 2.8.0) Target Version/s: 2.8.0 Status: Open

[jira] [Commented] (HADOOP-13179) TooRunner is not thread-safe because commons-cli OptionBuilder is not thread-safe

2016-05-19 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15292712#comment-15292712 ] Chris Nauroth commented on HADOOP-13179: Hello [~mahongbin]. Thank you for the patch. I was

[jira] [Updated] (HADOOP-13179) TooRunner is not thread-safe because commons-cli OptionBuilder is not thread-safe

2016-05-19 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HADOOP-13179: --- Assignee: hongbin ma > TooRunner is not thread-safe because commons-cli OptionBuilder is

[jira] [Commented] (HADOOP-13181) WASB append support: getPos incorrect

2016-05-19 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15292708#comment-15292708 ] Chris Nauroth commented on HADOOP-13181: This might warrant updating the contract tests in

[jira] [Commented] (HADOOP-13181) WASB append support: getPos incorrect

2016-05-19 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15292704#comment-15292704 ] Chris Nauroth commented on HADOOP-13181: [~bograd], thank you for the bug report. Are you

[jira] [Commented] (HADOOP-13154) S3AFileSystem printAmazonServiceException/printAmazonClientException appear copy & paste of AWS examples

2016-05-19 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15292699#comment-15292699 ] Chris Nauroth commented on HADOOP-13154: Before committing this, I had a successful full test

[jira] [Updated] (HADOOP-13154) S3AFileSystem printAmazonServiceException/printAmazonClientException appear copy & paste of AWS examples

2016-05-19 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HADOOP-13154: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.7.3 Status:

[jira] [Commented] (HADOOP-13183) S3A proxy tests fail after httpclient/httpcore upgrade.

2016-05-19 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15291616#comment-15291616 ] Chris Nauroth commented on HADOOP-13183: I see the problem on both trunk (Java 8) and branch-2.8

[jira] [Commented] (HADOOP-13154) S3AFileSystem printAmazonServiceException/printAmazonClientException appear copy & paste of AWS examples

2016-05-19 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15291588#comment-15291588 ] Chris Nauroth commented on HADOOP-13154: The patch looks good. I'll take it through a test run

[jira] [Commented] (HADOOP-12767) update apache httpclient version to 4.5.2; httpcore to 4.4.4

2016-05-19 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15291581#comment-15291581 ] Chris Nauroth commented on HADOOP-12767: I filed HADOOP-13183 for follow-up on an S3A test

[jira] [Created] (HADOOP-13183) S3A proxy tests fail after httpclient/httpcore upgrade.

2016-05-19 Thread Chris Nauroth (JIRA)
Chris Nauroth created HADOOP-13183: -- Summary: S3A proxy tests fail after httpclient/httpcore upgrade. Key: HADOOP-13183 URL: https://issues.apache.org/jira/browse/HADOOP-13183 Project: Hadoop Common

[jira] [Commented] (HADOOP-13183) S3A proxy tests fail after httpclient/httpcore upgrade.

2016-05-19 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15291577#comment-15291577 ] Chris Nauroth commented on HADOOP-13183: If I {{git checkout

[jira] [Commented] (HADOOP-13130) s3a failures can surface as RTEs, not IOEs

2016-05-19 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15291553#comment-15291553 ] Chris Nauroth commented on HADOOP-13130: Thanks, Steve. I'll wait for another patch revision.

[jira] [Updated] (HADOOP-13177) Native tests fail on OS X, because DYLD_LIBRARY_PATH is not defined to include libhadoop.dylib.

2016-05-19 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HADOOP-13177: --- Fix Version/s: (was: 3.0.0-alpha1) 2.8.0 Thanks, Allen. I

[jira] [Commented] (HADOOP-13130) s3a failures can surface as RTEs, not IOEs

2016-05-19 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15291359#comment-15291359 ] Chris Nauroth commented on HADOOP-13130: Thanks, Steve. Patch 009 looks good. I don't have any

[jira] [Commented] (HADOOP-13145) In DistCp, prevent unnecessary getFileStatus call when not preserving metadata.

2016-05-18 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15290079#comment-15290079 ] Chris Nauroth commented on HADOOP-13145: Interestingly, you're getting a much slower run than me

[jira] [Commented] (HADOOP-13177) Native tests fail on OS X, because DYLD_LIBRARY_PATH is not defined to include libhadoop.dylib.

2016-05-18 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15289884#comment-15289884 ] Chris Nauroth commented on HADOOP-13177: Haha, thanks. :-) I'll commit after I get a

[jira] [Commented] (HADOOP-13130) s3a failures can surface as RTEs, not IOEs

2016-05-18 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15289883#comment-15289883 ] Chris Nauroth commented on HADOOP-13130: Thank you for patch 008. This is looking good. I

[jira] [Updated] (HADOOP-13177) Native tests fail on OS X, because DYLD_LIBRARY_PATH is not defined to include libhadoop.dylib.

2016-05-18 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HADOOP-13177: --- Priority: Minor (was: Major) > Native tests fail on OS X, because DYLD_LIBRARY_PATH is not

[jira] [Updated] (HADOOP-13177) Native tests fail on OS X, because DYLD_LIBRARY_PATH is not defined to include libhadoop.dylib.

2016-05-18 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HADOOP-13177: --- Attachment: HADOOP-13177.001.patch I'm attaching a patch with just the Surefire

[jira] [Updated] (HADOOP-13177) Native tests fail on OS X, because DYLD_LIBRARY_PATH is not defined to include libhadoop.dylib.

2016-05-18 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HADOOP-13177: --- Status: Patch Available (was: Open) > Native tests fail on OS X, because DYLD_LIBRARY_PATH

[jira] [Created] (HADOOP-13177) Native tests fail on OS X, because DYLD_LIBRARY_PATH is not defined to include libhadoop.dylib.

2016-05-18 Thread Chris Nauroth (JIRA)
Chris Nauroth created HADOOP-13177: -- Summary: Native tests fail on OS X, because DYLD_LIBRARY_PATH is not defined to include libhadoop.dylib. Key: HADOOP-13177 URL:

[jira] [Commented] (HADOOP-12635) Adding Append API support for WASB

2016-05-18 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15289565#comment-15289565 ] Chris Nauroth commented on HADOOP-12635: [~bograd], I'm not aware of any work in progress on

<    2   3   4   5   6   7   8   9   10   11   >