[jira] [Updated] (HADOOP-12267) s3a failure due to integer overflow bug in AWS SDK

2015-07-29 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Fabbri updated HADOOP-12267: -- Attachment: HADOOP-12267.2.003.patch Submitting single patch for branch-2 instead [~eddyxu]

[jira] [Updated] (HADOOP-12267) s3a failure due to integer overflow bug in AWS SDK

2015-07-29 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Fabbri updated HADOOP-12267: -- Attachment: (was: HADOOP-12267.2.6.002.patch) s3a failure due to integer overflow bug in

[jira] [Commented] (HADOOP-12269) Update aws-sdk dependency to 1.10.6

2015-07-29 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14646844#comment-14646844 ] Aaron Fabbri commented on HADOOP-12269: --- Talked with [~eddyxu] and we agreed it is

[jira] [Updated] (HADOOP-12267) s3a failure due to integer overflow bug in AWS SDK

2015-07-29 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Fabbri updated HADOOP-12267: -- Attachment: HADOOP-12267.2.7.003.patch HADOOP-12267.2.6.003.patch Attached v3

[jira] [Updated] (HADOOP-12267) s3a failure due to integer overflow bug in AWS SDK

2015-07-29 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Fabbri updated HADOOP-12267: -- Attachment: (was: HADOOP-12267.2.7.003.patch) s3a failure due to integer overflow bug in

[jira] [Updated] (HADOOP-12267) s3a failure due to integer overflow bug in AWS SDK

2015-07-29 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Fabbri updated HADOOP-12267: -- Attachment: (was: HADOOP-12267.2.7.002.patch) s3a failure due to integer overflow bug in

[jira] [Updated] (HADOOP-12267) s3a failure due to integer overflow bug in AWS SDK

2015-07-29 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Fabbri updated HADOOP-12267: -- Attachment: (was: HADOOP-12267.2.6.003.patch) s3a failure due to integer overflow bug in

[jira] [Commented] (HADOOP-12269) Update aws-sdk dependency to 1.10.6

2015-07-31 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649784#comment-14649784 ] Aaron Fabbri commented on HADOOP-12269: --- [~Thomas Demoor] [~steve_l] I applied

[jira] [Commented] (HADOOP-12269) Update aws-sdk dependency to 1.10.6

2015-08-04 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14654014#comment-14654014 ] Aaron Fabbri commented on HADOOP-12269: --- +1 latest patch (in case that wasn't

[jira] [Commented] (HADOOP-12269) Update aws-sdk dependency to 1.10.6

2015-07-27 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14643580#comment-14643580 ] Aaron Fabbri commented on HADOOP-12269: --- I tested my HADOOP-12267 patches w/o the

[jira] [Updated] (HADOOP-12267) s3a failure due to integer overflow bug in AWS SDK

2015-07-27 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Fabbri updated HADOOP-12267: -- Attachment: (was: HADOOP-12267.2.6.0.001.patch) s3a failure due to integer overflow bug

[jira] [Updated] (HADOOP-12267) s3a failure due to integer overflow bug in AWS SDK

2015-07-27 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Fabbri updated HADOOP-12267: -- Attachment: HADOOP-12267.2.6.002.patch v2 patch for branch-2.6 s3a failure due to integer

[jira] [Commented] (HADOOP-12267) s3a failure due to integer overflow bug in AWS SDK

2015-07-27 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14643771#comment-14643771 ] Aaron Fabbri commented on HADOOP-12267: --- Tested these two v2 patches with S3,

[jira] [Updated] (HADOOP-12267) s3a failure due to integer overflow bug in AWS SDK

2015-07-27 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Fabbri updated HADOOP-12267: -- Attachment: HADOOP-12267.2.7.002.patch v2 patch for branch-2.7 s3a failure due to integer

[jira] [Updated] (HADOOP-12267) s3a failure due to integer overflow bug in AWS SDK

2015-07-27 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Fabbri updated HADOOP-12267: -- Attachment: (was: HADOOP-12267.2.7.1.001.patch) s3a failure due to integer overflow bug

[jira] [Updated] (HADOOP-12267) s3a failure due to integer overflow bug in AWS SDK

2015-07-27 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Fabbri updated HADOOP-12267: -- Attachment: (was: HADOOP-12267.2.6.002.patch) s3a failure due to integer overflow bug in

[jira] [Updated] (HADOOP-12267) s3a failure due to integer overflow bug in AWS SDK

2015-07-27 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Fabbri updated HADOOP-12267: -- Attachment: HADOOP-12267.2.6.002.patch s3a failure due to integer overflow bug in AWS SDK

[jira] [Updated] (HADOOP-12267) s3a failure due to integer overflow bug in AWS SDK

2015-07-23 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Fabbri updated HADOOP-12267: -- Attachment: HADOOP-12267.2.6.0.001-patch s3a failure due to integer overflow bug in AWS SDK

[jira] [Commented] (HADOOP-12267) s3a failure due to integer overflow bug in AWS SDK

2015-07-23 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14639980#comment-14639980 ] Aaron Fabbri commented on HADOOP-12267: --- Bug fix was backported to AWS SDK 1.7.14.

[jira] [Updated] (HADOOP-12267) s3a failure due to integer overflow bug in AWS SDK

2015-07-23 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Fabbri updated HADOOP-12267: -- Attachment: (was: HADOOP-12267.2.6.0.001-patch) s3a failure due to integer overflow bug

[jira] [Updated] (HADOOP-12267) s3a failure due to integer overflow bug in AWS SDK

2015-07-23 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Fabbri updated HADOOP-12267: -- Attachment: HADOOP-12267.2.6.0.001.patch HADOOP-12267.2.7.1.001.patch s3a

[jira] [Created] (HADOOP-12267) s3a failure due to integer overflow bug in AWS SDK

2015-07-23 Thread Aaron Fabbri (JIRA)
Aaron Fabbri created HADOOP-12267: - Summary: s3a failure due to integer overflow bug in AWS SDK Key: HADOOP-12267 URL: https://issues.apache.org/jira/browse/HADOOP-12267 Project: Hadoop Common

[jira] [Commented] (HADOOP-12269) Update aws-sdk dependency to 1.10.6

2015-07-24 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14640847#comment-14640847 ] Aaron Fabbri commented on HADOOP-12269: --- Can we use HADOOP-12267 for 2.6.x and

[jira] [Commented] (HADOOP-11684) S3a to use thread pool that blocks clients

2015-10-28 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14979575#comment-14979575 ] Aaron Fabbri commented on HADOOP-11684: --- Thanks for review [~eddyxu]. I will fix the style issues

[jira] [Updated] (HADOOP-11684) S3a to use thread pool that blocks clients

2015-11-04 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Fabbri updated HADOOP-11684: -- Attachment: HADOOP-11684-006.patch This 006 patch fixes indentation on the test I added. My

[jira] [Updated] (HADOOP-11684) S3a to use thread pool that blocks clients

2015-11-05 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Fabbri updated HADOOP-11684: -- Attachment: (was: HADOOP-11684-006.patch) > S3a to use thread pool that blocks clients >

[jira] [Updated] (HADOOP-11684) S3a to use thread pool that blocks clients

2015-11-05 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Fabbri updated HADOOP-11684: -- Attachment: HADOOP-11684-006.patch Re-attaching 006 patch. > S3a to use thread pool that

[jira] [Updated] (HADOOP-11684) S3a to use thread pool that blocks clients

2015-11-03 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Fabbri updated HADOOP-11684: -- Attachment: HADOOP-11684-005.patch 005 patch addresses [~eddyxu]'s comments on the test I

[jira] [Commented] (HADOOP-12553) [JDK8] Fix javadoc error caused by illegal tag

2015-11-06 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14994049#comment-14994049 ] Aaron Fabbri commented on HADOOP-12553: --- +1 Thanks for fixing this. > [JDK8] Fix javadoc error

[jira] [Commented] (HADOOP-11684) S3a to use thread pool that blocks clients

2015-11-06 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14994054#comment-14994054 ] Aaron Fabbri commented on HADOOP-11684: --- [~ste...@apache.org] What is up with these failures:

[jira] [Commented] (HADOOP-11684) S3a to use thread pool that blocks clients

2015-10-12 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14954431#comment-14954431 ] Aaron Fabbri commented on HADOOP-11684: --- +1 on the 002 patch. I'm attaching a 004 patch that is

[jira] [Updated] (HADOOP-11684) S3a to use thread pool that blocks clients

2015-10-12 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Fabbri updated HADOOP-11684: -- Attachment: HADOOP-11684-004.patch > S3a to use thread pool that blocks clients >

[jira] [Commented] (HADOOP-11684) S3a to use thread pool that blocks clients

2015-08-31 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14724435#comment-14724435 ] Aaron Fabbri commented on HADOOP-11684: --- [~Thomas Demoor] reading your patch.. Curious, did you

[jira] [Commented] (HADOOP-11684) S3a to use thread pool that blocks clients

2015-09-04 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14731695#comment-14731695 ] Aaron Fabbri commented on HADOOP-11684: --- I guess the argument for CallerRunsPolicy is: 1. One

[jira] [Commented] (HADOOP-11684) S3a to use thread pool that blocks clients

2015-09-30 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14939139#comment-14939139 ] Aaron Fabbri commented on HADOOP-11684: --- Ok. With that explanation I'm fine with the new

[jira] [Commented] (HADOOP-11684) S3a to use thread pool that blocks clients

2015-09-24 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14906766#comment-14906766 ] Aaron Fabbri commented on HADOOP-11684: --- Looks pretty good. A couple of questions: 1. Can you

[jira] [Commented] (HADOOP-11684) S3a to use thread pool that blocks clients

2015-09-24 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14906859#comment-14906859 ] Aaron Fabbri commented on HADOOP-11684: --- Thanks [~ste...@apache.org]. My remaining curiosity is

[jira] [Commented] (HADOOP-12666) Support Microsoft Azure Data Lake - as a file system in Hadoop

2016-06-10 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15324933#comment-15324933 ] Aaron Fabbri commented on HADOOP-12666: --- I meant the opposite.. I was open to the "subclass

[jira] [Commented] (HADOOP-12666) Support Microsoft Azure Data Lake - as a file system in Hadoop

2016-06-09 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15323473#comment-15323473 ] Aaron Fabbri commented on HADOOP-12666: --- You are welcome [~cnauroth].. One question: I thought we

[jira] [Created] (HADOOP-13230) s3a's use of fake empty directory blobs does not interoperate with other s3 tools

2016-06-01 Thread Aaron Fabbri (JIRA)
Aaron Fabbri created HADOOP-13230: - Summary: s3a's use of fake empty directory blobs does not interoperate with other s3 tools Key: HADOOP-13230 URL: https://issues.apache.org/jira/browse/HADOOP-13230

[jira] [Commented] (HADOOP-13207) Specify FileSystem listStatus and listFiles

2016-06-01 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15311270#comment-15311270 ] Aaron Fabbri commented on HADOOP-13207: --- Took a quick scan of the attached patch. Love the

[jira] [Commented] (HADOOP-12666) Support Microsoft Azure Data Lake - as a file system in Hadoop

2016-02-08 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15137927#comment-15137927 ] Aaron Fabbri commented on HADOOP-12666: --- {code} + /** + * Constructor. + */

[jira] [Commented] (HADOOP-12666) Support Windows Azure Data Lake - as a file system in Hadoop

2016-02-03 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15131388#comment-15131388 ] Aaron Fabbri commented on HADOOP-12666: --- Hi. First question: Why is there a separate

[jira] [Commented] (HADOOP-12666) Support Microsoft Azure Data Lake - as a file system in Hadoop

2016-02-24 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15166449#comment-15166449 ] Aaron Fabbri commented on HADOOP-12666: --- [~vishwajeet.dusane] thanks for the responses. It seems

[jira] [Commented] (HADOOP-12666) Support Microsoft Azure Data Lake - as a file system in Hadoop

2016-02-22 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15158357#comment-15158357 ] Aaron Fabbri commented on HADOOP-12666: --- Thank your for your contributions. This is a large patch

[jira] [Commented] (HADOOP-12666) Support Microsoft Azure Data Lake - as a file system in Hadoop

2016-02-17 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15151741#comment-15151741 ] Aaron Fabbri commented on HADOOP-12666: --- Yes, I confirmed the parameters should be documented w/

[jira] [Commented] (HADOOP-12666) Support Microsoft Azure Data Lake - as a file system in Hadoop

2016-03-08 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15185438#comment-15185438 ] Aaron Fabbri commented on HADOOP-12666: --- Hi [~vishwajeet.dusane]. Can you create a separate JIRA

[jira] [Commented] (HADOOP-13345) S3Guard: Improved Consistency for S3A

2016-07-26 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15394565#comment-15394565 ] Aaron Fabbri commented on HADOOP-13345: --- Thanks [~cnauroth]. Really cool to compare two

[jira] [Commented] (HADOOP-13208) S3A listFiles(recursive=true) to do a bulk listObjects instead of walking the pseudo-tree of directories

2016-07-26 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15394731#comment-15394731 ] Aaron Fabbri commented on HADOOP-13208: --- [~ayousufi] {{listStatus()}} already retrieves file info

[jira] [Commented] (HADOOP-13345) S3Guard: Improved Consistency for S3A

2016-07-14 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15378372#comment-15378372 ] Aaron Fabbri commented on HADOOP-13345: --- Thanks for posting [~cnauroth]. Very cool stuff. I'm

[jira] [Commented] (HADOOP-13208) S3A listFiles(recursive=true) to do a bulk listObjects instead of walking the pseudo-tree of directories

2016-07-28 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15398645#comment-15398645 ] Aaron Fabbri commented on HADOOP-13208: --- I spent a good amount of time this evening going over

[jira] [Commented] (HADOOP-13448) S3Guard: Define MetadataStore interface.

2016-08-10 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15415658#comment-15415658 ] Aaron Fabbri commented on HADOOP-13448: --- To start the interface discussion: I was looking at the

[jira] [Commented] (HADOOP-13345) S3Guard: Improved Consistency for S3A

2016-08-10 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15415653#comment-15415653 ] Aaron Fabbri commented on HADOOP-13345: --- Thanks [~cnauroth] for updating the doc. I was out last

[jira] [Commented] (HADOOP-13476) CredentialProviderFactory fails at class loading from libhdfs (JNI)

2016-08-10 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15415606#comment-15415606 ] Aaron Fabbri commented on HADOOP-13476: --- woot. Thanks [~cnauroth]! > CredentialProviderFactory

[jira] [Commented] (HADOOP-13452) S3Guard: Implement access policy for intra-client consistency with in-memory metadata store.

2016-08-10 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15415573#comment-15415573 ] Aaron Fabbri commented on HADOOP-13452: --- Hi [~cnauroth]. I'm happy to provide code reviews for

[jira] [Commented] (HADOOP-13448) S3Guard: Define MetadataStore interface.

2016-08-10 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15416334#comment-15416334 ] Aaron Fabbri commented on HADOOP-13448: --- Ok, cool. Sounds like we are on the same page. As I

[jira] [Commented] (HADOOP-13446) S3Guard: Support running isolated unit tests separate from AWS integration tests.

2016-08-10 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15416268#comment-15416268 ] Aaron Fabbri commented on HADOOP-13446: --- +1 on this patch. (I am only a committer on the feature

[jira] [Commented] (HADOOP-13447) S3Guard: Refactor S3AFileSystem to support introduction of separate metadata repository and tests.

2016-08-10 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15416289#comment-15416289 ] Aaron Fabbri commented on HADOOP-13447: --- Thanks for the work on this patch [~cnauroth]. Looks

[jira] [Commented] (HADOOP-13446) S3Guard: Support running isolated unit tests separate from AWS integration tests.

2016-08-10 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15415773#comment-15415773 ] Aaron Fabbri commented on HADOOP-13446: --- [~cnauroth] for the mvn behavior changes you mention, do

[jira] [Updated] (HADOOP-13476) CredentialProviderFactory fails at class loading from libhdfs (JNI)

2016-08-09 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Fabbri updated HADOOP-13476: -- Attachment: HADOOP-13476.001.patch Attaching v1 patch. Tested via libhdfs with impala-shell.

[jira] [Updated] (HADOOP-13476) CredentialProviderFactory fails at class loading from libhdfs (JNI)

2016-08-09 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Fabbri updated HADOOP-13476: -- Status: Patch Available (was: Open) > CredentialProviderFactory fails at class loading from

[jira] [Commented] (HADOOP-13452) S3Guard: Implement access policy for intra-client consistency with in-memory metadata store.

2016-08-09 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414619#comment-15414619 ] Aaron Fabbri commented on HADOOP-13452: --- I'll take this one, if that is cool with you [~cnauroth].

[jira] [Assigned] (HADOOP-13452) S3Guard: Implement access policy for intra-client consistency with in-memory metadata store.

2016-08-09 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Fabbri reassigned HADOOP-13452: - Assignee: Aaron Fabbri > S3Guard: Implement access policy for intra-client consistency

[jira] [Commented] (HADOOP-13447) S3Guard: Refactor S3AFileSystem to support introduction of separate metadata repository and tests.

2016-08-12 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15419351#comment-15419351 ] Aaron Fabbri commented on HADOOP-13447: --- I'm +1 on the 002 patch. Noticed one mention of S3Store

[jira] [Commented] (HADOOP-13447) S3Guard: Refactor S3AFileSystem to support introduction of separate metadata repository and tests.

2016-08-11 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15418098#comment-15418098 ] Aaron Fabbri commented on HADOOP-13447: --- Great discussion, I'm enjoying it (although an hour with

[jira] [Commented] (HADOOP-13351) TestDFSClientSocketSize buffer size tests are flaky

2016-07-13 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15375969#comment-15375969 ] Aaron Fabbri commented on HADOOP-13351: --- [~liuml07] v6 looks good to me +1 (non-binding). Glad we

[jira] [Updated] (HADOOP-13351) TestDFSClientSocketSize buffer size tests are flaky

2016-07-13 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Fabbri updated HADOOP-13351: -- Status: Open (was: Patch Available) > TestDFSClientSocketSize buffer size tests are flaky >

[jira] [Updated] (HADOOP-13351) TestDFSClientSocketSize buffer size tests are flaky

2016-07-13 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Fabbri updated HADOOP-13351: -- Status: Patch Available (was: Open) > TestDFSClientSocketSize buffer size tests are flaky >

[jira] [Updated] (HADOOP-13351) TestDFSClientSocketSize buffer size tests are flaky

2016-07-13 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Fabbri updated HADOOP-13351: -- Attachment: HADOOP-13551.004.patch Attaching v4 patch with checkstyle fixes and

[jira] [Commented] (HADOOP-13207) Specify FileSystem listStatus, listFiles and RemoteIterator

2016-07-13 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15375773#comment-15375773 ] Aaron Fabbri commented on HADOOP-13207: --- Reviewing HADOOP-13207-branch-2-010.patch. On first scan

[jira] [Commented] (HADOOP-13207) Specify FileSystem listStatus, listFiles and RemoteIterator

2016-07-13 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15376283#comment-15376283 ] Aaron Fabbri commented on HADOOP-13207: --- Applied patch and ran tests successfully ({{mvn test

[jira] [Updated] (HADOOP-13351) TestDFSClientSocketSize buffer size tests are flaky

2016-07-11 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Fabbri updated HADOOP-13351: -- Attachment: HADOOP-13551.003.patch Attaching v3 patch that also closes the two sockets from

[jira] [Commented] (HADOOP-13351) TestDFSClientSocketSize buffer size tests are flaky

2016-07-08 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15368024#comment-15368024 ] Aaron Fabbri commented on HADOOP-13351: --- [~liuml07] seems like your suggestion would usually work.

[jira] [Updated] (HADOOP-13351) TestDFSClientSocketSize buffer size tests are flaky

2016-07-08 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Fabbri updated HADOOP-13351: -- Attachment: HADOOP-13551.002.patch Attaching v2 patch. I also noticed and fixed other

[jira] [Created] (HADOOP-13351) TestDFSClientSocketSize buffer size tests are flaky

2016-07-07 Thread Aaron Fabbri (JIRA)
Aaron Fabbri created HADOOP-13351: - Summary: TestDFSClientSocketSize buffer size tests are flaky Key: HADOOP-13351 URL: https://issues.apache.org/jira/browse/HADOOP-13351 Project: Hadoop Common

[jira] [Updated] (HADOOP-13351) TestDFSClientSocketSize buffer size tests are flaky

2016-07-07 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Fabbri updated HADOOP-13351: -- Attachment: HADOOP-13551.001.patch > TestDFSClientSocketSize buffer size tests are flaky >

[jira] [Commented] (HADOOP-13351) TestDFSClientSocketSize buffer size tests are flaky

2016-07-07 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15366982#comment-15366982 ] Aaron Fabbri commented on HADOOP-13351: --- Thank you for review [~liuml07]. I do not have ability to

[jira] [Commented] (HADOOP-13351) TestDFSClientSocketSize buffer size tests are flaky

2016-07-07 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15366937#comment-15366937 ] Aaron Fabbri commented on HADOOP-13351: --- [~liuml07] I'm already working on this.. Attaching patch.

[jira] [Commented] (HADOOP-13351) TestDFSClientSocketSize buffer size tests are flaky

2016-07-07 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15366935#comment-15366935 ] Aaron Fabbri commented on HADOOP-13351: --- Example error message (from [~xiaochen]): {noformat} Send

[jira] [Created] (HADOOP-13476) CredentialProviderFactory fails at class loading from libhdfs (JNI)

2016-08-09 Thread Aaron Fabbri (JIRA)
Aaron Fabbri created HADOOP-13476: - Summary: CredentialProviderFactory fails at class loading from libhdfs (JNI) Key: HADOOP-13476 URL: https://issues.apache.org/jira/browse/HADOOP-13476 Project:

[jira] [Commented] (HADOOP-13476) CredentialProviderFactory fails at class loading from libhdfs (JNI)

2016-08-09 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414212#comment-15414212 ] Aaron Fabbri commented on HADOOP-13476: --- I've tested the same fix as was used for HDFS-7075, and

[jira] [Commented] (HADOOP-13207) Specify FileSystem listStatus and listFiles

2016-06-29 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15355585#comment-15355585 ] Aaron Fabbri commented on HADOOP-13207: --- Reviewing the 006 patch. {code} +### `listStatus(Path

[jira] [Commented] (HADOOP-13208) S3A listFiles(recursive=true) to do a bulk listObjects instead of walking the pseudo-tree of directories

2016-06-29 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15355681#comment-15355681 ] Aaron Fabbri commented on HADOOP-13208: --- Looks like there is a merge conflict in

[jira] [Comment Edited] (HADOOP-13208) S3A listFiles(recursive=true) to do a bulk listObjects instead of walking the pseudo-tree of directories

2016-06-29 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15355681#comment-15355681 ] Aaron Fabbri edited comment on HADOOP-13208 at 6/29/16 7:13 PM: Looks

[jira] [Commented] (HADOOP-13208) S3A listFiles(recursive=true) to do a bulk listObjects instead of walking the pseudo-tree of directories

2016-06-29 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15355684#comment-15355684 ] Aaron Fabbri commented on HADOOP-13208: --- Should we get HADOOP-13207 committed and then post a new

[jira] [Updated] (HADOOP-13876) S3Guard: better support for multi-bucket access

2017-02-01 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Fabbri updated HADOOP-13876: -- Status: Patch Available (was: Open) > S3Guard: better support for multi-bucket access >

[jira] [Commented] (HADOOP-13876) S3Guard: better support for multi-bucket access

2017-02-03 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15852099#comment-15852099 ] Aaron Fabbri commented on HADOOP-13876: --- #1 thanks very much for the review. I'm happy to change

[jira] [Commented] (HADOOP-13904) DynamoDBMetadataStore to handle DDB throttling failures through retry policy

2017-02-03 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15852047#comment-15852047 ] Aaron Fabbri commented on HADOOP-13904: --- Thank you for the review. {quote} Yetus is unhappy with

[jira] [Commented] (HADOOP-13998) initial s3guard preview

2017-02-02 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15850796#comment-15850796 ] Aaron Fabbri commented on HADOOP-13998: --- [~aw] no.. thanks for noticing. I'll fix that (filed

[jira] [Created] (HADOOP-14051) S3Guard: link docs from index, fix typos

2017-02-02 Thread Aaron Fabbri (JIRA)
Type: Sub-task Reporter: Aaron Fabbri Assignee: Aaron Fabbri JIRA for a quick round of s3guard.md documentation improvements. - Link from index.md - Make a pass and fix typos / outdated stuff / spelling etc. -- This message was sent by Atlassian JIRA (v6.3.15#6346

[jira] [Updated] (HADOOP-13904) DynamoDBMetadataStore to handle DDB throttling failures through retry policy

2017-02-01 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Fabbri updated HADOOP-13904: -- Attachment: HADOOP-13904-HADOOP-13345.002.patch Attaching v2 patch: Add exponential backoff

[jira] [Comment Edited] (HADOOP-13998) initial s3guard preview

2017-02-02 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15849666#comment-15849666 ] Aaron Fabbri edited comment on HADOOP-13998 at 2/2/17 8:56 AM: --- All of the

[jira] [Updated] (HADOOP-14013) S3Guard: fix multi-bucket integration tests

2017-02-02 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Fabbri updated HADOOP-14013: -- Attachment: HADOOP-14013-HADOOP-13345.001.patch Attaching v1 patch, based on suggestions from

[jira] [Updated] (HADOOP-14013) S3Guard: fix multi-bucket integration tests

2017-02-02 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Fabbri updated HADOOP-14013: -- Status: Patch Available (was: Open) > S3Guard: fix multi-bucket integration tests >

[jira] [Commented] (HADOOP-13998) initial s3guard preview

2017-02-02 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15849666#comment-15849666 ] Aaron Fabbri commented on HADOOP-13998: --- All of the dependencies for this have patches available

[jira] [Commented] (HADOOP-13936) S3Guard: DynamoDB can go out of sync with S3AFileSystem::delete operation

2017-02-03 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15852359#comment-15852359 ] Aaron Fabbri commented on HADOOP-13936: --- I chatted with [~mackrorysd] a little bit about an

[jira] [Commented] (HADOOP-13876) S3Guard: better support for multi-bucket access

2017-02-03 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15852453#comment-15852453 ] Aaron Fabbri commented on HADOOP-13876: --- Committed to feature branch. Big thanks to

[jira] [Updated] (HADOOP-13876) S3Guard: better support for multi-bucket access

2017-02-03 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Fabbri updated HADOOP-13876: -- Resolution: Fixed Status: Resolved (was: Patch Available) > S3Guard: better support

[jira] [Updated] (HADOOP-13876) S3Guard: better support for multi-bucket access

2017-02-03 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Fabbri updated HADOOP-13876: -- Attachment: HADOOP-13876-HADOOP-13345.005.patch Attaching v5 to get a jenkins run. Only

[jira] [Commented] (HADOOP-14041) CLI command to prune old metadata

2017-02-03 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15852389#comment-15852389 ] Aaron Fabbri commented on HADOOP-14041: --- Thanks for the hard work on this [~mackrorysd]. Will try

  1   2   3   4   5   6   7   8   9   10   >