[jira] [Commented] (HADOOP-6852) apparent bug in concatenated-bzip2 support (decoding)

2018-02-21 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-6852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16371680#comment-16371680 ] Sean Mackrory commented on HADOOP-6852: --- Thanks for fixing the checkstyle issue. Te

[jira] [Commented] (HADOOP-6852) apparent bug in concatenated-bzip2 support (decoding)

2018-02-14 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-6852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16365109#comment-16365109 ] Sean Mackrory commented on HADOOP-6852: --- So after much review and reading the code,

[jira] [Commented] (HADOOP-13551) hook up AwsSdkMetrics to hadoop metrics

2018-02-12 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16361241#comment-16361241 ] Sean Mackrory commented on HADOOP-13551: I hadn't started on it, no. Do you know

[jira] [Commented] (HADOOP-15040) Upgrade AWS SDK: NPE bug spams logs w/ Yarn Log Aggregation

2018-02-02 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16351214#comment-16351214 ] Sean Mackrory commented on HADOOP-15040: +1, given your testing. We should file

[jira] [Commented] (HADOOP-15199) hadoop_verify_confdir prevents previously valid log4j config file names

2018-01-31 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16347512#comment-16347512 ] Sean Mackrory commented on HADOOP-15199: CC'ing [~aw], in case you have any inpu

[jira] [Created] (HADOOP-15199) hadoop_verify_confdir prevents previously valid log4j config file names

2018-01-31 Thread Sean Mackrory (JIRA)
Sean Mackrory created HADOOP-15199: -- Summary: hadoop_verify_confdir prevents previously valid log4j config file names Key: HADOOP-15199 URL: https://issues.apache.org/jira/browse/HADOOP-15199 Project

[jira] [Commented] (HADOOP-15079) ITestS3AFileOperationCost#testFakeDirectoryDeletion failing after OutputCommitter patch

2018-01-10 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16321310#comment-16321310 ] Sean Mackrory commented on HADOOP-15079: Your explanation sounds good to me. Sur

[jira] [Updated] (HADOOP-15161) s3a: Stream and common statistics missing from metrics

2018-01-08 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Mackrory updated HADOOP-15161: --- Attachment: HADOOP-15161.002.patch Attaching patch using try-with-resources and addressing c

[jira] [Updated] (HADOOP-15161) s3a: Stream and common statistics missing from metrics

2018-01-08 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Mackrory updated HADOOP-15161: --- Status: Patch Available (was: Open) > s3a: Stream and common statistics missing from metric

[jira] [Updated] (HADOOP-15161) s3a: Stream and common statistics missing from metrics

2018-01-07 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Mackrory updated HADOOP-15161: --- Attachment: HADOOP-15161.001.patch Attaching a patch. Eliminates the separate containers & l

[jira] [Created] (HADOOP-15161) s3a: Stream and common statistics missing from metrics

2018-01-05 Thread Sean Mackrory (JIRA)
Sean Mackrory created HADOOP-15161: -- Summary: s3a: Stream and common statistics missing from metrics Key: HADOOP-15161 URL: https://issues.apache.org/jira/browse/HADOOP-15161 Project: Hadoop Common

[jira] [Comment Edited] (HADOOP-13171) Add StorageStatistics to S3A; instrument some more operations

2017-12-13 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16289648#comment-16289648 ] Sean Mackrory edited comment on HADOOP-13171 at 12/13/17 6:07 PM:

[jira] [Commented] (HADOOP-13171) Add StorageStatistics to S3A; instrument some more operations

2017-12-13 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16289648#comment-16289648 ] Sean Mackrory commented on HADOOP-13171: [~ste...@apache.org] Apologies if it's

[jira] [Updated] (HADOOP-15080) Aliyun OSS: update oss sdk from 2.8.1 to 2.8.3 to remove its dependency on Cat-x "json-lib"

2017-12-07 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Mackrory updated HADOOP-15080: --- Fix Version/s: 2.9.1 2.10.0 Yes, you're right. Cherry-picked to branch-2.

[jira] [Commented] (HADOOP-15080) Aliyun OSS: update oss sdk from 2.8.1 to 2.8.3 to remove its dependency on Cat-x "json-lib"

2017-12-07 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16282475#comment-16282475 ] Sean Mackrory commented on HADOOP-15080: I just checked and Sammi already backpo

[jira] [Updated] (HADOOP-15098) TestClusterTopology#testChooseRandom fails intermittently

2017-12-07 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Mackrory updated HADOOP-15098: --- Resolution: Fixed Fix Version/s: 3.0.1 3.1.0 Status: Res

[jira] [Updated] (HADOOP-15080) Aliyun OSS: update oss sdk from 2.8.1 to 2.8.3 to remove its dependency on Cat-x "json-lib"

2017-12-07 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Mackrory updated HADOOP-15080: --- Resolution: Fixed Assignee: SammiChen Fix Version/s: 3.0.1

[jira] [Commented] (HADOOP-15098) TestClusterTopology#testChooseRandom fails intermittently

2017-12-07 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16282343#comment-16282343 ] Sean Mackrory commented on HADOOP-15098: +1. The reasoning is sound, code change

[jira] [Commented] (HADOOP-15080) Aliyun OSS: update oss sdk from 2.8.1 to 2.8.3 to remove its dependency on Cat-x "json-lib"

2017-12-07 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16282134#comment-16282134 ] Sean Mackrory commented on HADOOP-15080: Thanks for the quick turn-around on the

[jira] [Commented] (HADOOP-15080) Cat-X dependency on org.json via derived json-lib

2017-12-06 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16280732#comment-16280732 ] Sean Mackrory commented on HADOOP-15080: {quote}I agree. It's like saying "we ne

[jira] [Commented] (HADOOP-15080) Cat-X dependency on org.json via derived json-lib

2017-12-06 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16280340#comment-16280340 ] Sean Mackrory commented on HADOOP-15080: I think what you're suggesting sounds g

[jira] [Commented] (HADOOP-15080) Cat-X dependency on org.json via derived json-lib

2017-12-05 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16278965#comment-16278965 ] Sean Mackrory commented on HADOOP-15080: Good idea - done. > Cat-X dependency o

[jira] [Comment Edited] (HADOOP-15080) Cat-X dependency on org.json via derived json-lib

2017-12-05 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16278809#comment-16278809 ] Sean Mackrory edited comment on HADOOP-15080 at 12/5/17 4:23 PM: -

[jira] [Commented] (HADOOP-15080) Cat-X dependency on org.json via derived json-lib

2017-12-05 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16278809#comment-16278809 ] Sean Mackrory commented on HADOOP-15080: {quote}explicitly add it as a test-scop

[jira] [Commented] (HADOOP-15080) Cat-X dependency on org.json via derived json-lib

2017-12-05 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16278731#comment-16278731 ] Sean Mackrory commented on HADOOP-15080: Someone can correct me if a higher auth

[jira] [Updated] (HADOOP-15080) Cat-X dependency on org.json via derived json-lib

2017-12-04 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Mackrory updated HADOOP-15080: --- Attachment: (was: HADOOP-15080-branch-3.0.0.patch) > Cat-X dependency on org.json via de

[jira] [Updated] (HADOOP-15080) Cat-X dependency on org.json via derived json-lib

2017-12-04 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Mackrory updated HADOOP-15080: --- Attachment: HADOOP-15080-branch-3.0.0.001.patch > Cat-X dependency on org.json via derived j

[jira] [Updated] (HADOOP-15080) Cat-X dependency on org.json via derived json-lib

2017-12-04 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Mackrory updated HADOOP-15080: --- Attachment: HADOOP-15080-branch-3.0.0.patch > Cat-X dependency on org.json via derived json-

[jira] [Updated] (HADOOP-15080) Cat-X dependency on org.json via derived json-lib

2017-12-04 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Mackrory updated HADOOP-15080: --- Attachment: (was: HADOOP-15080.001.patch) > Cat-X dependency on org.json via derived jso

[jira] [Updated] (HADOOP-15080) Cat-X dependency on org.json via derived json-lib

2017-12-04 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Mackrory updated HADOOP-15080: --- Status: Patch Available (was: Open) Just "submitting" to get a Pre-Commit run - I'm not pro

[jira] [Updated] (HADOOP-15080) Cat-X dependency on org.json via derived json-lib

2017-12-04 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Mackrory updated HADOOP-15080: --- Attachment: HADOOP-15080.001.patch Just to make sure we have at least one legal option to pr

[jira] [Updated] (HADOOP-15058) create-release site build outputs dummy shaded jars due to skipShade

2017-12-04 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Mackrory updated HADOOP-15058: --- Resolution: Fixed Fix Version/s: 3.0.1 3.1.0 3.0

[jira] [Commented] (HADOOP-15058) create-release site build outputs dummy shaded jars due to skipShade

2017-12-04 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16277616#comment-16277616 ] Sean Mackrory commented on HADOOP-15058: Looks good to me! +1 > create-release

[jira] [Commented] (HADOOP-15058) create-release site build outputs dummy shaded jars due to skipShade

2017-12-04 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16277555#comment-16277555 ] Sean Mackrory commented on HADOOP-15058: [~andrew.wang] Sure I'll take a look. A

[jira] [Updated] (HADOOP-14475) Metrics of S3A don't print out when enable it in Hadoop metrics property file

2017-12-01 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Mackrory updated HADOOP-14475: --- Attachment: HADOOP-14475.017.patch Let's try this one on for size :) The only change in 016

[jira] [Commented] (HADOOP-14475) Metrics of S3A don't print out when enable it in Hadoop metrics property file

2017-12-01 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16274907#comment-16274907 ] Sean Mackrory commented on HADOOP-14475: {quote} the test thinks s3guard is off,

[jira] [Updated] (HADOOP-14475) Metrics of S3A don't print out when enable it in Hadoop metrics property file

2017-12-01 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Mackrory updated HADOOP-14475: --- Attachment: HADOOP-14475.016.patch Yes, that documentation blurb is out of date (and the "an

[jira] [Commented] (HADOOP-15079) ITestS3AFileOperationCost#testFakeDirectoryDeletion failing after OutputCommitter patch

2017-12-01 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16274728#comment-16274728 ] Sean Mackrory commented on HADOOP-15079: So the innerMkdirs redundancy causes th

[jira] [Commented] (HADOOP-15079) ITestS3AFileOperationCost#testFakeDirectoryDeletion failing after OutputCommitter patch

2017-12-01 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16274630#comment-16274630 ] Sean Mackrory commented on HADOOP-15079: Contrary to the comment, I think we do

[jira] [Commented] (HADOOP-15079) ITestS3AFileOperationCost#testFakeDirectoryDeletion failing after OutputCommitter patch

2017-11-30 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16273638#comment-16273638 ] Sean Mackrory commented on HADOOP-15079: I suspected that simply removing the de

[jira] [Commented] (HADOOP-14475) Metrics of S3A don't print out when enable it in Hadoop metrics property file

2017-11-30 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16273554#comment-16273554 ] Sean Mackrory commented on HADOOP-14475: Filed HADOOP-15079. I'm quite certain i

[jira] [Created] (HADOOP-15079) ITestS3AFileOperationCost#testFakeDirectoryDeletion failing after OutputCommitter patch

2017-11-30 Thread Sean Mackrory (JIRA)
Sean Mackrory created HADOOP-15079: -- Summary: ITestS3AFileOperationCost#testFakeDirectoryDeletion failing after OutputCommitter patch Key: HADOOP-15079 URL: https://issues.apache.org/jira/browse/HADOOP-15079

[jira] [Commented] (HADOOP-14475) Metrics of S3A don't print out when enable it in Hadoop metrics property file

2017-11-30 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16272970#comment-16272970 ] Sean Mackrory commented on HADOOP-14475: I never saw the issue you were referrin

[jira] [Comment Edited] (HADOOP-14475) Metrics of S3A don't print out when enable it in Hadoop metrics property file

2017-11-28 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16269021#comment-16269021 ] Sean Mackrory edited comment on HADOOP-14475 at 11/28/17 4:44 PM:

[jira] [Commented] (HADOOP-14475) Metrics of S3A don't print out when enable it in Hadoop metrics property file

2017-11-28 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16269021#comment-16269021 ] Sean Mackrory commented on HADOOP-14475: Yeah FileSink seems to be too primitive

[jira] [Commented] (HADOOP-14475) Metrics of S3A don't print out when enable it in Hadoop metrics property file

2017-11-28 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16268964#comment-16268964 ] Sean Mackrory commented on HADOOP-14475: Okay - sounds like we're on the same pa

[jira] [Comment Edited] (HADOOP-14475) Metrics of S3A don't print out when enable it in Hadoop metrics property file

2017-11-27 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16268073#comment-16268073 ] Sean Mackrory edited comment on HADOOP-14475 at 11/28/17 4:07 AM:

[jira] [Commented] (HADOOP-14475) Metrics of S3A don't print out when enable it in Hadoop metrics property file

2017-11-27 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16268073#comment-16268073 ] Sean Mackrory commented on HADOOP-14475: [~iyonger] I don't believe I've changed

[jira] [Commented] (HADOOP-14475) Metrics of S3A don't print out when enable it in Hadoop metrics property file

2017-11-27 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16267865#comment-16267865 ] Sean Mackrory commented on HADOOP-14475: One other thing worth mentioning is the

[jira] [Updated] (HADOOP-14475) Metrics of S3A don't print out when enable it in Hadoop metrics property file

2017-11-27 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Mackrory updated HADOOP-14475: --- Attachment: HADOOP-14475.015.patch Conflict presumably due to s3a output committer. Relative

[jira] [Updated] (HADOOP-14475) Metrics of S3A don't print out when enable it in Hadoop metrics property file

2017-11-27 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Mackrory updated HADOOP-14475: --- Attachment: HADOOP-14475.014.patch So I see the local hostname is already included in metric

[jira] [Commented] (HADOOP-14475) Metrics of S3A don't print out when enable it in Hadoop metrics property file

2017-11-27 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16267086#comment-16267086 ] Sean Mackrory commented on HADOOP-14475: {quote}I think we'd probably be better

[jira] [Resolved] (HADOOP-14973) [s3a] Log StorageStatistics

2017-11-20 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Mackrory resolved HADOOP-14973. Resolution: Duplicate Resolving in favor of HADOOP-14475 since that's the right approach.

[jira] [Created] (HADOOP-15055) Add s3 metrics from AWS SDK to s3a metrics tracking

2017-11-20 Thread Sean Mackrory (JIRA)
Sean Mackrory created HADOOP-15055: -- Summary: Add s3 metrics from AWS SDK to s3a metrics tracking Key: HADOOP-15055 URL: https://issues.apache.org/jira/browse/HADOOP-15055 Project: Hadoop Common

[jira] [Updated] (HADOOP-14475) Metrics of S3A don't print out when enable it in Hadoop metrics property file

2017-11-20 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Mackrory updated HADOOP-14475: --- Attachment: HADOOP-14475.013.patch * Made S3AInstrumentation implement Closeable and use IOU

[jira] [Updated] (HADOOP-14475) Metrics of S3A don't print out when enable it in Hadoop metrics property file

2017-11-17 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Mackrory updated HADOOP-14475: --- Attachment: HADOOP-14475.012.patch - Dropping .stop(). Looking at the MetricsSystemImpl cod

[jira] [Commented] (HADOOP-14475) Metrics of S3A don't print out when enable it in Hadoop metrics property file

2017-11-17 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16257249#comment-16257249 ] Sean Mackrory commented on HADOOP-14475: Also note that I made the record name /

[jira] [Updated] (HADOOP-14475) Metrics of S3A don't print out when enable it in Hadoop metrics property file

2017-11-17 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Mackrory updated HADOOP-14475: --- Attachment: HADOOP-14475.011.patch Same as .010. but with: - Checkstyle issues fixed, with a

[jira] [Comment Edited] (HADOOP-14475) Metrics of S3A don't print out when enable it in Hadoop metrics property file

2017-11-16 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16256303#comment-16256303 ] Sean Mackrory edited comment on HADOOP-14475 at 11/17/17 1:51 AM:

[jira] [Updated] (HADOOP-14475) Metrics of S3A don't print out when enable it in Hadoop metrics property file

2017-11-16 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Mackrory updated HADOOP-14475: --- Attachment: HADOOP-14475.010.patch Attaching a patch trying out the idea of a separate Metri

[jira] [Comment Edited] (HADOOP-14475) Metrics of S3A don't print out when enable it in Hadoop metrics property file

2017-11-15 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16254662#comment-16254662 ] Sean Mackrory edited comment on HADOOP-14475 at 11/16/17 2:37 AM:

[jira] [Commented] (HADOOP-14475) Metrics of S3A don't print out when enable it in Hadoop metrics property file

2017-11-15 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16254662#comment-16254662 ] Sean Mackrory commented on HADOOP-14475: {quote}DefaultMetricsSystem lifecycle A

[jira] [Updated] (HADOOP-14475) Metrics of S3A don't print out when enable it in Hadoop metrics property file

2017-11-15 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Mackrory updated HADOOP-14475: --- Attachment: HADOOP-14475.009.patch Thanks Yonger. I've attached a patch with some trivial ch

[jira] [Commented] (HADOOP-14475) Metrics of S3A don't print out when enable it in Hadoop metrics property file

2017-11-14 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16252886#comment-16252886 ] Sean Mackrory commented on HADOOP-14475: Okay - thanks for the additional contex

[jira] [Commented] (HADOOP-14475) Metrics of S3A don't print out when enable it in Hadoop metrics property file

2017-11-14 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16251577#comment-16251577 ] Sean Mackrory commented on HADOOP-14475: Also some minor checkstyle issues - but

[jira] [Commented] (HADOOP-14475) Metrics of S3A don't print out when enable it in Hadoop metrics property file

2017-11-14 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16251543#comment-16251543 ] Sean Mackrory commented on HADOOP-14475: Thanks for the update [~iyonger]! Your

[jira] [Commented] (HADOOP-14475) Metrics of S3A don't print out when enable it in Hadoop metrics property file

2017-11-01 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16234542#comment-16234542 ] Sean Mackrory commented on HADOOP-14475: I tried this out on a cluster. I saw th

[jira] [Commented] (HADOOP-14475) Metrics of S3A don't print out when enable it in Hadoop metrics property file

2017-10-30 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16225594#comment-16225594 ] Sean Mackrory commented on HADOOP-14475: Actually I do have a couple of thoughts

[jira] [Commented] (HADOOP-14475) Metrics of S3A don't print out when enable it in Hadoop metrics property file

2017-10-30 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16225425#comment-16225425 ] Sean Mackrory commented on HADOOP-14475: This is needed: {code} -String tar

[jira] [Commented] (HADOOP-14475) Metrics of S3A don't print out when enable it in Hadoop metrics property file

2017-10-30 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16225089#comment-16225089 ] Sean Mackrory commented on HADOOP-14475: I'm taking a look at this. For what it'

[jira] [Commented] (HADOOP-14973) [s3a] Log StorageStatistics

2017-10-27 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16222859#comment-16222859 ] Sean Mackrory commented on HADOOP-14973: {quote}discouraging any attempts to avo

[jira] [Commented] (HADOOP-14973) [s3a] Log StorageStatistics

2017-10-27 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16222715#comment-16222715 ] Sean Mackrory commented on HADOOP-14973: I think you misunderstand where these r

[jira] [Commented] (HADOOP-14973) [s3a] Log StorageStatistics

2017-10-27 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16222441#comment-16222441 ] Sean Mackrory commented on HADOOP-14973: Yeah let me take a closer look at how w

[jira] [Updated] (HADOOP-14973) [s3a] Log StorageStatistics

2017-10-24 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Mackrory updated HADOOP-14973: --- Issue Type: Sub-task (was: Bug) Parent: HADOOP-14831 > [s3a] Log StorageStatistics

[jira] [Updated] (HADOOP-14973) [s3a] Log StorageStatistics

2017-10-24 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Mackrory updated HADOOP-14973: --- Summary: [s3a] Log StorageStatistics (was: Log StorageStatistics) > [s3a] Log StorageStatis

[jira] [Updated] (HADOOP-14973) Log StorageStatistics

2017-10-24 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Mackrory updated HADOOP-14973: --- Affects Version/s: 3.0.0-beta1 2.8.1 > Log StorageStatistics > --

[jira] [Created] (HADOOP-14973) Log StorageStatistics

2017-10-23 Thread Sean Mackrory (JIRA)
Sean Mackrory created HADOOP-14973: -- Summary: Log StorageStatistics Key: HADOOP-14973 URL: https://issues.apache.org/jira/browse/HADOOP-14973 Project: Hadoop Common Issue Type: Bug

[jira] [Updated] (HADOOP-14972) Histogram metrics types for latency, etc.

2017-10-23 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Mackrory updated HADOOP-14972: --- Description: We'd like metrics to track latencies for various operations, such as latencies

[jira] [Created] (HADOOP-14972) Histogram metrics types for latency, etc.

2017-10-23 Thread Sean Mackrory (JIRA)
Sean Mackrory created HADOOP-14972: -- Summary: Histogram metrics types for latency, etc. Key: HADOOP-14972 URL: https://issues.apache.org/jira/browse/HADOOP-14972 Project: Hadoop Common Issue

[jira] [Moved] (HADOOP-14931) Isolation of native libraries in JARs

2017-10-05 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Mackrory moved HDFS-12595 to HADOOP-14931: --- Key: HADOOP-14931 (was: HDFS-12595) Project: Hadoop Common

[jira] [Updated] (HADOOP-14835) mvn site build throws SAX errors

2017-09-13 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Mackrory updated HADOOP-14835: --- Attachment: HADOOP-14835.003.patch +1 - but attaching a v3 patch that also adds a note to BU

[jira] [Commented] (HADOOP-13887) Support for client-side encryption in S3A file system

2017-08-31 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16149157#comment-16149157 ] Sean Mackrory commented on HADOOP-13887: Just wanted to comment that I gave [~mo

[jira] [Commented] (HADOOP-14801) s3guard diff demand creates a new table

2017-08-23 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16138736#comment-16138736 ] Sean Mackrory commented on HADOOP-14801: This is probably it. The forceCreate op

[jira] [Commented] (HADOOP-13998) Merge initial S3guard release into trunk

2017-08-16 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16129461#comment-16129461 ] Sean Mackrory commented on HADOOP-13998: I'm happy with this patch. +1 to an 's3

[jira] [Commented] (HADOOP-13998) Merge initial s3guard release into trunk

2017-08-14 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16126687#comment-16126687 ] Sean Mackrory commented on HADOOP-13998: Thanks, [~steve_l] - I'm reviewing (is

[jira] [Comment Edited] (HADOOP-14260) Configuration.dumpConfiguration should redact sensitive information

2017-08-10 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16122623#comment-16122623 ] Sean Mackrory edited comment on HADOOP-14260 at 8/11/17 12:53 AM:

[jira] [Commented] (HADOOP-14260) Configuration.dumpConfiguration should redact sensitive information

2017-08-10 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16122623#comment-16122623 ] Sean Mackrory commented on HADOOP-14260: +1, pending a clean Yetus run. As a si

[jira] [Updated] (HADOOP-13952) tools dependency hooks are throwing errors

2017-08-04 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Mackrory updated HADOOP-13952: --- Attachment: HADOOP-13952.001.patch Made the suggested changes, rebuilt and re-ran Yetus (alt

[jira] [Updated] (HADOOP-13952) tools dependency hooks are throwing errors

2017-08-04 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Mackrory updated HADOOP-13952: --- Attachment: HADOOP-13952.000.patch I added an "extra_dir" parameter so you can specify a dep

[jira] [Comment Edited] (HADOOP-13952) tools dependency hooks are throwing errors

2017-08-04 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16114886#comment-16114886 ] Sean Mackrory edited comment on HADOOP-13952 at 8/4/17 7:51 PM: --

[jira] [Updated] (HADOOP-13952) tools dependency hooks are throwing errors

2017-08-04 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Mackrory updated HADOOP-13952: --- Status: Patch Available (was: Open) > tools dependency hooks are throwing errors >

[jira] [Commented] (HADOOP-13952) tools dependency hooks are throwing errors

2017-08-04 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16114453#comment-16114453 ] Sean Mackrory commented on HADOOP-13952: Changing findfileindir in dist-layout-s

[jira] [Comment Edited] (HADOOP-13952) tools dependency hooks are throwing errors

2017-08-03 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16113722#comment-16113722 ] Sean Mackrory edited comment on HADOOP-13952 at 8/4/17 12:10 AM: -

[jira] [Commented] (HADOOP-13952) tools dependency hooks are throwing errors

2017-08-03 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16113722#comment-16113722 ] Sean Mackrory commented on HADOOP-13952: So: hadoop-tool-dist is including these

[jira] [Comment Edited] (HADOOP-13952) tools dependency hooks are throwing errors

2017-08-03 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16113523#comment-16113523 ] Sean Mackrory edited comment on HADOOP-13952 at 8/3/17 9:29 PM: --

[jira] [Updated] (HADOOP-13952) tools dependency hooks are throwing errors

2017-08-03 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Mackrory updated HADOOP-13952: --- Attachment: HADOOP-13952.preview.patch I couldn't find much official documentation on the fo

[jira] [Assigned] (HADOOP-13952) tools dependency hooks are throwing errors

2017-08-03 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Mackrory reassigned HADOOP-13952: -- Assignee: Sean Mackrory > tools dependency hooks are throwing errors > --

[jira] [Commented] (HADOOP-13952) tools dependency hooks are throwing errors

2017-08-03 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16113086#comment-16113086 ] Sean Mackrory commented on HADOOP-13952: FYI most of these appear to have been f

[jira] [Updated] (HADOOP-14498) HADOOP_OPTIONAL_TOOLS not parsed correctly

2017-08-03 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Mackrory updated HADOOP-14498: --- Attachment: HADOOP-14498.003.patch .003 patch address shellcheck issues and refactors the lo

[jira] [Updated] (HADOOP-14498) HADOOP_OPTIONAL_TOOLS not parsed correctly

2017-08-02 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Mackrory updated HADOOP-14498: --- Attachment: HADOOP-14498.002.patch Attaching said patch It'd be nice to replace that inl

<    1   2   3   4   5   6   7   8   9   10   >