[jira] [Commented] (HADOOP-14703) ConsoleSink for metrics2
[ https://issues.apache.org/jira/browse/HADOOP-14703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16138068#comment-16138068 ] Ronald Macmaster commented on HADOOP-14703: --- Woah, I just saw your comment. That's freaky. I will need to look into that more. > ConsoleSink for metrics2 > > > Key: HADOOP-14703 > URL: https://issues.apache.org/jira/browse/HADOOP-14703 > Project: Hadoop Common > Issue Type: Improvement > Components: common, metrics >Affects Versions: 3.0.0-beta1 >Reporter: Ronald Macmaster >Assignee: Ronald Macmaster > Labels: newbie > Attachments: > 0001-HADOOP-14703.-ConsoleSink-for-simple-metrics-printin.patch, > HADOOP-14703.001.patch, HADOOP-14703.002.patch, HADOOP-14703.003.patch, > HADOOP-14703.004.patch, HADOOP-14703.006.patch > > Original Estimate: 6h > Remaining Estimate: 6h > > The ConsoleSink will provide a simple solution to dump metrics to the console > through std.out. > Quick access to metrics through the console will simplify the development, > testing, and debugging process. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-14703) ConsoleSink for metrics2
[ https://issues.apache.org/jira/browse/HADOOP-14703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ronald Macmaster updated HADOOP-14703: -- Attachment: HADOOP-14703.006.patch I've added a Thread.sleep(3000) call after the metrics publishMetricsNow call. hadoop-metrics2-test.properties must be sourced as a resource from the classpath, and the GenericTestUtils.getTestDir() directory (target/test/data) is not normally in the classpath. Now, the test tries to add target/test/data to the classpath. The test works locally, but it fails on the Jenkins server (despite correctly sourcing from hadoop-metrics2-test.properties). If the test still fails on the Jenkins server with a 3 second delay, it may be best to revert it to the original properties file creation method. > ConsoleSink for metrics2 > > > Key: HADOOP-14703 > URL: https://issues.apache.org/jira/browse/HADOOP-14703 > Project: Hadoop Common > Issue Type: Improvement > Components: common, metrics >Affects Versions: 3.0.0-beta1 >Reporter: Ronald Macmaster >Assignee: Ronald Macmaster > Labels: newbie > Attachments: > 0001-HADOOP-14703.-ConsoleSink-for-simple-metrics-printin.patch, > HADOOP-14703.001.patch, HADOOP-14703.002.patch, HADOOP-14703.003.patch, > HADOOP-14703.004.patch, HADOOP-14703.006.patch > > Original Estimate: 6h > Remaining Estimate: 6h > > The ConsoleSink will provide a simple solution to dump metrics to the console > through std.out. > Quick access to metrics through the console will simplify the development, > testing, and debugging process. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-14703) ConsoleSink for metrics2
[ https://issues.apache.org/jira/browse/HADOOP-14703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ronald Macmaster updated HADOOP-14703: -- Attachment: HADOOP-14703.004.patch Force sequential test execution. > ConsoleSink for metrics2 > > > Key: HADOOP-14703 > URL: https://issues.apache.org/jira/browse/HADOOP-14703 > Project: Hadoop Common > Issue Type: Improvement > Components: common, metrics >Affects Versions: 3.0.0-beta1 >Reporter: Ronald Macmaster >Assignee: Ronald Macmaster > Labels: newbie > Attachments: > 0001-HADOOP-14703.-ConsoleSink-for-simple-metrics-printin.patch, > HADOOP-14703.001.patch, HADOOP-14703.002.patch, HADOOP-14703.003.patch, > HADOOP-14703.004.patch > > Original Estimate: 6h > Remaining Estimate: 6h > > The ConsoleSink will provide a simple solution to dump metrics to the console > through std.out. > Quick access to metrics through the console will simplify the development, > testing, and debugging process. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-14703) ConsoleSink for metrics2
[ https://issues.apache.org/jira/browse/HADOOP-14703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ronald Macmaster updated HADOOP-14703: -- Attachment: HADOOP-14703.003.patch > ConsoleSink for metrics2 > > > Key: HADOOP-14703 > URL: https://issues.apache.org/jira/browse/HADOOP-14703 > Project: Hadoop Common > Issue Type: Improvement > Components: common, metrics >Affects Versions: 3.0.0-beta1 >Reporter: Ronald Macmaster >Assignee: Ronald Macmaster > Labels: newbie > Attachments: > 0001-HADOOP-14703.-ConsoleSink-for-simple-metrics-printin.patch, > HADOOP-14703.001.patch, HADOOP-14703.002.patch, HADOOP-14703.003.patch > > Original Estimate: 6h > Remaining Estimate: 6h > > The ConsoleSink will provide a simple solution to dump metrics to the console > through std.out. > Quick access to metrics through the console will simplify the development, > testing, and debugging process. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-14703) ConsoleSink for metrics2
[ https://issues.apache.org/jira/browse/HADOOP-14703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124430#comment-16124430 ] Ronald Macmaster commented on HADOOP-14703: --- How does it look? Can we apply this patch? The unit tests that fail are not because of my patch. > ConsoleSink for metrics2 > > > Key: HADOOP-14703 > URL: https://issues.apache.org/jira/browse/HADOOP-14703 > Project: Hadoop Common > Issue Type: Improvement > Components: common, metrics >Affects Versions: 3.0.0-beta1 >Reporter: Ronald Macmaster >Assignee: Ronald Macmaster > Labels: newbie > Attachments: > 0001-HADOOP-14703.-ConsoleSink-for-simple-metrics-printin.patch, > HADOOP-14703.001.patch, HADOOP-14703.002.patch > > Original Estimate: 6h > Remaining Estimate: 6h > > The ConsoleSink will provide a simple solution to dump metrics to the console > through std.out. > Quick access to metrics through the console will simplify the development, > testing, and debugging process. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-14703) ConsoleSink for metrics2
[ https://issues.apache.org/jira/browse/HADOOP-14703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ronald Macmaster updated HADOOP-14703: -- Attachment: HADOOP-14703.002.patch Fixed the checkstyle failures. SFTP test failure is not due to LogSink because LogSink is an independent addition to hadoop-common. > ConsoleSink for metrics2 > > > Key: HADOOP-14703 > URL: https://issues.apache.org/jira/browse/HADOOP-14703 > Project: Hadoop Common > Issue Type: Improvement > Components: common, metrics >Affects Versions: 3.0.0-beta1 >Reporter: Ronald Macmaster >Assignee: Ronald Macmaster > Labels: newbie > Attachments: > 0001-HADOOP-14703.-ConsoleSink-for-simple-metrics-printin.patch, > HADOOP-14703.001.patch, HADOOP-14703.002.patch > > Original Estimate: 6h > Remaining Estimate: 6h > > The ConsoleSink will provide a simple solution to dump metrics to the console > through std.out. > Quick access to metrics through the console will simplify the development, > testing, and debugging process. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-14703) ConsoleSink for metrics2
[ https://issues.apache.org/jira/browse/HADOOP-14703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ronald Macmaster updated HADOOP-14703: -- Attachment: HADOOP-14703.001.patch LogSink for metrics printing via slf4j. > ConsoleSink for metrics2 > > > Key: HADOOP-14703 > URL: https://issues.apache.org/jira/browse/HADOOP-14703 > Project: Hadoop Common > Issue Type: Improvement > Components: common, metrics >Affects Versions: 3.0.0-beta1 >Reporter: Ronald Macmaster >Assignee: Ronald Macmaster > Labels: newbie > Attachments: > 0001-HADOOP-14703.-ConsoleSink-for-simple-metrics-printin.patch, > HADOOP-14703.001.patch > > Original Estimate: 6h > Remaining Estimate: 6h > > The ConsoleSink will provide a simple solution to dump metrics to the console > through std.out. > Quick access to metrics through the console will simplify the development, > testing, and debugging process. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-14703) ConsoleSink for metrics2
[ https://issues.apache.org/jira/browse/HADOOP-14703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16107633#comment-16107633 ] Ronald Macmaster commented on HADOOP-14703: --- That should be a simple fix. I'd just have to properly translate the uses of System.out to LOG. Should we call it an Slf4jSink? LogSink? > ConsoleSink for metrics2 > > > Key: HADOOP-14703 > URL: https://issues.apache.org/jira/browse/HADOOP-14703 > Project: Hadoop Common > Issue Type: Improvement > Components: common, metrics >Affects Versions: 3.0.0-beta1 >Reporter: Ronald Macmaster >Assignee: Ronald Macmaster > Labels: newbie > Attachments: > 0001-HADOOP-14703.-ConsoleSink-for-simple-metrics-printin.patch > > Original Estimate: 6h > Remaining Estimate: 6h > > The ConsoleSink will provide a simple solution to dump metrics to the console > through std.out. > Quick access to metrics through the console will simplify the development, > testing, and debugging process. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-14703) ConsoleSink for metrics2
[ https://issues.apache.org/jira/browse/HADOOP-14703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ronald Macmaster updated HADOOP-14703: -- Tags: hadoop-common metrics metrics2 debugging (was: hadoop-common metrics2 debugging) > ConsoleSink for metrics2 > > > Key: HADOOP-14703 > URL: https://issues.apache.org/jira/browse/HADOOP-14703 > Project: Hadoop Common > Issue Type: Improvement > Components: common, metrics >Affects Versions: 3.0.0-beta1 >Reporter: Ronald Macmaster >Assignee: Ronald Macmaster > Labels: newbie > Attachments: > 0001-HADOOP-14703.-ConsoleSink-for-simple-metrics-printin.patch > > Original Estimate: 6h > Remaining Estimate: 6h > > The ConsoleSink will provide a simple solution to dump metrics to the console > through std.out. > Quick access to metrics through the console will simplify the development, > testing, and debugging process. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Resolved] (HADOOP-14704) KafkaSink for metrics2
[ https://issues.apache.org/jira/browse/HADOOP-14704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ronald Macmaster resolved HADOOP-14704. --- Resolution: Duplicate Fix Version/s: 3.0.0-beta1 Release Note: hadoop-tools/hadoop-kafka already contains a KafkaSink. > KafkaSink for metrics2 > -- > > Key: HADOOP-14704 > URL: https://issues.apache.org/jira/browse/HADOOP-14704 > Project: Hadoop Common > Issue Type: Improvement > Components: common, metrics >Affects Versions: 3.0.0-beta1 >Reporter: Ronald Macmaster > Fix For: 3.0.0-beta1 > > > The KafkaSink, acting as a KafkaProducer, publishes metrics to a Kafka topic. > The regular kafka configuration parameters can be directly specified in the > hadoop-metrics2.properties file under the metrics2 sink prefix (ex. > test.sink.kafka.bootstrap.servers or client.sink.kafka.compression.type). > Addition of the KafkaSink will enrich the metrics2 sink repertory that > already includes sinks for Graphite and Ganglia. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-14704) KafkaSink for metrics2
[ https://issues.apache.org/jira/browse/HADOOP-14704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16107613#comment-16107613 ] Ronald Macmaster commented on HADOOP-14704: --- Oh, nice. I didn't see that there. > KafkaSink for metrics2 > -- > > Key: HADOOP-14704 > URL: https://issues.apache.org/jira/browse/HADOOP-14704 > Project: Hadoop Common > Issue Type: Improvement > Components: common, metrics >Affects Versions: 3.0.0-beta1 >Reporter: Ronald Macmaster > > The KafkaSink, acting as a KafkaProducer, publishes metrics to a Kafka topic. > The regular kafka configuration parameters can be directly specified in the > hadoop-metrics2.properties file under the metrics2 sink prefix (ex. > test.sink.kafka.bootstrap.servers or client.sink.kafka.compression.type). > Addition of the KafkaSink will enrich the metrics2 sink repertory that > already includes sinks for Graphite and Ganglia. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-14704) KafkaSink for metrics2
[ https://issues.apache.org/jira/browse/HADOOP-14704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ronald Macmaster updated HADOOP-14704: -- Description: The KafkaSink, acting as a KafkaProducer, publishes metrics to a Kafka topic. The regular kafka configuration parameters can be directly specified in the hadoop-metrics2.properties file under the metrics2 sink prefix (ex. test.sink.kafka.bootstrap.servers or client.sink.kafka.compression.type). Addition of the KafkaSink will enrich the metrics2 sink repertory that already includes sinks for Graphite and Ganglia. was: The KafkaSink, acting as a KafkaProducer, publishes metrics to a Kafka topic. The regular kafka configuration parameters can be directly specified in the hadoop-metrics2.properties file under the metrics2 sink prefix (ex. test.sink.kafka.bootstrap.servers or client.sink.kafka.compression.type). > KafkaSink for metrics2 > -- > > Key: HADOOP-14704 > URL: https://issues.apache.org/jira/browse/HADOOP-14704 > Project: Hadoop Common > Issue Type: Improvement > Components: common >Affects Versions: 3.0.0-beta1 >Reporter: Ronald Macmaster > Fix For: 3.0.0-beta1 > > > The KafkaSink, acting as a KafkaProducer, publishes metrics to a Kafka topic. > The regular kafka configuration parameters can be directly specified in the > hadoop-metrics2.properties file under the metrics2 sink prefix (ex. > test.sink.kafka.bootstrap.servers or client.sink.kafka.compression.type). > Addition of the KafkaSink will enrich the metrics2 sink repertory that > already includes sinks for Graphite and Ganglia. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Created] (HADOOP-14704) KafkaSink for metrics2
Ronald Macmaster created HADOOP-14704: - Summary: KafkaSink for metrics2 Key: HADOOP-14704 URL: https://issues.apache.org/jira/browse/HADOOP-14704 Project: Hadoop Common Issue Type: Improvement Components: common Affects Versions: 3.0.0-beta1 Reporter: Ronald Macmaster Fix For: 3.0.0-beta1 The KafkaSink, acting as a KafkaProducer, publishes metrics to a Kafka topic. The regular kafka configuration parameters can be directly specified in the hadoop-metrics2.properties file under the metrics2 sink prefix (ex. test.sink.kafka.bootstrap.servers or client.sink.kafka.compression.type). -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-14703) ConsoleSink for metrics2
[ https://issues.apache.org/jira/browse/HADOOP-14703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ronald Macmaster updated HADOOP-14703: -- Attachment: 0001-HADOOP-14703.-ConsoleSink-for-simple-metrics-printin.patch > ConsoleSink for metrics2 > > > Key: HADOOP-14703 > URL: https://issues.apache.org/jira/browse/HADOOP-14703 > Project: Hadoop Common > Issue Type: Improvement > Components: common >Affects Versions: 3.0.0-beta1 >Reporter: Ronald Macmaster > Labels: newbie > Fix For: 3.0.0-beta1 > > Attachments: > 0001-HADOOP-14703.-ConsoleSink-for-simple-metrics-printin.patch > > Original Estimate: 6h > Remaining Estimate: 6h > > The ConsoleSink will provide a simple solution to dump metrics to the console > through std.out. > Quick access to metrics through the console will simplify the development, > testing, and debugging process. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Created] (HADOOP-14703) ConsoleSink for metrics2
Ronald Macmaster created HADOOP-14703: - Summary: ConsoleSink for metrics2 Key: HADOOP-14703 URL: https://issues.apache.org/jira/browse/HADOOP-14703 Project: Hadoop Common Issue Type: Improvement Components: common Affects Versions: 3.0.0-beta1 Reporter: Ronald Macmaster Fix For: 3.0.0-beta1 The ConsoleSink will provide a simple solution to dump metrics to the console through std.out. Quick access to metrics through the console will simplify the development, testing, and debugging process. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-14703) ConsoleSink for metrics2
[ https://issues.apache.org/jira/browse/HADOOP-14703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ronald Macmaster updated HADOOP-14703: -- Description: The ConsoleSink will provide a simple solution to dump metrics to the console through std.out. Quick access to metrics through the console will simplify the development, testing, and debugging process. was:The ConsoleSink will provide a simple solution to dump metrics to the console through std.out. Quick access to metrics through the console will simplify the development, testing, and debugging process. > ConsoleSink for metrics2 > > > Key: HADOOP-14703 > URL: https://issues.apache.org/jira/browse/HADOOP-14703 > Project: Hadoop Common > Issue Type: Improvement > Components: common >Affects Versions: 3.0.0-beta1 >Reporter: Ronald Macmaster > Labels: newbie > Fix For: 3.0.0-beta1 > > Original Estimate: 6h > Remaining Estimate: 6h > > The ConsoleSink will provide a simple solution to dump metrics to the console > through std.out. > Quick access to metrics through the console will simplify the development, > testing, and debugging process. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
