from:"Anubhav Kale \(JIRA\)"

[jira] [Commented] (SPARK-5784) Add StatsDSink to MetricsSystem

2015-11-21 Thread Anubhav Kale (JIRA)


[ 
https://issues.apache.org/jira/browse/SPARK-5784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15020745#comment-15020745
 ] 

Anubhav Kale commented on SPARK-5784:
-

I was able to build and use this. Let me know if I should share the JARs 
somewhere. 

Thanks !

> Add StatsDSink to MetricsSystem
> ---
>
> Key: SPARK-5784
> URL: https://issues.apache.org/jira/browse/SPARK-5784
> Project: Spark
>  Issue Type: Improvement
>  Components: Spark Core
>Affects Versions: 1.2.1
>Reporter: Ryan Williams
>Priority: Minor
> Attachments: statsd.patch
>
>
> [StatsD|https://github.com/etsy/statsd/] is a common wrapper for Graphite; it 
> would be useful to support sending metrics to StatsD in addition to [the 
> existing Graphite 
> support|https://github.com/apache/spark/blob/6a1be026cf37e4c8bf39133dfb4a73f7caedcc26/core/src/main/scala/org/apache/spark/metrics/sink/GraphiteSink.scala].
> [readytalk/metrics-statsd|https://github.com/readytalk/metrics-statsd] is a 
> StatsD adapter for the 
> [dropwizard/metrics|https://github.com/dropwizard/metrics] library that Spark 
> uses. The Maven repository at http://dl.bintray.com/readytalk/maven/ serves 
> {{metrics-statsd}}.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

[jira] [Commented] (SPARK-5784) Add StatsDSink to MetricsSystem

2015-11-17 Thread Anubhav Kale (JIRA)


[ 
https://issues.apache.org/jira/browse/SPARK-5784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15009874#comment-15009874
 ] 

Anubhav Kale commented on SPARK-5784:
-

Is there a handy list of all the dependent JARs needed to build this ? I tried 
pulling spark,metrics JARs and struggling a bit. 

> Add StatsDSink to MetricsSystem
> ---
>
> Key: SPARK-5784
> URL: https://issues.apache.org/jira/browse/SPARK-5784
> Project: Spark
>  Issue Type: Improvement
>  Components: Spark Core
>Affects Versions: 1.2.1
>Reporter: Ryan Williams
>Priority: Minor
> Attachments: statsd.patch
>
>
> [StatsD|https://github.com/etsy/statsd/] is a common wrapper for Graphite; it 
> would be useful to support sending metrics to StatsD in addition to [the 
> existing Graphite 
> support|https://github.com/apache/spark/blob/6a1be026cf37e4c8bf39133dfb4a73f7caedcc26/core/src/main/scala/org/apache/spark/metrics/sink/GraphiteSink.scala].
> [readytalk/metrics-statsd|https://github.com/readytalk/metrics-statsd] is a 
> StatsD adapter for the 
> [dropwizard/metrics|https://github.com/dropwizard/metrics] library that Spark 
> uses. The Maven repository at http://dl.bintray.com/readytalk/maven/ serves 
> {{metrics-statsd}}.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

[jira] [Issue Comment Deleted] (SPARK-5784) Add StatsDSink to MetricsSystem

2015-11-17 Thread Anubhav Kale (JIRA)


 [ 
https://issues.apache.org/jira/browse/SPARK-5784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Anubhav Kale updated SPARK-5784:

Comment: was deleted

(was: I pulled metrics-adapter-4.0.0-SNAPSHOT.jar and spark-core_2.11-1.5.2.jar 
to build, but running into below. Any ideas ?

13:48:58.32;E:\DI\SparkStatsd>sbt run
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=256m; 
support was removed in 8.0
[info] Set current project to sparkstatsd (in build file:/E:/DI/SparkStatsd/)
[info] Compiling 1 Scala source to 
E:\DI\SparkStatsd\target\scala-2.10\classes...
[warn] 
E:\DI\SparkStatsd\src\main\scala\org\apache\spark\metrics\sink\StatsDSink.scala:14:
 imported `Sink' is permanently hidden by definition of trait Sink in
package sink
[warn] import org.apache.spark.metrics.sink.Sink
[warn]  ^
[warn] Class org.slf4j.Logger not found - continuing with a stub.
[warn] Class com.codahale.metrics.ScheduledReporter not found - continuing with 
a stub.
[warn] Class com.readytalk.metrics.StatsD not found - continuing with a stub.
[warn] Class com.readytalk.metrics.StatsD not found - continuing with a stub.
[error]
[error]  while compiling: 
E:\DI\SparkStatsd\src\main\scala\org\apache\spark\metrics\sink\StatsDSink.scala
[error] during phase: typer
[error]  library version: version 2.10.4
[error] compiler version: version 2.10.4
[error]   reconstructed args: -classpath 
E:\DI\SparkStatsd\target\scala-2.10\classes;E:\DI\SparkStatsd\lib\metrics-adapter-4.0.0-SNAPSHOT.jar;E:\DI\SparkStatsd\
lib\metrics-core-4.0.0-SNAPSHOT.jar;E:\DI\SparkStatsd\lib\metrics3-statsd-4.1.0.jar;E:\DI\SparkStatsd\lib\spark-core_2.11-1.5.2.jar
 -bootclasspath C:\Java\jre\l
ib\resources.jar;C:\Java\jre\lib\rt.jar;C:\Java\jre\lib\sunrsasign.jar;C:\Java\jre\lib\jsse.jar;C:\Java\jre\lib\jce.jar;C:\Java\jre\lib\charsets.jar;C:\Java\jre
\lib\jfr.jar;C:\Java\jre\classes;C:\Users\anubhavk\.sbt\boot\scala-2.10.4\lib\scala-library.jar
[error]
[error]   last tree to typer: Ident(MetricFilter)
[error]   symbol:  (flags: )
[error]symbol definition: 
[error]symbol owners:
[error]   context owners: value reporter -> class StatsDSink -> package sink
[error]
[error] == Enclosing template or block ==
[error]
[error] Template( // val :  in class StatsDSink
[error]   "org.apache.spark.metrics.sink.Sink" // parents
[error]   ValDef(
[error] private
[error] "_"
[error] 
[error] 
[error]   )
[error]   // 25 statements
[error]   ValDef( // private[this] val property: java.util.Properties in class 
StatsDSink



[error] uncaught exception during compilation: java.lang.AssertionError
java.lang.AssertionError: assertion failed: com.readytalk.metrics.StatsD
at scala.reflect.internal.Symbols$Symbol.info(Symbols.scala:1212)
at 
scala.reflect.internal.Symbols$Symbol.baseTypeSeqLength$1(Symbols.scala:1628)
)

> Add StatsDSink to MetricsSystem
> ---
>
> Key: SPARK-5784
> URL: https://issues.apache.org/jira/browse/SPARK-5784
> Project: Spark
>  Issue Type: Improvement
>  Components: Spark Core
>Affects Versions: 1.2.1
>Reporter: Ryan Williams
>Priority: Minor
> Attachments: statsd.patch
>
>
> [StatsD|https://github.com/etsy/statsd/] is a common wrapper for Graphite; it 
> would be useful to support sending metrics to StatsD in addition to [the 
> existing Graphite 
> support|https://github.com/apache/spark/blob/6a1be026cf37e4c8bf39133dfb4a73f7caedcc26/core/src/main/scala/org/apache/spark/metrics/sink/GraphiteSink.scala].
> [readytalk/metrics-statsd|https://github.com/readytalk/metrics-statsd] is a 
> StatsD adapter for the 
> [dropwizard/metrics|https://github.com/dropwizard/metrics] library that Spark 
> uses. The Maven repository at http://dl.bintray.com/readytalk/maven/ serves 
> {{metrics-statsd}}.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

[jira] [Commented] (SPARK-5784) Add StatsDSink to MetricsSystem

2015-11-17 Thread Anubhav Kale (JIRA)


[ 
https://issues.apache.org/jira/browse/SPARK-5784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15009870#comment-15009870
 ] 

Anubhav Kale commented on SPARK-5784:
-

I pulled metrics-adapter-4.0.0-SNAPSHOT.jar and spark-core_2.11-1.5.2.jar to 
build, but running into below. Any ideas ?

13:48:58.32;E:\DI\SparkStatsd>sbt run
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=256m; 
support was removed in 8.0
[info] Set current project to sparkstatsd (in build file:/E:/DI/SparkStatsd/)
[info] Compiling 1 Scala source to 
E:\DI\SparkStatsd\target\scala-2.10\classes...
[warn] 
E:\DI\SparkStatsd\src\main\scala\org\apache\spark\metrics\sink\StatsDSink.scala:14:
 imported `Sink' is permanently hidden by definition of trait Sink in
package sink
[warn] import org.apache.spark.metrics.sink.Sink
[warn]  ^
[warn] Class org.slf4j.Logger not found - continuing with a stub.
[warn] Class com.codahale.metrics.ScheduledReporter not found - continuing with 
a stub.
[warn] Class com.readytalk.metrics.StatsD not found - continuing with a stub.
[warn] Class com.readytalk.metrics.StatsD not found - continuing with a stub.
[error]
[error]  while compiling: 
E:\DI\SparkStatsd\src\main\scala\org\apache\spark\metrics\sink\StatsDSink.scala
[error] during phase: typer
[error]  library version: version 2.10.4
[error] compiler version: version 2.10.4
[error]   reconstructed args: -classpath 
E:\DI\SparkStatsd\target\scala-2.10\classes;E:\DI\SparkStatsd\lib\metrics-adapter-4.0.0-SNAPSHOT.jar;E:\DI\SparkStatsd\
lib\metrics-core-4.0.0-SNAPSHOT.jar;E:\DI\SparkStatsd\lib\metrics3-statsd-4.1.0.jar;E:\DI\SparkStatsd\lib\spark-core_2.11-1.5.2.jar
 -bootclasspath C:\Java\jre\l
ib\resources.jar;C:\Java\jre\lib\rt.jar;C:\Java\jre\lib\sunrsasign.jar;C:\Java\jre\lib\jsse.jar;C:\Java\jre\lib\jce.jar;C:\Java\jre\lib\charsets.jar;C:\Java\jre
\lib\jfr.jar;C:\Java\jre\classes;C:\Users\anubhavk\.sbt\boot\scala-2.10.4\lib\scala-library.jar
[error]
[error]   last tree to typer: Ident(MetricFilter)
[error]   symbol:  (flags: )
[error]symbol definition: 
[error]symbol owners:
[error]   context owners: value reporter -> class StatsDSink -> package sink
[error]
[error] == Enclosing template or block ==
[error]
[error] Template( // val :  in class StatsDSink
[error]   "org.apache.spark.metrics.sink.Sink" // parents
[error]   ValDef(
[error] private
[error] "_"
[error] 
[error] 
[error]   )
[error]   // 25 statements
[error]   ValDef( // private[this] val property: java.util.Properties in class 
StatsDSink



[error] uncaught exception during compilation: java.lang.AssertionError
java.lang.AssertionError: assertion failed: com.readytalk.metrics.StatsD
at scala.reflect.internal.Symbols$Symbol.info(Symbols.scala:1212)
at 
scala.reflect.internal.Symbols$Symbol.baseTypeSeqLength$1(Symbols.scala:1628)


> Add StatsDSink to MetricsSystem
> ---
>
> Key: SPARK-5784
> URL: https://issues.apache.org/jira/browse/SPARK-5784
> Project: Spark
>  Issue Type: Improvement
>  Components: Spark Core
>Affects Versions: 1.2.1
>Reporter: Ryan Williams
>Priority: Minor
> Attachments: statsd.patch
>
>
> [StatsD|https://github.com/etsy/statsd/] is a common wrapper for Graphite; it 
> would be useful to support sending metrics to StatsD in addition to [the 
> existing Graphite 
> support|https://github.com/apache/spark/blob/6a1be026cf37e4c8bf39133dfb4a73f7caedcc26/core/src/main/scala/org/apache/spark/metrics/sink/GraphiteSink.scala].
> [readytalk/metrics-statsd|https://github.com/readytalk/metrics-statsd] is a 
> StatsD adapter for the 
> [dropwizard/metrics|https://github.com/dropwizard/metrics] library that Spark 
> uses. The Maven repository at http://dl.bintray.com/readytalk/maven/ serves 
> {{metrics-statsd}}.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

[jira] [Commented] (SPARK-5784) Add StatsDSink to MetricsSystem

2015-11-17 Thread Anubhav Kale (JIRA)


[ 
https://issues.apache.org/jira/browse/SPARK-5784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15009612#comment-15009612
 ] 

Anubhav Kale commented on SPARK-5784:
-

I am interested in using this as a standalone JAR. Are you able to build one ? 
If so, could you please share it here ?

This seems like the only support for sending Spark metrics to StatsD, so it 
would be immensely helpful if you can ship a JAR.

> Add StatsDSink to MetricsSystem
> ---
>
> Key: SPARK-5784
> URL: https://issues.apache.org/jira/browse/SPARK-5784
> Project: Spark
>  Issue Type: Improvement
>  Components: Spark Core
>Affects Versions: 1.2.1
>Reporter: Ryan Williams
>Priority: Minor
> Attachments: statsd.patch
>
>
> [StatsD|https://github.com/etsy/statsd/] is a common wrapper for Graphite; it 
> would be useful to support sending metrics to StatsD in addition to [the 
> existing Graphite 
> support|https://github.com/apache/spark/blob/6a1be026cf37e4c8bf39133dfb4a73f7caedcc26/core/src/main/scala/org/apache/spark/metrics/sink/GraphiteSink.scala].
> [readytalk/metrics-statsd|https://github.com/readytalk/metrics-statsd] is a 
> StatsD adapter for the 
> [dropwizard/metrics|https://github.com/dropwizard/metrics] library that Spark 
> uses. The Maven repository at http://dl.bintray.com/readytalk/maven/ serves 
> {{metrics-statsd}}.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

[jira] [Commented] (SPARK-5784) Add StatsDSink to MetricsSystem

[jira] [Commented] (SPARK-5784) Add StatsDSink to MetricsSystem

[jira] [Issue Comment Deleted] (SPARK-5784) Add StatsDSink to MetricsSystem

[jira] [Commented] (SPARK-5784) Add StatsDSink to MetricsSystem

[jira] [Commented] (SPARK-5784) Add StatsDSink to MetricsSystem

5 matches

Site Navigation

Mail list logo

Footer information