Re: Is it possible to set the akka specify properties (akka.extensions) in spark

[Akhil Das]

Try SparkConf.set(spark.akka.extensions,Whatever), underneath i think
spark won't ship properties which don't start with spark.* to the executors.

Thanks
Best Regards

On Mon, May 11, 2015 at 8:33 AM, Terry Hole hujie.ea...@gmail.com wrote:

 Hi all,

 I'd like to monitor the akka using kamon, which need to set the
 akka.extension to a list like this in typesafe config format:
   akka {
 extensions = [kamon.system.SystemMetrics, kamon.statsd.StatsD]
   }

 But i can not find a way to do this, i have tried these:
 1. SparkConf.set(akka.extensions, [kamon.system.SystemMetrics,
 kamon.statsd.StatsD])
 2. use application.conf and set it use java option
 -Dconfig.resource=/path/to/conf
 3. Set akka.extensions [kamon.system.SystemMetrics,
 kamon.statsd.StatsD] in spark conf file

 None of these work.

 Do we have others ways to set this?

 Thanks!

Re: Is it possible to set the akka specify properties (akka.extensions) in spark

[Terry Hole]

Hi, Akhil,

I tried this. It did not work. I also tried SparkConf.set(akka.
extensions,[\kamon.system.SystemMetrics\, \kamon.statsd.StatsD\]), it
also did not work.

Thanks

On Mon, May 11, 2015 at 2:56 PM, Akhil Das ak...@sigmoidanalytics.com
wrote:

 Try SparkConf.set(spark.akka.extensions,Whatever), underneath i think
 spark won't ship properties which don't start with spark.* to the executors.

 Thanks
 Best Regards

 On Mon, May 11, 2015 at 8:33 AM, Terry Hole hujie.ea...@gmail.com wrote:

 Hi all,

 I'd like to monitor the akka using kamon, which need to set the
 akka.extension to a list like this in typesafe config format:
   akka {
 extensions = [kamon.system.SystemMetrics, kamon.statsd.StatsD]
   }

 But i can not find a way to do this, i have tried these:
 1. SparkConf.set(akka.extensions, [kamon.system.SystemMetrics,
 kamon.statsd.StatsD])
 2. use application.conf and set it use java option
 -Dconfig.resource=/path/to/conf
 3. Set akka.extensions [kamon.system.SystemMetrics,
 kamon.statsd.StatsD] in spark conf file

 None of these work.

 Do we have others ways to set this?

 Thanks!

Is it possible to set the akka specify properties (akka.extensions) in spark

[Terry Hole]

Hi all,

I'd like to monitor the akka using kamon, which need to set the
akka.extension to a list like this in typesafe config format:
  akka {
extensions = [kamon.system.SystemMetrics, kamon.statsd.StatsD]
  }

But i can not find a way to do this, i have tried these:
1. SparkConf.set(akka.extensions, [kamon.system.SystemMetrics,
kamon.statsd.StatsD])
2. use application.conf and set it use java option
-Dconfig.resource=/path/to/conf
3. Set akka.extensions [kamon.system.SystemMetrics,
kamon.statsd.StatsD] in spark conf file

None of these work.

Do we have others ways to set this?

Thanks!

Is it possible to set the akka specify properties (akka.extensions) in spark

[Terry Hole]

Hi all,

I'd like to monitor the akka using kamon, which need to set the
akka.extension to a list like this in typesafe config format:

  akka {

extensions = [kamon.system.SystemMetrics, kamon.statsd.StatsD]

  }

But i can not find a way to do this, i have tried these:

1. SparkConf.set(akka.extensions, [kamon.system.SystemMetrics,
kamon.statsd.StatsD])

2. use application.conf and set it use java option
-Dconfig.resource=/path/to/conf

3. Set akka.extensions [kamon.system.SystemMetrics,
kamon.statsd.StatsD] in spark conf file

None of these two works.

Do we have others ways to set this?

Thanks!

Is it possible to set the akka specify properties (akka.extensions) in spark

[Terry Hole]

Hi all,

I'd like to monitor the akka using kamon, which need to set the
akka.extension to a list like this in typesafe config format:
  akka {
extensions = [kamon.system.SystemMetrics, kamon.statsd.StatsD]
  }

But i can not find a way to do this, i have tried these:
1. SparkConf.set(akka.extensions, [kamon.system.SystemMetrics,
kamon.statsd.StatsD])
2. use application.conf and set it use java option
-Dconfig.resource=/path/to/conf
3. Set akka.extensions [kamon.system.SystemMetrics,
kamon.statsd.StatsD] in spark conf file

None of these two works.

Do we have others ways to set this?

Thanks!