Re: Is it possible to set the akka specify properties (akka.extensions) in spark

2015-05-11 Thread Terry Hole
Hi, Akhil,

I tried this. It did not work. I also tried SparkConf.set("akka.
extensions","[\"kamon.system.SystemMetrics\", \"kamon.statsd.StatsD\"]"), it
also did not work.

Thanks

On Mon, May 11, 2015 at 2:56 PM, Akhil Das 
wrote:

> Try SparkConf.set("spark.akka.extensions","Whatever"), underneath i think
> spark won't ship properties which don't start with spark.* to the executors.
>
> Thanks
> Best Regards
>
> On Mon, May 11, 2015 at 8:33 AM, Terry Hole  wrote:
>
>> Hi all,
>>
>> I'd like to monitor the akka using kamon, which need to set the
>> akka.extension to a list like this in typesafe config format:
>>   akka {
>> extensions = ["kamon.system.SystemMetrics", "kamon.statsd.StatsD"]
>>   }
>>
>> But i can not find a way to do this, i have tried these:
>> 1. SparkConf.set("akka.extensions", """["kamon.system.SystemMetrics",
>> "kamon.statsd.StatsD"]""")
>> 2. use application.conf and set it use java option
>> "-Dconfig.resource=/path/to/conf"
>> 3. Set "akka.extensions ["kamon.system.SystemMetrics",
>> "kamon.statsd.StatsD"]" in spark conf file
>>
>> None of these work.
>>
>> Do we have others ways to set this?
>>
>> Thanks!
>>
>
>


Re: Is it possible to set the akka specify properties (akka.extensions) in spark

2015-05-10 Thread Akhil Das
Try SparkConf.set("spark.akka.extensions","Whatever"), underneath i think
spark won't ship properties which don't start with spark.* to the executors.

Thanks
Best Regards

On Mon, May 11, 2015 at 8:33 AM, Terry Hole  wrote:

> Hi all,
>
> I'd like to monitor the akka using kamon, which need to set the
> akka.extension to a list like this in typesafe config format:
>   akka {
> extensions = ["kamon.system.SystemMetrics", "kamon.statsd.StatsD"]
>   }
>
> But i can not find a way to do this, i have tried these:
> 1. SparkConf.set("akka.extensions", """["kamon.system.SystemMetrics",
> "kamon.statsd.StatsD"]""")
> 2. use application.conf and set it use java option
> "-Dconfig.resource=/path/to/conf"
> 3. Set "akka.extensions ["kamon.system.SystemMetrics",
> "kamon.statsd.StatsD"]" in spark conf file
>
> None of these work.
>
> Do we have others ways to set this?
>
> Thanks!
>