Re: Setting network variables in spark-shell

Don't set `spark.akka.frameSize` to 1. The max value of `spark.akka.frameSize` is 2047. The unit is MB. Best Regards, Shixiong Zhu 2014-12-01 0:51 GMT+08:00 Yanbo : > > Try to use spark-shell --conf spark.akka.frameSize=1 > > 在 2014年12月1日，上午12:25，Brian Dolan 写道： > > Howdy Folks, > > Wha

Re: Setting network variables in spark-shell

Try to use spark-shell --conf spark.akka.frameSize=1 > 在 2014年12月1日，上午12:25，Brian Dolan 写道： > > Howdy Folks, > > What is the correct syntax in 1.0.0 to set networking variables in spark > shell? Specifically, I'd like to set the spark.akka.frameSize > > I'm attempting this: > spark-shel

Re: Setting network variables in spark-shell

Spark configuration settings can be found here Hope it helps :) On Sun, Nov 30, 2014 at 9:55 PM, Brian Dolan wrote: > Howdy Folks, > > What is the correct syntax in 1.0.0 to set networking variables in spark > shell? Specifically, I'd li

Setting network variables in spark-shell

Howdy Folks, What is the correct syntax in 1.0.0 to set networking variables in spark shell? Specifically, I'd like to set the spark.akka.frameSize I'm attempting this: spark-shell -Dspark.akka.frameSize=1 --executor-memory 4g Only to get this within the session: System.getProperty("spark