Re: spark.driver.maxResultSize doesn't work in conf-file

In spark-defaults you put the values like "spark.driver.maxResultSize 0" instead of "spark.driver.maxResultSize=0" I think. On Sat, Feb 20, 2016 at 3:40 PM, AlexModestov wrote: > I have a string spark.driver.maxResultSize=0 in the spark-defaults.conf. > But I get

spark.driver.maxResultSize doesn't work in conf-file

I have a string spark.driver.maxResultSize=0 in the spark-defaults.conf. But I get an error: "org.apache.spark.SparkException: Job aborted due to stage failure: Total size of serialized results of 18 tasks (1070.5 MB) is bigger than spark.driver.maxResultSize (1024.0 MB)" But if I write --conf