When I run my code in Eclipse with the following parameters, VM Args: -Xmx4g OS: Windows Time: 4.4 minutes
It is faster than submitting to a cluster with these parameters: SPARK_EXECUTOR_MEMORY=4G OS: Ubuntu Time: 5.2 minutes They are equivalent options are they not? Both environments run on the same CPU/SSD (dual boot Windows/Ubuntu). Thanks, Justin -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Why-is-a-Spark-job-faster-through-Eclipse-than-Standalone-Cluster-tp22305.html Sent from the Apache Spark User List mailing list archive at Nabble.com. --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
