Hi Peng, Setting properties through --conf should still work in Spark 1.4. From the warning it looks like the config you are trying to set does not start with the prefix "spark.". What is the config that you are trying to set?
-Andrew 2015-06-12 11:17 GMT-07:00 Peng Cheng <[email protected]>: > In Spark <1.3.x, the system property of the driver can be set by --conf > option, shared between setting spark properties and system properties. > > In Spark 1.4.0 this feature is removed, the driver instead log the > following > warning: > > Warning: Ignoring non-spark config property: xxx.xxx=vvvvv > > How do set driver's system property in 1.4.0? Is there a reason it is > removed without a deprecation warning? > > Thanks a lot for your advices. > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Spark-1-4-0-How-to-set-driver-s-system-property-using-spark-submit-options-tp23298.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. > > --------------------------------------------------------------------- > To unsubscribe, e-mail: [email protected] > For additional commands, e-mail: [email protected] > >
