Run "spark-submit --help" to see all available options. To get JMX to work you need to:
spark-submit --driver-java-options "-Dcom.sun.management.jmxremote -Dcom.sun.management.jmxremote.authenticate=false -Dcom.sun.management.jmxremote.ssl=false -Dcom.sun.management.jmxremote.port=JMX_PORT" --conf spark.metrics.conf=metrics.properties --class 'CLASS_NAME' --master yarn-cluster --files /PATH/TO/metrics.properties /PATH/TO/JAR.FILE This will run JMX on the driver node on or "JMX_PORT". Note that the driver node and the YARN master node are not the same, you'll have to look where spark put the driver node and then connect there. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/JMXSink-for-YARN-deployment-tp13958p25572.html Sent from the Apache Spark User List mailing list archive at Nabble.com. --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
