Github user viirya commented on a diff in the pull request:
https://github.com/apache/spark/pull/16061#discussion_r90168566
--- Diff: kubernetes/README.md ---
@@ -0,0 +1,21 @@
+# Pre-requisites
+* maven, JDK and all other pre-requisites for building Spark.
+
+# Steps to compile
+
+* Clone the fork of spark: https://github.com/foxish/spark/ and switch to
the k8s-support branch.
+* Build the project
+ * ./build/mvn -Pkubernetes -Phadoop-2.4 -Dhadoop.version=2.4.0
-DskipTests package
+* Ensure that you are pointing to a k8s cluster (kubectl config
current-context), which you want to use with spark.
+* Launch a spark-submit job:
+ * `./bin/spark-submit --deploy-mode cluster --class
org.apache.spark.examples.SparkPi --master k8s://default --conf
spark.executor.instances=5 --conf
spark.kubernetes.sparkImage=manyangled/kube-spark:dynamic
http://storage.googleapis.com/foxish-spark-distro/original-spark-examples_2.11-2.1.0-SNAPSHOT.jar
10000`
--- End diff --
Do we need to prepare an official image for this?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
