skonto opened a new pull request #23599: [Spark][K8s] Enhance spark-submit for app management URL: https://github.com/apache/spark/pull/23599 ## What changes were proposed in this pull request? - supports `--kill` & `--status` flags. - supports globs which is useful in general check this long standing [issue](https://github.com/kubernetes/kubernetes/issues/17144#issuecomment-272052461) for kubectl. ## How was this patch tested? Manually against running apps. Example output: > ./bin/spark-submit --status spark:spark-pi* --master k8s://https://192.168.2.8:8443 > 2019-01-20 22:27:44 WARN Utils:70 - Your hostname, universe resolves to a loopback address: 127.0.0.1; using 192.168.2.8 instead (on interface wlp2s0) > 2019-01-20 22:27:44 WARN Utils:70 - Set SPARK_LOCAL_IP if you need to bind to another address > Application status (driver): > pod name: spark-pi-1547948600328-driver > namespace: spark > labels: spark-app-selector -> spark-f13f01702f0b4503975ce98252d59b94, spark-role -> driver > pod uid: c576e1c6-1c54-11e9-8215-a434d9270a65 > creation time: 2019-01-20T01:43:22Z > service account name: spark-sa > volumes: spark-local-dir-1, spark-conf-volume, spark-sa-token-b7wcm > node name: minikube > start time: 2019-01-20T01:43:22Z > phase: Running > container status: > container name: spark-kubernetes-driver > container image: skonto/spark:k8s-3.0.0 > container state: running > container started at: 2019-01-20T01:43:27Z > Application status (driver): > pod name: spark-pi-1547948792539-driver > namespace: spark > labels: spark-app-selector -> spark-006d252db9b24f25b5069df357c30264, spark-role -> driver > pod uid: 38375b4b-1c55-11e9-8215-a434d9270a65 > creation time: 2019-01-20T01:46:35Z > service account name: spark-sa > volumes: spark-local-dir-1, spark-conf-volume, spark-sa-token-b7wcm > node name: minikube > start time: 2019-01-20T01:46:35Z > phase: Succeeded > container status: > container name: spark-kubernetes-driver > container image: skonto/spark:k8s-3.0.0 > container state: terminated > container started at: 2019-01-20T01:46:39Z > container finished at: 2019-01-20T01:46:56Z > exit code: 0 > termination reason: Completed >
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
