Github user dongjoon-hyun commented on a diff in the pull request:
https://github.com/apache/spark/pull/19061#discussion_r142571432
--- Diff: core/src/main/scala/org/apache/spark/deploy/SparkSubmit.scala ---
@@ -598,6 +598,15 @@ object SparkSubmit extends CommandLineUtils with
Logging {
}
}
+ // In case of shells, spark.ui.showConsoleProgress can be true by
default or by user.
+ if (isShell(args.primaryResource)) {
+ if (!sparkConf.contains("spark.ui.showConsoleProgress")) {
--- End diff --
Thanks! Then, I'll create a `deploy/config.scala` and put it there. The
followings are the existing `config.scala` files, but it seems to be irrelevant
to `deploy/SparkSubmit.scala`.
```
$ find . -name config.scala
./core/src/main/scala/org/apache/spark/deploy/history/config.scala
./resource-managers/mesos/src/main/scala/org/apache/spark/deploy/mesos/config.scala
./resource-managers/yarn/src/main/scala/org/apache/spark/deploy/yarn/config.scala
```
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
