[GitHub] spark issue #19354: [SPARK-20992][Scheduler] Add links in documentation to N...

2017-10-16 Thread barnardb
Github user barnardb commented on the issue: https://github.com/apache/spark/pull/19354 I've updated the PR to leave the Kubernetes links as they are, and just to add a link to the Nomad integration project with wording indicating that it's not supported by the Spark project

[GitHub] spark issue #19354: [SPARK-20992][Scheduler] Add links in documentation to N...

2017-10-13 Thread barnardb
Github user barnardb commented on the issue: https://github.com/apache/spark/pull/19354 I totally understand the reluctance to have non-ASF projects in a list headed by "The system currently supports…". Looking at the [Powered By](https://spark.apache.org/powered-by.

[GitHub] spark pull request #18209: [SPARK-20992][Scheduler] Add support for Nomad as...

2017-09-26 Thread barnardb
Github user barnardb closed the pull request at: https://github.com/apache/spark/pull/18209 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request #19354: [SPARK-20992][Scheduler] Add links in documentati...

2017-09-26 Thread barnardb
GitHub user barnardb opened a pull request: https://github.com/apache/spark/pull/19354 [SPARK-20992][Scheduler] Add links in documentation to Nomad integration. ## What changes were proposed in this pull request? Adds links to the fork that provides integration with Nomad

[GitHub] spark pull request #18209: [SPARK-20992][Scheduler] Add support for Nomad as...

2017-06-05 Thread barnardb
GitHub user barnardb opened a pull request: https://github.com/apache/spark/pull/18209 [SPARK-20992][Scheduler] Add support for Nomad as a scheduler backend ## What changes were proposed in this pull request? Adds support for [Nomad](https://github.com/hashicorp/nomad

[GitHub] spark issue #17551: [SPARK-20242][Web UI] Add spark.ui.stopDelay

2017-04-06 Thread barnardb
Github user barnardb commented on the issue: https://github.com/apache/spark/pull/17551 > It's still running your code, right? Why can't you add a configuration to your own code that tells it to wait some time before shutting down the SparkContext? We're trying to supp

[GitHub] spark issue #17551: [SPARK-20242][Web UI] Add spark.ui.stopDelay

2017-04-06 Thread barnardb
Github user barnardb commented on the issue: https://github.com/apache/spark/pull/17551 Our use case involves jobs running in a remote cluster without a Spark master. I agree that the history server is the better to solve this, but we'd like to get a solution that doesn't depend

[GitHub] spark pull request #17551: [SPARK-20242][Web UI] Add spark.ui.stopDelay

2017-04-06 Thread barnardb
GitHub user barnardb opened a pull request: https://github.com/apache/spark/pull/17551 [SPARK-20242][Web UI] Add spark.ui.stopDelay ## What changes were proposed in this pull request? Adds a spark.ui.stopDelay configuration property that can be used to keep the UI running