[GitHub] spark pull request: [SPARK-9882][Core] Priority-based scheduling f...

2016-04-10 Thread viirya
Github user viirya commented on the pull request: https://github.com/apache/spark/pull/8129#issuecomment-207946763 I've just rebase this branch with master branch. So it should be built and use. --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark pull request: [SPARK-9882][Core] Priority-based scheduling f...

2016-04-10 Thread viirya
Github user viirya commented on the pull request: https://github.com/apache/spark/pull/8129#issuecomment-207943102 @fathersson this branch is what we implement for preemptive scheduling for standalone mode. I have deployed it on production Spark cluster in my previous company. But as

[GitHub] spark pull request: [SPARK-9882][Core] Priority-based scheduling f...

2016-03-02 Thread fathersson
Github user fathersson commented on the pull request: https://github.com/apache/spark/pull/8129#issuecomment-191537656 I'd be interested in having preemptive scheduler for standalone deployment. I'd really appreciate it if you could share your code if it's been implemented. ---

[GitHub] spark pull request: [SPARK-9882][Core] Priority-based scheduling f...

2015-10-07 Thread viirya
Github user viirya commented on the pull request: https://github.com/apache/spark/pull/8129#issuecomment-146283094 Because there seems be no interesting to this patch, I would close this PR first. --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark pull request: [SPARK-9882][Core] Priority-based scheduling f...

2015-10-07 Thread viirya
Github user viirya closed the pull request at: https://github.com/apache/spark/pull/8129 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-9882][Core] Priority-based scheduling f...

2015-08-28 Thread thegiive
Github user thegiive commented on the pull request: https://github.com/apache/spark/pull/8129#issuecomment-135786660 hi @JoshRosen , @andrewor14 , @srowen Viirya and I are in the same team. Currently Spark standalone has only one FIFO scheduler outside the application and

[GitHub] spark pull request: [SPARK-9882][Core] Priority-based scheduling f...

2015-08-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8129#issuecomment-130551156 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-9882][Core] Priority-based scheduling f...

2015-08-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8129#issuecomment-130551177 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-9882][Core] Priority-based scheduling f...

2015-08-13 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8129#issuecomment-130551460 [Test build #40745 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/40745/consoleFull) for PR 8129 at commit

[GitHub] spark pull request: [SPARK-9882][Core] Priority-based scheduling f...

2015-08-13 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8129#issuecomment-130551698 [Test build #40745 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/40745/console) for PR 8129 at commit

[GitHub] spark pull request: [SPARK-9882][Core] Priority-based scheduling f...

2015-08-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8129#issuecomment-130551699 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-9882][Core] Priority-based scheduling f...

2015-08-13 Thread viirya
Github user viirya commented on the pull request: https://github.com/apache/spark/pull/8129#issuecomment-130550969 retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-9882][Core] Priority-based scheduling f...

2015-08-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8129#issuecomment-130553847 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-9882][Core] Priority-based scheduling f...

2015-08-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8129#issuecomment-130553715 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-9882][Core] Priority-based scheduling f...

2015-08-13 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8129#issuecomment-130555864 [Test build #40746 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/40746/consoleFull) for PR 8129 at commit

[GitHub] spark pull request: [SPARK-9882][Core] Priority-based scheduling f...

2015-08-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8129#issuecomment-130605258 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-9882][Core] Priority-based scheduling f...

2015-08-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8129#issuecomment-130605274 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-9882][Core] Priority-based scheduling f...

2015-08-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8129#issuecomment-130591634 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-9882][Core] Priority-based scheduling f...

2015-08-13 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8129#issuecomment-130591580 **[Test build #40746 timed out](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/40746/console)** for PR 8129 at commit

[GitHub] spark pull request: [SPARK-9882][Core] Priority-based scheduling f...

2015-08-13 Thread viirya
Github user viirya commented on the pull request: https://github.com/apache/spark/pull/8129#issuecomment-130605212 retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-9882][Core] Priority-based scheduling f...

2015-08-13 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8129#issuecomment-130605632 [Test build #40757 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/40757/consoleFull) for PR 8129 at commit

[GitHub] spark pull request: [SPARK-9882][Core] Priority-based scheduling f...

2015-08-13 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8129#issuecomment-130549724 [Test build #40722 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/40722/console) for PR 8129 at commit

[GitHub] spark pull request: [SPARK-9882][Core] Priority-based scheduling f...

2015-08-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8129#issuecomment-130549775 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-9882][Core] Priority-based scheduling f...

2015-08-13 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8129#issuecomment-130663858 [Test build #40757 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/40757/console) for PR 8129 at commit

[GitHub] spark pull request: [SPARK-9882][Core] Priority-based scheduling f...

2015-08-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8129#issuecomment-130663980 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-9882][Core] Priority-based scheduling f...

2015-08-13 Thread viirya
Github user viirya commented on the pull request: https://github.com/apache/spark/pull/8129#issuecomment-130961086 /cc @JoshRosen @andrewor14 @srowen Would you have time to look at this? Thanks. --- If your project is set up for it, you can reply to this email and have your

[GitHub] spark pull request: [SPARK-9882][Core] Priority-based scheduling f...

2015-08-12 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8129#issuecomment-130473133 [Test build #40686 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/40686/console) for PR 8129 at commit

[GitHub] spark pull request: [SPARK-9882][Core] Priority-based scheduling f...

2015-08-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8129#issuecomment-130473135 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-9882][Core] Priority-based scheduling f...

2015-08-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8129#issuecomment-130485842 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-9882][Core] Priority-based scheduling f...

2015-08-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8129#issuecomment-130485829 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-9882][Core] Priority-based scheduling f...

2015-08-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8129#issuecomment-130471986 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-9882][Core] Priority-based scheduling f...

2015-08-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8129#issuecomment-130471965 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-9882][Core] Priority-based scheduling f...

2015-08-12 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8129#issuecomment-130472818 [Test build #40686 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/40686/consoleFull) for PR 8129 at commit

[GitHub] spark pull request: [SPARK-9882][Core] Priority-based scheduling f...

2015-08-12 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8129#issuecomment-130486485 [Test build #40696 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/40696/consoleFull) for PR 8129 at commit

[GitHub] spark pull request: [SPARK-9882][Core] Priority-based scheduling f...

2015-08-12 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8129#issuecomment-130513636 **[Test build #40696 timed out](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/40696/console)** for PR 8129 at commit

[GitHub] spark pull request: [SPARK-9882][Core] Priority-based scheduling f...

2015-08-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8129#issuecomment-130515792 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-9882][Core] Priority-based scheduling f...

2015-08-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8129#issuecomment-130515801 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-9882][Core] Priority-based scheduling f...

2015-08-12 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8129#issuecomment-130517227 [Test build #40722 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/40722/consoleFull) for PR 8129 at commit

[GitHub] spark pull request: [SPARK-9882][Core] Priority-based scheduling f...

2015-08-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8129#issuecomment-130535563 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-9882][Core] Priority-based scheduling f...

2015-08-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8129#issuecomment-130513785 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-9882][Core] Priority-based scheduling f...

2015-08-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8129#issuecomment-130535577 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-9882][Core] Priority-based scheduling f...

2015-08-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8129#issuecomment-130536464 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-9882][Core] Priority-based scheduling f...

2015-08-12 Thread viirya
GitHub user viirya opened a pull request: https://github.com/apache/spark/pull/8129 [SPARK-9882][Core] Priority-based scheduling for Spark applications JIRA: https://issues.apache.org/jira/browse/SPARK-9882 This is a priority-based scheduling based on the interface proposed

[GitHub] spark pull request: [SPARK-9882][Core] Priority-based scheduling f...

2015-08-12 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8129#issuecomment-130364043 [Test build #40639 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/40639/console) for PR 8129 at commit

[GitHub] spark pull request: [SPARK-9882][Core] Priority-based scheduling f...

2015-08-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8129#issuecomment-130356031 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-9882][Core] Priority-based scheduling f...

2015-08-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8129#issuecomment-130355993 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-9882][Core] Priority-based scheduling f...

2015-08-12 Thread viirya
Github user viirya commented on the pull request: https://github.com/apache/spark/pull/8129#issuecomment-130362157 retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-9882][Core] Priority-based scheduling f...

2015-08-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8129#issuecomment-130357213 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-9882][Core] Priority-based scheduling f...

2015-08-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8129#issuecomment-130362672 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-9882][Core] Priority-based scheduling f...

2015-08-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8129#issuecomment-130362651 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-9882][Core] Priority-based scheduling f...

2015-08-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8129#issuecomment-130364047 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-9882][Core] Priority-based scheduling f...

2015-08-12 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8129#issuecomment-130364014 [Test build #40639 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/40639/consoleFull) for PR 8129 at commit