[GitHub] spark issue #15848: [SPARK-9487] Use the same num. worker threads in Java/Sc...

2017-01-17 Thread skanjila
Github user skanjila commented on the issue: https://github.com/apache/spark/pull/15848 Yes by all means --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #15848: [SPARK-9487] Use the same num. worker threads in Java/Sc...

2017-01-17 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/15848 @skanjila Could we close this for now? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15848: [SPARK-9487] Use the same num. worker threads in Java/Sc...

2017-01-01 Thread skanjila
Github user skanjila commented on the issue: https://github.com/apache/spark/pull/15848 HyukjinKwon I've been out of the country the last 2 weeks, that's why you don't see updates, I plan to resume work on this next week by making unit tests in the sql module more reliable, once

[GitHub] spark issue #15848: [SPARK-9487] Use the same num. worker threads in Java/Sc...

2017-01-01 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/15848 @skanjila We would be able to close this if there are no updates for now. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #15848: [SPARK-9487] Use the same num. worker threads in Java/Sc...

2016-11-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15848 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15848: [SPARK-9487] Use the same num. worker threads in Java/Sc...

2016-11-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15848 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69297/ Test FAILed. ---

[GitHub] spark issue #15848: [SPARK-9487] Use the same num. worker threads in Java/Sc...

2016-11-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15848 **[Test build #69297 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69297/consoleFull)** for PR 15848 at commit

[GitHub] spark issue #15848: [SPARK-9487] Use the same num. worker threads in Java/Sc...

2016-11-28 Thread skanjila
Github user skanjila commented on the issue: https://github.com/apache/spark/pull/15848 I've changed the underlying trait for LogisticRegressionSuite and OneVsRestSuite to use local[2], will add in python changes next , want to get this PR across with this set of changes --- If

[GitHub] spark issue #15848: [SPARK-9487] Use the same num. worker threads in Java/Sc...

2016-11-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15848 **[Test build #69297 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69297/consoleFull)** for PR 15848 at commit

[GitHub] spark issue #15848: [SPARK-9487] Use the same num. worker threads in Java/Sc...

2016-11-27 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/15848 I saw several PRs time to time to run automatic Jenkins tests. So, I _think_ it is fine to keep this open and push some commits/run some tests to detect the failure tests if you are proceeding

[GitHub] spark issue #15848: [SPARK-9487] Use the same num. worker threads in Java/Sc...

2016-11-27 Thread skanjila
Github user skanjila commented on the issue: https://github.com/apache/spark/pull/15848 Sorry I meant Pyspark failures from unit tests , pardon my typos --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark issue #15848: [SPARK-9487] Use the same num. worker threads in Java/Sc...

2016-11-27 Thread skanjila
Github user skanjila commented on the issue: https://github.com/apache/spark/pull/15848 @HyujkinKwon I saw at least 3 to 4 failures in unit tests that happened in Jenkins but not locally (meaning the test succeeded locally). I completely agree with you about not marking something

[GitHub] spark issue #15848: [SPARK-9487] Use the same num. worker threads in Java/Sc...

2016-11-27 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/15848 In my personal opinion, I think we should fix here together. Maybe we could - Run the tests with `--fail-never` flag in the maven in order to list up the failed tests. If they are few

[GitHub] spark issue #15848: [SPARK-9487] Use the same num. worker threads in Java/Sc...

2016-11-27 Thread skanjila
Github user skanjila commented on the issue: https://github.com/apache/spark/pull/15848 The plan is to comment out the tests causing Jenkins failures for now, fix the Python unit tests to work with local[4] and then come back and fix these other Jenkins failures, make sense? ---

[GitHub] spark issue #15848: [SPARK-9487] Use the same num. worker threads in Java/Sc...

2016-11-27 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/15848 This is actually what I was worried of initially. So, you mean you are going to fix the failure tests here in this PR at the end? --- If your project is set up for it, you can reply to this

[GitHub] spark issue #15848: [SPARK-9487] Use the same num. worker threads in Java/Sc...

2016-11-27 Thread skanjila
Github user skanjila commented on the issue: https://github.com/apache/spark/pull/15848 Yes the plan is to comment out the failures for now but keep the rest of the changes, fix the Python unit tests with local[4] and then come back and fix the rest of the failures, let me know if

[GitHub] spark issue #15848: [SPARK-9487] Use the same num. worker threads in Java/Sc...

2016-11-27 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/15848 @skanjila are you proceeding with this? if not can you close it for now? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #15848: [SPARK-9487] Use the same num. worker threads in Java/Sc...

2016-11-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15848 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68897/ Test FAILed. ---

[GitHub] spark issue #15848: [SPARK-9487] Use the same num. worker threads in Java/Sc...

2016-11-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15848 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15848: [SPARK-9487] Use the same num. worker threads in Java/Sc...

2016-11-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15848 **[Test build #68897 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68897/consoleFull)** for PR 15848 at commit

[GitHub] spark issue #15848: [SPARK-9487] Use the same num. worker threads in Java/Sc...

2016-11-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15848 **[Test build #68897 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68897/consoleFull)** for PR 15848 at commit

[GitHub] spark issue #15848: [SPARK-9487] Use the same num. worker threads in Java/Sc...

2016-11-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15848 **[Test build #3422 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3422/consoleFull)** for PR 15848 at commit

[GitHub] spark issue #15848: [SPARK-9487] Use the same num. worker threads in Java/Sc...

2016-11-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15848 **[Test build #3422 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3422/consoleFull)** for PR 15848 at commit

[GitHub] spark issue #15848: [SPARK-9487] Use the same num. worker threads in Java/Sc...

2016-11-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15848 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15848: [SPARK-9487] Use the same num. worker threads in Java/Sc...

2016-11-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15848 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68531/ Test FAILed. ---

[GitHub] spark issue #15848: [SPARK-9487] Use the same num. worker threads in Java/Sc...

2016-11-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15848 **[Test build #68531 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68531/consoleFull)** for PR 15848 at commit

[GitHub] spark issue #15848: [SPARK-9487] Use the same num. worker threads in Java/Sc...

2016-11-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15848 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68529/ Test FAILed. ---

[GitHub] spark issue #15848: [SPARK-9487] Use the same num. worker threads in Java/Sc...

2016-11-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15848 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15848: [SPARK-9487] Use the same num. worker threads in Java/Sc...

2016-11-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15848 **[Test build #68529 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68529/consoleFull)** for PR 15848 at commit

[GitHub] spark issue #15848: [SPARK-9487] Use the same num. worker threads in Java/Sc...

2016-11-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15848 **[Test build #68531 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68531/consoleFull)** for PR 15848 at commit