[GitHub] spark issue #18541: [SPARK-21315][SQL]Skip some spill files when generateIte...

2017-07-10 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/18541 thanks, merging to master! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #18541: [SPARK-21315][SQL]Skip some spill files when generateIte...

2017-07-10 Thread jinxing64
Github user jinxing64 commented on the issue: https://github.com/apache/spark/pull/18541 @jiangxb1987 Thanks for approving ! Already updated to PR description. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark issue #18541: [SPARK-21315][SQL]Skip some spill files when generateIte...

2017-07-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18541 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79453/ Test PASSed. ---

[GitHub] spark issue #18541: [SPARK-21315][SQL]Skip some spill files when generateIte...

2017-07-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18541 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18541: [SPARK-21315][SQL]Skip some spill files when generateIte...

2017-07-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18541 **[Test build #79453 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79453/testReport)** for PR 18541 at commit

[GitHub] spark issue #18541: [SPARK-21315][SQL]Skip some spill files when generateIte...

2017-07-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18541 **[Test build #79453 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79453/testReport)** for PR 18541 at commit

[GitHub] spark issue #18541: [SPARK-21315][SQL]Skip some spill files when generateIte...

2017-07-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18541 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79437/ Test FAILed. ---

[GitHub] spark issue #18541: [SPARK-21315][SQL]Skip some spill files when generateIte...

2017-07-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18541 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79444/ Test FAILed. ---

[GitHub] spark issue #18541: [SPARK-21315][SQL]Skip some spill files when generateIte...

2017-07-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18541 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18541: [SPARK-21315][SQL]Skip some spill files when generateIte...

2017-07-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18541 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18541: [SPARK-21315][SQL]Skip some spill files when generateIte...

2017-07-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18541 **[Test build #79444 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79444/testReport)** for PR 18541 at commit

[GitHub] spark issue #18541: [SPARK-21315][SQL]Skip some spill files when generateIte...

2017-07-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18541 **[Test build #79437 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79437/testReport)** for PR 18541 at commit

[GitHub] spark issue #18541: [SPARK-21315][SQL]Skip some spill files when generateIte...

2017-07-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18541 **[Test build #79444 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79444/testReport)** for PR 18541 at commit

[GitHub] spark issue #18541: [SPARK-21315][SQL]Skip some spill files when generateIte...

2017-07-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18541 **[Test build #79437 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79437/testReport)** for PR 18541 at commit

[GitHub] spark issue #18541: [SPARK-21315][SQL]Skip some spill files when generateIte...

2017-07-09 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/18541 LGTM except some minor comments, good catch! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #18541: [SPARK-21315][SQL]Skip some spill files when generateIte...

2017-07-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18541 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18541: [SPARK-21315][SQL]Skip some spill files when generateIte...

2017-07-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18541 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79411/ Test PASSed. ---

[GitHub] spark issue #18541: [SPARK-21315][SQL]Skip some spill files when generateIte...

2017-07-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18541 **[Test build #79411 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79411/testReport)** for PR 18541 at commit

[GitHub] spark issue #18541: [SPARK-21315][SQL]Skip some spill files when generateIte...

2017-07-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18541 **[Test build #79411 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79411/testReport)** for PR 18541 at commit

[GitHub] spark issue #18541: [SPARK-21315][SQL]Skip some spill files when generateIte...

2017-07-09 Thread jinxing64
Github user jinxing64 commented on the issue: https://github.com/apache/spark/pull/18541 @cloud-fan Would you mind take a look when you have time :) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark issue #18541: [SPARK-21315][SQL]Skip some spill files when generateIte...

2017-07-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18541 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18541: [SPARK-21315][SQL]Skip some spill files when generateIte...

2017-07-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18541 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79282/ Test PASSed. ---

[GitHub] spark issue #18541: [SPARK-21315][SQL]Skip some spill files when generateIte...

2017-07-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18541 **[Test build #79282 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79282/testReport)** for PR 18541 at commit

[GitHub] spark issue #18541: [SPARK-21315][SQL]Skip some spill files when generateIte...

2017-07-06 Thread jinxing64
Github user jinxing64 commented on the issue: https://github.com/apache/spark/pull/18541 @hvanhovell I refined according to your comments. Please take another look when you have time :) --- If your project is set up for it, you can reply to this email and have your reply appear

[GitHub] spark issue #18541: [SPARK-21315][SQL]Skip some spill files when generateIte...

2017-07-06 Thread jinxing64
Github user jinxing64 commented on the issue: https://github.com/apache/spark/pull/18541 Did a small test: 2000200 rows in the `UnsafeExternalSorter`: 2 spill files(each contains 100 rows) and `inMemSorter` contains 200 rows. I want to target the iterator to index=201.

[GitHub] spark issue #18541: [SPARK-21315][SQL]Skip some spill files when generateIte...

2017-07-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18541 **[Test build #79282 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79282/testReport)** for PR 18541 at commit

[GitHub] spark issue #18541: [SPARK-21315][SQL]Skip some spill files when generateIte...

2017-07-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18541 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18541: [SPARK-21315][SQL]Skip some spill files when generateIte...

2017-07-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18541 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79216/ Test PASSed. ---

[GitHub] spark issue #18541: [SPARK-21315][SQL]Skip some spill files when generateIte...

2017-07-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18541 **[Test build #79216 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79216/testReport)** for PR 18541 at commit

[GitHub] spark issue #18541: [SPARK-21315][SQL]Skip some spill files when generateIte...

2017-07-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18541 **[Test build #79216 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79216/testReport)** for PR 18541 at commit

[GitHub] spark issue #18541: [SPARK-21315][SQL]Skip some spill files when generateIte...

2017-07-05 Thread hvanhovell
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/18541 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #18541: [SPARK-21315][SQL]Skip some spill files when generateIte...

2017-07-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18541 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79213/ Test FAILed. ---

[GitHub] spark issue #18541: [SPARK-21315][SQL]Skip some spill files when generateIte...

2017-07-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18541 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18541: [SPARK-21315][SQL]Skip some spill files when generateIte...

2017-07-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18541 **[Test build #79213 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79213/testReport)** for PR 18541 at commit

[GitHub] spark issue #18541: [SPARK-21315][SQL]Skip some spill files when generateIte...

2017-07-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18541 **[Test build #79213 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79213/testReport)** for PR 18541 at commit