Github user cenyuhai commented on the issue:
https://github.com/apache/spark/pull/15041
Ok, I close this PR
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/15041
Limiting 10 million records is really a corner case. A workaround is to
save your sorted query result into a new table and read the new table with your
large limit. I don't think this corner case
Github user cenyuhai commented on the issue:
https://github.com/apache/spark/pull/15041
Driver is ok, but executor is running out of memory, this method is called
by executor. Our maximum limit of memory is 15G.
---
If your project is set up for it, you can reply to this email and
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/15041
This takes a heavy sort-based path well before it would cause an OOM it
seems though. This is a simple Utils method and I'm not sure it should be
causing spills to disk. If the problem is that
Github user cenyuhai commented on the issue:
https://github.com/apache/spark/pull/15041
In terms of data security, we can't get all data. Every sql should limit 10
million records. But sometimes it will OOM... My demand is to avoid OOM.
@srowen Do you have any idea?
---
If your
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/15041
This is introducing a lot of complexity and I'm still not sure why we'd
want to _sort_ here. You do not in general want to sort something to get the
result here.
---
If your project is set up for
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/15041
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/15041
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65814/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/15041
**[Test build #65814 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65814/consoleFull)**
for PR 15041 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/15041
**[Test build #65814 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65814/consoleFull)**
for PR 15041 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/15041
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/15041
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65809/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/15041
**[Test build #65809 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65809/consoleFull)**
for PR 15041 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/15041
**[Test build #65809 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65809/consoleFull)**
for PR 15041 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/15041
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65782/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/15041
**[Test build #65782 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65782/consoleFull)**
for PR 15041 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/15041
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/15041
**[Test build #65782 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65782/consoleFull)**
for PR 15041 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/15041
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65781/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/15041
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/15041
**[Test build #65781 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65781/consoleFull)**
for PR 15041 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/15041
**[Test build #65781 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65781/consoleFull)**
for PR 15041 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/15041
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/15041
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65780/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/15041
**[Test build #65780 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65780/consoleFull)**
for PR 15041 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/15041
**[Test build #65780 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65780/consoleFull)**
for PR 15041 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/15041
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/15041
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65773/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/15041
**[Test build #65773 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65773/consoleFull)**
for PR 15041 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/15041
**[Test build #65773 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65773/consoleFull)**
for PR 15041 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/15041
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65772/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/15041
**[Test build #65772 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65772/consoleFull)**
for PR 15041 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/15041
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/15041
**[Test build #65772 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65772/consoleFull)**
for PR 15041 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/15041
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65771/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/15041
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/15041
**[Test build #65771 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65771/consoleFull)**
for PR 15041 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/15041
**[Test build #65771 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65771/consoleFull)**
for PR 15041 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/15041
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/15041
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65759/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/15041
**[Test build #65759 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65759/consoleFull)**
for PR 15041 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/15041
**[Test build #65759 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65759/consoleFull)**
for PR 15041 at commit
Github user viirya commented on the issue:
https://github.com/apache/spark/pull/15041
cc @cloud-fan @hvanhovell
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/15041
**[Test build #3271 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3271/consoleFull)**
for PR 15041 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/15041
**[Test build #3271 has
started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3271/consoleFull)**
for PR 15041 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/15041
**[Test build #65438 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65438/consoleFull)**
for PR 15041 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/15041
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/15041
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65438/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/15041
**[Test build #65438 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65438/consoleFull)**
for PR 15041 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/15041
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65202/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/15041
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/15041
**[Test build #65202 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65202/consoleFull)**
for PR 15041 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/15041
**[Test build #65202 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65202/consoleFull)**
for PR 15041 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/15041
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/15041
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65197/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/15041
**[Test build #65197 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65197/consoleFull)**
for PR 15041 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/15041
**[Test build #65197 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65197/consoleFull)**
for PR 15041 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/15041
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/15041
**[Test build #65194 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65194/consoleFull)**
for PR 15041 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/15041
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65194/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/15041
**[Test build #65194 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65194/consoleFull)**
for PR 15041 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/15041
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/15041
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65193/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/15041
**[Test build #65193 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65193/consoleFull)**
for PR 15041 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/15041
**[Test build #65193 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65193/consoleFull)**
for PR 15041 at commit
65 matches
Mail list logo