Github user j143 commented on the issue:
https://github.com/apache/spark/pull/14995
Hi @witgo, Did you test this PR in production environment. If yes, can you
share the results on this
[jira](https://issues.apache.org/jira/browse/SPARK-6235). If you have problems
with downloading
Github user lklong commented on the issue:
https://github.com/apache/spark/pull/14995
@witgo i am very sorry to ask you give me a zip to my email ,because i try
to get this branch more than 10 times ,but i can not download this branch ,my
email is 380312...@qq.com,please help me
Github user lklong commented on the issue:
https://github.com/apache/spark/pull/14995
@witgo thank you very much ,my product of next generation will use
spark-2.1,now i use spark-1.6,i am often meet 2g error ,i am very glad to see
you code! thanks! i just use spark-ml in my
Github user witgo commented on the issue:
https://github.com/apache/spark/pull/14995
I did not do much testing, but I think it can be used in the production
environment
the url:
https://github.com/witgo/spark/tree/SPARK-6235_Address_various_2G_limits
---
If your project is set
Github user lklong commented on the issue:
https://github.com/apache/spark/pull/14995
@witgo hi ,i want to know this patch can be used in preduct env?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does
Github user lklong commented on the issue:
https://github.com/apache/spark/pull/14995
hi@witgo ,i am glad to see this patch ,but i do not know how should i check
this patch,i need this very much, thank you for give me this patch url.please
and thanks!
---
If your project is set up
Github user witgo commented on the issue:
https://github.com/apache/spark/pull/14995
Thanks, I am glad to hear this, and I want to solve the issues of reading,
storing and transmitting data as much as possible.
---
If your project is set up for it, you can reply to this email and
Github user opme commented on the issue:
https://github.com/apache/spark/pull/14995
@witgo I have a Pyspark application that was failing in 3 different places
but is able to run without errors now. I'm glad for this patch as I am not
sure how I would have explained to my professors
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14995
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69116/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14995
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14995
**[Test build #69116 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69116/consoleFull)**
for PR 14995 at commit
Github user witgo commented on the issue:
https://github.com/apache/spark/pull/14995
This PR is Test only, it used to
1. verify code through CI
2. verify the effectiveness of the solution
includes two underlying API changes.
1. Replace ByteBuffer with
Github user opme commented on the issue:
https://github.com/apache/spark/pull/14995
I compiled this pull request into the main branch. I can confirm it fixes
the problem where I was performing joins between tables with 2 million and 300
million records + making counts and then
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/14995
This change is marked as not ready to merge, does not merge, hasn't been
reviewed, and isn't going to be reviewed as a huge 143-file, 4400 line change.
This has been discussed in many different ways
Github user witgo commented on the issue:
https://github.com/apache/spark/pull/14995
@srowen
This PR is a comprehensive solution. Used to solve address various 2G
limits, RPC memory footprint and other issues.
Users often encounter these problems. Why don't we need to solve
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/14995
@witgo if this is a stale WIP, would you mind closing it? as far as I know
it doesn't necessarily solve the problem in the JIRA and may be misleading to
those that think there is a solution
Github user opme commented on the issue:
https://github.com/apache/spark/pull/14995
What is the plan to incorporate this patch into a released version? I am
hitting this limit when doing simple joins of a table with 2 million records to
a table of 300 million records and performing
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14995
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68069/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14995
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14995
**[Test build #68069 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68069/consoleFull)**
for PR 14995 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14995
**[Test build #68069 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68069/consoleFull)**
for PR 14995 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14995
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67024/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14995
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14995
**[Test build #67024 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67024/consoleFull)**
for PR 14995 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14995
**[Test build #67024 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67024/consoleFull)**
for PR 14995 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14995
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14995
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66956/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14995
**[Test build #66956 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66956/consoleFull)**
for PR 14995 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14995
**[Test build #66956 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66956/consoleFull)**
for PR 14995 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14995
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66579/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14995
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14995
**[Test build #66579 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66579/consoleFull)**
for PR 14995 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14995
**[Test build #66579 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66579/consoleFull)**
for PR 14995 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14995
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14995
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66032/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14995
**[Test build #66032 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66032/consoleFull)**
for PR 14995 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14995
**[Test build #66032 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66032/consoleFull)**
for PR 14995 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14995
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14995
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65968/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14995
**[Test build #65968 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65968/consoleFull)**
for PR 14995 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14995
**[Test build #65968 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65968/consoleFull)**
for PR 14995 at commit
Github user witgo commented on the issue:
https://github.com/apache/spark/pull/14995
Jenkins, retest this please
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14995
**[Test build #65967 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65967/consoleFull)**
for PR 14995 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14995
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65967/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14995
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14995
**[Test build #65967 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65967/consoleFull)**
for PR 14995 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14995
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65695/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14995
Build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14995
**[Test build #65695 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65695/consoleFull)**
for PR 14995 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14995
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14995
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65696/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14995
**[Test build #65696 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65696/consoleFull)**
for PR 14995 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14995
**[Test build #65696 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65696/consoleFull)**
for PR 14995 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14995
**[Test build #65695 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65695/consoleFull)**
for PR 14995 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14995
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14995
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65584/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14995
**[Test build #65584 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65584/consoleFull)**
for PR 14995 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14995
**[Test build #65584 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65584/consoleFull)**
for PR 14995 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14995
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65305/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14995
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14995
**[Test build #65305 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65305/consoleFull)**
for PR 14995 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14995
**[Test build #65305 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65305/consoleFull)**
for PR 14995 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14995
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65291/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14995
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14995
**[Test build #65291 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65291/consoleFull)**
for PR 14995 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14995
**[Test build #65291 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65291/consoleFull)**
for PR 14995 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14995
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14995
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65247/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14995
**[Test build #65247 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65247/consoleFull)**
for PR 14995 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14995
**[Test build #65247 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65247/consoleFull)**
for PR 14995 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14995
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65126/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/14995
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14995
**[Test build #65126 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65126/consoleFull)**
for PR 14995 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/14995
**[Test build #65126 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65126/consoleFull)**
for PR 14995 at commit
Github user witgo commented on the issue:
https://github.com/apache/spark/pull/14995
Jenkins, retest this please
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and
75 matches
Mail list logo
