Github user rvesse commented on the issue:
https://github.com/apache/spark/pull/13599
@holdenk What we're doing in some of our products currently is that we
require that users create their Python environments up front and that they be
stored on a file system that is accessible to all
Github user holdenk commented on the issue:
https://github.com/apache/spark/pull/13599
I'm interested in us fixing this, especially after yesterday when I spent
several hours working with workaround hacks. But I want us to do something not
YARN specific and not involve a large slow
Github user gsemet commented on the issue:
https://github.com/apache/spark/pull/13599
Hi. I think until we get a core developer really interested in packaging
python dependencies correctly, this PR wonât evolve a lot
---
Github user ifilonenko commented on the issue:
https://github.com/apache/spark/pull/13599
Is there any work being done on this PR at this point in time?
---
-
To unsubscribe, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13599
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/91891/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13599
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/13599
**[Test build #91891 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91891/testReport)**
for PR 13599 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13599
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/91892/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13599
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/13599
**[Test build #91892 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91892/testReport)**
for PR 13599 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/13599
**[Test build #91892 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91892/testReport)**
for PR 13599 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13599
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/176/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13599
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/4066/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13599
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13599
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13599
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/4065/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13599
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/13599
**[Test build #91891 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91891/testReport)**
for PR 13599 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13599
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13599
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/175/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13599
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13599
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/91519/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/13599
**[Test build #91519 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91519/testReport)**
for PR 13599 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13599
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/3830/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13599
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/13599
**[Test build #91519 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91519/testReport)**
for PR 13599 at commit
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/13599
@JoshRosen, I roughly heard that you took a look about this before. Do you
have a concern to address maybe?
---
-
To
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/13599
@holdenk and @zjffdu, I believe manual tests are a-okay if it's difficult
to write a test. We can manually test and expose this as an experimental
feature too.
BTW, I believe we can
Github user zjffdu commented on the issue:
https://github.com/apache/spark/pull/13599
Thanks for the interest on this PR and the info about `Pipfiles`. I think
we could support that after this PR get merged so that we can provide users
more options for virtualenv based on their
Github user kokes commented on the issue:
https://github.com/apache/spark/pull/13599
Hi, thanks for all the work on this! I see requirements.txt mentioned here
and there and, browsing this and other JIRAs, it seems to be the proposed way
to specify dependencies in PySpark. As you
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13599
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13599
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/91438/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/13599
**[Test build #91438 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91438/testReport)**
for PR 13599 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/13599
**[Test build #91438 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91438/testReport)**
for PR 13599 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13599
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/3790/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13599
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/13599
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13599
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13599
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/91437/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/13599
**[Test build #91437 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91437/testReport)**
for PR 13599 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13599
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13599
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/3789/
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/13599
**[Test build #91437 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91437/testReport)**
for PR 13599 at commit
Github user holdenk commented on the issue:
https://github.com/apache/spark/pull/13599
One point that I'm reminded of looking at this is the lack of tests for
important functionality is probably not an acceptable solution. I understand
testing this in Jenkins could be complicated but
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13599
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/91302/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13599
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/13599
**[Test build #91302 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91302/testReport)**
for PR 13599 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13599
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/3703/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13599
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/13599
**[Test build #91302 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91302/testReport)**
for PR 13599 at commit
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/13599
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13599
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/91252/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13599
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/13599
**[Test build #91252 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91252/testReport)**
for PR 13599 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13599
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13599
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/3665/
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/13599
**[Test build #91252 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91252/testReport)**
for PR 13599 at commit
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/13599
cc @JoshRosen too
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/13599
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13599
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13599
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/91239/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/13599
**[Test build #91239 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91239/testReport)**
for PR 13599 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13599
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13599
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/3653/
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/13599
**[Test build #91239 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91239/testReport)**
for PR 13599 at commit
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/13599
(Oops, the test failure was legitimate.)
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user holdenk commented on the issue:
https://github.com/apache/spark/pull/13599
Actually lets also loop in @ifilonenko who's been thinking about similar
things but with more of a K8s bent.
---
-
To
Github user holdenk commented on the issue:
https://github.com/apache/spark/pull/13599
It's certainly closer, I haven't had a chance to take a look super recently
(been focused on the PySpark K8s integration). I'm still hesitant about this
merged as-is from a skim through, but maybe
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/13599
**[Test build #91238 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91238/testReport)**
for PR 13599 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13599
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13599
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13599
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/91238/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13599
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/3652/
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/13599
**[Test build #91238 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91238/testReport)**
for PR 13599 at commit
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/13599
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13599
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/91235/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13599
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/3649/
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/13599
**[Test build #91235 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91235/testReport)**
for PR 13599 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13599
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13599
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/13599
**[Test build #91235 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91235/testReport)**
for PR 13599 at commit
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/13599
Hey @zjffdu, would you have some time to update this PR?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/13599
**[Test build #88968 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88968/testReport)**
for PR 13599 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13599
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/88968/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13599
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13599
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/2025/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13599
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/13599
**[Test build #88968 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88968/testReport)**
for PR 13599 at commit
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/13599
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/13599
Will try to set up an env and test this by myself shortly as well.
---
-
To unsubscribe, e-mail:
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/13599
@holdenk, so have you concerns been addressed properly?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
Github user gsemet commented on the issue:
https://github.com/apache/spark/pull/13599
I would be glad to participate to this hangout as well :)
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/13599
**[Test build #87749 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87749/testReport)**
for PR 13599 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13599
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/87749/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13599
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/13599
**[Test build #87749 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87749/testReport)**
for PR 13599 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13599
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/1126/
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13599
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/13599
**[Test build #87745 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87745/testReport)**
for PR 13599 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/13599
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
1 - 100 of 326 matches
Mail list logo
