[GitHub] spark issue #18459: [SPARK-13534][PYSPARK] Using Apache Arrow to increase pe...

Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/18459 great work! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark issue #18459: [SPARK-13534][PYSPARK] Using Apache Arrow to increase pe...

Github user BryanCutler commented on the issue: https://github.com/apache/spark/pull/18459 Thanks @holdenk! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #18459: [SPARK-13534][PYSPARK] Using Apache Arrow to increase pe...

Github user holdenk commented on the issue: https://github.com/apache/spark/pull/18459 Merged to master. Thanks everyone (especially @shaneknapp & @BryanCutler ) :) If anyone sees anything come up in the builds we will revert, but I think the multiple runes @shaneknapp's verification

[GitHub] spark issue #18459: [SPARK-13534][PYSPARK] Using Apache Arrow to increase pe...

Github user holdenk commented on the issue: https://github.com/apache/spark/pull/18459 I think we are indeed good to go. I'll merge this back in if no one objects before 4pm pacific today. --- If your project is set up for it, you can reply to this email and have your reply appear

[GitHub] spark issue #18459: [SPARK-13534][PYSPARK] Using Apache Arrow to increase pe...

Github user BryanCutler commented on the issue: https://github.com/apache/spark/pull/18459 That's great to hear @shaneknapp , thanks for all your help getting this going! @cloud-fan , @holdenk since the environment upgrades this has passed tests 4 time in a row, and I had

[GitHub] spark issue #18459: [SPARK-13534][PYSPARK] Using Apache Arrow to increase pe...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18459 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18459: [SPARK-13534][PYSPARK] Using Apache Arrow to increase pe...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18459 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79468/ Test PASSed. ---

[GitHub] spark issue #18459: [SPARK-13534][PYSPARK] Using Apache Arrow to increase pe...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18459 **[Test build #79468 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79468/testReport)** for PR 18459 at commit

[GitHub] spark issue #18459: [SPARK-13534][PYSPARK] Using Apache Arrow to increase pe...

Github user shaneknapp commented on the issue: https://github.com/apache/spark/pull/18459 ok, i feel confident that this PR should be g2g: - i checked the workers that this PRs builds were on and they didn't leave any stray lockfiles - i checked ALL workers for stray

[GitHub] spark issue #18459: [SPARK-13534][PYSPARK] Using Apache Arrow to increase pe...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18459 **[Test build #79468 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79468/testReport)** for PR 18459 at commit

[GitHub] spark issue #18459: [SPARK-13534][PYSPARK] Using Apache Arrow to increase pe...

Github user shaneknapp commented on the issue: https://github.com/apache/spark/pull/18459 test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #18459: [SPARK-13534][PYSPARK] Using Apache Arrow to increase pe...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18459 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79427/ Test PASSed. ---

[GitHub] spark issue #18459: [SPARK-13534][PYSPARK] Using Apache Arrow to increase pe...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18459 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18459: [SPARK-13534][PYSPARK] Using Apache Arrow to increase pe...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18459 **[Test build #79427 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79427/testReport)** for PR 18459 at commit

[GitHub] spark issue #18459: [SPARK-13534][PYSPARK] Using Apache Arrow to increase pe...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18459 **[Test build #79427 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79427/testReport)** for PR 18459 at commit

[GitHub] spark issue #18459: [SPARK-13534][PYSPARK] Using Apache Arrow to increase pe...

Github user BryanCutler commented on the issue: https://github.com/apache/spark/pull/18459 jenkins retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #18459: [SPARK-13534][PYSPARK] Using Apache Arrow to increase pe...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18459 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18459: [SPARK-13534][PYSPARK] Using Apache Arrow to increase pe...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18459 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79363/ Test PASSed. ---

[GitHub] spark issue #18459: [SPARK-13534][PYSPARK] Using Apache Arrow to increase pe...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18459 **[Test build #79363 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79363/testReport)** for PR 18459 at commit

[GitHub] spark issue #18459: [SPARK-13534][PYSPARK] Using Apache Arrow to increase pe...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18459 **[Test build #79363 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79363/testReport)** for PR 18459 at commit

[GitHub] spark issue #18459: [SPARK-13534][PYSPARK] Using Apache Arrow to increase pe...

Github user shaneknapp commented on the issue: https://github.com/apache/spark/pull/18459 test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #18459: [SPARK-13534][PYSPARK] Using Apache Arrow to increase pe...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18459 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18459: [SPARK-13534][PYSPARK] Using Apache Arrow to increase pe...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18459 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79355/ Test PASSed. ---

[GitHub] spark issue #18459: [SPARK-13534][PYSPARK] Using Apache Arrow to increase pe...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18459 **[Test build #79355 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79355/testReport)** for PR 18459 at commit

[GitHub] spark issue #18459: [SPARK-13534][PYSPARK] Using Apache Arrow to increase pe...

Github user holdenk commented on the issue: https://github.com/apache/spark/pull/18459 I haven't seen lock contention before setting up conda enviroments, if it happens again lets dig deeper but if its just a one off I wouldn't be too worried. --- If your project is set up for it,

[GitHub] spark issue #18459: [SPARK-13534][PYSPARK] Using Apache Arrow to increase pe...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18459 **[Test build #79355 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79355/testReport)** for PR 18459 at commit

[GitHub] spark issue #18459: [SPARK-13534][PYSPARK] Using Apache Arrow to increase pe...

Github user BryanCutler commented on the issue: https://github.com/apache/spark/pull/18459 jenkins retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #18459: [SPARK-13534][PYSPARK] Using Apache Arrow to increase pe...

Github user shaneknapp commented on the issue: https://github.com/apache/spark/pull/18459 i'd kick off a couple #tbh :) On Fri, Jul 7, 2017 at 5:02 PM, Bryan Cutler wrote: > Ok, no prob. I'll kick off another test, maybe that was just a

[GitHub] spark issue #18459: [SPARK-13534][PYSPARK] Using Apache Arrow to increase pe...

Github user BryanCutler commented on the issue: https://github.com/apache/spark/pull/18459 Ok, no prob. I'll kick off another test, maybe that was just a fluke. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #18459: [SPARK-13534][PYSPARK] Using Apache Arrow to increase pe...

Github user shaneknapp commented on the issue: https://github.com/apache/spark/pull/18459 hmm. i have a feeling w/o looking at the test code that we're creating lots of envs, installing things, and then moving on to a new env... which is leading to a race condition w/lockfiles.

[GitHub] spark issue #18459: [SPARK-13534][PYSPARK] Using Apache Arrow to increase pe...

Github user BryanCutler commented on the issue: https://github.com/apache/spark/pull/18459 @shaneknapp this passed the ArrowTests, but looks like it failed while setting up conda for pip-tests because it couldn't acquire a lock ``` Exceeded max retries, giving upError:

[GitHub] spark issue #18459: [SPARK-13534][PYSPARK] Using Apache Arrow to increase pe...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18459 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18459: [SPARK-13534][PYSPARK] Using Apache Arrow to increase pe...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18459 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79346/ Test FAILed. ---

[GitHub] spark issue #18459: [SPARK-13534][PYSPARK] Using Apache Arrow to increase pe...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18459 **[Test build #79346 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79346/testReport)** for PR 18459 at commit

[GitHub] spark issue #18459: [SPARK-13534][PYSPARK] Using Apache Arrow to increase pe...

Github user shaneknapp commented on the issue: https://github.com/apache/spark/pull/18459 one quick comment... i see that these tests are using the default ivy cache of `/home/jenkins/.ivy2/cache`, which is dangerous as other builds and whatnot can pollute this w/jars and cause test

[GitHub] spark issue #18459: [SPARK-13534][PYSPARK] Using Apache Arrow to increase pe...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18459 **[Test build #79346 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79346/testReport)** for PR 18459 at commit

[GitHub] spark issue #18459: [SPARK-13534][PYSPARK] Using Apache Arrow to increase pe...

Github user BryanCutler commented on the issue: https://github.com/apache/spark/pull/18459 ArrowTests are verified to be running after forcing this failure: ``` == FAIL: test_filtered_frame

[GitHub] spark issue #18459: [SPARK-13534][PYSPARK] Using Apache Arrow to increase pe...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18459 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79339/ Test FAILed. ---

[GitHub] spark issue #18459: [SPARK-13534][PYSPARK] Using Apache Arrow to increase pe...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18459 Build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #18459: [SPARK-13534][PYSPARK] Using Apache Arrow to increase pe...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18459 **[Test build #79339 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79339/testReport)** for PR 18459 at commit

[GitHub] spark issue #18459: [SPARK-13534][PYSPARK] Using Apache Arrow to increase pe...

Github user BryanCutler commented on the issue: https://github.com/apache/spark/pull/18459 Great, thanks @shaneknapp! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #18459: [SPARK-13534][PYSPARK] Using Apache Arrow to increase pe...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18459 **[Test build #79339 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79339/testReport)** for PR 18459 at commit

[GitHub] spark issue #18459: [SPARK-13534][PYSPARK] Using Apache Arrow to increase pe...

Github user shaneknapp commented on the issue: https://github.com/apache/spark/pull/18459 test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #18459: [SPARK-13534][PYSPARK] Using Apache Arrow to increase pe...

Github user shaneknapp commented on the issue: https://github.com/apache/spark/pull/18459 ``` (py3k) [root@amp-jenkins-worker-01 ~]# pip show pandas numpy Name: pandas Version: 0.19.2 Summary: Powerful data structures for data analysis, time series,and statistics

[GitHub] spark issue #18459: [SPARK-13534][PYSPARK] Using Apache Arrow to increase pe...

Github user shaneknapp commented on the issue: https://github.com/apache/spark/pull/18459 this has been done. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #18459: [SPARK-13534][PYSPARK] Using Apache Arrow to increase pe...

Github user shaneknapp commented on the issue: https://github.com/apache/spark/pull/18459 ok, i've backed up the existing anaconda installation on all of the workers, so i can do the system-wide upgrade and back out if necessary. i'll post to the dev@ list about upgrading

[GitHub] spark issue #18459: [SPARK-13534][PYSPARK] Using Apache Arrow to increase pe...

Github user shaneknapp commented on the issue: https://github.com/apache/spark/pull/18459 alright, this is what a `conda install numpy` would update on the workers: ``` package|build ---|-

[GitHub] spark issue #18459: [SPARK-13534][PYSPARK] Using Apache Arrow to increase pe...

Github user BryanCutler commented on the issue: https://github.com/apache/spark/pull/18459 No problem, I used to have a life too ;) I need to push an update to fix the conflict, but I'll hold off until we are ready to run again. Thanks! On Wed, Jul 5, 2017 at 5:17 PM,

[GitHub] spark issue #18459: [SPARK-13534][PYSPARK] Using Apache Arrow to increase pe...

Github user shaneknapp commented on the issue: https://github.com/apache/spark/pull/18459 no, i will tomorrow though. real life[tm] took over my day today. On Wed, Jul 5, 2017 at 4:54 PM, Bryan Cutler wrote: > Hi @shaneknapp

[GitHub] spark issue #18459: [SPARK-13534][PYSPARK] Using Apache Arrow to increase pe...

Github user BryanCutler commented on the issue: https://github.com/apache/spark/pull/18459 Hi @shaneknapp, did you happen to get a chance to work on this yet? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #18459: [SPARK-13534][PYSPARK] Using Apache Arrow to increase pe...

Github user shaneknapp commented on the issue: https://github.com/apache/spark/pull/18459 nah, i got it. On Sat, Jul 1, 2017 at 7:19 PM, Holden Karau wrote: > @shaneknapp - I can do the update if you >

[GitHub] spark issue #18459: [SPARK-13534][PYSPARK] Using Apache Arrow to increase pe...

Github user holdenk commented on the issue: https://github.com/apache/spark/pull/18459 @shaneknapp - I can do the update if you want next week? Let me know :) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #18459: [SPARK-13534][PYSPARK] Using Apache Arrow to increase pe...

Github user BryanCutler commented on the issue: https://github.com/apache/spark/pull/18459 Great, thanks @shaneknapp! Just let me know what I can do to help On Jun 30, 2017 4:52 PM, "shane" wrote: > i won't have time to think about and do

[GitHub] spark issue #18459: [SPARK-13534][PYSPARK] Using Apache Arrow to increase pe...

Github user shaneknapp commented on the issue: https://github.com/apache/spark/pull/18459 i won't have time to think about and do something until monday... but i have some ideas. On Fri, Jun 30, 2017 at 4:29 PM, Bryan Cutler wrote:

[GitHub] spark issue #18459: [SPARK-13534][PYSPARK] Using Apache Arrow to increase pe...

Github user BryanCutler commented on the issue: https://github.com/apache/spark/pull/18459 Thanks for checking on that Wes! @shaneknapp and @holdenk I definitely don't want you to go through dependency hell... :-1: I'm not too sure how to resolve this since I have no access to

[GitHub] spark issue #18459: [SPARK-13534][PYSPARK] Using Apache Arrow to increase pe...

Github user wesm commented on the issue: https://github.com/apache/spark/pull/18459 I just checked and pandas 0.18.1 is the minimum supported version. It's possible with some effort we could maintain against 0.17.x (which is the first release to have datetime with TZ column types)

[GitHub] spark issue #18459: [SPARK-13534][PYSPARK] Using Apache Arrow to increase pe...

Github user BryanCutler commented on the issue: https://github.com/apache/spark/pull/18459 Hmm, that's a pretty old version of Pandas also. I'm not too sure if that would pose a problem too. @wesm, do you have any advice on compatibility for manually setting up the Spark Jenkins

[GitHub] spark issue #18459: [SPARK-13534][PYSPARK] Using Apache Arrow to increase pe...

Github user shaneknapp commented on the issue: https://github.com/apache/spark/pull/18459 pandas is currently at 0.15.2. and no, no plans to upgrade unless it's forced by dependency hell. --- If your project is set up for it, you can reply to this email and have your

[GitHub] spark issue #18459: [SPARK-13534][PYSPARK] Using Apache Arrow to increase pe...

Github user BryanCutler commented on the issue: https://github.com/apache/spark/pull/18459 Hi @shaneknapp, I should have probably asked what version of Pandas is currently installed and if you will be upgrading that also with numpy? Thanks! --- If your project is set up for it,

[GitHub] spark issue #18459: [SPARK-13534][PYSPARK] Using Apache Arrow to increase pe...

Github user BryanCutler commented on the issue: https://github.com/apache/spark/pull/18459 It looks like the minimum version in the pyarrow conda recipie is 1.11.x [link](https://github.com/conda-forge/pyarrow-feedstock/blob/master/appveyor.yml#L13). Up to version 1.13.x is

[GitHub] spark issue #18459: [SPARK-13534][PYSPARK] Using Apache Arrow to increase pe...

Github user shaneknapp commented on the issue: https://github.com/apache/spark/pull/18459 is there a specific version that you would like installed (current is 1.9.2)? i'll do the this as i need to update some setup scripts and whatnot. --- If your project is set up for

[GitHub] spark issue #18459: [SPARK-13534][PYSPARK] Using Apache Arrow to increase pe...

Github user BryanCutler commented on the issue: https://github.com/apache/spark/pull/18459 Thanks @holdenk , I thought there was probably some kind of import error causing the tests to be skipped. I'll see if I can update the min numpy ver. I'm not sure its such a good idea to skip

[GitHub] spark issue #18459: [SPARK-13534][PYSPARK] Using Apache Arrow to increase pe...

Github user holdenk commented on the issue: https://github.com/apache/spark/pull/18459 So I went to go take a look on the host and it seems that the numpy version is sufficiently out of date it fails. cc @shaneknapp - would it be ok to install a modern version of numpy in the

[GitHub] spark issue #18459: [SPARK-13534][PYSPARK] Using Apache Arrow to increase pe...

Github user holdenk commented on the issue: https://github.com/apache/spark/pull/18459 The error is: > >>> import pyarrow > RuntimeError: module compiled against API version a but this version of numpy is 9 > Traceback (most recent call last): > File "", line 1,

[GitHub] spark issue #18459: [SPARK-13534][PYSPARK] Using Apache Arrow to increase pe...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18459 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18459: [SPARK-13534][PYSPARK] Using Apache Arrow to increase pe...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18459 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78842/ Test PASSed. ---

[GitHub] spark issue #18459: [SPARK-13534][PYSPARK] Using Apache Arrow to increase pe...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18459 **[Test build #78842 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78842/testReport)** for PR 18459 at commit

[GitHub] spark issue #18459: [SPARK-13534][PYSPARK] Using Apache Arrow to increase pe...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18459 **[Test build #78842 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78842/testReport)** for PR 18459 at commit

[GitHub] spark issue #18459: [SPARK-13534][PYSPARK] Using Apache Arrow to increase pe...

Github user holdenk commented on the issue: https://github.com/apache/spark/pull/18459 I think strangely enough it's only persisted on failure. I'd just put an assert false true at the end to verify the test is running, then take it out and we can merge it. Sound good?

[GitHub] spark issue #18459: [SPARK-13534][PYSPARK] Using Apache Arrow to increase pe...

Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/18459 Thanks for cc'ing me. I am investigating this here - https://github.com/apache/spark/pull/18456. --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark issue #18459: [SPARK-13534][PYSPARK] Using Apache Arrow to increase pe...

Github user BryanCutler commented on the issue: https://github.com/apache/spark/pull/18459 @holdenk @HyukjinKwon any ideas what caused this last error? It look like pyspark.sql.tests ran fine, which should have run the Arrow tests assuming pyarrow was on the worker but Is there

[GitHub] spark issue #18459: [SPARK-13534][PYSPARK] Using Apache Arrow to increase pe...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18459 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78822/ Test FAILed. ---

[GitHub] spark issue #18459: [SPARK-13534][PYSPARK] Using Apache Arrow to increase pe...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18459 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18459: [SPARK-13534][PYSPARK] Using Apache Arrow to increase pe...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18459 **[Test build #78822 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78822/testReport)** for PR 18459 at commit

[GitHub] spark issue #18459: [SPARK-13534][PYSPARK] Using Apache Arrow to increase pe...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18459 **[Test build #78822 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78822/testReport)** for PR 18459 at commit

[GitHub] spark issue #18459: [SPARK-13534][PYSPARK] Using Apache Arrow to increase pe...

Github user BryanCutler commented on the issue: https://github.com/apache/spark/pull/18459 Jenkins retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #18459: [SPARK-13534][PYSPARK] Using Apache Arrow to increase pe...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18459 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18459: [SPARK-13534][PYSPARK] Using Apache Arrow to increase pe...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18459 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/78818/ Test FAILed. ---

[GitHub] spark issue #18459: [SPARK-13534][PYSPARK] Using Apache Arrow to increase pe...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18459 **[Test build #78818 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78818/testReport)** for PR 18459 at commit

[GitHub] spark issue #18459: [SPARK-13534][PYSPARK] Using Apache Arrow to increase pe...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18459 **[Test build #78818 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/78818/testReport)** for PR 18459 at commit