[GitHub] spark issue #15089: [SPARK-15621] [SQL] Support spilling for Python UDF
Github user rxin commented on the issue: https://github.com/apache/spark/pull/15089 LGTM - we should double check whether the synchronized block is sufficient, but we can fix that in a follow-up pr if needed. Merging in master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #15089: [SPARK-15621] [SQL] Support spilling for Python UDF
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15089 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #15089: [SPARK-15621] [SQL] Support spilling for Python UDF
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15089 **[Test build #66187 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66187/consoleFull)** for PR 15089 at commit [`ca607e0`](https://github.com/apache/spark/commit/ca607e038259cff7d50b732801cfc5144dedb6d1). * This patch passes all tests. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #15089: [SPARK-15621] [SQL] Support spilling for Python UDF
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15089 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #15089: [SPARK-15621] [SQL] Support spilling for Python UDF
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15089 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66132/ Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #15089: [SPARK-15621] [SQL] Support spilling for Python UDF
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15089 **[Test build #66132 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66132/consoleFull)** for PR 15089 at commit [`14aef61`](https://github.com/apache/spark/commit/14aef61c467d6c8867ffb53d92eb1a6e10469c53). * This patch passes all tests. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #15089: [SPARK-15621] [SQL] Support spilling for Python UDF
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15089 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66127/ Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #15089: [SPARK-15621] [SQL] Support spilling for Python UDF
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15089 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #15089: [SPARK-15621] [SQL] Support spilling for Python UDF
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15089 **[Test build #66127 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66127/consoleFull)** for PR 15089 at commit [`c4f890c`](https://github.com/apache/spark/commit/c4f890c48c04fcc423d0584be4d1e583edf0). * This patch passes all tests. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #15089: [SPARK-15621] [SQL] Support spilling for Python UDF
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15089 **[Test build #66132 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66132/consoleFull)** for PR 15089 at commit [`14aef61`](https://github.com/apache/spark/commit/14aef61c467d6c8867ffb53d92eb1a6e10469c53). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #15089: [SPARK-15621] [SQL] Support spilling for Python UDF
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15089 **[Test build #66127 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66127/consoleFull)** for PR 15089 at commit [`c4f890c`](https://github.com/apache/spark/commit/c4f890c48c04fcc423d0584be4d1e583edf0). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #15089: [SPARK-15621] [SQL] Support spilling for Python UDF
Github user davies commented on the issue: https://github.com/apache/spark/pull/15089 @JoshRosen Could you take another look? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #15089: [SPARK-15621] [SQL] Support spilling for Python UDF
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15089 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #15089: [SPARK-15621] [SQL] Support spilling for Python UDF
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15089 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65850/ Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #15089: [SPARK-15621] [SQL] Support spilling for Python UDF
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15089 **[Test build #65850 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65850/consoleFull)** for PR 15089 at commit [`5239042`](https://github.com/apache/spark/commit/52390429fb1f7b20705ddad5621e8267c2aff12b). * This patch passes all tests. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #15089: [SPARK-15621] [SQL] Support spilling for Python UDF
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15089 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65848/ Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #15089: [SPARK-15621] [SQL] Support spilling for Python UDF
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15089 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #15089: [SPARK-15621] [SQL] Support spilling for Python UDF
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15089 **[Test build #65848 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65848/consoleFull)** for PR 15089 at commit [`87ecc0d`](https://github.com/apache/spark/commit/87ecc0db2c5c980273e06d37ecb764fd03ad2b65). * This patch passes all tests. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #15089: [SPARK-15621] [SQL] Support spilling for Python UDF
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15089 **[Test build #65850 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65850/consoleFull)** for PR 15089 at commit [`5239042`](https://github.com/apache/spark/commit/52390429fb1f7b20705ddad5621e8267c2aff12b). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #15089: [SPARK-15621] [SQL] Support spilling for Python UDF
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15089 **[Test build #65848 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65848/consoleFull)** for PR 15089 at commit [`87ecc0d`](https://github.com/apache/spark/commit/87ecc0db2c5c980273e06d37ecb764fd03ad2b65). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #15089: [SPARK-15621] [SQL] Support spilling for Python UDF
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15089 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65505/ Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #15089: [SPARK-15621] [SQL] Support spilling for Python UDF
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15089 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #15089: [SPARK-15621] [SQL] Support spilling for Python UDF
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15089 **[Test build #65505 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65505/consoleFull)** for PR 15089 at commit [`9a84870`](https://github.com/apache/spark/commit/9a84870f13e2f75d050153c5d573526fdd3b23a4). * This patch passes all tests. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #15089: [SPARK-15621] [SQL] Support spilling for Python UDF
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15089 **[Test build #65505 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65505/consoleFull)** for PR 15089 at commit [`9a84870`](https://github.com/apache/spark/commit/9a84870f13e2f75d050153c5d573526fdd3b23a4). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #15089: [SPARK-15621] [SQL] Support spilling for Python UDF
Github user davies commented on the issue: https://github.com/apache/spark/pull/15089 @JoshRosen Answer your questions here: 1. This is special designed for Python UDF (we do not have similar requirement in other place), I'd not to make it general without have a real use case from other places. 2. Since we already have page pool, so I did not try to re-use the page here (will be more complicated). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #15089: [SPARK-15621] [SQL] Support spilling for Python UDF
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15089 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65500/ Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #15089: [SPARK-15621] [SQL] Support spilling for Python UDF
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15089 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #15089: [SPARK-15621] [SQL] Support spilling for Python UDF
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15089 **[Test build #65500 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65500/consoleFull)** for PR 15089 at commit [`fc4858c`](https://github.com/apache/spark/commit/fc4858c45cdd647a0d688dcaf12871ee2308129e). * This patch passes all tests. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #15089: [SPARK-15621] [SQL] Support spilling for Python UDF
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15089 **[Test build #65500 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65500/consoleFull)** for PR 15089 at commit [`fc4858c`](https://github.com/apache/spark/commit/fc4858c45cdd647a0d688dcaf12871ee2308129e). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #15089: [SPARK-15621] [SQL] Support spilling for Python UDF
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15089 **[Test build #65456 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65456/consoleFull)** for PR 15089 at commit [`27b162b`](https://github.com/apache/spark/commit/27b162b69d2f249e5119dfb7cae86b20477aac1c). * This patch **fails to build**. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #15089: [SPARK-15621] [SQL] Support spilling for Python UDF
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15089 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #15089: [SPARK-15621] [SQL] Support spilling for Python UDF
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15089 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65456/ Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #15089: [SPARK-15621] [SQL] Support spilling for Python UDF
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15089 **[Test build #65456 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65456/consoleFull)** for PR 15089 at commit [`27b162b`](https://github.com/apache/spark/commit/27b162b69d2f249e5119dfb7cae86b20477aac1c). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #15089: [SPARK-15621] [SQL] Support spilling for Python UDF
Github user davies commented on the issue: https://github.com/apache/spark/pull/15089 @JoshRosen The current fix looks good to me. Could you also fix the case that LocalLimit is correctly inserted when we turn a Python DataFrame with limit into a Python RDD? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #15089: [SPARK-15621] [SQL] Support spilling for Python UDF
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15089 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65340/ Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #15089: [SPARK-15621] [SQL] Support spilling for Python UDF
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15089 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #15089: [SPARK-15621] [SQL] Support spilling for Python UDF
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15089 **[Test build #65340 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65340/consoleFull)** for PR 15089 at commit [`4964b9a`](https://github.com/apache/spark/commit/4964b9a611ed01aaa5252ac642df94db07a38868). * This patch passes all tests. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #15089: [SPARK-15621] [SQL] Support spilling for Python UDF
Github user davies commented on the issue: https://github.com/apache/spark/pull/15089 cc @JoshRosen @rxin --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #15089: [SPARK-15621] [SQL] Support spilling for Python UDF
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15089 **[Test build #65340 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65340/consoleFull)** for PR 15089 at commit [`4964b9a`](https://github.com/apache/spark/commit/4964b9a611ed01aaa5252ac642df94db07a38868). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
