[GitHub] [spark] HyukjinKwon commented on issue #25594: [SPARK-28881][PYTHON][TESTS] Add a test to make sure toPandas with Arrow optimization throws an exception per maxResultSize

HyukjinKwon commented on issue #25594: [SPARK-28881][PYTHON][TESTS] Add a test to make sure toPandas with Arrow optimization throws an exception per maxResultSize URL: https://github.com/apache/spark/pull/25594#issuecomment-525198670 Thanks, @dongjoon-hyun and @cloud-fan

[GitHub] [spark] SparkQA commented on issue #25594: [SPARK-28881][PYTHON][TESTS] Add a test to make sure toPandas with Arrow optimization throws an exception per maxResultSize

SparkQA commented on issue #25594: [SPARK-28881][PYTHON][TESTS] Add a test to make sure toPandas with Arrow optimization throws an exception per maxResultSize URL: https://github.com/apache/spark/pull/25594#issuecomment-525197842 **[Test build #109800 has finished](https://amplab.cs.berkel

[GitHub] [spark] HyukjinKwon closed pull request #25594: [SPARK-28881][PYTHON][TESTS] Add a test to make sure toPandas with Arrow optimization throws an exception per maxResultSize

HyukjinKwon closed pull request #25594: [SPARK-28881][PYTHON][TESTS] Add a test to make sure toPandas with Arrow optimization throws an exception per maxResultSize URL: https://github.com/apache/spark/pull/25594 This is an

[GitHub] [spark] AmplabJenkins commented on issue #25594: [SPARK-28881][PYTHON][TESTS] Add a test to make sure toPandas with Arrow optimization throws an exception per maxResultSize

AmplabJenkins commented on issue #25594: [SPARK-28881][PYTHON][TESTS] Add a test to make sure toPandas with Arrow optimization throws an exception per maxResultSize URL: https://github.com/apache/spark/pull/25594#issuecomment-525198461 Test PASSed. Refer to this link for build results (

[GitHub] [spark] AmplabJenkins commented on issue #25594: [SPARK-28881][PYTHON][TESTS] Add a test to make sure toPandas with Arrow optimization throws an exception per maxResultSize

AmplabJenkins commented on issue #25594: [SPARK-28881][PYTHON][TESTS] Add a test to make sure toPandas with Arrow optimization throws an exception per maxResultSize URL: https://github.com/apache/spark/pull/25594#issuecomment-525198445 Merged build finished. Test PASSed. -

[GitHub] [spark] AmplabJenkins removed a comment on issue #25594: [SPARK-28881][PYTHON][TESTS] Add a test to make sure toPandas with Arrow optimization throws an exception per maxResultSize

AmplabJenkins removed a comment on issue #25594: [SPARK-28881][PYTHON][TESTS] Add a test to make sure toPandas with Arrow optimization throws an exception per maxResultSize URL: https://github.com/apache/spark/pull/25594#issuecomment-525198445 Merged build finished. Test PASSed. -

[GitHub] [spark] AmplabJenkins removed a comment on issue #25594: [SPARK-28881][PYTHON][TESTS] Add a test to make sure toPandas with Arrow optimization throws an exception per maxResultSize

AmplabJenkins removed a comment on issue #25594: [SPARK-28881][PYTHON][TESTS] Add a test to make sure toPandas with Arrow optimization throws an exception per maxResultSize URL: https://github.com/apache/spark/pull/25594#issuecomment-525198461 Test PASSed. Refer to this link for build r

[GitHub] [spark] HyukjinKwon commented on issue #25594: [SPARK-28881][PYTHON][TESTS] Add a test to make sure toPandas with Arrow optimization throws an exception per maxResultSize

HyukjinKwon commented on issue #25594: [SPARK-28881][PYTHON][TESTS] Add a test to make sure toPandas with Arrow optimization throws an exception per maxResultSize URL: https://github.com/apache/spark/pull/25594#issuecomment-525198546 Merged to master. It will be backported together

[GitHub] [spark] AmplabJenkins removed a comment on issue #25594: [SPARK-28881][PYTHON][TESTS] Add a test to make sure toPandas with Arrow optimization throws an exception per maxResultSize

AmplabJenkins removed a comment on issue #25594: [SPARK-28881][PYTHON][TESTS] Add a test to make sure toPandas with Arrow optimization throws an exception per maxResultSize URL: https://github.com/apache/spark/pull/25594#issuecomment-525194866 Merged build finished. Test PASSed. -

[GitHub] [spark] AmplabJenkins removed a comment on issue #25594: [SPARK-28881][PYTHON][TESTS] Add a test to make sure toPandas with Arrow optimization throws an exception per maxResultSize

AmplabJenkins removed a comment on issue #25594: [SPARK-28881][PYTHON][TESTS] Add a test to make sure toPandas with Arrow optimization throws an exception per maxResultSize URL: https://github.com/apache/spark/pull/25594#issuecomment-525194899 Test PASSed. Refer to this link for build r

[GitHub] [spark] AmplabJenkins commented on issue #25594: [SPARK-28881][PYTHON][TESTS] Add a test to make sure toPandas with Arrow optimization throws an exception per maxResultSize

AmplabJenkins commented on issue #25594: [SPARK-28881][PYTHON][TESTS] Add a test to make sure toPandas with Arrow optimization throws an exception per maxResultSize URL: https://github.com/apache/spark/pull/25594#issuecomment-525194899 Test PASSed. Refer to this link for build results (

[GitHub] [spark] AmplabJenkins commented on issue #25594: [SPARK-28881][PYTHON][TESTS] Add a test to make sure toPandas with Arrow optimization throws an exception per maxResultSize

AmplabJenkins commented on issue #25594: [SPARK-28881][PYTHON][TESTS] Add a test to make sure toPandas with Arrow optimization throws an exception per maxResultSize URL: https://github.com/apache/spark/pull/25594#issuecomment-525194866 Merged build finished. Test PASSed. -

[GitHub] [spark] SparkQA removed a comment on issue #25594: [SPARK-28881][PYTHON][TESTS] Add a test to make sure toPandas with Arrow optimization throws an exception per maxResultSize

SparkQA removed a comment on issue #25594: [SPARK-28881][PYTHON][TESTS] Add a test to make sure toPandas with Arrow optimization throws an exception per maxResultSize URL: https://github.com/apache/spark/pull/25594#issuecomment-525182924 **[Test build #109799 has started](https://amplab.c

[GitHub] [spark] SparkQA commented on issue #25594: [SPARK-28881][PYTHON][TESTS] Add a test to make sure toPandas with Arrow optimization throws an exception per maxResultSize

SparkQA commented on issue #25594: [SPARK-28881][PYTHON][TESTS] Add a test to make sure toPandas with Arrow optimization throws an exception per maxResultSize URL: https://github.com/apache/spark/pull/25594#issuecomment-525194331 **[Test build #109799 has finished](https://amplab.cs.berkel

[GitHub] [spark] gengliangwang commented on a change in pull request #25581: [SPARK-28495][SQL] Introduce ANSI store assignment policy for table insertion

gengliangwang commented on a change in pull request #25581: [SPARK-28495][SQL] Introduce ANSI store assignment policy for table insertion URL: https://github.com/apache/spark/pull/25581#discussion_r317950237 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/types/DataT

[GitHub] [spark] dongjoon-hyun commented on issue #25593: [SPARK-27992][PYTHON][2.4] Allow Python to join with connection thread to propagate errors

dongjoon-hyun commented on issue #25593: [SPARK-27992][PYTHON][2.4] Allow Python to join with connection thread to propagate errors URL: https://github.com/apache/spark/pull/25593#issuecomment-525193177 Wow. Thank you for confirmation. 😄 ---

[GitHub] [spark] HyukjinKwon edited a comment on issue #25593: [SPARK-27992][PYTHON][2.4] Allow Python to join with connection thread to propagate errors

HyukjinKwon edited a comment on issue #25593: [SPARK-27992][PYTHON][2.4] Allow Python to join with connection thread to propagate errors URL: https://github.com/apache/spark/pull/25593#issuecomment-525192356 Between Spark 2.4.4 and RC 2.4.5, there look only one fix: https://github.com/a

[GitHub] [spark] HyukjinKwon commented on issue #25593: [SPARK-27992][PYTHON][2.4] Allow Python to join with connection thread to propagate errors

HyukjinKwon commented on issue #25593: [SPARK-27992][PYTHON][2.4] Allow Python to join with connection thread to propagate errors URL: https://github.com/apache/spark/pull/25593#issuecomment-525192356 Between Spark 2.4.3 and RC 2.4.4, there look only one fix: https://github.com/apache/s

[GitHub] [spark] wangyum commented on a change in pull request #25584: [SPARK-28876][SQL] fallBackToHdfs should not support Hive partitioned table

wangyum commented on a change in pull request #25584: [SPARK-28876][SQL] fallBackToHdfs should not support Hive partitioned table URL: https://github.com/apache/spark/pull/25584#discussion_r317948185 ## File path: sql/hive/src/test/scala/org/apache/spark/sql/hive/StatisticsSuite.sc

[GitHub] [spark] SparkQA commented on issue #25512: [SPARK-28782][SQL] Support explode function on aggregate expressions

SparkQA commented on issue #25512: [SPARK-28782][SQL] Support explode function on aggregate expressions URL: https://github.com/apache/spark/pull/25512#issuecomment-525191552 **[Test build #109803 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/109803/testRe

[GitHub] [spark] AmplabJenkins removed a comment on issue #25512: [SPARK-28782][SQL] Support explode function on aggregate expressions

AmplabJenkins removed a comment on issue #25512: [SPARK-28782][SQL] Support explode function on aggregate expressions URL: https://github.com/apache/spark/pull/25512#issuecomment-525190690 Test PASSed. Refer to this link for build results (access rights to CI server needed): https:/

[GitHub] [spark] AmplabJenkins removed a comment on issue #25512: [SPARK-28782][SQL] Support explode function on aggregate expressions

AmplabJenkins removed a comment on issue #25512: [SPARK-28782][SQL] Support explode function on aggregate expressions URL: https://github.com/apache/spark/pull/25512#issuecomment-525190672 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25512: [SPARK-28782][SQL] Support explode function on aggregate expressions

AmplabJenkins commented on issue #25512: [SPARK-28782][SQL] Support explode function on aggregate expressions URL: https://github.com/apache/spark/pull/25512#issuecomment-525190690 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.

[GitHub] [spark] AmplabJenkins commented on issue #25512: [SPARK-28782][SQL] Support explode function on aggregate expressions

AmplabJenkins commented on issue #25512: [SPARK-28782][SQL] Support explode function on aggregate expressions URL: https://github.com/apache/spark/pull/25512#issuecomment-525190672 Merged build finished. Test PASSed. This is

[GitHub] [spark] cloud-fan commented on issue #25512: [SPARK-28782][SQL] Support explode function on aggregate expressions

cloud-fan commented on issue #25512: [SPARK-28782][SQL] Support explode function on aggregate expressions URL: https://github.com/apache/spark/pull/25512#issuecomment-525189428 retest this please This is an automated message

[GitHub] [spark] HyukjinKwon commented on a change in pull request #25594: [SPARK-28881][PYTHON][TESTS] Add a test to make sure toPandas with Arrow optimization throws an exception per maxResultSize

HyukjinKwon commented on a change in pull request #25594: [SPARK-28881][PYTHON][TESTS] Add a test to make sure toPandas with Arrow optimization throws an exception per maxResultSize URL: https://github.com/apache/spark/pull/25594#discussion_r317945400 ## File path: python/pyspark/s

[GitHub] [spark] HyukjinKwon commented on a change in pull request #25594: [SPARK-28881][PYTHON][TESTS] Add a test to make sure toPandas with Arrow optimization throws an exception per maxResultSize

HyukjinKwon commented on a change in pull request #25594: [SPARK-28881][PYTHON][TESTS] Add a test to make sure toPandas with Arrow optimization throws an exception per maxResultSize URL: https://github.com/apache/spark/pull/25594#discussion_r317944914 ## File path: python/pyspark/s

[GitHub] [spark] dongjoon-hyun edited a comment on issue #25593: [SPARK-27992][PYTHON][2.4] Allow Python to join with connection thread to propagate errors

dongjoon-hyun edited a comment on issue #25593: [SPARK-27992][PYTHON][2.4] Allow Python to join with connection thread to propagate errors URL: https://github.com/apache/spark/pull/25593#issuecomment-525188416 Thank you for reporting and making PR swiftly. We can cut another RC, but still

[GitHub] [spark] SparkQA commented on issue #22138: [SPARK-25151][SS] Apply Apache Commons Pool to KafkaDataConsumer

SparkQA commented on issue #22138: [SPARK-25151][SS] Apply Apache Commons Pool to KafkaDataConsumer URL: https://github.com/apache/spark/pull/22138#issuecomment-525188732 **[Test build #109802 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/109802/testReport

[GitHub] [spark] HyukjinKwon commented on a change in pull request #25594: [SPARK-28881][PYTHON][TESTS] Add a test to make sure toPandas with Arrow optimization throws an exception per maxResultSize

HyukjinKwon commented on a change in pull request #25594: [SPARK-28881][PYTHON][TESTS] Add a test to make sure toPandas with Arrow optimization throws an exception per maxResultSize URL: https://github.com/apache/spark/pull/25594#discussion_r317944289 ## File path: python/pyspark/s

[GitHub] [spark] dongjoon-hyun edited a comment on issue #25593: [SPARK-27992][PYTHON][2.4] Allow Python to join with connection thread to propagate errors

dongjoon-hyun edited a comment on issue #25593: [SPARK-27992][PYTHON][2.4] Allow Python to join with connection thread to propagate errors URL: https://github.com/apache/spark/pull/25593#issuecomment-525188416 Thank you for reporting and making PR swiftly. We can cut another RC, but still

[GitHub] [spark] dongjoon-hyun edited a comment on issue #25593: [SPARK-27992][PYTHON][2.4] Allow Python to join with connection thread to propagate errors

dongjoon-hyun edited a comment on issue #25593: [SPARK-27992][PYTHON][2.4] Allow Python to join with connection thread to propagate errors URL: https://github.com/apache/spark/pull/25593#issuecomment-525188416 Thank you for reporting and making PR swiftly. We can cut another RC, but still

[GitHub] [spark] gengliangwang edited a comment on issue #25577: [WIP][CORE][SPARK-28867] InMemoryStore checkpoint to speed up replay log file in HistoryServer

gengliangwang edited a comment on issue #25577: [WIP][CORE][SPARK-28867] InMemoryStore checkpoint to speed up replay log file in HistoryServer URL: https://github.com/apache/spark/pull/25577#issuecomment-525188398 @HeartSaVioR +1 with rolling event logs. ---

[GitHub] [spark] cloud-fan commented on a change in pull request #25594: [SPARK-28881][PYTHON][TESTS] Add a test to make sure toPandas with Arrow optimization throws an exception per maxResultSize

cloud-fan commented on a change in pull request #25594: [SPARK-28881][PYTHON][TESTS] Add a test to make sure toPandas with Arrow optimization throws an exception per maxResultSize URL: https://github.com/apache/spark/pull/25594#discussion_r317944103 ## File path: python/pyspark/sql

[GitHub] [spark] dongjoon-hyun commented on issue #25593: [SPARK-27992][PYTHON][2.4] Allow Python to join with connection thread to propagate errors

dongjoon-hyun commented on issue #25593: [SPARK-27992][PYTHON][2.4] Allow Python to join with connection thread to propagate errors URL: https://github.com/apache/spark/pull/25593#issuecomment-525188416 Thank you for reporting and making PR swiftly. We can cut another RC, but still I didn'

[GitHub] [spark] gengliangwang commented on issue #25577: [WIP][CORE][SPARK-28867] InMemoryStore checkpoint to speed up replay log file in HistoryServer

gengliangwang commented on issue #25577: [WIP][CORE][SPARK-28867] InMemoryStore checkpoint to speed up replay log file in HistoryServer URL: https://github.com/apache/spark/pull/25577#issuecomment-525188398 @HeartSaVioR +1 with rolling over event logs. -

[GitHub] [spark] ulysses-you commented on issue #25464: [SPARK-28746][SQL] Add partitionby hint for sql queries

ulysses-you commented on issue #25464: [SPARK-28746][SQL] Add partitionby hint for sql queries URL: https://github.com/apache/spark/pull/25464#issuecomment-525188183 @maropu The build error is just a probability problem, right... ?

[GitHub] [spark] HyukjinKwon commented on a change in pull request #25594: [SPARK-28881][PYTHON][TESTS] Add a test to make sure toPandas with Arrow optimization throws an exception per maxResultSize

HyukjinKwon commented on a change in pull request #25594: [SPARK-28881][PYTHON][TESTS] Add a test to make sure toPandas with Arrow optimization throws an exception per maxResultSize URL: https://github.com/apache/spark/pull/25594#discussion_r317943848 ## File path: python/pyspark/s

[GitHub] [spark] cloud-fan commented on a change in pull request #25581: [SPARK-28495][SQL] Introduce ANSI store assignment policy for table insertion

cloud-fan commented on a change in pull request #25581: [SPARK-28495][SQL] Introduce ANSI store assignment policy for table insertion URL: https://github.com/apache/spark/pull/25581#discussion_r317943392 ## File path: sql/core/src/test/scala/org/apache/spark/sql/sources/InsertSuite

[GitHub] [spark] cloud-fan commented on a change in pull request #25581: [SPARK-28495][SQL] Introduce ANSI store assignment policy for table insertion

cloud-fan commented on a change in pull request #25581: [SPARK-28495][SQL] Introduce ANSI store assignment policy for table insertion URL: https://github.com/apache/spark/pull/25581#discussion_r317942895 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/types/DataTypeW

[GitHub] [spark] cloud-fan commented on a change in pull request #25581: [SPARK-28495][SQL] Introduce ANSI store assignment policy for table insertion

cloud-fan commented on a change in pull request #25581: [SPARK-28495][SQL] Introduce ANSI store assignment policy for table insertion URL: https://github.com/apache/spark/pull/25581#discussion_r317942895 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/types/DataTypeW

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #25594: [SPARK-28881][PYTHON][TESTS] Add a test to make sure toPandas with Arrow optimization throws an exception per maxResultSize

dongjoon-hyun commented on a change in pull request #25594: [SPARK-28881][PYTHON][TESTS] Add a test to make sure toPandas with Arrow optimization throws an exception per maxResultSize URL: https://github.com/apache/spark/pull/25594#discussion_r317941239 ## File path: python/pyspark

[GitHub] [spark] HeartSaVioR commented on issue #22138: [SPARK-25151][SS] Apply Apache Commons Pool to KafkaDataConsumer

HeartSaVioR commented on issue #22138: [SPARK-25151][SS] Apply Apache Commons Pool to KafkaDataConsumer URL: https://github.com/apache/spark/pull/22138#issuecomment-525186217 retest this, please This is an automated message f

[GitHub] [spark] HeartSaVioR commented on issue #22138: [SPARK-25151][SS] Apply Apache Commons Pool to KafkaDataConsumer

HeartSaVioR commented on issue #22138: [SPARK-25151][SS] Apply Apache Commons Pool to KafkaDataConsumer URL: https://github.com/apache/spark/pull/22138#issuecomment-525186186 Looks like master branch is kind of "unstable" in terms of CI build now. Retriggering build. -

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #25594: [SPARK-28881][PYTHON][TESTS] Add a test to make sure toPandas with Arrow optimization throws an exception per maxResultSize

dongjoon-hyun commented on a change in pull request #25594: [SPARK-28881][PYTHON][TESTS] Add a test to make sure toPandas with Arrow optimization throws an exception per maxResultSize URL: https://github.com/apache/spark/pull/25594#discussion_r317941239 ## File path: python/pyspark

[GitHub] [spark] SparkQA commented on issue #25584: [SPARK-28876][SQL] fallBackToHdfs should not support Hive partitioned table

SparkQA commented on issue #25584: [SPARK-28876][SQL] fallBackToHdfs should not support Hive partitioned table URL: https://github.com/apache/spark/pull/25584#issuecomment-525185754 **[Test build #109801 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/109801

[GitHub] [spark] SparkQA commented on issue #25594: [SPARK-28881][PYTHON][TESTS] Add a test to make sure toPandas with Arrow optimization throws an exception per maxResultSize

SparkQA commented on issue #25594: [SPARK-28881][PYTHON][TESTS] Add a test to make sure toPandas with Arrow optimization throws an exception per maxResultSize URL: https://github.com/apache/spark/pull/25594#issuecomment-525185690 **[Test build #109800 has started](https://amplab.cs.berkele

[GitHub] [spark] cloud-fan commented on a change in pull request #25581: [SPARK-28495][SQL] Introduce ANSI store assignment policy for table insertion

cloud-fan commented on a change in pull request #25581: [SPARK-28495][SQL] Introduce ANSI store assignment policy for table insertion URL: https://github.com/apache/spark/pull/25581#discussion_r317941017 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/types/DataTypeW

[GitHub] [spark] AmplabJenkins removed a comment on issue #25584: [SPARK-28876][SQL] fallBackToHdfs should not support Hive partitioned table

AmplabJenkins removed a comment on issue #25584: [SPARK-28876][SQL] fallBackToHdfs should not support Hive partitioned table URL: https://github.com/apache/spark/pull/25584#issuecomment-525185004 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25584: [SPARK-28876][SQL] fallBackToHdfs should not support Hive partitioned table

AmplabJenkins removed a comment on issue #25584: [SPARK-28876][SQL] fallBackToHdfs should not support Hive partitioned table URL: https://github.com/apache/spark/pull/25584#issuecomment-525184996 Merged build finished. Test PASSed. --

[GitHub] [spark] AmplabJenkins removed a comment on issue #25594: [SPARK-28881][PYTHON][TESTS] Add a test to make sure toPandas with Arrow optimization throws an exception per maxResultSize

AmplabJenkins removed a comment on issue #25594: [SPARK-28881][PYTHON][TESTS] Add a test to make sure toPandas with Arrow optimization throws an exception per maxResultSize URL: https://github.com/apache/spark/pull/25594#issuecomment-525184887 Test PASSed. Refer to this link for build r

[GitHub] [spark] cloud-fan commented on a change in pull request #25581: [SPARK-28495][SQL] Introduce ANSI store assignment policy for table insertion

cloud-fan commented on a change in pull request #25581: [SPARK-28495][SQL] Introduce ANSI store assignment policy for table insertion URL: https://github.com/apache/spark/pull/25581#discussion_r317941017 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/types/DataTypeW

[GitHub] [spark] AmplabJenkins removed a comment on issue #25594: [SPARK-28881][PYTHON][TESTS] Add a test to make sure toPandas with Arrow optimization throws an exception per maxResultSize

AmplabJenkins removed a comment on issue #25594: [SPARK-28881][PYTHON][TESTS] Add a test to make sure toPandas with Arrow optimization throws an exception per maxResultSize URL: https://github.com/apache/spark/pull/25594#issuecomment-525184876 Merged build finished. Test PASSed. -

[GitHub] [spark] AmplabJenkins commented on issue #25584: [SPARK-28876][SQL] fallBackToHdfs should not support Hive partitioned table

AmplabJenkins commented on issue #25584: [SPARK-28876][SQL] fallBackToHdfs should not support Hive partitioned table URL: https://github.com/apache/spark/pull/25584#issuecomment-525185004 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://

[GitHub] [spark] AmplabJenkins commented on issue #25584: [SPARK-28876][SQL] fallBackToHdfs should not support Hive partitioned table

AmplabJenkins commented on issue #25584: [SPARK-28876][SQL] fallBackToHdfs should not support Hive partitioned table URL: https://github.com/apache/spark/pull/25584#issuecomment-525184996 Merged build finished. Test PASSed. T

[GitHub] [spark] AmplabJenkins commented on issue #25594: [SPARK-28881][PYTHON][TESTS] Add a test to make sure toPandas with Arrow optimization throws an exception per maxResultSize

AmplabJenkins commented on issue #25594: [SPARK-28881][PYTHON][TESTS] Add a test to make sure toPandas with Arrow optimization throws an exception per maxResultSize URL: https://github.com/apache/spark/pull/25594#issuecomment-525184887 Test PASSed. Refer to this link for build results (

[GitHub] [spark] AmplabJenkins commented on issue #25594: [SPARK-28881][PYTHON][TESTS] Add a test to make sure toPandas with Arrow optimization throws an exception per maxResultSize

AmplabJenkins commented on issue #25594: [SPARK-28881][PYTHON][TESTS] Add a test to make sure toPandas with Arrow optimization throws an exception per maxResultSize URL: https://github.com/apache/spark/pull/25594#issuecomment-525184876 Merged build finished. Test PASSed. -

[GitHub] [spark] HyukjinKwon commented on issue #25593: [SPARK-27992][PYTHON][2.4] Allow Python to join with connection thread to propagate errors

HyukjinKwon commented on issue #25593: [SPARK-27992][PYTHON][2.4] Allow Python to join with connection thread to propagate errors URL: https://github.com/apache/spark/pull/25593#issuecomment-525184156 From what I know, this is the last one. Actually, this was reported yesterday .. I am a b

[GitHub] [spark] SparkQA commented on issue #25594: [SPARK-28881][PYTHON][TESTS] Add a test to make sure toPandas with Arrow optimization throws an exception per maxResultSize

SparkQA commented on issue #25594: [SPARK-28881][PYTHON][TESTS] Add a test to make sure toPandas with Arrow optimization throws an exception per maxResultSize URL: https://github.com/apache/spark/pull/25594#issuecomment-525182924 **[Test build #109799 has started](https://amplab.cs.berkele

[GitHub] [spark] AmplabJenkins removed a comment on issue #25594: [SPARK-28881][PYTHON][TESTS] Add a test to make sure toPandas with Arrow optimization throws an exception per maxResultSize

AmplabJenkins removed a comment on issue #25594: [SPARK-28881][PYTHON][TESTS] Add a test to make sure toPandas with Arrow optimization throws an exception per maxResultSize URL: https://github.com/apache/spark/pull/25594#issuecomment-525182114 Merged build finished. Test PASSed. -

[GitHub] [spark] AmplabJenkins removed a comment on issue #25594: [SPARK-28881][PYTHON][TESTS] Add a test to make sure toPandas with Arrow optimization throws an exception per maxResultSize

AmplabJenkins removed a comment on issue #25594: [SPARK-28881][PYTHON][TESTS] Add a test to make sure toPandas with Arrow optimization throws an exception per maxResultSize URL: https://github.com/apache/spark/pull/25594#issuecomment-525182117 Test PASSed. Refer to this link for build r

[GitHub] [spark] AmplabJenkins commented on issue #25594: [SPARK-28881][PYTHON][TESTS] Add a test to make sure toPandas with Arrow optimization throws an exception per maxResultSize

AmplabJenkins commented on issue #25594: [SPARK-28881][PYTHON][TESTS] Add a test to make sure toPandas with Arrow optimization throws an exception per maxResultSize URL: https://github.com/apache/spark/pull/25594#issuecomment-525182117 Test PASSed. Refer to this link for build results (

[GitHub] [spark] AmplabJenkins commented on issue #25594: [SPARK-28881][PYTHON][TESTS] Add a test to make sure toPandas with Arrow optimization throws an exception per maxResultSize

AmplabJenkins commented on issue #25594: [SPARK-28881][PYTHON][TESTS] Add a test to make sure toPandas with Arrow optimization throws an exception per maxResultSize URL: https://github.com/apache/spark/pull/25594#issuecomment-525182114 Merged build finished. Test PASSed. -

[GitHub] [spark] dongjoon-hyun commented on issue #25593: [SPARK-27992][PYTHON][2.4] Allow Python to join with connection thread to propagate errors

dongjoon-hyun commented on issue #25593: [SPARK-27992][PYTHON][2.4] Allow Python to join with connection thread to propagate errors URL: https://github.com/apache/spark/pull/25593#issuecomment-525180662 BTW, is this the last one in Python side, @HyukjinKwon ? Do we have more blockers in Py

[GitHub] [spark] cloud-fan commented on a change in pull request #25570: [SPARK-23519][SQL] create view should work from query with duplicate output columns

cloud-fan commented on a change in pull request #25570: [SPARK-23519][SQL] create view should work from query with duplicate output columns URL: https://github.com/apache/spark/pull/25570#discussion_r317935181 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/com

[GitHub] [spark] SparkQA commented on issue #25465: [SPARK-28747][SQL] merge the two data source v2 fallback configs

SparkQA commented on issue #25465: [SPARK-28747][SQL] merge the two data source v2 fallback configs URL: https://github.com/apache/spark/pull/25465#issuecomment-525180256 **[Test build #109798 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/109798/testReport

[GitHub] [spark] AmplabJenkins removed a comment on issue #25594: [SPARK-28881][PYTHON][TESTS] Add a test to make sure toPandas with Arrow optimization throws an exception per maxResultSize

AmplabJenkins removed a comment on issue #25594: [SPARK-28881][PYTHON][TESTS] Add a test to make sure toPandas with Arrow optimization throws an exception per maxResultSize URL: https://github.com/apache/spark/pull/25594#issuecomment-525179235 Test FAILed. Refer to this link for build r

[GitHub] [spark] SparkQA commented on issue #25520: [SPARK-28621][SQL] Make spark.sql.crossJoin.enabled default value true

SparkQA commented on issue #25520: [SPARK-28621][SQL] Make spark.sql.crossJoin.enabled default value true URL: https://github.com/apache/spark/pull/25520#issuecomment-525180257 **[Test build #109797 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/109797/test

[GitHub] [spark] dongjoon-hyun commented on issue #25594: [SPARK-28881][PYTHON][TESTS] Add a test to make sure toPandas with Arrow optimization throws an exception per maxResultSize

dongjoon-hyun commented on issue #25594: [SPARK-28881][PYTHON][TESTS] Add a test to make sure toPandas with Arrow optimization throws an exception per maxResultSize URL: https://github.com/apache/spark/pull/25594#issuecomment-525180274 Ur, one of the pythons (python2/python3/pypy) seems to

[GitHub] [spark] cloud-fan commented on issue #25470: [SPARK-28751][Core][WIP] Improve java serializer deserialization performance

cloud-fan commented on issue #25470: [SPARK-28751][Core][WIP] Improve java serializer deserialization performance URL: https://github.com/apache/spark/pull/25470#issuecomment-525180226 OK then I think the caching approach makes sense. BTW have you also benchmarked kryo serializer? AFAIK ma

[GitHub] [spark] AmplabJenkins removed a comment on issue #25594: [SPARK-28881][PYTHON][TESTS] Add a test to make sure toPandas with Arrow optimization throws an exception per maxResultSize

AmplabJenkins removed a comment on issue #25594: [SPARK-28881][PYTHON][TESTS] Add a test to make sure toPandas with Arrow optimization throws an exception per maxResultSize URL: https://github.com/apache/spark/pull/25594#issuecomment-525179231 Merged build finished. Test FAILed. -

[GitHub] [spark] AmplabJenkins removed a comment on issue #25520: [SPARK-28621][SQL] Make spark.sql.crossJoin.enabled default value true

AmplabJenkins removed a comment on issue #25520: [SPARK-28621][SQL] Make spark.sql.crossJoin.enabled default value true URL: https://github.com/apache/spark/pull/25520#issuecomment-525179538 Merged build finished. Test PASSed. ---

[GitHub] [spark] SparkQA removed a comment on issue #25594: [SPARK-28881][PYTHON][TESTS] Add a test to make sure toPandas with Arrow optimization throws an exception per maxResultSize

SparkQA removed a comment on issue #25594: [SPARK-28881][PYTHON][TESTS] Add a test to make sure toPandas with Arrow optimization throws an exception per maxResultSize URL: https://github.com/apache/spark/pull/25594#issuecomment-525174836 **[Test build #109794 has started](https://amplab.c

[GitHub] [spark] AmplabJenkins removed a comment on issue #25520: [SPARK-28621][SQL] Make spark.sql.crossJoin.enabled default value true

AmplabJenkins removed a comment on issue #25520: [SPARK-28621][SQL] Make spark.sql.crossJoin.enabled default value true URL: https://github.com/apache/spark/pull/25520#issuecomment-525179544 Test PASSed. Refer to this link for build results (access rights to CI server needed): https

[GitHub] [spark] AmplabJenkins removed a comment on issue #25465: [SPARK-28747][SQL] merge the two data source v2 fallback configs

AmplabJenkins removed a comment on issue #25465: [SPARK-28747][SQL] merge the two data source v2 fallback configs URL: https://github.com/apache/spark/pull/25465#issuecomment-525179499 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins removed a comment on issue #25465: [SPARK-28747][SQL] merge the two data source v2 fallback configs

AmplabJenkins removed a comment on issue #25465: [SPARK-28747][SQL] merge the two data source v2 fallback configs URL: https://github.com/apache/spark/pull/25465#issuecomment-525179514 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amp

[GitHub] [spark] AmplabJenkins commented on issue #25520: [SPARK-28621][SQL] Make spark.sql.crossJoin.enabled default value true

AmplabJenkins commented on issue #25520: [SPARK-28621][SQL] Make spark.sql.crossJoin.enabled default value true URL: https://github.com/apache/spark/pull/25520#issuecomment-525179544 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://ampla

[GitHub] [spark] AmplabJenkins commented on issue #25520: [SPARK-28621][SQL] Make spark.sql.crossJoin.enabled default value true

AmplabJenkins commented on issue #25520: [SPARK-28621][SQL] Make spark.sql.crossJoin.enabled default value true URL: https://github.com/apache/spark/pull/25520#issuecomment-525179538 Merged build finished. Test PASSed. This i

[GitHub] [spark] AmplabJenkins commented on issue #25465: [SPARK-28747][SQL] merge the two data source v2 fallback configs

AmplabJenkins commented on issue #25465: [SPARK-28747][SQL] merge the two data source v2 fallback configs URL: https://github.com/apache/spark/pull/25465#issuecomment-525179499 Merged build finished. Test PASSed. This is an a

[GitHub] [spark] AmplabJenkins commented on issue #25465: [SPARK-28747][SQL] merge the two data source v2 fallback configs

AmplabJenkins commented on issue #25465: [SPARK-28747][SQL] merge the two data source v2 fallback configs URL: https://github.com/apache/spark/pull/25465#issuecomment-525179514 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.b

[GitHub] [spark] AmplabJenkins commented on issue #25594: [SPARK-28881][PYTHON][TESTS] Add a test to make sure toPandas with Arrow optimization throws an exception per maxResultSize

AmplabJenkins commented on issue #25594: [SPARK-28881][PYTHON][TESTS] Add a test to make sure toPandas with Arrow optimization throws an exception per maxResultSize URL: https://github.com/apache/spark/pull/25594#issuecomment-525179235 Test FAILed. Refer to this link for build results (

[GitHub] [spark] SparkQA commented on issue #25594: [SPARK-28881][PYTHON][TESTS] Add a test to make sure toPandas with Arrow optimization throws an exception per maxResultSize

SparkQA commented on issue #25594: [SPARK-28881][PYTHON][TESTS] Add a test to make sure toPandas with Arrow optimization throws an exception per maxResultSize URL: https://github.com/apache/spark/pull/25594#issuecomment-525179146 **[Test build #109794 has finished](https://amplab.cs.berkel

[GitHub] [spark] AmplabJenkins commented on issue #25594: [SPARK-28881][PYTHON][TESTS] Add a test to make sure toPandas with Arrow optimization throws an exception per maxResultSize

AmplabJenkins commented on issue #25594: [SPARK-28881][PYTHON][TESTS] Add a test to make sure toPandas with Arrow optimization throws an exception per maxResultSize URL: https://github.com/apache/spark/pull/25594#issuecomment-525179231 Merged build finished. Test FAILed. -

[GitHub] [spark] cloud-fan commented on issue #25520: [SPARK-28621][SQL] Make spark.sql.crossJoin.enabled default value true

cloud-fan commented on issue #25520: [SPARK-28621][SQL] Make spark.sql.crossJoin.enabled default value true URL: https://github.com/apache/spark/pull/25520#issuecomment-525178901 retest this please This is an automated messag

[GitHub] [spark] cloud-fan commented on a change in pull request #25584: [SPARK-28876][SQL] fallBackToHdfs should not support Hive partitioned table

cloud-fan commented on a change in pull request #25584: [SPARK-28876][SQL] fallBackToHdfs should not support Hive partitioned table URL: https://github.com/apache/spark/pull/25584#discussion_r317932180 ## File path: sql/hive/src/test/scala/org/apache/spark/sql/hive/StatisticsSuite.

[GitHub] [spark] cloud-fan commented on issue #25465: [SPARK-28747][SQL] merge the two data source v2 fallback configs

cloud-fan commented on issue #25465: [SPARK-28747][SQL] merge the two data source v2 fallback configs URL: https://github.com/apache/spark/pull/25465#issuecomment-525177530 retest this please This is an automated message from

[GitHub] [spark] AmplabJenkins removed a comment on issue #25525: [SPARK-28786][DOC][SQL]Document INSERT statement in SQL Reference

AmplabJenkins removed a comment on issue #25525: [SPARK-28786][DOC][SQL]Document INSERT statement in SQL Reference URL: https://github.com/apache/spark/pull/25525#issuecomment-525176071 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amp

[GitHub] [spark] SparkQA removed a comment on issue #25525: [SPARK-28786][DOC][SQL]Document INSERT statement in SQL Reference

SparkQA removed a comment on issue #25525: [SPARK-28786][DOC][SQL]Document INSERT statement in SQL Reference URL: https://github.com/apache/spark/pull/25525#issuecomment-525172234 **[Test build #109792 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/109792/t

[GitHub] [spark] AmplabJenkins removed a comment on issue #25525: [SPARK-28786][DOC][SQL]Document INSERT statement in SQL Reference

AmplabJenkins removed a comment on issue #25525: [SPARK-28786][DOC][SQL]Document INSERT statement in SQL Reference URL: https://github.com/apache/spark/pull/25525#issuecomment-525176068 Merged build finished. Test PASSed. Thi

[GitHub] [spark] AmplabJenkins commented on issue #25525: [SPARK-28786][DOC][SQL]Document INSERT statement in SQL Reference

AmplabJenkins commented on issue #25525: [SPARK-28786][DOC][SQL]Document INSERT statement in SQL Reference URL: https://github.com/apache/spark/pull/25525#issuecomment-525176071 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.b

[GitHub] [spark] AmplabJenkins commented on issue #25525: [SPARK-28786][DOC][SQL]Document INSERT statement in SQL Reference

AmplabJenkins commented on issue #25525: [SPARK-28786][DOC][SQL]Document INSERT statement in SQL Reference URL: https://github.com/apache/spark/pull/25525#issuecomment-525176068 Merged build finished. Test PASSed. This is an

[GitHub] [spark] SparkQA commented on issue #25525: [SPARK-28786][DOC][SQL]Document INSERT statement in SQL Reference

SparkQA commented on issue #25525: [SPARK-28786][DOC][SQL]Document INSERT statement in SQL Reference URL: https://github.com/apache/spark/pull/25525#issuecomment-525175964 **[Test build #109792 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/109792/testRepo

[GitHub] [spark] huaxingao edited a comment on issue #25525: [SPARK-28786][DOC][SQL]Document INSERT statement in SQL Reference

huaxingao edited a comment on issue #25525: [SPARK-28786][DOC][SQL]Document INSERT statement in SQL Reference URL: https://github.com/apache/spark/pull/25525#issuecomment-525171979 ![image](https://user-images.githubusercontent.com/13592258/63749043-6e54a480-c85f-11e9-9257-d67c8acae956.png

[GitHub] [spark] SparkQA commented on issue #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command

SparkQA commented on issue #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command URL: https://github.com/apache/spark/pull/24903#issuecomment-525174877 **[Test build #109796 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPul

[GitHub] [spark] AmplabJenkins removed a comment on issue #25594: [SPARK-28881][PYTHON][TESTS] Add a test to make sure toPandas with Arrow optimization throws an exception per maxResultSize

AmplabJenkins removed a comment on issue #25594: [SPARK-28881][PYTHON][TESTS] Add a test to make sure toPandas with Arrow optimization throws an exception per maxResultSize URL: https://github.com/apache/spark/pull/25594#issuecomment-525174182 Test PASSed. Refer to this link for build r

[GitHub] [spark] SparkQA commented on issue #25594: [SPARK-28881][PYTHON][TESTS] Add a test to make sure toPandas with Arrow optimization throws an exception per maxResultSize

SparkQA commented on issue #25594: [SPARK-28881][PYTHON][TESTS] Add a test to make sure toPandas with Arrow optimization throws an exception per maxResultSize URL: https://github.com/apache/spark/pull/25594#issuecomment-525174836 **[Test build #109794 has started](https://amplab.cs.berkele

[GitHub] [spark] AmplabJenkins removed a comment on issue #25594: [SPARK-28881][PYTHON][TESTS] Add a test to make sure toPandas with Arrow optimization throws an exception per maxResultSize

AmplabJenkins removed a comment on issue #25594: [SPARK-28881][PYTHON][TESTS] Add a test to make sure toPandas with Arrow optimization throws an exception per maxResultSize URL: https://github.com/apache/spark/pull/25594#issuecomment-525174173 Merged build finished. Test PASSed. -

[GitHub] [spark] SparkQA commented on issue #25593: [SPARK-27992][PYTHON][2.4] Allow Python to join with connection thread to propagate errors

SparkQA commented on issue #25593: [SPARK-27992][PYTHON][2.4] Allow Python to join with connection thread to propagate errors URL: https://github.com/apache/spark/pull/25593#issuecomment-525174855 **[Test build #109795 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullReques

[GitHub] [spark] AmplabJenkins removed a comment on issue #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command

AmplabJenkins removed a comment on issue #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command URL: https://github.com/apache/spark/pull/24903#issuecomment-525174202 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins removed a comment on issue #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command

AmplabJenkins removed a comment on issue #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command URL: https://github.com/apache/spark/pull/24903#issuecomment-525174198 Merged build finished. Test PASSed.

<    4   5   6   7   8   9   10   11   >