[GitHub] [spark] d80tb7 commented on a change in pull request #24981: [SPARK-27463][PYTHON] Support Dataframe Cogroup via Pandas UDFs

d80tb7 commented on a change in pull request #24981: [SPARK-27463][PYTHON] Support Dataframe Cogroup via Pandas UDFs URL: https://github.com/apache/spark/pull/24981#discussion_r315752866 ## File path: python/pyspark/worker.py ## @@ -359,10 +417,24 @@ def map_batch(batch):

[GitHub] [spark] d80tb7 commented on a change in pull request #24981: [SPARK-27463][PYTHON] Support Dataframe Cogroup via Pandas UDFs

d80tb7 commented on a change in pull request #24981: [SPARK-27463][PYTHON] Support Dataframe Cogroup via Pandas UDFs URL: https://github.com/apache/spark/pull/24981#discussion_r315750156 ## File path: python/pyspark/serializers.py ## @@ -401,6 +427,22 @@ def

[GitHub] [spark] joshrosen-stripe commented on a change in pull request #25503: [SPARK-28702][SQL] Display useful error message (instead of NPE) for invalid Dataset operations

joshrosen-stripe commented on a change in pull request #25503: [SPARK-28702][SQL] Display useful error message (instead of NPE) for invalid Dataset operations URL: https://github.com/apache/spark/pull/25503#discussion_r315749862 ## File path:

[GitHub] [spark] cloud-fan commented on a change in pull request #25465: [SPARK-28747][SQL] merge the two data source v2 fallback configs

cloud-fan commented on a change in pull request #25465: [SPARK-28747][SQL] merge the two data source v2 fallback configs URL: https://github.com/apache/spark/pull/25465#discussion_r315744878 ## File path:

[GitHub] [spark] gengliangwang commented on a change in pull request #25461: [SPARK-28741][SQL]Throw exceptions when casting to integers causes overflow

gengliangwang commented on a change in pull request #25461: [SPARK-28741][SQL]Throw exceptions when casting to integers causes overflow URL: https://github.com/apache/spark/pull/25461#discussion_r315743000 ## File path:

[GitHub] [spark] gengliangwang commented on a change in pull request #25461: [SPARK-28741][SQL]Throw exceptions when casting to integers causes overflow

gengliangwang commented on a change in pull request #25461: [SPARK-28741][SQL]Throw exceptions when casting to integers causes overflow URL: https://github.com/apache/spark/pull/25461#discussion_r315743000 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #25491: [SPARK-28699][SQL] Disable using radix sort for ShuffleExchangeExec in repartition case

AmplabJenkins removed a comment on issue #25491: [SPARK-28699][SQL] Disable using radix sort for ShuffleExchangeExec in repartition case URL: https://github.com/apache/spark/pull/25491#issuecomment-523053857 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25491: [SPARK-28699][SQL] Disable using radix sort for ShuffleExchangeExec in repartition case

AmplabJenkins removed a comment on issue #25491: [SPARK-28699][SQL] Disable using radix sort for ShuffleExchangeExec in repartition case URL: https://github.com/apache/spark/pull/25491#issuecomment-523053870 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #25491: [SPARK-28699][SQL] Disable using radix sort for ShuffleExchangeExec in repartition case

AmplabJenkins commented on issue #25491: [SPARK-28699][SQL] Disable using radix sort for ShuffleExchangeExec in repartition case URL: https://github.com/apache/spark/pull/25491#issuecomment-523053857 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25491: [SPARK-28699][SQL] Disable using radix sort for ShuffleExchangeExec in repartition case

AmplabJenkins commented on issue #25491: [SPARK-28699][SQL] Disable using radix sort for ShuffleExchangeExec in repartition case URL: https://github.com/apache/spark/pull/25491#issuecomment-523053870 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #25491: [SPARK-28699][SQL] Disable using radix sort for ShuffleExchangeExec in repartition case

SparkQA removed a comment on issue #25491: [SPARK-28699][SQL] Disable using radix sort for ShuffleExchangeExec in repartition case URL: https://github.com/apache/spark/pull/25491#issuecomment-522969004 **[Test build #109405 has

[GitHub] [spark] SparkQA commented on issue #25491: [SPARK-28699][SQL] Disable using radix sort for ShuffleExchangeExec in repartition case

SparkQA commented on issue #25491: [SPARK-28699][SQL] Disable using radix sort for ShuffleExchangeExec in repartition case URL: https://github.com/apache/spark/pull/25491#issuecomment-523052888 **[Test build #109405 has

[GitHub] [spark] SparkQA commented on issue #25513: [MINOR] [DOC] Fix Dockerfile path reference

SparkQA commented on issue #25513: [MINOR] [DOC] Fix Dockerfile path reference URL: https://github.com/apache/spark/pull/25513#issuecomment-523045716 **[Test build #4838 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4838/testReport)** for PR 25513 at

[GitHub] [spark] SparkQA removed a comment on issue #25513: [MINOR] [DOC] Fix Dockerfile path reference

SparkQA removed a comment on issue #25513: [MINOR] [DOC] Fix Dockerfile path reference URL: https://github.com/apache/spark/pull/25513#issuecomment-523040303 **[Test build #4838 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4838/testReport)** for PR

[GitHub] [spark] AmplabJenkins removed a comment on issue #25513: [MINOR] [DOC] Fix Dockerfile path reference

AmplabJenkins removed a comment on issue #25513: [MINOR] [DOC] Fix Dockerfile path reference URL: https://github.com/apache/spark/pull/25513#issuecomment-523004032 Can one of the admins verify this patch? This is an

[GitHub] [spark] SparkQA commented on issue #25513: [MINOR] [DOC] Fix Dockerfile path reference

SparkQA commented on issue #25513: [MINOR] [DOC] Fix Dockerfile path reference URL: https://github.com/apache/spark/pull/25513#issuecomment-523040303 **[Test build #4838 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4838/testReport)** for PR 25513 at

[GitHub] [spark] AmplabJenkins removed a comment on issue #25505: [SPARK-28776][ML] SparkML Writer gets hadoop conf from session state

AmplabJenkins removed a comment on issue #25505: [SPARK-28776][ML] SparkML Writer gets hadoop conf from session state URL: https://github.com/apache/spark/pull/25505#issuecomment-522769932 Can one of the admins verify this patch?

[GitHub] [spark] SparkQA commented on issue #25505: [SPARK-28776][ML] SparkML Writer gets hadoop conf from session state

SparkQA commented on issue #25505: [SPARK-28776][ML] SparkML Writer gets hadoop conf from session state URL: https://github.com/apache/spark/pull/25505#issuecomment-523039575 **[Test build #4837 has

[GitHub] [spark] AmplabJenkins commented on issue #25499: [SPARK-28774] [SQL] Fix exchange reuse for columnar data

AmplabJenkins commented on issue #25499: [SPARK-28774] [SQL] Fix exchange reuse for columnar data URL: https://github.com/apache/spark/pull/25499#issuecomment-523037527 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #25499: [SPARK-28774] [SQL] Fix exchange reuse for columnar data

AmplabJenkins removed a comment on issue #25499: [SPARK-28774] [SQL] Fix exchange reuse for columnar data URL: https://github.com/apache/spark/pull/25499#issuecomment-523037551 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25499: [SPARK-28774] [SQL] Fix exchange reuse for columnar data

AmplabJenkins commented on issue #25499: [SPARK-28774] [SQL] Fix exchange reuse for columnar data URL: https://github.com/apache/spark/pull/25499#issuecomment-523037551 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25499: [SPARK-28774] [SQL] Fix exchange reuse for columnar data

AmplabJenkins removed a comment on issue #25499: [SPARK-28774] [SQL] Fix exchange reuse for columnar data URL: https://github.com/apache/spark/pull/25499#issuecomment-523037527 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #25499: [SPARK-28774] [SQL] Fix exchange reuse for columnar data

AmplabJenkins removed a comment on issue #25499: [SPARK-28774] [SQL] Fix exchange reuse for columnar data URL: https://github.com/apache/spark/pull/25499#issuecomment-523035942 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #25499: [SPARK-28774] [SQL] Fix exchange reuse for columnar data

SparkQA removed a comment on issue #25499: [SPARK-28774] [SQL] Fix exchange reuse for columnar data URL: https://github.com/apache/spark/pull/25499#issuecomment-523034986 **[Test build #109416 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #25499: [SPARK-28774] [SQL] Fix exchange reuse for columnar data

AmplabJenkins removed a comment on issue #25499: [SPARK-28774] [SQL] Fix exchange reuse for columnar data URL: https://github.com/apache/spark/pull/25499#issuecomment-523035935 Merged build finished. Test FAILed. This is an

[GitHub] [spark] SparkQA commented on issue #25499: [SPARK-28774] [SQL] Fix exchange reuse for columnar data

SparkQA commented on issue #25499: [SPARK-28774] [SQL] Fix exchange reuse for columnar data URL: https://github.com/apache/spark/pull/25499#issuecomment-523035918 **[Test build #109416 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/109416/testReport)**

[GitHub] [spark] AmplabJenkins commented on issue #25499: [SPARK-28774] [SQL] Fix exchange reuse for columnar data

AmplabJenkins commented on issue #25499: [SPARK-28774] [SQL] Fix exchange reuse for columnar data URL: https://github.com/apache/spark/pull/25499#issuecomment-523035942 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25499: [SPARK-28774] [SQL] Fix exchange reuse for columnar data

AmplabJenkins commented on issue #25499: [SPARK-28774] [SQL] Fix exchange reuse for columnar data URL: https://github.com/apache/spark/pull/25499#issuecomment-523035935 Merged build finished. Test FAILed. This is an

[GitHub] [spark] SparkQA commented on issue #25499: [SPARK-28774] [SQL] Fix exchange reuse for columnar data

SparkQA commented on issue #25499: [SPARK-28774] [SQL] Fix exchange reuse for columnar data URL: https://github.com/apache/spark/pull/25499#issuecomment-523034986 **[Test build #109416 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/109416/testReport)**

[GitHub] [spark] srowen commented on a change in pull request #25383: [SPARK-13677][ML] Implement Tree-Based Feature Transformation for ML

srowen commented on a change in pull request #25383: [SPARK-13677][ML] Implement Tree-Based Feature Transformation for ML URL: https://github.com/apache/spark/pull/25383#discussion_r315708128 ## File path:

[GitHub] [spark] srowen commented on a change in pull request #25383: [SPARK-13677][ML] Implement Tree-Based Feature Transformation for ML

srowen commented on a change in pull request #25383: [SPARK-13677][ML] Implement Tree-Based Feature Transformation for ML URL: https://github.com/apache/spark/pull/25383#discussion_r315709454 ## File path: mllib/src/main/scala/org/apache/spark/ml/tree/treeModels.scala ##

[GitHub] [spark] srowen commented on a change in pull request #25383: [SPARK-13677][ML] Implement Tree-Based Feature Transformation for ML

srowen commented on a change in pull request #25383: [SPARK-13677][ML] Implement Tree-Based Feature Transformation for ML URL: https://github.com/apache/spark/pull/25383#discussion_r315707751 ## File path:

[GitHub] [spark] srowen commented on a change in pull request #25383: [SPARK-13677][ML] Implement Tree-Based Feature Transformation for ML

srowen commented on a change in pull request #25383: [SPARK-13677][ML] Implement Tree-Based Feature Transformation for ML URL: https://github.com/apache/spark/pull/25383#discussion_r315710356 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation

AmplabJenkins removed a comment on issue #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation URL: https://github.com/apache/spark/pull/24715#issuecomment-523030586 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] SparkQA commented on issue #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation

SparkQA commented on issue #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation URL: https://github.com/apache/spark/pull/24715#issuecomment-523031483 **[Test build #109415 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation

AmplabJenkins removed a comment on issue #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation URL: https://github.com/apache/spark/pull/24715#issuecomment-523030574 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation

AmplabJenkins commented on issue #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation URL: https://github.com/apache/spark/pull/24715#issuecomment-523030586 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation

AmplabJenkins commented on issue #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation URL: https://github.com/apache/spark/pull/24715#issuecomment-523030574 Merged build finished. Test PASSed.

[GitHub] [spark] wangyum commented on issue #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation

wangyum commented on issue #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation URL: https://github.com/apache/spark/pull/24715#issuecomment-523029568 @cloud-fan I added a test for external partitioned table:

[GitHub] [spark] AmplabJenkins removed a comment on issue #25499: [SPARK-28774] [SQL] Fix exchange reuse for columnar data

AmplabJenkins removed a comment on issue #25499: [SPARK-28774] [SQL] Fix exchange reuse for columnar data URL: https://github.com/apache/spark/pull/25499#issuecomment-523028915 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25512: [WIP][SPARK-28782][SQL] Support explode function on aggregate expressions

AmplabJenkins removed a comment on issue #25512: [WIP][SPARK-28782][SQL] Support explode function on aggregate expressions URL: https://github.com/apache/spark/pull/25512#issuecomment-523028370 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25499: [SPARK-28774] [SQL] Fix exchange reuse for columnar data

AmplabJenkins removed a comment on issue #25499: [SPARK-28774] [SQL] Fix exchange reuse for columnar data URL: https://github.com/apache/spark/pull/25499#issuecomment-523028877 Merged build finished. Test FAILed. This is an

[GitHub] [spark] srowen commented on a change in pull request #25439: [SPARK-28709][DSTREAMS] - Fix StreamingContext leak through Streaming…

srowen commented on a change in pull request #25439: [SPARK-28709][DSTREAMS] - Fix StreamingContext leak through Streaming… URL: https://github.com/apache/spark/pull/25439#discussion_r315706056 ## File path:

[GitHub] [spark] AmplabJenkins commented on issue #25499: [SPARK-28774] [SQL] Fix exchange reuse for columnar data

AmplabJenkins commented on issue #25499: [SPARK-28774] [SQL] Fix exchange reuse for columnar data URL: https://github.com/apache/spark/pull/25499#issuecomment-523028877 Merged build finished. Test FAILed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #25499: [SPARK-28774] [SQL] Fix exchange reuse for columnar data

AmplabJenkins commented on issue #25499: [SPARK-28774] [SQL] Fix exchange reuse for columnar data URL: https://github.com/apache/spark/pull/25499#issuecomment-523028915 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #25512: [WIP][SPARK-28782][SQL] Support explode function on aggregate expressions

SparkQA removed a comment on issue #25512: [WIP][SPARK-28782][SQL] Support explode function on aggregate expressions URL: https://github.com/apache/spark/pull/25512#issuecomment-522995123 **[Test build #109408 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #25512: [WIP][SPARK-28782][SQL] Support explode function on aggregate expressions

AmplabJenkins removed a comment on issue #25512: [WIP][SPARK-28782][SQL] Support explode function on aggregate expressions URL: https://github.com/apache/spark/pull/25512#issuecomment-523028355 Merged build finished. Test FAILed.

[GitHub] [spark] SparkQA commented on issue #25499: [SPARK-28774] [SQL] Fix exchange reuse for columnar data

SparkQA commented on issue #25499: [SPARK-28774] [SQL] Fix exchange reuse for columnar data URL: https://github.com/apache/spark/pull/25499#issuecomment-523028859 **[Test build #109414 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/109414/testReport)**

[GitHub] [spark] SparkQA removed a comment on issue #25499: [SPARK-28774] [SQL] Fix exchange reuse for columnar data

SparkQA removed a comment on issue #25499: [SPARK-28774] [SQL] Fix exchange reuse for columnar data URL: https://github.com/apache/spark/pull/25499#issuecomment-523027928 **[Test build #109414 has

[GitHub] [spark] srowen commented on a change in pull request #25439: [SPARK-28709][DSTREAMS] - Fix StreamingContext leak through Streaming…

srowen commented on a change in pull request #25439: [SPARK-28709][DSTREAMS] - Fix StreamingContext leak through Streaming… URL: https://github.com/apache/spark/pull/25439#discussion_r315706444 ## File path: streaming/src/main/scala/org/apache/spark/streaming/ui/StreamingTab.scala

[GitHub] [spark] AmplabJenkins commented on issue #25512: [WIP][SPARK-28782][SQL] Support explode function on aggregate expressions

AmplabJenkins commented on issue #25512: [WIP][SPARK-28782][SQL] Support explode function on aggregate expressions URL: https://github.com/apache/spark/pull/25512#issuecomment-523028355 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins commented on issue #25512: [WIP][SPARK-28782][SQL] Support explode function on aggregate expressions

AmplabJenkins commented on issue #25512: [WIP][SPARK-28782][SQL] Support explode function on aggregate expressions URL: https://github.com/apache/spark/pull/25512#issuecomment-523028370 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #25512: [WIP][SPARK-28782][SQL] Support explode function on aggregate expressions

SparkQA commented on issue #25512: [WIP][SPARK-28782][SQL] Support explode function on aggregate expressions URL: https://github.com/apache/spark/pull/25512#issuecomment-523028097 **[Test build #109408 has

[GitHub] [spark] SparkQA commented on issue #25499: [SPARK-28774] [SQL] Fix exchange reuse for columnar data

SparkQA commented on issue #25499: [SPARK-28774] [SQL] Fix exchange reuse for columnar data URL: https://github.com/apache/spark/pull/25499#issuecomment-523027928 **[Test build #109414 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/109414/testReport)**

[GitHub] [spark] revans2 commented on issue #25499: [SPARK-28774] [SQL] Fix exchange reuse for columnar data

revans2 commented on issue #25499: [SPARK-28774] [SQL] Fix exchange reuse for columnar data URL: https://github.com/apache/spark/pull/25499#issuecomment-523026985 @kiszk @cloud-fan @HyukjinKwon I added in a simple unit test that fails without the changes and passes with them. I didn't go

[GitHub] [spark] AmplabJenkins removed a comment on issue #25499: [SPARK-28774] [SQL] Fix exchange reuse for columnar data

AmplabJenkins removed a comment on issue #25499: [SPARK-28774] [SQL] Fix exchange reuse for columnar data URL: https://github.com/apache/spark/pull/25499#issuecomment-523026914 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #25499: [SPARK-28774] [SQL] Fix exchange reuse for columnar data

AmplabJenkins removed a comment on issue #25499: [SPARK-28774] [SQL] Fix exchange reuse for columnar data URL: https://github.com/apache/spark/pull/25499#issuecomment-523026928 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25499: [SPARK-28774] [SQL] Fix exchange reuse for columnar data

AmplabJenkins commented on issue #25499: [SPARK-28774] [SQL] Fix exchange reuse for columnar data URL: https://github.com/apache/spark/pull/25499#issuecomment-523026928 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25499: [SPARK-28774] [SQL] Fix exchange reuse for columnar data

AmplabJenkins commented on issue #25499: [SPARK-28774] [SQL] Fix exchange reuse for columnar data URL: https://github.com/apache/spark/pull/25499#issuecomment-523026914 Merged build finished. Test PASSed. This is an

[GitHub] [spark] gengliangwang commented on a change in pull request #25465: [SPARK-28747][SQL] merge the two data source v2 fallback configs

gengliangwang commented on a change in pull request #25465: [SPARK-28747][SQL] merge the two data source v2 fallback configs URL: https://github.com/apache/spark/pull/25465#discussion_r315682070 ## File path: sql/core/src/main/scala/org/apache/spark/sql/DataFrameWriter.scala

[GitHub] [spark] gengliangwang commented on a change in pull request #25465: [SPARK-28747][SQL] merge the two data source v2 fallback configs

gengliangwang commented on a change in pull request #25465: [SPARK-28747][SQL] merge the two data source v2 fallback configs URL: https://github.com/apache/spark/pull/25465#discussion_r315698408 ## File path:

[GitHub] [spark] gengliangwang commented on a change in pull request #25465: [SPARK-28747][SQL] merge the two data source v2 fallback configs

gengliangwang commented on a change in pull request #25465: [SPARK-28747][SQL] merge the two data source v2 fallback configs URL: https://github.com/apache/spark/pull/25465#discussion_r315694264 ## File path:

[GitHub] [spark] gengliangwang commented on a change in pull request #25465: [SPARK-28747][SQL] merge the two data source v2 fallback configs

gengliangwang commented on a change in pull request #25465: [SPARK-28747][SQL] merge the two data source v2 fallback configs URL: https://github.com/apache/spark/pull/25465#discussion_r315685899 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation

AmplabJenkins removed a comment on issue #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation URL: https://github.com/apache/spark/pull/24715#issuecomment-523013286 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation

AmplabJenkins removed a comment on issue #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation URL: https://github.com/apache/spark/pull/24715#issuecomment-523013295 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation

AmplabJenkins commented on issue #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation URL: https://github.com/apache/spark/pull/24715#issuecomment-523013295 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation

AmplabJenkins commented on issue #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation URL: https://github.com/apache/spark/pull/24715#issuecomment-523013286 Merged build finished. Test PASSed.

[GitHub] [spark] wangyum commented on a change in pull request #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation

wangyum commented on a change in pull request #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation URL: https://github.com/apache/spark/pull/24715#discussion_r315685206 ## File path:

[GitHub] [spark] cloud-fan commented on issue #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation

cloud-fan commented on issue #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation URL: https://github.com/apache/spark/pull/24715#issuecomment-523010988 Does anyone has an answer for https://github.com/apache/spark/pull/24715#issuecomment-522414331 ?

[GitHub] [spark] cloud-fan edited a comment on issue #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation

cloud-fan edited a comment on issue #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation URL: https://github.com/apache/spark/pull/24715#issuecomment-523010988 Does anyone have an answer for

[GitHub] [spark] SparkQA commented on issue #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation

SparkQA commented on issue #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation URL: https://github.com/apache/spark/pull/24715#issuecomment-523010743 **[Test build #109413 has

[GitHub] [spark] helenyugithub commented on issue #25505: [SPARK-28776][ML] SparkML Writer gets hadoop conf from session state

helenyugithub commented on issue #25505: [SPARK-28776][ML] SparkML Writer gets hadoop conf from session state URL: https://github.com/apache/spark/pull/25505#issuecomment-523007466 Hi @srowen I believe the general convention is to use the session state's hadoop conf (see

[GitHub] [spark] tgravescs commented on issue #25491: [SPARK-28699][SQL] Disable using radix sort for ShuffleExchangeExec in repartition case

tgravescs commented on issue #25491: [SPARK-28699][SQL] Disable using radix sort for ShuffleExchangeExec in repartition case URL: https://github.com/apache/spark/pull/25491#issuecomment-523007056 I'm ok either way, I guess it comes down to the performance implications, which is why I

[GitHub] [spark] AmplabJenkins commented on issue #25465: [SPARK-28747][SQL] merge the two data source v2 fallback configs

AmplabJenkins commented on issue #25465: [SPARK-28747][SQL] merge the two data source v2 fallback configs URL: https://github.com/apache/spark/pull/25465#issuecomment-523006533 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #25465: [SPARK-28747][SQL] merge the two data source v2 fallback configs

AmplabJenkins removed a comment on issue #25465: [SPARK-28747][SQL] merge the two data source v2 fallback configs URL: https://github.com/apache/spark/pull/25465#issuecomment-523006533 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25465: [SPARK-28747][SQL] merge the two data source v2 fallback configs

AmplabJenkins removed a comment on issue #25465: [SPARK-28747][SQL] merge the two data source v2 fallback configs URL: https://github.com/apache/spark/pull/25465#issuecomment-523006543 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25465: [SPARK-28747][SQL] merge the two data source v2 fallback configs

AmplabJenkins commented on issue #25465: [SPARK-28747][SQL] merge the two data source v2 fallback configs URL: https://github.com/apache/spark/pull/25465#issuecomment-523006543 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25453: [SPARK-28730][SQL] Configurable type coercion policy for table insertion

AmplabJenkins removed a comment on issue #25453: [SPARK-28730][SQL] Configurable type coercion policy for table insertion URL: https://github.com/apache/spark/pull/25453#issuecomment-523003300 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25453: [SPARK-28730][SQL] Configurable type coercion policy for table insertion

AmplabJenkins removed a comment on issue #25453: [SPARK-28730][SQL] Configurable type coercion policy for table insertion URL: https://github.com/apache/spark/pull/25453#issuecomment-523003307 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25136: [SPARK-28322][SQL] Add support to Decimal type for integral divide

AmplabJenkins removed a comment on issue #25136: [SPARK-28322][SQL] Add support to Decimal type for integral divide URL: https://github.com/apache/spark/pull/25136#issuecomment-523003402 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25136: [SPARK-28322][SQL] Add support to Decimal type for integral divide

AmplabJenkins removed a comment on issue #25136: [SPARK-28322][SQL] Add support to Decimal type for integral divide URL: https://github.com/apache/spark/pull/25136#issuecomment-523003407 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25513: [MINOR] [DOC] Fix Dockerfile path reference

AmplabJenkins removed a comment on issue #25513: [MINOR] [DOC] Fix Dockerfile path reference URL: https://github.com/apache/spark/pull/25513#issuecomment-523003146 Can one of the admins verify this patch? This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #25513: [MINOR] [DOC] Fix Dockerfile path reference

AmplabJenkins removed a comment on issue #25513: [MINOR] [DOC] Fix Dockerfile path reference URL: https://github.com/apache/spark/pull/25513#issuecomment-523002828 Can one of the admins verify this patch? This is an

[GitHub] [spark] SparkQA commented on issue #25465: [SPARK-28747][SQL] merge the two data source v2 fallback configs

SparkQA commented on issue #25465: [SPARK-28747][SQL] merge the two data source v2 fallback configs URL: https://github.com/apache/spark/pull/25465#issuecomment-523004203 **[Test build #109412 has

[GitHub] [spark] AmplabJenkins commented on issue #25513: [MINOR] [DOC] Fix Dockerfile path reference

AmplabJenkins commented on issue #25513: [MINOR] [DOC] Fix Dockerfile path reference URL: https://github.com/apache/spark/pull/25513#issuecomment-523004032 Can one of the admins verify this patch? This is an automated

[GitHub] [spark] AmplabJenkins commented on issue #25136: [SPARK-28322][SQL] Add support to Decimal type for integral divide

AmplabJenkins commented on issue #25136: [SPARK-28322][SQL] Add support to Decimal type for integral divide URL: https://github.com/apache/spark/pull/25136#issuecomment-523003407 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25136: [SPARK-28322][SQL] Add support to Decimal type for integral divide

AmplabJenkins commented on issue #25136: [SPARK-28322][SQL] Add support to Decimal type for integral divide URL: https://github.com/apache/spark/pull/25136#issuecomment-523003402 Merged build finished. Test PASSed. This is

[GitHub] [spark] AmplabJenkins commented on issue #25513: [MINOR] [DOC] Fix Dockerfile path reference

AmplabJenkins commented on issue #25513: [MINOR] [DOC] Fix Dockerfile path reference URL: https://github.com/apache/spark/pull/25513#issuecomment-523003146 Can one of the admins verify this patch? This is an automated

[GitHub] [spark] AmplabJenkins commented on issue #25453: [SPARK-28730][SQL] Configurable type coercion policy for table insertion

AmplabJenkins commented on issue #25453: [SPARK-28730][SQL] Configurable type coercion policy for table insertion URL: https://github.com/apache/spark/pull/25453#issuecomment-523003300 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25453: [SPARK-28730][SQL] Configurable type coercion policy for table insertion

AmplabJenkins commented on issue #25453: [SPARK-28730][SQL] Configurable type coercion policy for table insertion URL: https://github.com/apache/spark/pull/25453#issuecomment-523003307 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25513: [MINOR] [DOC] Fix Dockerfile path reference

AmplabJenkins commented on issue #25513: [MINOR] [DOC] Fix Dockerfile path reference URL: https://github.com/apache/spark/pull/25513#issuecomment-523002828 Can one of the admins verify this patch? This is an automated

[GitHub] [spark] dlstadther opened a new pull request #25513: [MINOR] [DOC] Fix Dockerfile path reference

dlstadther opened a new pull request #25513: [MINOR] [DOC] Fix Dockerfile path reference URL: https://github.com/apache/spark/pull/25513 ### What changes were proposed in this pull request? Fixes the referenced file path for building Python/R binding docker files.

[GitHub] [spark] gengliangwang commented on a change in pull request #25453: [SPARK-28730][SQL] Configurable type coercion policy for table insertion

gengliangwang commented on a change in pull request #25453: [SPARK-28730][SQL] Configurable type coercion policy for table insertion URL: https://github.com/apache/spark/pull/25453#discussion_r315673294 ## File path:

[GitHub] [spark] SparkQA commented on issue #25453: [SPARK-28730][SQL] Configurable type coercion policy for table insertion

SparkQA commented on issue #25453: [SPARK-28730][SQL] Configurable type coercion policy for table insertion URL: https://github.com/apache/spark/pull/25453#issuecomment-523001087 **[Test build #109410 has

[GitHub] [spark] SparkQA commented on issue #25136: [SPARK-28322][SQL] Add support to Decimal type for integral divide

SparkQA commented on issue #25136: [SPARK-28322][SQL] Add support to Decimal type for integral divide URL: https://github.com/apache/spark/pull/25136#issuecomment-523001086 **[Test build #109411 has

[GitHub] [spark] AmplabJenkins commented on issue #25512: [WIP][SPARK-28782][SQL] Support explode function on aggregate expressions

AmplabJenkins commented on issue #25512: [WIP][SPARK-28782][SQL] Support explode function on aggregate expressions URL: https://github.com/apache/spark/pull/25512#issuecomment-522997115 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25512: [WIP][SPARK-28782][SQL] Support explode function on aggregate expressions

AmplabJenkins removed a comment on issue #25512: [WIP][SPARK-28782][SQL] Support explode function on aggregate expressions URL: https://github.com/apache/spark/pull/25512#issuecomment-522997115 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25512: [WIP][SPARK-28782][SQL] Support explode function on aggregate expressions

AmplabJenkins removed a comment on issue #25512: [WIP][SPARK-28782][SQL] Support explode function on aggregate expressions URL: https://github.com/apache/spark/pull/25512#issuecomment-522997104 Merged build finished. Test PASSed.

[GitHub] [spark] mgaido91 commented on a change in pull request #25136: [SPARK-28322][SQL] Add support to Decimal type for integral divide

mgaido91 commented on a change in pull request #25136: [SPARK-28322][SQL] Add support to Decimal type for integral divide URL: https://github.com/apache/spark/pull/25136#discussion_r315667092 ## File path:

[GitHub] [spark] AmplabJenkins commented on issue #25512: [WIP][SPARK-28782][SQL] Support explode function on aggregate expressions

AmplabJenkins commented on issue #25512: [WIP][SPARK-28782][SQL] Support explode function on aggregate expressions URL: https://github.com/apache/spark/pull/25512#issuecomment-522997104 Merged build finished. Test PASSed.

<    3   4   5   6   7   8   9   10   11   12   >