[GitHub] [spark] maropu commented on a change in pull request #25461: [SPARK-28741][SQL]Throw exceptions when casting to integers causes overflow

maropu commented on a change in pull request #25461: [SPARK-28741][SQL]Throw exceptions when casting to integers causes overflow URL: https://github.com/apache/spark/pull/25461#discussion_r315047654 ## File path:

[GitHub] [spark] gengliangwang commented on a change in pull request #25461: [SPARK-28741][SQL]Throw exceptions when casting to integers causes overflow

gengliangwang commented on a change in pull request #25461: [SPARK-28741][SQL]Throw exceptions when casting to integers causes overflow URL: https://github.com/apache/spark/pull/25461#discussion_r315047295 ## File path:

[GitHub] [spark] wangyum commented on a change in pull request #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation

wangyum commented on a change in pull request #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation URL: https://github.com/apache/spark/pull/24715#discussion_r315046331 ## File path:

[GitHub] [spark] cloud-fan commented on a change in pull request #25247: [SPARK-28319][SQL] Implement SHOW TABLES for Data Source V2 Tables

cloud-fan commented on a change in pull request #25247: [SPARK-28319][SQL] Implement SHOW TABLES for Data Source V2 Tables URL: https://github.com/apache/spark/pull/25247#discussion_r315042984 ## File path:

[GitHub] [spark] cloud-fan commented on issue #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation

cloud-fan commented on issue #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation URL: https://github.com/apache/spark/pull/24715#issuecomment-522414331 Actually, can we really fallback to HDFS size for partitioned tables? The partitions can be

[GitHub] [spark] cloud-fan commented on a change in pull request #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation

cloud-fan commented on a change in pull request #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation URL: https://github.com/apache/spark/pull/24715#discussion_r315039281 ## File path:

[GitHub] [spark] cloud-fan commented on a change in pull request #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation

cloud-fan commented on a change in pull request #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation URL: https://github.com/apache/spark/pull/24715#discussion_r315038877 ## File path:

[GitHub] [spark] cloud-fan commented on issue #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation

cloud-fan commented on issue #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation URL: https://github.com/apache/spark/pull/24715#issuecomment-522412152 > Then shouldn't we update the table statistics after it computes first time, and next time

[GitHub] [spark] HyukjinKwon commented on issue #25472: [SPARK-28756][R] Fix checkJavaVersion to accept JDK8+

HyukjinKwon commented on issue #25472: [SPARK-28756][R] Fix checkJavaVersion to accept JDK8+ URL: https://github.com/apache/spark/pull/25472#issuecomment-522409839 Hm, does CRAN counts `SystemRequirements`? I thought it's just additional metadata. Let me clarify the upper bound as well.

[GitHub] [spark] cloud-fan commented on a change in pull request #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation

cloud-fan commented on a change in pull request #24715: [SPARK-25474][SQL] Data source tables support fallback to HDFS for size estimation URL: https://github.com/apache/spark/pull/24715#discussion_r315036601 ## File path:

[GitHub] [spark] SparkQA commented on issue #25033: [SPARK-28224][SQL] Check overflow in decimal Sum aggregate

SparkQA commented on issue #25033: [SPARK-28224][SQL] Check overflow in decimal Sum aggregate URL: https://github.com/apache/spark/pull/25033#issuecomment-522407723 **[Test build #109312 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/109312/testReport)**

[GitHub] [spark] AmplabJenkins removed a comment on issue #25033: [SPARK-28224][SQL] Check overflow in decimal Sum aggregate

AmplabJenkins removed a comment on issue #25033: [SPARK-28224][SQL] Check overflow in decimal Sum aggregate URL: https://github.com/apache/spark/pull/25033#issuecomment-522407455 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25033: [SPARK-28224][SQL] Check overflow in decimal Sum aggregate

AmplabJenkins removed a comment on issue #25033: [SPARK-28224][SQL] Check overflow in decimal Sum aggregate URL: https://github.com/apache/spark/pull/25033#issuecomment-522407451 Merged build finished. Test PASSed. This is

[GitHub] [spark] AmplabJenkins commented on issue #25033: [SPARK-28224][SQL] Check overflow in decimal Sum aggregate

AmplabJenkins commented on issue #25033: [SPARK-28224][SQL] Check overflow in decimal Sum aggregate URL: https://github.com/apache/spark/pull/25033#issuecomment-522407455 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25033: [SPARK-28224][SQL] Check overflow in decimal Sum aggregate

AmplabJenkins commented on issue #25033: [SPARK-28224][SQL] Check overflow in decimal Sum aggregate URL: https://github.com/apache/spark/pull/25033#issuecomment-522407451 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #25489: [WIP] pyspark.sql.functions.col as C

AmplabJenkins removed a comment on issue #25489: [WIP] pyspark.sql.functions.col as C URL: https://github.com/apache/spark/pull/25489#issuecomment-522405415 Can one of the admins verify this patch? This is an automated

[GitHub] [spark] AmplabJenkins commented on issue #25489: [WIP] pyspark.sql.functions.col as C

AmplabJenkins commented on issue #25489: [WIP] pyspark.sql.functions.col as C URL: https://github.com/apache/spark/pull/25489#issuecomment-522406161 Can one of the admins verify this patch? This is an automated message from

[GitHub] [spark] felixcheung commented on issue #25472: [SPARK-28756][R] Fix checkJavaVersion to accept JDK8+

felixcheung commented on issue #25472: [SPARK-28756][R] Fix checkJavaVersion to accept JDK8+ URL: https://github.com/apache/spark/pull/25472#issuecomment-522405742 Note: this is likely going to cause CRAN release to be rejected as CRAN tests run on the latest JDK (like JDK 12) Also

[GitHub] [spark] AmplabJenkins removed a comment on issue #25489: [WIP] pyspark.sql.functions.col as C

AmplabJenkins removed a comment on issue #25489: [WIP] pyspark.sql.functions.col as C URL: https://github.com/apache/spark/pull/25489#issuecomment-522405092 Can one of the admins verify this patch? This is an automated

[GitHub] [spark] AmplabJenkins commented on issue #25489: [WIP] pyspark.sql.functions.col as C

AmplabJenkins commented on issue #25489: [WIP] pyspark.sql.functions.col as C URL: https://github.com/apache/spark/pull/25489#issuecomment-522405415 Can one of the admins verify this patch? This is an automated message from

[GitHub] [spark] AmplabJenkins commented on issue #25489: [WIP] pyspark.sql.functions.col as C

AmplabJenkins commented on issue #25489: [WIP] pyspark.sql.functions.col as C URL: https://github.com/apache/spark/pull/25489#issuecomment-522405092 Can one of the admins verify this patch? This is an automated message from

[GitHub] [spark] dougbateman opened a new pull request #25489: [WIP] pyspark.sql.functions.col as C

dougbateman opened a new pull request #25489: [WIP] pyspark.sql.functions.col as C URL: https://github.com/apache/spark/pull/25489 # What changes were proposed in this pull request? This introduces a C.colName shorthand for col("colName") in pyspark. ### Why are the changes

[GitHub] [spark] AmplabJenkins removed a comment on issue #25445: [SPARK-28541][WEBUI] Document Storage page

AmplabJenkins removed a comment on issue #25445: [SPARK-28541][WEBUI] Document Storage page URL: https://github.com/apache/spark/pull/25445#issuecomment-522404739 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] SparkQA removed a comment on issue #25445: [SPARK-28541][WEBUI] Document Storage page

SparkQA removed a comment on issue #25445: [SPARK-28541][WEBUI] Document Storage page URL: https://github.com/apache/spark/pull/25445#issuecomment-522403284 **[Test build #109311 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/109311/testReport)** for PR

[GitHub] [spark] AmplabJenkins removed a comment on issue #25445: [SPARK-28541][WEBUI] Document Storage page

AmplabJenkins removed a comment on issue #25445: [SPARK-28541][WEBUI] Document Storage page URL: https://github.com/apache/spark/pull/25445#issuecomment-522404742 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25445: [SPARK-28541][WEBUI] Document Storage page

AmplabJenkins commented on issue #25445: [SPARK-28541][WEBUI] Document Storage page URL: https://github.com/apache/spark/pull/25445#issuecomment-522404739 Merged build finished. Test PASSed. This is an automated message from

[GitHub] [spark] AmplabJenkins commented on issue #25445: [SPARK-28541][WEBUI] Document Storage page

AmplabJenkins commented on issue #25445: [SPARK-28541][WEBUI] Document Storage page URL: https://github.com/apache/spark/pull/25445#issuecomment-522404742 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #25445: [SPARK-28541][WEBUI] Document Storage page

SparkQA commented on issue #25445: [SPARK-28541][WEBUI] Document Storage page URL: https://github.com/apache/spark/pull/25445#issuecomment-522404703 **[Test build #109311 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/109311/testReport)** for PR 25445 at

[GitHub] [spark] AmplabJenkins removed a comment on issue #24965: [WIP][SPARK-27463][PYTHON] Support Dataframe Cogroup via Pandas UDFs

AmplabJenkins removed a comment on issue #24965: [WIP][SPARK-27463][PYTHON] Support Dataframe Cogroup via Pandas UDFs URL: https://github.com/apache/spark/pull/24965#issuecomment-521042073 Can one of the admins verify this patch?

[GitHub] [spark] AmplabJenkins commented on issue #24965: [WIP][SPARK-27463][PYTHON] Support Dataframe Cogroup via Pandas UDFs

AmplabJenkins commented on issue #24965: [WIP][SPARK-27463][PYTHON] Support Dataframe Cogroup via Pandas UDFs URL: https://github.com/apache/spark/pull/24965#issuecomment-522404378 Can one of the admins verify this patch?

[GitHub] [spark] AmplabJenkins removed a comment on issue #25445: [SPARK-28541][WEBUI] Document Storage page

AmplabJenkins removed a comment on issue #25445: [SPARK-28541][WEBUI] Document Storage page URL: https://github.com/apache/spark/pull/25445#issuecomment-522404116 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] AmplabJenkins removed a comment on issue #25445: [SPARK-28541][WEBUI] Document Storage page

AmplabJenkins removed a comment on issue #25445: [SPARK-28541][WEBUI] Document Storage page URL: https://github.com/apache/spark/pull/25445#issuecomment-522404128 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25445: [SPARK-28541][WEBUI] Document Storage page

AmplabJenkins commented on issue #25445: [SPARK-28541][WEBUI] Document Storage page URL: https://github.com/apache/spark/pull/25445#issuecomment-522404116 Merged build finished. Test PASSed. This is an automated message from

[GitHub] [spark] AmplabJenkins commented on issue #25445: [SPARK-28541][WEBUI] Document Storage page

AmplabJenkins commented on issue #25445: [SPARK-28541][WEBUI] Document Storage page URL: https://github.com/apache/spark/pull/25445#issuecomment-522404128 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] HyukjinKwon closed pull request #25415: [SPARK-28390][SQL][PYTHON][TESTS] [FOLLOW-UP] Update the TODO with actual blocking JIRA IDs

HyukjinKwon closed pull request #25415: [SPARK-28390][SQL][PYTHON][TESTS] [FOLLOW-UP] Update the TODO with actual blocking JIRA IDs URL: https://github.com/apache/spark/pull/25415 This is an automated message from the

[GitHub] [spark] SparkQA commented on issue #25445: [SPARK-28541][WEBUI] Document Storage page

SparkQA commented on issue #25445: [SPARK-28541][WEBUI] Document Storage page URL: https://github.com/apache/spark/pull/25445#issuecomment-522403284 **[Test build #109311 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/109311/testReport)** for PR 25445 at

[GitHub] [spark] HyukjinKwon commented on issue #25415: [SPARK-28390][SQL][PYTHON][TESTS] [FOLLOW-UP] Update the TODO with actual blocking JIRA IDs

HyukjinKwon commented on issue #25415: [SPARK-28390][SQL][PYTHON][TESTS] [FOLLOW-UP] Update the TODO with actual blocking JIRA IDs URL: https://github.com/apache/spark/pull/25415#issuecomment-522403090 Merged to master.

[GitHub] [spark] zhengruifeng commented on issue #25445: [SPARK-28541][WEBUI] Document Storage page

zhengruifeng commented on issue #25445: [SPARK-28541][WEBUI] Document Storage page URL: https://github.com/apache/spark/pull/25445#issuecomment-522402951 

[GitHub] [spark] AmplabJenkins removed a comment on issue #25415: [SPARK-28390][SQL][PYTHON][TESTS] [FOLLOW-UP] Update the TODO with actual blocking JIRA IDs

AmplabJenkins removed a comment on issue #25415: [SPARK-28390][SQL][PYTHON][TESTS] [FOLLOW-UP] Update the TODO with actual blocking JIRA IDs URL: https://github.com/apache/spark/pull/25415#issuecomment-522402659 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins removed a comment on issue #25415: [SPARK-28390][SQL][PYTHON][TESTS] [FOLLOW-UP] Update the TODO with actual blocking JIRA IDs

AmplabJenkins removed a comment on issue #25415: [SPARK-28390][SQL][PYTHON][TESTS] [FOLLOW-UP] Update the TODO with actual blocking JIRA IDs URL: https://github.com/apache/spark/pull/25415#issuecomment-522402655 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25415: [SPARK-28390][SQL][PYTHON][TESTS] [FOLLOW-UP] Update the TODO with actual blocking JIRA IDs

AmplabJenkins commented on issue #25415: [SPARK-28390][SQL][PYTHON][TESTS] [FOLLOW-UP] Update the TODO with actual blocking JIRA IDs URL: https://github.com/apache/spark/pull/25415#issuecomment-522402655 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25415: [SPARK-28390][SQL][PYTHON][TESTS] [FOLLOW-UP] Update the TODO with actual blocking JIRA IDs

AmplabJenkins commented on issue #25415: [SPARK-28390][SQL][PYTHON][TESTS] [FOLLOW-UP] Update the TODO with actual blocking JIRA IDs URL: https://github.com/apache/spark/pull/25415#issuecomment-522402659 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] SparkQA removed a comment on issue #25415: [SPARK-28390][SQL][PYTHON][TESTS] [FOLLOW-UP] Update the TODO with actual blocking JIRA IDs

SparkQA removed a comment on issue #25415: [SPARK-28390][SQL][PYTHON][TESTS] [FOLLOW-UP] Update the TODO with actual blocking JIRA IDs URL: https://github.com/apache/spark/pull/25415#issuecomment-522372291 **[Test build #109304 has

[GitHub] [spark] SparkQA commented on issue #25415: [SPARK-28390][SQL][PYTHON][TESTS] [FOLLOW-UP] Update the TODO with actual blocking JIRA IDs

SparkQA commented on issue #25415: [SPARK-28390][SQL][PYTHON][TESTS] [FOLLOW-UP] Update the TODO with actual blocking JIRA IDs URL: https://github.com/apache/spark/pull/25415#issuecomment-522402395 **[Test build #109304 has

[GitHub] [spark] zhengruifeng commented on a change in pull request #25445: [SPARK-28541][WEBUI] Document Storage page

zhengruifeng commented on a change in pull request #25445: [SPARK-28541][WEBUI] Document Storage page URL: https://github.com/apache/spark/pull/25445#discussion_r315030988 ## File path: docs/web-ui.md ## @@ -45,6 +45,53 @@ The Storage tab displays the persisted RDDs and

[GitHub] [spark] SparkQA commented on issue #24936: [SPARK-24634][SS] Add a new metric regarding number of rows later than watermark

SparkQA commented on issue #24936: [SPARK-24634][SS] Add a new metric regarding number of rows later than watermark URL: https://github.com/apache/spark/pull/24936#issuecomment-522400843 **[Test build #109310 has

[GitHub] [spark] HeartSaVioR commented on issue #24936: [SPARK-24634][SS] Add a new metric regarding number of rows later than watermark

HeartSaVioR commented on issue #24936: [SPARK-24634][SS] Add a new metric regarding number of rows later than watermark URL: https://github.com/apache/spark/pull/24936#issuecomment-522399908 retest this, please This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #24936: [SPARK-24634][SS] Add a new metric regarding number of rows later than watermark

AmplabJenkins removed a comment on issue #24936: [SPARK-24634][SS] Add a new metric regarding number of rows later than watermark URL: https://github.com/apache/spark/pull/24936#issuecomment-522399342 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24936: [SPARK-24634][SS] Add a new metric regarding number of rows later than watermark

AmplabJenkins removed a comment on issue #24936: [SPARK-24634][SS] Add a new metric regarding number of rows later than watermark URL: https://github.com/apache/spark/pull/24936#issuecomment-522399341 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins commented on issue #24936: [SPARK-24634][SS] Add a new metric regarding number of rows later than watermark

AmplabJenkins commented on issue #24936: [SPARK-24634][SS] Add a new metric regarding number of rows later than watermark URL: https://github.com/apache/spark/pull/24936#issuecomment-522399341 Merged build finished. Test FAILed.

[GitHub] [spark] SparkQA removed a comment on issue #24936: [SPARK-24634][SS] Add a new metric regarding number of rows later than watermark

SparkQA removed a comment on issue #24936: [SPARK-24634][SS] Add a new metric regarding number of rows later than watermark URL: https://github.com/apache/spark/pull/24936#issuecomment-522384485 **[Test build #109307 has

[GitHub] [spark] AmplabJenkins commented on issue #24936: [SPARK-24634][SS] Add a new metric regarding number of rows later than watermark

AmplabJenkins commented on issue #24936: [SPARK-24634][SS] Add a new metric regarding number of rows later than watermark URL: https://github.com/apache/spark/pull/24936#issuecomment-522399342 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25430: [SPARK-28540][WEBUI] Document Environment page

AmplabJenkins removed a comment on issue #25430: [SPARK-28540][WEBUI] Document Environment page URL: https://github.com/apache/spark/pull/25430#issuecomment-522399117 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] AmplabJenkins removed a comment on issue #25430: [SPARK-28540][WEBUI] Document Environment page

AmplabJenkins removed a comment on issue #25430: [SPARK-28540][WEBUI] Document Environment page URL: https://github.com/apache/spark/pull/25430#issuecomment-522399120 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #24936: [SPARK-24634][SS] Add a new metric regarding number of rows later than watermark

SparkQA commented on issue #24936: [SPARK-24634][SS] Add a new metric regarding number of rows later than watermark URL: https://github.com/apache/spark/pull/24936#issuecomment-522399225 **[Test build #109307 has

[GitHub] [spark] SparkQA removed a comment on issue #25430: [SPARK-28540][WEBUI] Document Environment page

SparkQA removed a comment on issue #25430: [SPARK-28540][WEBUI] Document Environment page URL: https://github.com/apache/spark/pull/25430#issuecomment-522397295 **[Test build #109309 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/109309/testReport)** for

[GitHub] [spark] AmplabJenkins commented on issue #25430: [SPARK-28540][WEBUI] Document Environment page

AmplabJenkins commented on issue #25430: [SPARK-28540][WEBUI] Document Environment page URL: https://github.com/apache/spark/pull/25430#issuecomment-522399117 Merged build finished. Test PASSed. This is an automated message

[GitHub] [spark] AmplabJenkins commented on issue #25430: [SPARK-28540][WEBUI] Document Environment page

AmplabJenkins commented on issue #25430: [SPARK-28540][WEBUI] Document Environment page URL: https://github.com/apache/spark/pull/25430#issuecomment-522399120 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #25430: [SPARK-28540][WEBUI] Document Environment page

SparkQA commented on issue #25430: [SPARK-28540][WEBUI] Document Environment page URL: https://github.com/apache/spark/pull/25430#issuecomment-522399055 **[Test build #109309 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/109309/testReport)** for PR

[GitHub] [spark] AmplabJenkins removed a comment on issue #25430: [SPARK-28540][WEBUI] Document Environment page

AmplabJenkins removed a comment on issue #25430: [SPARK-28540][WEBUI] Document Environment page URL: https://github.com/apache/spark/pull/25430#issuecomment-522398226 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25430: [SPARK-28540][WEBUI] Document Environment page

AmplabJenkins removed a comment on issue #25430: [SPARK-28540][WEBUI] Document Environment page URL: https://github.com/apache/spark/pull/25430#issuecomment-522398220 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] AmplabJenkins commented on issue #25430: [SPARK-28540][WEBUI] Document Environment page

AmplabJenkins commented on issue #25430: [SPARK-28540][WEBUI] Document Environment page URL: https://github.com/apache/spark/pull/25430#issuecomment-522398226 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25430: [SPARK-28540][WEBUI] Document Environment page

AmplabJenkins commented on issue #25430: [SPARK-28540][WEBUI] Document Environment page URL: https://github.com/apache/spark/pull/25430#issuecomment-522398220 Merged build finished. Test PASSed. This is an automated message

[GitHub] [spark] zhengruifeng commented on a change in pull request #25430: [SPARK-28540][WEBUI] Document Environment page

zhengruifeng commented on a change in pull request #25430: [SPARK-28540][WEBUI] Document Environment page URL: https://github.com/apache/spark/pull/25430#discussion_r315027567 ## File path: docs/web-ui.md ## @@ -49,6 +49,50 @@ sizes and using executors for all partitions

[GitHub] [spark] SparkQA commented on issue #25430: [SPARK-28540][WEBUI] Document Environment page

SparkQA commented on issue #25430: [SPARK-28540][WEBUI] Document Environment page URL: https://github.com/apache/spark/pull/25430#issuecomment-522397295 **[Test build #109309 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/109309/testReport)** for PR 25430

[GitHub] [spark] SparkQA commented on issue #25247: [SPARK-28319][SQL] Implement SHOW TABLES for Data Source V2 Tables

SparkQA commented on issue #25247: [SPARK-28319][SQL] Implement SHOW TABLES for Data Source V2 Tables URL: https://github.com/apache/spark/pull/25247#issuecomment-522392908 **[Test build #109308 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #25247: [SPARK-28319][SQL] Implement SHOW TABLES for Data Source V2 Tables

AmplabJenkins removed a comment on issue #25247: [SPARK-28319][SQL] Implement SHOW TABLES for Data Source V2 Tables URL: https://github.com/apache/spark/pull/25247#issuecomment-522392554 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25247: [SPARK-28319][SQL] Implement SHOW TABLES for Data Source V2 Tables

AmplabJenkins commented on issue #25247: [SPARK-28319][SQL] Implement SHOW TABLES for Data Source V2 Tables URL: https://github.com/apache/spark/pull/25247#issuecomment-522392554 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25247: [SPARK-28319][SQL] Implement SHOW TABLES for Data Source V2 Tables

AmplabJenkins commented on issue #25247: [SPARK-28319][SQL] Implement SHOW TABLES for Data Source V2 Tables URL: https://github.com/apache/spark/pull/25247#issuecomment-522392552 Merged build finished. Test PASSed. This is

[GitHub] [spark] AmplabJenkins removed a comment on issue #25247: [SPARK-28319][SQL] Implement SHOW TABLES for Data Source V2 Tables

AmplabJenkins removed a comment on issue #25247: [SPARK-28319][SQL] Implement SHOW TABLES for Data Source V2 Tables URL: https://github.com/apache/spark/pull/25247#issuecomment-522392552 Merged build finished. Test PASSed.

[GitHub] [spark] HyukjinKwon closed pull request #25334: [SPARK-28598][SQL] Few date time manipulation functions does not provide versions supporting Column as input through the Dataframe API

HyukjinKwon closed pull request #25334: [SPARK-28598][SQL] Few date time manipulation functions does not provide versions supporting Column as input through the Dataframe API URL: https://github.com/apache/spark/pull/25334

[GitHub] [spark] WeichenXu123 commented on issue #25334: [SPARK-28598][SQL] Few date time manipulation functions does not provide versions supporting Column as input through the Dataframe API

WeichenXu123 commented on issue #25334: [SPARK-28598][SQL] Few date time manipulation functions does not provide versions supporting Column as input through the Dataframe API URL: https://github.com/apache/spark/pull/25334#issuecomment-522390694 @HyukjinKwon Sure!

[GitHub] [spark] HyukjinKwon commented on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API

HyukjinKwon commented on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API URL: https://github.com/apache/spark/pull/24232#issuecomment-522390739 ping @nvander1 how's adding Java tests going? This is

[GitHub] [spark] HyukjinKwon commented on issue #25334: [SPARK-28598][SQL] Few date time manipulation functions does not provide versions supporting Column as input through the Dataframe API

HyukjinKwon commented on issue #25334: [SPARK-28598][SQL] Few date time manipulation functions does not provide versions supporting Column as input through the Dataframe API URL: https://github.com/apache/spark/pull/25334#issuecomment-522390518 Merged to master. @WeichenXu123, mind

[GitHub] [spark] advancedxy commented on issue #25306: [SPARK-28573][SQL] Convert InsertIntoTable(HiveTableRelation) to DataSource inserting for partitioned table

advancedxy commented on issue #25306: [SPARK-28573][SQL] Convert InsertIntoTable(HiveTableRelation) to DataSource inserting for partitioned table URL: https://github.com/apache/spark/pull/25306#issuecomment-522386167 @cloud-fan do you have any other suggestions? The previous failure

[GitHub] [spark] maropu commented on a change in pull request #25136: [SPARK-28322][SQL] Add support to Decimal type for integral divide

maropu commented on a change in pull request #25136: [SPARK-28322][SQL] Add support to Decimal type for integral divide URL: https://github.com/apache/spark/pull/25136#discussion_r315016848 ## File path:

[GitHub] [spark] maropu commented on a change in pull request #25136: [SPARK-28322][SQL] Add support to Decimal type for integral divide

maropu commented on a change in pull request #25136: [SPARK-28322][SQL] Add support to Decimal type for integral divide URL: https://github.com/apache/spark/pull/25136#discussion_r315017065 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/types/Decimal.scala

[GitHub] [spark] maropu commented on a change in pull request #25136: [SPARK-28322][SQL] Add support to Decimal type for integral divide

maropu commented on a change in pull request #25136: [SPARK-28322][SQL] Add support to Decimal type for integral divide URL: https://github.com/apache/spark/pull/25136#discussion_r315017489 ## File path:

[GitHub] [spark] maropu commented on a change in pull request #25136: [SPARK-28322][SQL] Add support to Decimal type for integral divide

maropu commented on a change in pull request #25136: [SPARK-28322][SQL] Add support to Decimal type for integral divide URL: https://github.com/apache/spark/pull/25136#discussion_r315016918 ## File path:

[GitHub] [spark] maropu commented on a change in pull request #25136: [SPARK-28322][SQL] Add support to Decimal type for integral divide

maropu commented on a change in pull request #25136: [SPARK-28322][SQL] Add support to Decimal type for integral divide URL: https://github.com/apache/spark/pull/25136#discussion_r315016810 ## File path: sql/core/src/test/resources/sql-tests/inputs/pgSQL/numeric.sql ## @@

[GitHub] [spark] SparkQA commented on issue #24936: [SPARK-24634][SS] Add a new metric regarding number of rows later than watermark

SparkQA commented on issue #24936: [SPARK-24634][SS] Add a new metric regarding number of rows later than watermark URL: https://github.com/apache/spark/pull/24936#issuecomment-522384485 **[Test build #109307 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #24936: [SPARK-24634][SS] Add a new metric regarding number of rows later than watermark

AmplabJenkins removed a comment on issue #24936: [SPARK-24634][SS] Add a new metric regarding number of rows later than watermark URL: https://github.com/apache/spark/pull/24936#issuecomment-522383533 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24936: [SPARK-24634][SS] Add a new metric regarding number of rows later than watermark

AmplabJenkins removed a comment on issue #24936: [SPARK-24634][SS] Add a new metric regarding number of rows later than watermark URL: https://github.com/apache/spark/pull/24936#issuecomment-522383527 Merged build finished. Test FAILed.

[GitHub] [spark] SparkQA removed a comment on issue #24936: [SPARK-24634][SS] Add a new metric regarding number of rows later than watermark

SparkQA removed a comment on issue #24936: [SPARK-24634][SS] Add a new metric regarding number of rows later than watermark URL: https://github.com/apache/spark/pull/24936#issuecomment-522383374 **[Test build #109306 has

[GitHub] [spark] AmplabJenkins commented on issue #24936: [SPARK-24634][SS] Add a new metric regarding number of rows later than watermark

AmplabJenkins commented on issue #24936: [SPARK-24634][SS] Add a new metric regarding number of rows later than watermark URL: https://github.com/apache/spark/pull/24936#issuecomment-522383533 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #24936: [SPARK-24634][SS] Add a new metric regarding number of rows later than watermark

SparkQA commented on issue #24936: [SPARK-24634][SS] Add a new metric regarding number of rows later than watermark URL: https://github.com/apache/spark/pull/24936#issuecomment-522383520 **[Test build #109306 has

[GitHub] [spark] AmplabJenkins commented on issue #24936: [SPARK-24634][SS] Add a new metric regarding number of rows later than watermark

AmplabJenkins commented on issue #24936: [SPARK-24634][SS] Add a new metric regarding number of rows later than watermark URL: https://github.com/apache/spark/pull/24936#issuecomment-522383527 Merged build finished. Test FAILed.

[GitHub] [spark] SparkQA commented on issue #24936: [SPARK-24634][SS] Add a new metric regarding number of rows later than watermark

SparkQA commented on issue #24936: [SPARK-24634][SS] Add a new metric regarding number of rows later than watermark URL: https://github.com/apache/spark/pull/24936#issuecomment-522383374 **[Test build #109306 has

[GitHub] [spark] HeartSaVioR edited a comment on issue #25488: [SPARK-28025][SS] Fix FileContextBasedCheckpointFileManager leaking crc files

HeartSaVioR edited a comment on issue #25488: [SPARK-28025][SS] Fix FileContextBasedCheckpointFileManager leaking crc files URL: https://github.com/apache/spark/pull/25488#issuecomment-522379521 As the issue only occurs from temp file, another possible approach would be removing crc file

[GitHub] [spark] HeartSaVioR edited a comment on issue #25488: [SPARK-28025][SS] Fix FileContextBasedCheckpointFileManager leaking crc files

HeartSaVioR edited a comment on issue #25488: [SPARK-28025][SS] Fix FileContextBasedCheckpointFileManager leaking crc files URL: https://github.com/apache/spark/pull/25488#issuecomment-522379521 Another possible approach would be removing crc file for temp file when FSOutputSummer is

[GitHub] [spark] HeartSaVioR edited a comment on issue #25488: [SPARK-28025][SS] Fix FileContextBasedCheckpointFileManager leaking crc files

HeartSaVioR edited a comment on issue #25488: [SPARK-28025][SS] Fix FileContextBasedCheckpointFileManager leaking crc files URL: https://github.com/apache/spark/pull/25488#issuecomment-522379521 As the issue only occurs from temp file, another possible approach would be removing crc file

[GitHub] [spark] HeartSaVioR commented on issue #25488: [SPARK-28025][SS] Fix FileContextBasedCheckpointFileManager leaking crc files

HeartSaVioR commented on issue #25488: [SPARK-28025][SS] Fix FileContextBasedCheckpointFileManager leaking crc files URL: https://github.com/apache/spark/pull/25488#issuecomment-522379521 Another possible approach would be removing crc file for temp file when FSOutputSummer is being used

[GitHub] [spark] hddong commented on a change in pull request #25412: [SPARK-28691][EXAMPLES] Add Java/Scala DirectKerberizedKafkaWordCount examples

hddong commented on a change in pull request #25412: [SPARK-28691][EXAMPLES] Add Java/Scala DirectKerberizedKafkaWordCount examples URL: https://github.com/apache/spark/pull/25412#discussion_r315014089 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #25488: [SPARK-28025][SS] Fix FileContextBasedCheckpointFileManager leaking crc files

AmplabJenkins removed a comment on issue #25488: [SPARK-28025][SS] Fix FileContextBasedCheckpointFileManager leaking crc files URL: https://github.com/apache/spark/pull/25488#issuecomment-522378786 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25488: [SPARK-28025][SS] Fix FileContextBasedCheckpointFileManager leaking crc files

AmplabJenkins removed a comment on issue #25488: [SPARK-28025][SS] Fix FileContextBasedCheckpointFileManager leaking crc files URL: https://github.com/apache/spark/pull/25488#issuecomment-522378790 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25488: [SPARK-28025][SS] Fix FileContextBasedCheckpointFileManager leaking crc files

AmplabJenkins commented on issue #25488: [SPARK-28025][SS] Fix FileContextBasedCheckpointFileManager leaking crc files URL: https://github.com/apache/spark/pull/25488#issuecomment-522378790 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25488: [SPARK-28025][SS] Fix FileContextBasedCheckpointFileManager leaking crc files

AmplabJenkins commented on issue #25488: [SPARK-28025][SS] Fix FileContextBasedCheckpointFileManager leaking crc files URL: https://github.com/apache/spark/pull/25488#issuecomment-522378786 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA removed a comment on issue #25488: [SPARK-28025][SS] Fix FileContextBasedCheckpointFileManager leaking crc files

SparkQA removed a comment on issue #25488: [SPARK-28025][SS] Fix FileContextBasedCheckpointFileManager leaking crc files URL: https://github.com/apache/spark/pull/25488#issuecomment-522358860 **[Test build #109302 has

[GitHub] [spark] SparkQA commented on issue #25488: [SPARK-28025][SS] Fix FileContextBasedCheckpointFileManager leaking crc files

SparkQA commented on issue #25488: [SPARK-28025][SS] Fix FileContextBasedCheckpointFileManager leaking crc files URL: https://github.com/apache/spark/pull/25488#issuecomment-522378565 **[Test build #109302 has

[GitHub] [spark] SparkQA commented on issue #25443: [WIP][SPARK-28723][test-hadoop3.2][test-maven] Test JDK 11 with Hadoop-3.2/Hive 2.3.6 on jenkins

SparkQA commented on issue #25443: [WIP][SPARK-28723][test-hadoop3.2][test-maven] Test JDK 11 with Hadoop-3.2/Hive 2.3.6 on jenkins URL: https://github.com/apache/spark/pull/25443#issuecomment-522378040 **[Test build #109305 has

  1   2   3   4   >