[GitHub] [spark] dongjoon-hyun commented on a change in pull request #27366: [SPARK-30648][SQL] Support filters pushdown in JSON datasource

dongjoon-hyun commented on a change in pull request #27366: [SPARK-30648][SQL] Support filters pushdown in JSON datasource URL: https://github.com/apache/spark/pull/27366#discussion_r373353871 ## File path:

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #27366: [SPARK-30648][SQL] Support filters pushdown in JSON datasource

dongjoon-hyun commented on a change in pull request #27366: [SPARK-30648][SQL] Support filters pushdown in JSON datasource URL: https://github.com/apache/spark/pull/27366#discussion_r373353871 ## File path:

[GitHub] [spark] zhengruifeng commented on issue #27396: [SPARK-30660][ML][PYSPARK] LinearRegression blockify input vectors

zhengruifeng commented on issue #27396: [SPARK-30660][ML][PYSPARK] LinearRegression blockify input vectors URL: https://github.com/apache/spark/pull/27396#issuecomment-580625348 @srowen The above test is also based on `a9a`, a small dataset with `numFeatures`=123, `numInstances`=32,561

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #27366: [SPARK-30648][SQL] Support filters pushdown in JSON datasource

dongjoon-hyun commented on a change in pull request #27366: [SPARK-30648][SQL] Support filters pushdown in JSON datasource URL: https://github.com/apache/spark/pull/27366#discussion_r373352443 ## File path:

[GitHub] [spark] AmplabJenkins commented on issue #27413: [SPARK-29938][SQL][FOLLOW-UP] Improve AlterTableAddPartitionCommand

AmplabJenkins commented on issue #27413: [SPARK-29938][SQL][FOLLOW-UP] Improve AlterTableAddPartitionCommand URL: https://github.com/apache/spark/pull/27413#issuecomment-580624681 Merged build finished. Test PASSed. This is

[GitHub] [spark] AmplabJenkins removed a comment on issue #27413: [SPARK-29938][SQL][FOLLOW-UP] Improve AlterTableAddPartitionCommand

AmplabJenkins removed a comment on issue #27413: [SPARK-29938][SQL][FOLLOW-UP] Improve AlterTableAddPartitionCommand URL: https://github.com/apache/spark/pull/27413#issuecomment-580624685 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27413: [SPARK-29938][SQL][FOLLOW-UP] Improve AlterTableAddPartitionCommand

AmplabJenkins commented on issue #27413: [SPARK-29938][SQL][FOLLOW-UP] Improve AlterTableAddPartitionCommand URL: https://github.com/apache/spark/pull/27413#issuecomment-580624685 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27413: [SPARK-29938][SQL][FOLLOW-UP] Improve AlterTableAddPartitionCommand

AmplabJenkins removed a comment on issue #27413: [SPARK-29938][SQL][FOLLOW-UP] Improve AlterTableAddPartitionCommand URL: https://github.com/apache/spark/pull/27413#issuecomment-580624681 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #27413: [SPARK-29938][SQL][FOLLOW-UP] Improve AlterTableAddPartitionCommand

SparkQA commented on issue #27413: [SPARK-29938][SQL][FOLLOW-UP] Improve AlterTableAddPartitionCommand URL: https://github.com/apache/spark/pull/27413#issuecomment-580624371 **[Test build #117632 has

[GitHub] [spark] xuanyuanking commented on issue #27293: [SPARK-29938][SQL][FOLLOW-UP] Improve AlterTableAddPartitionCommand

xuanyuanking commented on issue #27293: [SPARK-29938][SQL][FOLLOW-UP] Improve AlterTableAddPartitionCommand URL: https://github.com/apache/spark/pull/27293#issuecomment-580623479 In order to catch up on the deadline of Spark 3.0 code freeze, take over this in #27413.

[GitHub] [spark] HeartSaVioR commented on a change in pull request #25670: [SPARK-28869][CORE] Roll over event log files

HeartSaVioR commented on a change in pull request #25670: [SPARK-28869][CORE] Roll over event log files URL: https://github.com/apache/spark/pull/25670#discussion_r373350420 ## File path: core/src/main/scala/org/apache/spark/internal/config/package.scala ## @@ -179,6

[GitHub] [spark] xuanyuanking commented on a change in pull request #27293: [SPARK-29938][SQL][FOLLOW-UP] Improve AlterTableAddPartitionCommand

xuanyuanking commented on a change in pull request #27293: [SPARK-29938][SQL][FOLLOW-UP] Improve AlterTableAddPartitionCommand URL: https://github.com/apache/spark/pull/27293#discussion_r373350207 ## File path:

[GitHub] [spark] cloud-fan commented on a change in pull request #27350: [SPARK-30615][SQL] Introduce Analyzer rule for V2 AlterTable column change resolution

cloud-fan commented on a change in pull request #27350: [SPARK-30615][SQL] Introduce Analyzer rule for V2 AlterTable column change resolution URL: https://github.com/apache/spark/pull/27350#discussion_r373350285 ## File path:

[GitHub] [spark] xuanyuanking commented on a change in pull request #27293: [SPARK-29938][SQL][FOLLOW-UP] Improve AlterTableAddPartitionCommand

xuanyuanking commented on a change in pull request #27293: [SPARK-29938][SQL][FOLLOW-UP] Improve AlterTableAddPartitionCommand URL: https://github.com/apache/spark/pull/27293#discussion_r373350004 ## File path:

[GitHub] [spark] xuanyuanking opened a new pull request #27413: [SPARK-29938][SQL][FOLLOW-UP] Improve AlterTableAddPartitionCommand

xuanyuanking opened a new pull request #27413: [SPARK-29938][SQL][FOLLOW-UP] Improve AlterTableAddPartitionCommand URL: https://github.com/apache/spark/pull/27413 ### What changes were proposed in this pull request? This PR improves `AlterTableAddPartitionCommand` by: 1. adds an

[GitHub] [spark] huaxingao commented on issue #27397: [SPARK-29093][ML][PySpark][Follow-Up] Remove duplicate setter

huaxingao commented on issue #27397: [SPARK-29093][ML][PySpark][Follow-Up] Remove duplicate setter URL: https://github.com/apache/spark/pull/27397#issuecomment-580621625 Thank you very much! @dongjoon-hyun @viirya This is

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #27405: [SPARK-30684][WEBUI] Show the descripton of metrics for WholeStageCodegen in DAG viz

dongjoon-hyun commented on a change in pull request #27405: [SPARK-30684][WEBUI] Show the descripton of metrics for WholeStageCodegen in DAG viz URL: https://github.com/apache/spark/pull/27405#discussion_r373348768 ## File path:

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #27405: [SPARK-30684][WEBUI] Show the descripton of metrics for WholeStageCodegen in DAG viz

dongjoon-hyun commented on a change in pull request #27405: [SPARK-30684][WEBUI] Show the descripton of metrics for WholeStageCodegen in DAG viz URL: https://github.com/apache/spark/pull/27405#discussion_r373348768 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #26440: [SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support

AmplabJenkins removed a comment on issue #26440: [SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support URL: https://github.com/apache/spark/pull/26440#issuecomment-580620658 Test FAILed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #26440: [SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support

AmplabJenkins commented on issue #26440: [SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support URL: https://github.com/apache/spark/pull/26440#issuecomment-580620658 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #26440: [SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support

AmplabJenkins removed a comment on issue #26440: [SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support URL: https://github.com/apache/spark/pull/26440#issuecomment-580620649 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins commented on issue #26440: [SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support

AmplabJenkins commented on issue #26440: [SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support URL: https://github.com/apache/spark/pull/26440#issuecomment-580620649 Merged build finished. Test FAILed.

[GitHub] [spark] SparkQA commented on issue #26440: [SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support

SparkQA commented on issue #26440: [SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support URL: https://github.com/apache/spark/pull/26440#issuecomment-580620544 Kubernetes integration test status failure URL:

[GitHub] [spark] dongjoon-hyun commented on issue #27397: [SPARK-29093][ML][PySpark][Follow-Up] Remove duplicate setter

dongjoon-hyun commented on issue #27397: [SPARK-29093][ML][PySpark][Follow-Up] Remove duplicate setter URL: https://github.com/apache/spark/pull/27397#issuecomment-580620207 Merged to master. Thank you, @huaxingao and @viirya .

[GitHub] [spark] dongjoon-hyun closed pull request #27397: [SPARK-29093][ML][PySpark][Follow-Up] Remove duplicate setter

dongjoon-hyun closed pull request #27397: [SPARK-29093][ML][PySpark][Follow-Up] Remove duplicate setter URL: https://github.com/apache/spark/pull/27397 This is an automated message from the Apache Git Service. To respond to

[GitHub] [spark] HeartSaVioR commented on a change in pull request #27085: [SPARK-29779][CORE] Compact old event log files and cleanup

HeartSaVioR commented on a change in pull request #27085: [SPARK-29779][CORE] Compact old event log files and cleanup URL: https://github.com/apache/spark/pull/27085#discussion_r373347693 ## File path: core/src/main/scala/org/apache/spark/internal/config/package.scala ##

[GitHub] [spark] AmplabJenkins removed a comment on issue #27397: [SPARK-29093][ML][PySpark][Follow-Up] Remove duplicate setter

AmplabJenkins removed a comment on issue #27397: [SPARK-29093][ML][PySpark][Follow-Up] Remove duplicate setter URL: https://github.com/apache/spark/pull/27397#issuecomment-580619501 Merged build finished. Test PASSed. This

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #27299: [SPARK-30547][SQL][FOLLOWUP] Update since anotation for CalendarInterval class

dongjoon-hyun commented on a change in pull request #27299: [SPARK-30547][SQL][FOLLOWUP] Update since anotation for CalendarInterval class URL: https://github.com/apache/spark/pull/27299#discussion_r373347496 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #27397: [SPARK-29093][ML][PySpark][Follow-Up] Remove duplicate setter

AmplabJenkins removed a comment on issue #27397: [SPARK-29093][ML][PySpark][Follow-Up] Remove duplicate setter URL: https://github.com/apache/spark/pull/27397#issuecomment-580619505 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27397: [SPARK-29093][ML][PySpark][Follow-Up] Remove duplicate setter

AmplabJenkins commented on issue #27397: [SPARK-29093][ML][PySpark][Follow-Up] Remove duplicate setter URL: https://github.com/apache/spark/pull/27397#issuecomment-580619505 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27397: [SPARK-29093][ML][PySpark][Follow-Up] Remove duplicate setter

AmplabJenkins commented on issue #27397: [SPARK-29093][ML][PySpark][Follow-Up] Remove duplicate setter URL: https://github.com/apache/spark/pull/27397#issuecomment-580619501 Merged build finished. Test PASSed. This is an

[GitHub] [spark] SparkQA commented on issue #27397: [SPARK-29093][ML][PySpark][Follow-Up] Remove duplicate setter

SparkQA commented on issue #27397: [SPARK-29093][ML][PySpark][Follow-Up] Remove duplicate setter URL: https://github.com/apache/spark/pull/27397#issuecomment-580619258 **[Test build #117630 has

[GitHub] [spark] SparkQA removed a comment on issue #27397: [SPARK-29093][ML][PySpark][Follow-Up] Remove duplicate setter

SparkQA removed a comment on issue #27397: [SPARK-29093][ML][PySpark][Follow-Up] Remove duplicate setter URL: https://github.com/apache/spark/pull/27397#issuecomment-580612328 **[Test build #117630 has

[GitHub] [spark] HeartSaVioR commented on a change in pull request #27085: [SPARK-29779][CORE] Compact old event log files and cleanup

HeartSaVioR commented on a change in pull request #27085: [SPARK-29779][CORE] Compact old event log files and cleanup URL: https://github.com/apache/spark/pull/27085#discussion_r373346501 ## File path: core/src/main/scala/org/apache/spark/internal/config/package.scala ##

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #27397: [SPARK-29093][ML][PySpark][Follow-Up] Remove duplicate setter

dongjoon-hyun commented on a change in pull request #27397: [SPARK-29093][ML][PySpark][Follow-Up] Remove duplicate setter URL: https://github.com/apache/spark/pull/27397#discussion_r373346171 ## File path: python/pyspark/ml/regression.py ## @@ -2067,7 +2067,7 @@ def

[GitHub] [spark] HyukjinKwon commented on a change in pull request #27085: [SPARK-29779][CORE] Compact old event log files and cleanup

HyukjinKwon commented on a change in pull request #27085: [SPARK-29779][CORE] Compact old event log files and cleanup URL: https://github.com/apache/spark/pull/27085#discussion_r373345690 ## File path:

[GitHub] [spark] tdas commented on issue #27333: [SPARK-29438][SS][FOLLOWUP] Add regression tests for Streaming Aggregation and flatMapGroupsWithState

tdas commented on issue #27333: [SPARK-29438][SS][FOLLOWUP] Add regression tests for Streaming Aggregation and flatMapGroupsWithState URL: https://github.com/apache/spark/pull/27333#issuecomment-580616837 Also for completeness sake, we should add a test for streaming deduplication. That

[GitHub] [spark] tdas commented on issue #27333: [SPARK-29438][SS][FOLLOWUP] Add regression tests for Streaming Aggregation and flatMapGroupsWithState

tdas commented on issue #27333: [SPARK-29438][SS][FOLLOWUP] Add regression tests for Streaming Aggregation and flatMapGroupsWithState URL: https://github.com/apache/spark/pull/27333#issuecomment-580616641 As is the test look good. I would just test one more thing. If possible, introduce

[GitHub] [spark] viirya commented on issue #24938: [SPARK-27946][SQL] Hive DDL to Spark DDL conversion USING "show create table"

viirya commented on issue #24938: [SPARK-27946][SQL] Hive DDL to Spark DDL conversion USING "show create table" URL: https://github.com/apache/spark/pull/24938#issuecomment-580616073 Ok. I changed this to add `AS SERDE` option. `SHOW CREATE TABLE` now always generates Spark DDL, even for

[GitHub] [spark] AmplabJenkins removed a comment on issue #24938: [SPARK-27946][SQL] Hive DDL to Spark DDL conversion USING "show create table"

AmplabJenkins removed a comment on issue #24938: [SPARK-27946][SQL] Hive DDL to Spark DDL conversion USING "show create table" URL: https://github.com/apache/spark/pull/24938#issuecomment-580615022 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24938: [SPARK-27946][SQL] Hive DDL to Spark DDL conversion USING "show create table"

AmplabJenkins commented on issue #24938: [SPARK-27946][SQL] Hive DDL to Spark DDL conversion USING "show create table" URL: https://github.com/apache/spark/pull/24938#issuecomment-580615033 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24938: [SPARK-27946][SQL] Hive DDL to Spark DDL conversion USING "show create table"

AmplabJenkins commented on issue #24938: [SPARK-27946][SQL] Hive DDL to Spark DDL conversion USING "show create table" URL: https://github.com/apache/spark/pull/24938#issuecomment-580615022 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24938: [SPARK-27946][SQL] Hive DDL to Spark DDL conversion USING "show create table"

AmplabJenkins removed a comment on issue #24938: [SPARK-27946][SQL] Hive DDL to Spark DDL conversion USING "show create table" URL: https://github.com/apache/spark/pull/24938#issuecomment-580615033 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #24938: [SPARK-27946][SQL] Hive DDL to Spark DDL conversion USING "show create table"

SparkQA commented on issue #24938: [SPARK-27946][SQL] Hive DDL to Spark DDL conversion USING "show create table" URL: https://github.com/apache/spark/pull/24938#issuecomment-580614395 **[Test build #117631 has

[GitHub] [spark] HeartSaVioR commented on a change in pull request #27085: [SPARK-29779][CORE] Compact old event log files and cleanup

HeartSaVioR commented on a change in pull request #27085: [SPARK-29779][CORE] Compact old event log files and cleanup URL: https://github.com/apache/spark/pull/27085#discussion_r373343801 ## File path:

[GitHub] [spark] HyukjinKwon commented on issue #27164: [SPARK-30479][SQL] Apply compaction of event log to SQL events

HyukjinKwon commented on issue #27164: [SPARK-30479][SQL] Apply compaction of event log to SQL events URL: https://github.com/apache/spark/pull/27164#issuecomment-580613993 Thanks @HeartSaVioR! This is an automated message

[GitHub] [spark] HeartSaVioR commented on issue #27164: [SPARK-30479][SQL] Apply compaction of event log to SQL events

HeartSaVioR commented on issue #27164: [SPARK-30479][SQL] Apply compaction of event log to SQL events URL: https://github.com/apache/spark/pull/27164#issuecomment-580613812 Thanks for the post-hoc review. I'm seeing review comments from all of three PRs - let me deal with all of reviews

[GitHub] [spark] HeartSaVioR commented on a change in pull request #27164: [SPARK-30479][SQL] Apply compaction of event log to SQL events

HeartSaVioR commented on a change in pull request #27164: [SPARK-30479][SQL] Apply compaction of event log to SQL events URL: https://github.com/apache/spark/pull/27164#discussion_r373342723 ## File path:

[GitHub] [spark] HyukjinKwon closed pull request #27400: [SPARK-30671][SQL] emptyDataFrame should use a LocalRelation

HyukjinKwon closed pull request #27400: [SPARK-30671][SQL] emptyDataFrame should use a LocalRelation URL: https://github.com/apache/spark/pull/27400 This is an automated message from the Apache Git Service. To respond to

[GitHub] [spark] HyukjinKwon commented on issue #27400: [SPARK-30671][SQL] emptyDataFrame should use a LocalRelation

HyukjinKwon commented on issue #27400: [SPARK-30671][SQL] emptyDataFrame should use a LocalRelation URL: https://github.com/apache/spark/pull/27400#issuecomment-580613068 Let me merge instead. Seems hitting a network issue (?).

[GitHub] [spark] AmplabJenkins removed a comment on issue #27412: [SPARK-30690][DOCS][BUILD] Add CalendarInterval into API documentation

AmplabJenkins removed a comment on issue #27412: [SPARK-30690][DOCS][BUILD] Add CalendarInterval into API documentation URL: https://github.com/apache/spark/pull/27412#issuecomment-580612679 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27412: [SPARK-30690][DOCS][BUILD] Add CalendarInterval into API documentation

AmplabJenkins commented on issue #27412: [SPARK-30690][DOCS][BUILD] Add CalendarInterval into API documentation URL: https://github.com/apache/spark/pull/27412#issuecomment-580612673 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins commented on issue #27412: [SPARK-30690][DOCS][BUILD] Add CalendarInterval into API documentation

AmplabJenkins commented on issue #27412: [SPARK-30690][DOCS][BUILD] Add CalendarInterval into API documentation URL: https://github.com/apache/spark/pull/27412#issuecomment-580612679 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27397: [SPARK-29093][ML][PySpark][Follow-Up] Remove duplicate setter

AmplabJenkins commented on issue #27397: [SPARK-29093][ML][PySpark][Follow-Up] Remove duplicate setter URL: https://github.com/apache/spark/pull/27397#issuecomment-580612696 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #27397: [SPARK-29093][ML][PySpark][Follow-Up] Remove duplicate setter

AmplabJenkins removed a comment on issue #27397: [SPARK-29093][ML][PySpark][Follow-Up] Remove duplicate setter URL: https://github.com/apache/spark/pull/27397#issuecomment-580612702 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27397: [SPARK-29093][ML][PySpark][Follow-Up] Remove duplicate setter

AmplabJenkins commented on issue #27397: [SPARK-29093][ML][PySpark][Follow-Up] Remove duplicate setter URL: https://github.com/apache/spark/pull/27397#issuecomment-580612702 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27397: [SPARK-29093][ML][PySpark][Follow-Up] Remove duplicate setter

AmplabJenkins removed a comment on issue #27397: [SPARK-29093][ML][PySpark][Follow-Up] Remove duplicate setter URL: https://github.com/apache/spark/pull/27397#issuecomment-580612696 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins removed a comment on issue #27412: [SPARK-30690][DOCS][BUILD] Add CalendarInterval into API documentation

AmplabJenkins removed a comment on issue #27412: [SPARK-30690][DOCS][BUILD] Add CalendarInterval into API documentation URL: https://github.com/apache/spark/pull/27412#issuecomment-580612673 Merged build finished. Test PASSed.

[GitHub] [spark] HeartSaVioR commented on a change in pull request #27164: [SPARK-30479][SQL] Apply compaction of event log to SQL events

HeartSaVioR commented on a change in pull request #27164: [SPARK-30479][SQL] Apply compaction of event log to SQL events URL: https://github.com/apache/spark/pull/27164#discussion_r373341802 ## File path:

[GitHub] [spark] SparkQA commented on issue #27397: [SPARK-29093][ML][PySpark][Follow-Up] Remove duplicate setter

SparkQA commented on issue #27397: [SPARK-29093][ML][PySpark][Follow-Up] Remove duplicate setter URL: https://github.com/apache/spark/pull/27397#issuecomment-580612328 **[Test build #117630 has

[GitHub] [spark] SparkQA commented on issue #27412: [SPARK-30690][DOCS][BUILD] Add CalendarInterval into API documentation

SparkQA commented on issue #27412: [SPARK-30690][DOCS][BUILD] Add CalendarInterval into API documentation URL: https://github.com/apache/spark/pull/27412#issuecomment-580612306 **[Test build #117629 has

[GitHub] [spark] HyukjinKwon opened a new pull request #27412: [SPARK-30690][DOCS][BUILD] Add CalendarInterval into API documentation

HyukjinKwon opened a new pull request #27412: [SPARK-30690][DOCS][BUILD] Add CalendarInterval into API documentation URL: https://github.com/apache/spark/pull/27412 ### What changes were proposed in this pull request? We should also expose it in documentation as we marked it as

[GitHub] [spark] HeartSaVioR commented on a change in pull request #27164: [SPARK-30479][SQL] Apply compaction of event log to SQL events

HeartSaVioR commented on a change in pull request #27164: [SPARK-30479][SQL] Apply compaction of event log to SQL events URL: https://github.com/apache/spark/pull/27164#discussion_r373341293 ## File path:

[GitHub] [spark] huaxingao commented on a change in pull request #27397: [SPARK-29093][ML][PySpark][Follow-Up] Remove duplicate setter

huaxingao commented on a change in pull request #27397: [SPARK-29093][ML][PySpark][Follow-Up] Remove duplicate setter URL: https://github.com/apache/spark/pull/27397#discussion_r373340773 ## File path: python/pyspark/ml/regression.py ## @@ -2067,7 +2067,7 @@ def

[GitHub] [spark] AmplabJenkins removed a comment on issue #27411: [SPARK-30065][SQL][2.4] DataFrameNaFunctions.drop should handle duplicate columns

AmplabJenkins removed a comment on issue #27411: [SPARK-30065][SQL][2.4] DataFrameNaFunctions.drop should handle duplicate columns URL: https://github.com/apache/spark/pull/27411#issuecomment-580610153 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27411: [SPARK-30065][SQL][2.4] DataFrameNaFunctions.drop should handle duplicate columns

AmplabJenkins removed a comment on issue #27411: [SPARK-30065][SQL][2.4] DataFrameNaFunctions.drop should handle duplicate columns URL: https://github.com/apache/spark/pull/27411#issuecomment-580610159 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] SparkQA commented on issue #26440: [SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support

SparkQA commented on issue #26440: [SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support URL: https://github.com/apache/spark/pull/26440#issuecomment-580610130 Kubernetes integration test starting URL:

[GitHub] [spark] AmplabJenkins commented on issue #27411: [SPARK-30065][SQL][2.4] DataFrameNaFunctions.drop should handle duplicate columns

AmplabJenkins commented on issue #27411: [SPARK-30065][SQL][2.4] DataFrameNaFunctions.drop should handle duplicate columns URL: https://github.com/apache/spark/pull/27411#issuecomment-580610159 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] dongjoon-hyun closed pull request #27411: [SPARK-30065][SQL][2.4] DataFrameNaFunctions.drop should handle duplicate columns

dongjoon-hyun closed pull request #27411: [SPARK-30065][SQL][2.4] DataFrameNaFunctions.drop should handle duplicate columns URL: https://github.com/apache/spark/pull/27411 This is an automated message from the Apache Git

[GitHub] [spark] dongjoon-hyun commented on issue #27411: [SPARK-30065][SQL][2.4] DataFrameNaFunctions.drop should handle duplicate columns

dongjoon-hyun commented on issue #27411: [SPARK-30065][SQL][2.4] DataFrameNaFunctions.drop should handle duplicate columns URL: https://github.com/apache/spark/pull/27411#issuecomment-580610135 Merged to branch-2.4. This is

[GitHub] [spark] AmplabJenkins commented on issue #27411: [SPARK-30065][SQL][2.4] DataFrameNaFunctions.drop should handle duplicate columns

AmplabJenkins commented on issue #27411: [SPARK-30065][SQL][2.4] DataFrameNaFunctions.drop should handle duplicate columns URL: https://github.com/apache/spark/pull/27411#issuecomment-580610153 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA removed a comment on issue #27411: [SPARK-30065][SQL][2.4] DataFrameNaFunctions.drop should handle duplicate columns

SparkQA removed a comment on issue #27411: [SPARK-30065][SQL][2.4] DataFrameNaFunctions.drop should handle duplicate columns URL: https://github.com/apache/spark/pull/27411#issuecomment-580568569 **[Test build #117613 has

[GitHub] [spark] SparkQA commented on issue #27411: [SPARK-30065][SQL][2.4] DataFrameNaFunctions.drop should handle duplicate columns

SparkQA commented on issue #27411: [SPARK-30065][SQL][2.4] DataFrameNaFunctions.drop should handle duplicate columns URL: https://github.com/apache/spark/pull/27411#issuecomment-580609826 **[Test build #117613 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #27333: [SPARK-29438][SS][FOLLOWUP] Add regression tests for Streaming Aggregation and flatMapGroupsWithState

AmplabJenkins removed a comment on issue #27333: [SPARK-29438][SS][FOLLOWUP] Add regression tests for Streaming Aggregation and flatMapGroupsWithState URL: https://github.com/apache/spark/pull/27333#issuecomment-580608934 Test PASSed. Refer to this link for build results (access rights

[GitHub] [spark] AmplabJenkins commented on issue #27333: [SPARK-29438][SS][FOLLOWUP] Add regression tests for Streaming Aggregation and flatMapGroupsWithState

AmplabJenkins commented on issue #27333: [SPARK-29438][SS][FOLLOWUP] Add regression tests for Streaming Aggregation and flatMapGroupsWithState URL: https://github.com/apache/spark/pull/27333#issuecomment-580608934 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins commented on issue #27333: [SPARK-29438][SS][FOLLOWUP] Add regression tests for Streaming Aggregation and flatMapGroupsWithState

AmplabJenkins commented on issue #27333: [SPARK-29438][SS][FOLLOWUP] Add regression tests for Streaming Aggregation and flatMapGroupsWithState URL: https://github.com/apache/spark/pull/27333#issuecomment-580608926 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27333: [SPARK-29438][SS][FOLLOWUP] Add regression tests for Streaming Aggregation and flatMapGroupsWithState

AmplabJenkins removed a comment on issue #27333: [SPARK-29438][SS][FOLLOWUP] Add regression tests for Streaming Aggregation and flatMapGroupsWithState URL: https://github.com/apache/spark/pull/27333#issuecomment-580608926 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #27333: [SPARK-29438][SS][FOLLOWUP] Add regression tests for Streaming Aggregation and flatMapGroupsWithState

SparkQA commented on issue #27333: [SPARK-29438][SS][FOLLOWUP] Add regression tests for Streaming Aggregation and flatMapGroupsWithState URL: https://github.com/apache/spark/pull/27333#issuecomment-580608556 **[Test build #117628 has

[GitHub] [spark] cloud-fan commented on issue #27400: [SPARK-30671][SQL] emptyDataFrame should use a LocalRelation

cloud-fan commented on issue #27400: [SPARK-30671][SQL] emptyDataFrame should use a LocalRelation URL: https://github.com/apache/spark/pull/27400#issuecomment-580608291 thanks, merging to master! This is an automated message

[GitHub] [spark] HeartSaVioR commented on issue #27333: [SPARK-29438][SS][FOLLOWUP] Add regression tests for Streaming Aggregation and flatMapGroupsWithState

HeartSaVioR commented on issue #27333: [SPARK-29438][SS][FOLLOWUP] Add regression tests for Streaming Aggregation and flatMapGroupsWithState URL: https://github.com/apache/spark/pull/27333#issuecomment-580608310 @tdas Thanks for reviewing. Simplified the new UTs as well as

[GitHub] [spark] dongjoon-hyun closed pull request #27409: [SPARK-30192][SQL][FOLLOWUP] Rename SINGLETON to INSTANCE

dongjoon-hyun closed pull request #27409: [SPARK-30192][SQL][FOLLOWUP] Rename SINGLETON to INSTANCE URL: https://github.com/apache/spark/pull/27409 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] dongjoon-hyun commented on issue #27409: [SPARK-30192][SQL][FOLLOWUP] Rename SINGLETON to INSTANCE

dongjoon-hyun commented on issue #27409: [SPARK-30192][SQL][FOLLOWUP] Rename SINGLETON to INSTANCE URL: https://github.com/apache/spark/pull/27409#issuecomment-580607595 Merged to master. This is an automated message from

[GitHub] [spark] AmplabJenkins removed a comment on issue #27409: [SPARK-30192][SQL][FOLLOWUP] Rename SINGLETON to INSTANCE

AmplabJenkins removed a comment on issue #27409: [SPARK-30192][SQL][FOLLOWUP] Rename SINGLETON to INSTANCE URL: https://github.com/apache/spark/pull/27409#issuecomment-580606857 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #27409: [SPARK-30192][SQL][FOLLOWUP] Rename SINGLETON to INSTANCE

AmplabJenkins removed a comment on issue #27409: [SPARK-30192][SQL][FOLLOWUP] Rename SINGLETON to INSTANCE URL: https://github.com/apache/spark/pull/27409#issuecomment-580606864 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27409: [SPARK-30192][SQL][FOLLOWUP] Rename SINGLETON to INSTANCE

AmplabJenkins commented on issue #27409: [SPARK-30192][SQL][FOLLOWUP] Rename SINGLETON to INSTANCE URL: https://github.com/apache/spark/pull/27409#issuecomment-580606857 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #27409: [SPARK-30192][SQL][FOLLOWUP] Rename SINGLETON to INSTANCE

AmplabJenkins commented on issue #27409: [SPARK-30192][SQL][FOLLOWUP] Rename SINGLETON to INSTANCE URL: https://github.com/apache/spark/pull/27409#issuecomment-580606864 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #27409: [SPARK-30192][SQL][FOLLOWUP] Rename SINGLETON to INSTANCE

SparkQA removed a comment on issue #27409: [SPARK-30192][SQL][FOLLOWUP] Rename SINGLETON to INSTANCE URL: https://github.com/apache/spark/pull/27409#issuecomment-580554318 **[Test build #117611 has

[GitHub] [spark] SparkQA commented on issue #27409: [SPARK-30192][SQL][FOLLOWUP] Rename SINGLETON to INSTANCE

SparkQA commented on issue #27409: [SPARK-30192][SQL][FOLLOWUP] Rename SINGLETON to INSTANCE URL: https://github.com/apache/spark/pull/27409#issuecomment-580606375 **[Test build #117611 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/117611/testReport)**

[GitHub] [spark] AmplabJenkins commented on issue #27405: [SPARK-30684][WEBUI] Show the descripton of metrics for WholeStageCodegen in DAG viz

AmplabJenkins commented on issue #27405: [SPARK-30684][WEBUI] Show the descripton of metrics for WholeStageCodegen in DAG viz URL: https://github.com/apache/spark/pull/27405#issuecomment-580604994 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27405: [SPARK-30684][WEBUI] Show the descripton of metrics for WholeStageCodegen in DAG viz

AmplabJenkins removed a comment on issue #27405: [SPARK-30684][WEBUI] Show the descripton of metrics for WholeStageCodegen in DAG viz URL: https://github.com/apache/spark/pull/27405#issuecomment-580605002 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #27405: [SPARK-30684][WEBUI] Show the descripton of metrics for WholeStageCodegen in DAG viz

AmplabJenkins commented on issue #27405: [SPARK-30684][WEBUI] Show the descripton of metrics for WholeStageCodegen in DAG viz URL: https://github.com/apache/spark/pull/27405#issuecomment-580605002 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27405: [SPARK-30684][WEBUI] Show the descripton of metrics for WholeStageCodegen in DAG viz

AmplabJenkins removed a comment on issue #27405: [SPARK-30684][WEBUI] Show the descripton of metrics for WholeStageCodegen in DAG viz URL: https://github.com/apache/spark/pull/27405#issuecomment-580604994 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #27405: [SPARK-30684][WEBUI] Show the descripton of metrics for WholeStageCodegen in DAG viz

SparkQA commented on issue #27405: [SPARK-30684][WEBUI] Show the descripton of metrics for WholeStageCodegen in DAG viz URL: https://github.com/apache/spark/pull/27405#issuecomment-580604622 **[Test build #117627 has

[GitHub] [spark] gengliangwang commented on a change in pull request #27129: [SPARK-30427][SQL] Add config item for limiting partition number when calculating statistics through File System

gengliangwang commented on a change in pull request #27129: [SPARK-30427][SQL] Add config item for limiting partition number when calculating statistics through File System URL: https://github.com/apache/spark/pull/27129#discussion_r37887 ## File path:

[GitHub] [spark] AmplabJenkins commented on issue #27129: [SPARK-30427][SQL] Add config item for limiting partition number when calculating statistics through File System

AmplabJenkins commented on issue #27129: [SPARK-30427][SQL] Add config item for limiting partition number when calculating statistics through File System URL: https://github.com/apache/spark/pull/27129#issuecomment-580603187 Test PASSed. Refer to this link for build results (access

[GitHub] [spark] AmplabJenkins removed a comment on issue #27129: [SPARK-30427][SQL] Add config item for limiting partition number when calculating statistics through File System

AmplabJenkins removed a comment on issue #27129: [SPARK-30427][SQL] Add config item for limiting partition number when calculating statistics through File System URL: https://github.com/apache/spark/pull/27129#issuecomment-580603187 Test PASSed. Refer to this link for build results

[GitHub] [spark] AmplabJenkins removed a comment on issue #27129: [SPARK-30427][SQL] Add config item for limiting partition number when calculating statistics through File System

AmplabJenkins removed a comment on issue #27129: [SPARK-30427][SQL] Add config item for limiting partition number when calculating statistics through File System URL: https://github.com/apache/spark/pull/27129#issuecomment-580603180 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #27129: [SPARK-30427][SQL] Add config item for limiting partition number when calculating statistics through File System

AmplabJenkins commented on issue #27129: [SPARK-30427][SQL] Add config item for limiting partition number when calculating statistics through File System URL: https://github.com/apache/spark/pull/27129#issuecomment-580603180 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #27129: [SPARK-30427][SQL] Add config item for limiting partition number when calculating statistics through File System

SparkQA commented on issue #27129: [SPARK-30427][SQL] Add config item for limiting partition number when calculating statistics through File System URL: https://github.com/apache/spark/pull/27129#issuecomment-580602729 **[Test build #117626 has

[GitHub] [spark] HyukjinKwon commented on a change in pull request #27299: [SPARK-30547][SQL][FOLLOWUP] Update since anotation for CalendarInterval class

HyukjinKwon commented on a change in pull request #27299: [SPARK-30547][SQL][FOLLOWUP] Update since anotation for CalendarInterval class URL: https://github.com/apache/spark/pull/27299#discussion_r37044 ## File path:

  1   2   3   4   5   6   7   8   9   10   >