[GitHub] [spark] SparkQA commented on issue #27584: [SPARK-30814][SQL] ALTER TABLE ... ADD COLUMN position should be able to reference columns being added

2020-02-17 Thread GitBox
SparkQA commented on issue #27584: [SPARK-30814][SQL] ALTER TABLE ... ADD COLUMN position should be able to reference columns being added URL: https://github.com/apache/spark/pull/27584#issuecomment-587185860 **[Test build #118599 has

[GitHub] [spark] SparkQA commented on issue #27613: [SPARK-30859][PYSPARK][DOCS][MINOR] Fixed docstring syntax issues preventing proper compilation of documentation.

2020-02-17 Thread GitBox
SparkQA commented on issue #27613: [SPARK-30859][PYSPARK][DOCS][MINOR] Fixed docstring syntax issues preventing proper compilation of documentation. URL: https://github.com/apache/spark/pull/27613#issuecomment-587226144 **[Test build #118602 has

[GitHub] [spark] WeichenXu123 edited a comment on issue #27565: [SPARK-30791][SQL][PYTHON] Add 'sameSemantics' and 'sementicHash' methods in Dataset

2020-02-17 Thread GitBox
WeichenXu123 edited a comment on issue #27565: [SPARK-30791][SQL][PYTHON] Add 'sameSemantics' and 'sementicHash' methods in Dataset URL: https://github.com/apache/spark/pull/27565#issuecomment-587245610 Merge to master. Thanks!

[GitHub] [spark] cloud-fan closed pull request #27584: [SPARK-30814][SQL] ALTER TABLE ... ADD COLUMN position should be able to reference columns being added

2020-02-17 Thread GitBox
cloud-fan closed pull request #27584: [SPARK-30814][SQL] ALTER TABLE ... ADD COLUMN position should be able to reference columns being added URL: https://github.com/apache/spark/pull/27584 This is an automated message from

[GitHub] [spark] cloud-fan commented on issue #27584: [SPARK-30814][SQL] ALTER TABLE ... ADD COLUMN position should be able to reference columns being added

2020-02-17 Thread GitBox
cloud-fan commented on issue #27584: [SPARK-30814][SQL] ALTER TABLE ... ADD COLUMN position should be able to reference columns being added URL: https://github.com/apache/spark/pull/27584#issuecomment-587279776 thanks, merging to master/3.0!

[GitHub] [spark] AmplabJenkins removed a comment on issue #27612: [SPARK-30857][SQL][2.4] Fix truncations of timestamps before the epoch to hours and days

2020-02-17 Thread GitBox
AmplabJenkins removed a comment on issue #27612: [SPARK-30857][SQL][2.4] Fix truncations of timestamps before the epoch to hours and days URL: https://github.com/apache/spark/pull/27612#issuecomment-587292921 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #27612: [SPARK-30857][SQL][2.4] Fix truncations of timestamps before the epoch to hours and days

2020-02-17 Thread GitBox
AmplabJenkins commented on issue #27612: [SPARK-30857][SQL][2.4] Fix truncations of timestamps before the epoch to hours and days URL: https://github.com/apache/spark/pull/27612#issuecomment-587292926 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27612: [SPARK-30857][SQL][2.4] Fix truncations of timestamps before the epoch to hours and days

2020-02-17 Thread GitBox
AmplabJenkins removed a comment on issue #27612: [SPARK-30857][SQL][2.4] Fix truncations of timestamps before the epoch to hours and days URL: https://github.com/apache/spark/pull/27612#issuecomment-587292926 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #27612: [SPARK-30857][SQL][2.4] Fix truncations of timestamps before the epoch to hours and days

2020-02-17 Thread GitBox
AmplabJenkins commented on issue #27612: [SPARK-30857][SQL][2.4] Fix truncations of timestamps before the epoch to hours and days URL: https://github.com/apache/spark/pull/27612#issuecomment-587292921 Merged build finished. Test PASSed.

[GitHub] [spark] cloud-fan commented on a change in pull request #27616: [SPARK-30864] [SQL]add the user guide for Adaptive Query Execution

2020-02-17 Thread GitBox
cloud-fan commented on a change in pull request #27616: [SPARK-30864] [SQL]add the user guide for Adaptive Query Execution URL: https://github.com/apache/spark/pull/27616#discussion_r380471798 ## File path: docs/sql-performance-tuning.md ## @@ -186,3 +186,75 @@ The

[GitHub] [spark] SparkQA commented on issue #27563: [SPARK-30812][SQL][CORE] Revise boolean config name to comply with new config naming policy

2020-02-17 Thread GitBox
SparkQA commented on issue #27563: [SPARK-30812][SQL][CORE] Revise boolean config name to comply with new config naming policy URL: https://github.com/apache/spark/pull/27563#issuecomment-587298211 **[Test build #118614 has

[GitHub] [spark] HyukjinKwon commented on issue #27572: [SPARK-30825][SQL][DOC] Update documents information for window function.

2020-02-17 Thread GitBox
HyukjinKwon commented on issue #27572: [SPARK-30825][SQL][DOC] Update documents information for window function. URL: https://github.com/apache/spark/pull/27572#issuecomment-587219989 Merged to master and branch-3.0. This is

[GitHub] [spark] HyukjinKwon commented on issue #27572: [SPARK-30825][SQL][DOC] Update documents information for window function.

2020-02-17 Thread GitBox
HyukjinKwon commented on issue #27572: [SPARK-30825][SQL][DOC] Update documents information for window function. URL: https://github.com/apache/spark/pull/27572#issuecomment-587219059 Merged to master and branch-3.0. This is

[GitHub] [spark] HyukjinKwon closed pull request #27572: [SPARK-30825][SQL][DOC] Update documents information for window function.

2020-02-17 Thread GitBox
HyukjinKwon closed pull request #27572: [SPARK-30825][SQL][DOC] Update documents information for window function. URL: https://github.com/apache/spark/pull/27572 This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on issue #27613: [SPARK-30859][PYSPARK][DOCS][MINOR] Fixed docstring syntax issues preventing proper compilation of documentation.

2020-02-17 Thread GitBox
AmplabJenkins commented on issue #27613: [SPARK-30859][PYSPARK][DOCS][MINOR] Fixed docstring syntax issues preventing proper compilation of documentation. URL: https://github.com/apache/spark/pull/27613#issuecomment-587226418 Test PASSed. Refer to this link for build results (access

[GitHub] [spark] AmplabJenkins commented on issue #27613: [SPARK-30859][PYSPARK][DOCS][MINOR] Fixed docstring syntax issues preventing proper compilation of documentation.

2020-02-17 Thread GitBox
AmplabJenkins commented on issue #27613: [SPARK-30859][PYSPARK][DOCS][MINOR] Fixed docstring syntax issues preventing proper compilation of documentation. URL: https://github.com/apache/spark/pull/27613#issuecomment-587226414 Merged build finished. Test PASSed.

[GitHub] [spark] HyukjinKwon commented on a change in pull request #27610: [SPARK-30856][SQL][PySpark] Fix SQLContext.getOrCreate() when SparkContext is restarted

2020-02-17 Thread GitBox
HyukjinKwon commented on a change in pull request #27610: [SPARK-30856][SQL][PySpark] Fix SQLContext.getOrCreate() when SparkContext is restarted URL: https://github.com/apache/spark/pull/27610#discussion_r380411871 ## File path: python/pyspark/sql/tests/test_session.py

[GitHub] [spark] AmplabJenkins removed a comment on issue #27613: [SPARK-30859][PYSPARK][DOCS][MINOR] Fixed docstring syntax issues preventing proper compilation of documentation.

2020-02-17 Thread GitBox
AmplabJenkins removed a comment on issue #27613: [SPARK-30859][PYSPARK][DOCS][MINOR] Fixed docstring syntax issues preventing proper compilation of documentation. URL: https://github.com/apache/spark/pull/27613#issuecomment-587226414 Merged build finished. Test PASSed.

[GitHub] [spark] beliefer commented on a change in pull request #27592: [SPARK-30840][CORE][SQL] Add version property for ConfigEntry and ConfigBuilder

2020-02-17 Thread GitBox
beliefer commented on a change in pull request #27592: [SPARK-30840][CORE][SQL] Add version property for ConfigEntry and ConfigBuilder URL: https://github.com/apache/spark/pull/27592#discussion_r380412194 ## File path: sql/gen-sql-config-docs.py ## @@ -49,12 +50,13 @@ def

[GitHub] [spark] AmplabJenkins removed a comment on issue #27613: [SPARK-30859][PYSPARK][DOCS][MINOR] Fixed docstring syntax issues preventing proper compilation of documentation.

2020-02-17 Thread GitBox
AmplabJenkins removed a comment on issue #27613: [SPARK-30859][PYSPARK][DOCS][MINOR] Fixed docstring syntax issues preventing proper compilation of documentation. URL: https://github.com/apache/spark/pull/27613#issuecomment-587226418 Test PASSed. Refer to this link for build results

[GitHub] [spark] HyukjinKwon commented on a change in pull request #27610: [SPARK-30856][SQL][PySpark] Fix SQLContext.getOrCreate() when SparkContext is restarted

2020-02-17 Thread GitBox
HyukjinKwon commented on a change in pull request #27610: [SPARK-30856][SQL][PySpark] Fix SQLContext.getOrCreate() when SparkContext is restarted URL: https://github.com/apache/spark/pull/27610#discussion_r380422547 ## File path: python/pyspark/sql/tests/test_session.py

[GitHub] [spark] HyukjinKwon opened a new pull request #27614: [SPARK-30861][PYTHON][SQL] Deprecate constructor of SQLContext and getOrCreate in SQLContext at PySpark

2020-02-17 Thread GitBox
HyukjinKwon opened a new pull request #27614: [SPARK-30861][PYTHON][SQL] Deprecate constructor of SQLContext and getOrCreate in SQLContext at PySpark URL: https://github.com/apache/spark/pull/27614 ### What changes were proposed in this pull request? This PR proposes to deprecate

[GitHub] [spark] AmplabJenkins removed a comment on issue #27614: [SPARK-30861][PYTHON][SQL] Deprecate constructor of SQLContext and getOrCreate in SQLContext at PySpark

2020-02-17 Thread GitBox
AmplabJenkins removed a comment on issue #27614: [SPARK-30861][PYTHON][SQL] Deprecate constructor of SQLContext and getOrCreate in SQLContext at PySpark URL: https://github.com/apache/spark/pull/27614#issuecomment-587245723 Test PASSed. Refer to this link for build results (access

[GitHub] [spark] AmplabJenkins commented on issue #27614: [SPARK-30861][PYTHON][SQL] Deprecate constructor of SQLContext and getOrCreate in SQLContext at PySpark

2020-02-17 Thread GitBox
AmplabJenkins commented on issue #27614: [SPARK-30861][PYTHON][SQL] Deprecate constructor of SQLContext and getOrCreate in SQLContext at PySpark URL: https://github.com/apache/spark/pull/27614#issuecomment-587245723 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] WeichenXu123 commented on issue #27565: [SPARK-30791][SQL][PYTHON] Add 'sameSemantics' and 'sementicHash' methods in Dataset

2020-02-17 Thread GitBox
WeichenXu123 commented on issue #27565: [SPARK-30791][SQL][PYTHON] Add 'sameSemantics' and 'sementicHash' methods in Dataset URL: https://github.com/apache/spark/pull/27565#issuecomment-587245610 Merge to master/branch-3.0

[GitHub] [spark] AmplabJenkins commented on issue #27614: [SPARK-30861][PYTHON][SQL] Deprecate constructor of SQLContext and getOrCreate in SQLContext at PySpark

2020-02-17 Thread GitBox
AmplabJenkins commented on issue #27614: [SPARK-30861][PYTHON][SQL] Deprecate constructor of SQLContext and getOrCreate in SQLContext at PySpark URL: https://github.com/apache/spark/pull/27614#issuecomment-587245715 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27614: [SPARK-30861][PYTHON][SQL] Deprecate constructor of SQLContext and getOrCreate in SQLContext at PySpark

2020-02-17 Thread GitBox
AmplabJenkins removed a comment on issue #27614: [SPARK-30861][PYTHON][SQL] Deprecate constructor of SQLContext and getOrCreate in SQLContext at PySpark URL: https://github.com/apache/spark/pull/27614#issuecomment-587245715 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #27614: [SPARK-30861][PYTHON][SQL] Deprecate constructor of SQLContext and getOrCreate in SQLContext at PySpark

2020-02-17 Thread GitBox
SparkQA commented on issue #27614: [SPARK-30861][PYTHON][SQL] Deprecate constructor of SQLContext and getOrCreate in SQLContext at PySpark URL: https://github.com/apache/spark/pull/27614#issuecomment-587245482 **[Test build #118605 has

[GitHub] [spark] SparkQA removed a comment on issue #27614: [SPARK-30861][PYTHON][SQL] Deprecate constructor of SQLContext and getOrCreate in SQLContext at PySpark

2020-02-17 Thread GitBox
SparkQA removed a comment on issue #27614: [SPARK-30861][PYTHON][SQL] Deprecate constructor of SQLContext and getOrCreate in SQLContext at PySpark URL: https://github.com/apache/spark/pull/27614#issuecomment-587238159 **[Test build #118605 has

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #27612: [SPARK-30857][SQL][2.4] Fix truncations of timestamps before the epoch to hours and days

2020-02-17 Thread GitBox
dongjoon-hyun commented on a change in pull request #27612: [SPARK-30857][SQL][2.4] Fix truncations of timestamps before the epoch to hours and days URL: https://github.com/apache/spark/pull/27612#discussion_r380444937 ## File path:

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #27612: [SPARK-30857][SQL][2.4] Fix truncations of timestamps before the epoch to hours and days

2020-02-17 Thread GitBox
dongjoon-hyun commented on a change in pull request #27612: [SPARK-30857][SQL][2.4] Fix truncations of timestamps before the epoch to hours and days URL: https://github.com/apache/spark/pull/27612#discussion_r380444937 ## File path:

[GitHub] [spark] dongjoon-hyun closed pull request #27589: [WIP][K8S] Jenkins IT health check

2020-02-17 Thread GitBox
dongjoon-hyun closed pull request #27589: [WIP][K8S] Jenkins IT health check URL: https://github.com/apache/spark/pull/27589 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on issue #27615: [SPARK-29148][CORE][FOLLOW-UP] Don't dynamic allocation warning when it's disabled

2020-02-17 Thread GitBox
AmplabJenkins commented on issue #27615: [SPARK-29148][CORE][FOLLOW-UP] Don't dynamic allocation warning when it's disabled URL: https://github.com/apache/spark/pull/27615#issuecomment-587286852 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27615: [SPARK-29148][CORE][FOLLOW-UP] Don't dynamic allocation warning when it's disabled

2020-02-17 Thread GitBox
AmplabJenkins commented on issue #27615: [SPARK-29148][CORE][FOLLOW-UP] Don't dynamic allocation warning when it's disabled URL: https://github.com/apache/spark/pull/27615#issuecomment-587286849 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #27539: [SPARK-30786] [CORE] Fix Block replication failure propogation issue in BlockManager

2020-02-17 Thread GitBox
AmplabJenkins commented on issue #27539: [SPARK-30786] [CORE] Fix Block replication failure propogation issue in BlockManager URL: https://github.com/apache/spark/pull/27539#issuecomment-587286839 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27539: [SPARK-30786] [CORE] Fix Block replication failure propogation issue in BlockManager

2020-02-17 Thread GitBox
AmplabJenkins removed a comment on issue #27539: [SPARK-30786] [CORE] Fix Block replication failure propogation issue in BlockManager URL: https://github.com/apache/spark/pull/27539#issuecomment-587286841 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins removed a comment on issue #27615: [SPARK-29148][CORE][FOLLOW-UP] Don't dynamic allocation warning when it's disabled

2020-02-17 Thread GitBox
AmplabJenkins removed a comment on issue #27615: [SPARK-29148][CORE][FOLLOW-UP] Don't dynamic allocation warning when it's disabled URL: https://github.com/apache/spark/pull/27615#issuecomment-587286852 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins removed a comment on issue #27539: [SPARK-30786] [CORE] Fix Block replication failure propogation issue in BlockManager

2020-02-17 Thread GitBox
AmplabJenkins removed a comment on issue #27539: [SPARK-30786] [CORE] Fix Block replication failure propogation issue in BlockManager URL: https://github.com/apache/spark/pull/27539#issuecomment-587286839 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #27539: [SPARK-30786] [CORE] Fix Block replication failure propogation issue in BlockManager

2020-02-17 Thread GitBox
AmplabJenkins commented on issue #27539: [SPARK-30786] [CORE] Fix Block replication failure propogation issue in BlockManager URL: https://github.com/apache/spark/pull/27539#issuecomment-587286841 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27615: [SPARK-29148][CORE][FOLLOW-UP] Don't dynamic allocation warning when it's disabled

2020-02-17 Thread GitBox
AmplabJenkins removed a comment on issue #27615: [SPARK-29148][CORE][FOLLOW-UP] Don't dynamic allocation warning when it's disabled URL: https://github.com/apache/spark/pull/27615#issuecomment-587286849 Merged build finished. Test PASSed.

[GitHub] [spark] prakharjain09 commented on a change in pull request #27539: [SPARK-30786] [CORE] Fix Block replication failure propogation issue in BlockManager

2020-02-17 Thread GitBox
prakharjain09 commented on a change in pull request #27539: [SPARK-30786] [CORE] Fix Block replication failure propogation issue in BlockManager URL: https://github.com/apache/spark/pull/27539#discussion_r380462330 ## File path:

[GitHub] [spark] SparkQA commented on issue #27615: [SPARK-29148][CORE][FOLLOW-UP] Don't dynamic allocation warning when it's disabled

2020-02-17 Thread GitBox
SparkQA commented on issue #27615: [SPARK-29148][CORE][FOLLOW-UP] Don't dynamic allocation warning when it's disabled URL: https://github.com/apache/spark/pull/27615#issuecomment-587286579 **[Test build #118609 has

[GitHub] [spark] cloud-fan commented on a change in pull request #27495: [SPARK-28880][SQL] Support ANSI nested bracketed comments

2020-02-17 Thread GitBox
cloud-fan commented on a change in pull request #27495: [SPARK-28880][SQL] Support ANSI nested bracketed comments URL: https://github.com/apache/spark/pull/27495#discussion_r380469230 ## File path: sql/catalyst/src/main/antlr4/org/apache/spark/sql/catalyst/parser/SqlBase.g4

[GitHub] [spark] AmplabJenkins removed a comment on issue #27616: [SPARK-30864] [SQL]add the user guide for Adaptive Query Execution

2020-02-17 Thread GitBox
AmplabJenkins removed a comment on issue #27616: [SPARK-30864] [SQL]add the user guide for Adaptive Query Execution URL: https://github.com/apache/spark/pull/27616#issuecomment-587294916 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] cloud-fan commented on a change in pull request #27616: [SPARK-30864] [SQL]add the user guide for Adaptive Query Execution

2020-02-17 Thread GitBox
cloud-fan commented on a change in pull request #27616: [SPARK-30864] [SQL]add the user guide for Adaptive Query Execution URL: https://github.com/apache/spark/pull/27616#discussion_r380469633 ## File path: docs/sql-performance-tuning.md ## @@ -186,3 +186,75 @@ The

[GitHub] [spark] cloud-fan commented on a change in pull request #27616: [SPARK-30864] [SQL]add the user guide for Adaptive Query Execution

2020-02-17 Thread GitBox
cloud-fan commented on a change in pull request #27616: [SPARK-30864] [SQL]add the user guide for Adaptive Query Execution URL: https://github.com/apache/spark/pull/27616#discussion_r380469476 ## File path: docs/sql-performance-tuning.md ## @@ -186,3 +186,75 @@ The

[GitHub] [spark] SparkQA commented on issue #27616: [SPARK-30864] [SQL]add the user guide for Adaptive Query Execution

2020-02-17 Thread GitBox
SparkQA commented on issue #27616: [SPARK-30864] [SQL]add the user guide for Adaptive Query Execution URL: https://github.com/apache/spark/pull/27616#issuecomment-587294511 **[Test build #118613 has

[GitHub] [spark] AmplabJenkins commented on issue #27616: [SPARK-30864] [SQL]add the user guide for Adaptive Query Execution

2020-02-17 Thread GitBox
AmplabJenkins commented on issue #27616: [SPARK-30864] [SQL]add the user guide for Adaptive Query Execution URL: https://github.com/apache/spark/pull/27616#issuecomment-587294911 Merged build finished. Test PASSed. This is

[GitHub] [spark] AmplabJenkins commented on issue #27616: [SPARK-30864] [SQL]add the user guide for Adaptive Query Execution

2020-02-17 Thread GitBox
AmplabJenkins commented on issue #27616: [SPARK-30864] [SQL]add the user guide for Adaptive Query Execution URL: https://github.com/apache/spark/pull/27616#issuecomment-587294916 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27616: [SPARK-30864] [SQL]add the user guide for Adaptive Query Execution

2020-02-17 Thread GitBox
AmplabJenkins removed a comment on issue #27616: [SPARK-30864] [SQL]add the user guide for Adaptive Query Execution URL: https://github.com/apache/spark/pull/27616#issuecomment-587294911 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #27563: [SPARK-30812][SQL][CORE] Revise boolean config name to comply with new config naming policy

2020-02-17 Thread GitBox
SparkQA commented on issue #27563: [SPARK-30812][SQL][CORE] Revise boolean config name to comply with new config naming policy URL: https://github.com/apache/spark/pull/27563#issuecomment-587302299 **[Test build #118614 has

[GitHub] [spark] AmplabJenkins commented on issue #27563: [SPARK-30812][SQL][CORE] Revise boolean config name to comply with new config naming policy

2020-02-17 Thread GitBox
AmplabJenkins commented on issue #27563: [SPARK-30812][SQL][CORE] Revise boolean config name to comply with new config naming policy URL: https://github.com/apache/spark/pull/27563#issuecomment-587302308 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27563: [SPARK-30812][SQL][CORE] Revise boolean config name to comply with new config naming policy

2020-02-17 Thread GitBox
AmplabJenkins removed a comment on issue #27563: [SPARK-30812][SQL][CORE] Revise boolean config name to comply with new config naming policy URL: https://github.com/apache/spark/pull/27563#issuecomment-587302308 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins commented on issue #27563: [SPARK-30812][SQL][CORE] Revise boolean config name to comply with new config naming policy

2020-02-17 Thread GitBox
AmplabJenkins commented on issue #27563: [SPARK-30812][SQL][CORE] Revise boolean config name to comply with new config naming policy URL: https://github.com/apache/spark/pull/27563#issuecomment-587302311 Test FAILed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] SparkQA removed a comment on issue #27563: [SPARK-30812][SQL][CORE] Revise boolean config name to comply with new config naming policy

2020-02-17 Thread GitBox
SparkQA removed a comment on issue #27563: [SPARK-30812][SQL][CORE] Revise boolean config name to comply with new config naming policy URL: https://github.com/apache/spark/pull/27563#issuecomment-587298211 **[Test build #118614 has

[GitHub] [spark] SparkQA removed a comment on issue #27608: [SPARK-30863][SQL] Distinguish Cast and AnsiCast in toString

2020-02-17 Thread GitBox
SparkQA removed a comment on issue #27608: [SPARK-30863][SQL] Distinguish Cast and AnsiCast in toString URL: https://github.com/apache/spark/pull/27608#issuecomment-587250020 **[Test build #118607 has

[GitHub] [spark] SparkQA commented on issue #27608: [SPARK-30863][SQL] Distinguish Cast and AnsiCast in toString

2020-02-17 Thread GitBox
SparkQA commented on issue #27608: [SPARK-30863][SQL] Distinguish Cast and AnsiCast in toString URL: https://github.com/apache/spark/pull/27608#issuecomment-587318252 **[Test build #118607 has

[GitHub] [spark] huaxingao commented on a change in pull request #27570: [SPARK-30820][SPARKR][ML] Add FMClassifier to SparkR

2020-02-17 Thread GitBox
huaxingao commented on a change in pull request #27570: [SPARK-30820][SPARKR][ML] Add FMClassifier to SparkR URL: https://github.com/apache/spark/pull/27570#discussion_r380399728 ## File path: mllib/src/main/scala/org/apache/spark/ml/r/FMClassifierWrapper.scala ## @@ -0,0

[GitHub] [spark] huaxingao commented on a change in pull request #27570: [SPARK-30820][SPARKR][ML] Add FMClassifier to SparkR

2020-02-17 Thread GitBox
huaxingao commented on a change in pull request #27570: [SPARK-30820][SPARKR][ML] Add FMClassifier to SparkR URL: https://github.com/apache/spark/pull/27570#discussion_r380399541 ## File path: examples/src/main/r/ml/fmClassifier.R ## @@ -0,0 +1,45 @@ +# +# Licensed to the

[GitHub] [spark] huaxingao commented on a change in pull request #27570: [SPARK-30820][SPARKR][ML] Add FMClassifier to SparkR

2020-02-17 Thread GitBox
huaxingao commented on a change in pull request #27570: [SPARK-30820][SPARKR][ML] Add FMClassifier to SparkR URL: https://github.com/apache/spark/pull/27570#discussion_r380399205 ## File path: R/pkg/tests/fulltests/test_mllib_classification.R ## @@ -488,4 +488,36 @@

[GitHub] [spark] huaxingao commented on a change in pull request #27570: [SPARK-30820][SPARKR][ML] Add FMClassifier to SparkR

2020-02-17 Thread GitBox
huaxingao commented on a change in pull request #27570: [SPARK-30820][SPARKR][ML] Add FMClassifier to SparkR URL: https://github.com/apache/spark/pull/27570#discussion_r380397275 ## File path: R/pkg/R/mllib_classification.R ## @@ -649,3 +655,154 @@ setMethod("write.ml",

[GitHub] [spark] HyukjinKwon commented on issue #27613: [SPARK-30859][PYSPARK][DOCS][MINOR] Fixed docstring syntax issues preventing proper compilation of documentation.

2020-02-17 Thread GitBox
HyukjinKwon commented on issue #27613: [SPARK-30859][PYSPARK][DOCS][MINOR] Fixed docstring syntax issues preventing proper compilation of documentation. URL: https://github.com/apache/spark/pull/27613#issuecomment-587225335 ok to test

[GitHub] [spark] zero323 commented on a change in pull request #27570: [SPARK-30820][SPARKR][ML] Add FMClassifier to SparkR

2020-02-17 Thread GitBox
zero323 commented on a change in pull request #27570: [SPARK-30820][SPARKR][ML] Add FMClassifier to SparkR URL: https://github.com/apache/spark/pull/27570#discussion_r380410686 ## File path: R/pkg/R/mllib_classification.R ## @@ -649,3 +655,154 @@ setMethod("write.ml",

[GitHub] [spark] zero323 commented on a change in pull request #27570: [SPARK-30820][SPARKR][ML] Add FMClassifier to SparkR

2020-02-17 Thread GitBox
zero323 commented on a change in pull request #27570: [SPARK-30820][SPARKR][ML] Add FMClassifier to SparkR URL: https://github.com/apache/spark/pull/27570#discussion_r380410443 ## File path: R/pkg/tests/fulltests/test_mllib_classification.R ## @@ -488,4 +488,36 @@

[GitHub] [spark] AmplabJenkins removed a comment on issue #27613: [SPARK-30859][PYSPARK][DOCS][MINOR] Fixed docstring syntax issues preventing proper compilation of documentation.

2020-02-17 Thread GitBox
AmplabJenkins removed a comment on issue #27613: [SPARK-30859][PYSPARK][DOCS][MINOR] Fixed docstring syntax issues preventing proper compilation of documentation. URL: https://github.com/apache/spark/pull/27613#issuecomment-587129161 Can one of the admins verify this patch?

[GitHub] [spark] HyukjinKwon commented on issue #27613: [SPARK-30859][PYSPARK][DOCS][MINOR] Fixed docstring syntax issues preventing proper compilation of documentation.

2020-02-17 Thread GitBox
HyukjinKwon commented on issue #27613: [SPARK-30859][PYSPARK][DOCS][MINOR] Fixed docstring syntax issues preventing proper compilation of documentation. URL: https://github.com/apache/spark/pull/27613#issuecomment-587225458 @DavidToneian, can you check if there are more instances to fix in

[GitHub] [spark] WeichenXu123 closed pull request #27565: [SPARK-30791][SQL][PYTHON] Add 'sameSemantics' and 'sementicHash' methods in Dataset

2020-02-17 Thread GitBox
WeichenXu123 closed pull request #27565: [SPARK-30791][SQL][PYTHON] Add 'sameSemantics' and 'sementicHash' methods in Dataset URL: https://github.com/apache/spark/pull/27565 This is an automated message from the Apache Git

[GitHub] [spark] HyukjinKwon commented on issue #27610: [SPARK-30856][SQL][PySpark] Fix SQLContext.getOrCreate() when SparkContext is restarted

2020-02-17 Thread GitBox
HyukjinKwon commented on issue #27610: [SPARK-30856][SQL][PySpark] Fix SQLContext.getOrCreate() when SparkContext is restarted URL: https://github.com/apache/spark/pull/27610#issuecomment-587230056 The fix looks fine but I found another issue. `SQLContext.getOrCreate` was removed but

[GitHub] [spark] SparkQA commented on issue #27570: [SPARK-30820][SPARKR][ML] Add FMClassifier to SparkR

2020-02-17 Thread GitBox
SparkQA commented on issue #27570: [SPARK-30820][SPARKR][ML] Add FMClassifier to SparkR URL: https://github.com/apache/spark/pull/27570#issuecomment-587230419 **[Test build #118603 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/118603/testReport)** for PR

[GitHub] [spark] Ngone51 commented on a change in pull request #27539: [SPARK-30786] [CORE] Fix Block replication failure propogation issue in BlockManager

2020-02-17 Thread GitBox
Ngone51 commented on a change in pull request #27539: [SPARK-30786] [CORE] Fix Block replication failure propogation issue in BlockManager URL: https://github.com/apache/spark/pull/27539#discussion_r380419021 ## File path:

[GitHub] [spark] Ngone51 commented on a change in pull request #27539: [SPARK-30786] [CORE] Fix Block replication failure propogation issue in BlockManager

2020-02-17 Thread GitBox
Ngone51 commented on a change in pull request #27539: [SPARK-30786] [CORE] Fix Block replication failure propogation issue in BlockManager URL: https://github.com/apache/spark/pull/27539#discussion_r380419076 ## File path:

[GitHub] [spark] ajithme commented on issue #27041: [SPARK-25061][SQL] Precedence for ThriftServer hiveconf commandline parameter

2020-02-17 Thread GitBox
ajithme commented on issue #27041: [SPARK-25061][SQL] Precedence for ThriftServer hiveconf commandline parameter URL: https://github.com/apache/spark/pull/27041#issuecomment-587238739 gentle ping @dongjoon-hyun @yhuai @cloud-fan @HyukjinKwon can we get this fix in 3.0.?

[GitHub] [spark] ajithme removed a comment on issue #27234: [SPARK-23626][CORE] DAGScheduler blocked due to JobSubmitted event

2020-02-17 Thread GitBox
ajithme removed a comment on issue #27234: [SPARK-23626][CORE] DAGScheduler blocked due to JobSubmitted event URL: https://github.com/apache/spark/pull/27234#issuecomment-578640423 gentle ping @squito @dongjoon-hyun @vanzin @srowen

[GitHub] [spark] ajithme commented on issue #27234: [SPARK-23626][CORE] DAGScheduler blocked due to JobSubmitted event

2020-02-17 Thread GitBox
ajithme commented on issue #27234: [SPARK-23626][CORE] DAGScheduler blocked due to JobSubmitted event URL: https://github.com/apache/spark/pull/27234#issuecomment-587239018 gentle ping @squito @dongjoon-hyun @vanzin @srowen

[GitHub] [spark] HyukjinKwon edited a comment on issue #27313: [SPARK-29148][CORE] Add stage level scheduling dynamic allocation and scheduler backend changes

2020-02-17 Thread GitBox
HyukjinKwon edited a comment on issue #27313: [SPARK-29148][CORE] Add stage level scheduling dynamic allocation and scheduler backend changes URL: https://github.com/apache/spark/pull/27313#issuecomment-587241841 @tgravescs, I wonder if we can split a PR into multiple small ones next

[GitHub] [spark] HyukjinKwon commented on a change in pull request #27313: [SPARK-29148][CORE] Add stage level scheduling dynamic allocation and scheduler backend changes

2020-02-17 Thread GitBox
HyukjinKwon commented on a change in pull request #27313: [SPARK-29148][CORE] Add stage level scheduling dynamic allocation and scheduler backend changes URL: https://github.com/apache/spark/pull/27313#discussion_r380435488 ## File path:

[GitHub] [spark] SparkQA commented on issue #27609: [WIP][SPARK-27733][CORE] Upgrade Avro to version 1.9.2

2020-02-17 Thread GitBox
SparkQA commented on issue #27609: [WIP][SPARK-27733][CORE] Upgrade Avro to version 1.9.2 URL: https://github.com/apache/spark/pull/27609#issuecomment-587264297 **[Test build #118608 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/118608/testReport)** for

[GitHub] [spark] dongjoon-hyun commented on issue #27536: [SPARK-30784] Use ORC nohive

2020-02-17 Thread GitBox
dongjoon-hyun commented on issue #27536: [SPARK-30784] Use ORC nohive URL: https://github.com/apache/spark/pull/27536#issuecomment-587268128 Yes. Right. `Hive 1.2` exists before `Apache ORC` and has all ORC related stuff as a embedded manner like `org.apache.hive.orc.TypeDescription`.

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #27612: [SPARK-30857][SQL][2.4] Fix truncations of timestamps before the epoch to hours and days

2020-02-17 Thread GitBox
dongjoon-hyun commented on a change in pull request #27612: [SPARK-30857][SQL][2.4] Fix truncations of timestamps before the epoch to hours and days URL: https://github.com/apache/spark/pull/27612#discussion_r380444937 ## File path:

[GitHub] [spark] zhengruifeng commented on a change in pull request #27527: [SPARK-30776][ML] Support FValueRegressionSelector for continuous features and continuous labels

2020-02-17 Thread GitBox
zhengruifeng commented on a change in pull request #27527: [SPARK-30776][ML] Support FValueRegressionSelector for continuous features and continuous labels URL: https://github.com/apache/spark/pull/27527#discussion_r379299313 ## File path:

[GitHub] [spark] cloud-fan commented on a change in pull request #27482: [SPARK-30613][SQL] Support Hive style REPLACE COLUMNS syntax

2020-02-17 Thread GitBox
cloud-fan commented on a change in pull request #27482: [SPARK-30613][SQL] Support Hive style REPLACE COLUMNS syntax URL: https://github.com/apache/spark/pull/27482#discussion_r380458080 ## File path:

[GitHub] [spark] zhengruifeng commented on a change in pull request #27527: [SPARK-30776][ML] Support FValueRegressionSelector for continuous features and continuous labels

2020-02-17 Thread GitBox
zhengruifeng commented on a change in pull request #27527: [SPARK-30776][ML] Support FValueRegressionSelector for continuous features and continuous labels URL: https://github.com/apache/spark/pull/27527#discussion_r379299313 ## File path:

[GitHub] [spark] zhengruifeng commented on a change in pull request #27527: [SPARK-30776][ML] Support FValueRegressionSelector for continuous features and continuous labels

2020-02-17 Thread GitBox
zhengruifeng commented on a change in pull request #27527: [SPARK-30776][ML] Support FValueRegressionSelector for continuous features and continuous labels URL: https://github.com/apache/spark/pull/27527#discussion_r379299313 ## File path:

[GitHub] [spark] AmplabJenkins commented on issue #27495: [SPARK-28880][SQL] Support ANSI nested bracketed comments

2020-02-17 Thread GitBox
AmplabJenkins commented on issue #27495: [SPARK-28880][SQL] Support ANSI nested bracketed comments URL: https://github.com/apache/spark/pull/27495#issuecomment-587290393 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27495: [SPARK-28880][SQL] Support ANSI nested bracketed comments

2020-02-17 Thread GitBox
AmplabJenkins commented on issue #27495: [SPARK-28880][SQL] Support ANSI nested bracketed comments URL: https://github.com/apache/spark/pull/27495#issuecomment-587290390 Merged build finished. Test PASSed. This is an

[GitHub] [spark] dongjoon-hyun edited a comment on issue #27592: [SPARK-30840][CORE][SQL] Add version property for ConfigEntry and ConfigBuilder

2020-02-17 Thread GitBox
dongjoon-hyun edited a comment on issue #27592: [SPARK-30840][CORE][SQL] Add version property for ConfigEntry and ConfigBuilder URL: https://github.com/apache/spark/pull/27592#issuecomment-587289558 The above comment was based on the current JIRA status. If you are going to land on

[GitHub] [spark] zhengruifeng commented on a change in pull request #27527: [SPARK-30776][ML] Support FValueRegressionSelector for continuous features and continuous labels

2020-02-17 Thread GitBox
zhengruifeng commented on a change in pull request #27527: [SPARK-30776][ML] Support FValueRegressionSelector for continuous features and continuous labels URL: https://github.com/apache/spark/pull/27527#discussion_r380457865 ## File path:

[GitHub] [spark] dongjoon-hyun commented on issue #27592: [SPARK-30840][CORE][SQL] Add version property for ConfigEntry and ConfigBuilder

2020-02-17 Thread GitBox
dongjoon-hyun commented on issue #27592: [SPARK-30840][CORE][SQL] Add version property for ConfigEntry and ConfigBuilder URL: https://github.com/apache/spark/pull/27592#issuecomment-587289558 The above comment is based on the current JIRA status. If you are going to land on `branch-3.0`

[GitHub] [spark] dongjoon-hyun edited a comment on issue #27592: [SPARK-30840][CORE][SQL] Add version property for ConfigEntry and ConfigBuilder

2020-02-17 Thread GitBox
dongjoon-hyun edited a comment on issue #27592: [SPARK-30840][CORE][SQL] Add version property for ConfigEntry and ConfigBuilder URL: https://github.com/apache/spark/pull/27592#issuecomment-587289558 The above comment was based on the current JIRA status. If you are going to land on

[GitHub] [spark] dongjoon-hyun edited a comment on issue #27592: [SPARK-30840][CORE][SQL] Add version property for ConfigEntry and ConfigBuilder

2020-02-17 Thread GitBox
dongjoon-hyun edited a comment on issue #27592: [SPARK-30840][CORE][SQL] Add version property for ConfigEntry and ConfigBuilder URL: https://github.com/apache/spark/pull/27592#issuecomment-587289558 The above comment was based on the current JIRA status. If you are going to land on

[GitHub] [spark] cloud-fan commented on a change in pull request #27616: [SPARK-30864] [SQL]add the user guide for Adaptive Query Execution

2020-02-17 Thread GitBox
cloud-fan commented on a change in pull request #27616: [SPARK-30864] [SQL]add the user guide for Adaptive Query Execution URL: https://github.com/apache/spark/pull/27616#discussion_r380470558 ## File path: docs/sql-performance-tuning.md ## @@ -186,3 +186,75 @@ The

[GitHub] [spark] Ngone51 commented on a change in pull request #27563: [SPARK-30812][SQL][CORE] Revise boolean config name to comply with new config naming policy

2020-02-17 Thread GitBox
Ngone51 commented on a change in pull request #27563: [SPARK-30812][SQL][CORE] Revise boolean config name to comply with new config naming policy URL: https://github.com/apache/spark/pull/27563#discussion_r380470606 ## File path:

[GitHub] [spark] zhengruifeng commented on a change in pull request #27555: [SPARK-30802][ML] Use Summarizer instead of MultivariateOnlineSummarizer in Aggregator test suite

2020-02-17 Thread GitBox
zhengruifeng commented on a change in pull request #27555: [SPARK-30802][ML] Use Summarizer instead of MultivariateOnlineSummarizer in Aggregator test suite URL: https://github.com/apache/spark/pull/27555#discussion_r380468433 ## File path:

[GitHub] [spark] zhengruifeng commented on a change in pull request #27555: [SPARK-30802][ML] Use Summarizer instead of MultivariateOnlineSummarizer in Aggregator test suite

2020-02-17 Thread GitBox
zhengruifeng commented on a change in pull request #27555: [SPARK-30802][ML] Use Summarizer instead of MultivariateOnlineSummarizer in Aggregator test suite URL: https://github.com/apache/spark/pull/27555#discussion_r380469360 ## File path:

[GitHub] [spark] AmplabJenkins commented on issue #27563: [SPARK-30812][SQL][CORE] Revise boolean config name to comply with new config naming policy

2020-02-17 Thread GitBox
AmplabJenkins commented on issue #27563: [SPARK-30812][SQL][CORE] Revise boolean config name to comply with new config naming policy URL: https://github.com/apache/spark/pull/27563#issuecomment-587296563 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins removed a comment on issue #27563: [SPARK-30812][SQL][CORE] Revise boolean config name to comply with new config naming policy

2020-02-17 Thread GitBox
AmplabJenkins removed a comment on issue #27563: [SPARK-30812][SQL][CORE] Revise boolean config name to comply with new config naming policy URL: https://github.com/apache/spark/pull/27563#issuecomment-587296551 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27563: [SPARK-30812][SQL][CORE] Revise boolean config name to comply with new config naming policy

2020-02-17 Thread GitBox
AmplabJenkins removed a comment on issue #27563: [SPARK-30812][SQL][CORE] Revise boolean config name to comply with new config naming policy URL: https://github.com/apache/spark/pull/27563#issuecomment-587296563 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins commented on issue #27563: [SPARK-30812][SQL][CORE] Revise boolean config name to comply with new config naming policy

2020-02-17 Thread GitBox
AmplabJenkins commented on issue #27563: [SPARK-30812][SQL][CORE] Revise boolean config name to comply with new config naming policy URL: https://github.com/apache/spark/pull/27563#issuecomment-587296551 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #27592: [SPARK-30840][CORE][SQL] Add version property for ConfigEntry and ConfigBuilder

2020-02-17 Thread GitBox
SparkQA commented on issue #27592: [SPARK-30840][CORE][SQL] Add version property for ConfigEntry and ConfigBuilder URL: https://github.com/apache/spark/pull/27592#issuecomment-587303954 **[Test build #118616 has

[GitHub] [spark] SparkQA commented on issue #27617: [SPARK-30865][SQL] Refactor DateTimeUtils

2020-02-17 Thread GitBox
SparkQA commented on issue #27617: [SPARK-30865][SQL] Refactor DateTimeUtils URL: https://github.com/apache/spark/pull/27617#issuecomment-587303945 **[Test build #118615 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/118615/testReport)** for PR 27617 at

<    1   2   3   4   5   6   7   8   9   10   >