[GitHub] [spark] AmplabJenkins commented on issue #27581: [SPARK-11150][SQL][FOLLOWUP] Move sql/dynamicpruning to sql/execution/dynamicpruning

AmplabJenkins commented on issue #27581: [SPARK-11150][SQL][FOLLOWUP] Move sql/dynamicpruning to sql/execution/dynamicpruning URL: https://github.com/apache/spark/pull/27581#issuecomment-587040215 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27581: [SPARK-11150][SQL][FOLLOWUP] Move sql/dynamicpruning to sql/execution/dynamicpruning

AmplabJenkins commented on issue #27581: [SPARK-11150][SQL][FOLLOWUP] Move sql/dynamicpruning to sql/execution/dynamicpruning URL: https://github.com/apache/spark/pull/27581#issuecomment-587040197 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #27579: [SPARK-30829][SQL] Define LegacyBehaviorPolicy enumeration as the common value for result change configs

SparkQA commented on issue #27579: [SPARK-30829][SQL] Define LegacyBehaviorPolicy enumeration as the common value for result change configs URL: https://github.com/apache/spark/pull/27579#issuecomment-587048660 **[Test build #118565 has

[GitHub] [spark] SparkQA removed a comment on issue #27579: [SPARK-30829][SQL] Define LegacyBehaviorPolicy enumeration as the common value for result change configs

SparkQA removed a comment on issue #27579: [SPARK-30829][SQL] Define LegacyBehaviorPolicy enumeration as the common value for result change configs URL: https://github.com/apache/spark/pull/27579#issuecomment-586912201 **[Test build #118565 has

[GitHub] [spark] AmplabJenkins commented on issue #27495: [SPARK-28880][SQL] Support ANSI nested bracketed comments

AmplabJenkins commented on issue #27495: [SPARK-28880][SQL] Support ANSI nested bracketed comments URL: https://github.com/apache/spark/pull/27495#issuecomment-587054269 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27495: [SPARK-28880][SQL] Support ANSI nested bracketed comments

AmplabJenkins commented on issue #27495: [SPARK-28880][SQL] Support ANSI nested bracketed comments URL: https://github.com/apache/spark/pull/27495#issuecomment-587054264 Merged build finished. Test PASSed. This is an

[GitHub] [spark] cloud-fan closed pull request #27579: [SPARK-30829][SQL] Define LegacyBehaviorPolicy enumeration as the common value for result change configs

cloud-fan closed pull request #27579: [SPARK-30829][SQL] Define LegacyBehaviorPolicy enumeration as the common value for result change configs URL: https://github.com/apache/spark/pull/27579 This is an automated message

[GitHub] [spark] cloud-fan commented on issue #27579: [SPARK-30829][SQL] Define LegacyBehaviorPolicy enumeration as the common value for result change configs

cloud-fan commented on issue #27579: [SPARK-30829][SQL] Define LegacyBehaviorPolicy enumeration as the common value for result change configs URL: https://github.com/apache/spark/pull/27579#issuecomment-587081627 thanks, merging to master/3.0!

[GitHub] [spark] AmplabJenkins commented on issue #27610: [SPARK-30856][SQL][PySpark] Fix SQLContext.getOrCreate() when SparkContext is restarted

AmplabJenkins commented on issue #27610: [SPARK-30856][SQL][PySpark] Fix SQLContext.getOrCreate() when SparkContext is restarted URL: https://github.com/apache/spark/pull/27610#issuecomment-587086259 Can one of the admins verify this patch?

[GitHub] [spark] AmplabJenkins commented on issue #27610: [SPARK-30856][SQL][PySpark] Fix SQLContext.getOrCreate() when SparkContext is restarted

AmplabJenkins commented on issue #27610: [SPARK-30856][SQL][PySpark] Fix SQLContext.getOrCreate() when SparkContext is restarted URL: https://github.com/apache/spark/pull/27610#issuecomment-587086776 Can one of the admins verify this patch?

[GitHub] [spark] cloud-fan commented on a change in pull request #27592: [SPARK-30840][CORE][SQL] Add version property for ConfigEntry and ConfigBuilder

cloud-fan commented on a change in pull request #27592: [SPARK-30840][CORE][SQL] Add version property for ConfigEntry and ConfigBuilder URL: https://github.com/apache/spark/pull/27592#discussion_r380301741 ## File path: sql/gen-sql-config-docs.py ## @@ -49,12 +50,13 @@

[GitHub] [spark] AmplabJenkins removed a comment on issue #27611: [SPARK-30793][SQL][2.4] Fix truncations of timestamps before the epoch to minutes and seconds

AmplabJenkins removed a comment on issue #27611: [SPARK-30793][SQL][2.4] Fix truncations of timestamps before the epoch to minutes and seconds URL: https://github.com/apache/spark/pull/27611#issuecomment-587089784 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27565: [SPARK-30791][SQL][PYTHON] Add 'sameSemantics' and 'sementicHash' methods in Dataset

AmplabJenkins removed a comment on issue #27565: [SPARK-30791][SQL][PYTHON] Add 'sameSemantics' and 'sementicHash' methods in Dataset URL: https://github.com/apache/spark/pull/27565#issuecomment-587090205 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins removed a comment on issue #27539: [SPARK-30786] [CORE] Fix Block replication failure propogation issue in BlockManager

AmplabJenkins removed a comment on issue #27539: [SPARK-30786] [CORE] Fix Block replication failure propogation issue in BlockManager URL: https://github.com/apache/spark/pull/27539#issuecomment-587089846 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] SparkQA removed a comment on issue #27565: [SPARK-30791][SQL][PYTHON] Add 'sameSemantics' and 'sementicHash' methods in Dataset

SparkQA removed a comment on issue #27565: [SPARK-30791][SQL][PYTHON] Add 'sameSemantics' and 'sementicHash' methods in Dataset URL: https://github.com/apache/spark/pull/27565#issuecomment-586948085 **[Test build #118572 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #27539: [SPARK-30786] [CORE] Fix Block replication failure propogation issue in BlockManager

AmplabJenkins removed a comment on issue #27539: [SPARK-30786] [CORE] Fix Block replication failure propogation issue in BlockManager URL: https://github.com/apache/spark/pull/27539#issuecomment-587089837 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27565: [SPARK-30791][SQL][PYTHON] Add 'sameSemantics' and 'sementicHash' methods in Dataset

AmplabJenkins removed a comment on issue #27565: [SPARK-30791][SQL][PYTHON] Add 'sameSemantics' and 'sementicHash' methods in Dataset URL: https://github.com/apache/spark/pull/27565#issuecomment-587090196 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #27608: [MINOR][SQL] Distinguish Cast and AnsiCast in toString

SparkQA commented on issue #27608: [MINOR][SQL] Distinguish Cast and AnsiCast in toString URL: https://github.com/apache/spark/pull/27608#issuecomment-587097895 **[Test build #118592 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/118592/testReport)** for

[GitHub] [spark] AmplabJenkins removed a comment on issue #27611: [SPARK-30793][SQL][2.4] Fix truncations of timestamps before the epoch to minutes and seconds

AmplabJenkins removed a comment on issue #27611: [SPARK-30793][SQL][2.4] Fix truncations of timestamps before the epoch to minutes and seconds URL: https://github.com/apache/spark/pull/27611#issuecomment-587089796 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] MaxGekk commented on issue #27612: [SPARK-30857][SQL][2.4] Fix truncations of timestamps before the epoch to hours and days

MaxGekk commented on issue #27612: [SPARK-30857][SQL][2.4] Fix truncations of timestamps before the epoch to hours and days URL: https://github.com/apache/spark/pull/27612#issuecomment-587105179 @cloud-fan @dongjoon-hyun 2.4 has similar to #27611 issue but for the `HOUR` and `DAY` levels.

[GitHub] [spark] SparkQA commented on issue #27558: [SPARK-30806][SQL]Evaluate once per group in UnboundedWindowFunctionFrame

SparkQA commented on issue #27558: [SPARK-30806][SQL]Evaluate once per group in UnboundedWindowFunctionFrame URL: https://github.com/apache/spark/pull/27558#issuecomment-587041398 **[Test build #118591 has

[GitHub] [spark] srowen commented on issue #25899: [SPARK-29089][SQL] Parallelize blocking FileSystem calls in DataSource#checkAndGlobPathIfNecessary

srowen commented on issue #25899: [SPARK-29089][SQL] Parallelize blocking FileSystem calls in DataSource#checkAndGlobPathIfNecessary URL: https://github.com/apache/spark/pull/25899#issuecomment-587046752 Merged to master

[GitHub] [spark] srowen closed pull request #25899: [SPARK-29089][SQL] Parallelize blocking FileSystem calls in DataSource#checkAndGlobPathIfNecessary

srowen closed pull request #25899: [SPARK-29089][SQL] Parallelize blocking FileSystem calls in DataSource#checkAndGlobPathIfNecessary URL: https://github.com/apache/spark/pull/25899 This is an automated message from the

[GitHub] [spark] AmplabJenkins removed a comment on issue #27518: [WIP][SPARK-30768][SQL] Constraints should be inferred from inequality attributes

AmplabJenkins removed a comment on issue #27518: [WIP][SPARK-30768][SQL] Constraints should be inferred from inequality attributes URL: https://github.com/apache/spark/pull/27518#issuecomment-587045960 Test FAILed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #27266: [SPARK-22590][SQL] Copy sparkContext.localproperties to child thread in BroadcastExchangeExec.executionContext

AmplabJenkins commented on issue #27266: [SPARK-22590][SQL] Copy sparkContext.localproperties to child thread in BroadcastExchangeExec.executionContext URL: https://github.com/apache/spark/pull/27266#issuecomment-587058422 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins commented on issue #27266: [SPARK-22590][SQL] Copy sparkContext.localproperties to child thread in BroadcastExchangeExec.executionContext

AmplabJenkins commented on issue #27266: [SPARK-22590][SQL] Copy sparkContext.localproperties to child thread in BroadcastExchangeExec.executionContext URL: https://github.com/apache/spark/pull/27266#issuecomment-587058430 Test FAILed. Refer to this link for build results (access

[GitHub] [spark] AmplabJenkins removed a comment on issue #27266: [SPARK-22590][SQL] Copy sparkContext.localproperties to child thread in BroadcastExchangeExec.executionContext

AmplabJenkins removed a comment on issue #27266: [SPARK-22590][SQL] Copy sparkContext.localproperties to child thread in BroadcastExchangeExec.executionContext URL: https://github.com/apache/spark/pull/27266#issuecomment-587058422 Merged build finished. Test FAILed.

[GitHub] [spark] SparkQA removed a comment on issue #27266: [SPARK-22590][SQL] Copy sparkContext.localproperties to child thread in BroadcastExchangeExec.executionContext

SparkQA removed a comment on issue #27266: [SPARK-22590][SQL] Copy sparkContext.localproperties to child thread in BroadcastExchangeExec.executionContext URL: https://github.com/apache/spark/pull/27266#issuecomment-586991112 **[Test build #118583 has

[GitHub] [spark] SparkQA commented on issue #27266: [SPARK-22590][SQL] Copy sparkContext.localproperties to child thread in BroadcastExchangeExec.executionContext

SparkQA commented on issue #27266: [SPARK-22590][SQL] Copy sparkContext.localproperties to child thread in BroadcastExchangeExec.executionContext URL: https://github.com/apache/spark/pull/27266#issuecomment-587057881 **[Test build #118583 has

[GitHub] [spark] AmplabJenkins commented on issue #27539: [SPARK-30786] [CORE] Fix Block replication failure propogation issue in BlockManager

AmplabJenkins commented on issue #27539: [SPARK-30786] [CORE] Fix Block replication failure propogation issue in BlockManager URL: https://github.com/apache/spark/pull/27539#issuecomment-587089846 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27611: [SPARK-30793][SQL][2.4] Fix truncations of timestamps before the epoch to minutes and seconds

AmplabJenkins commented on issue #27611: [SPARK-30793][SQL][2.4] Fix truncations of timestamps before the epoch to minutes and seconds URL: https://github.com/apache/spark/pull/27611#issuecomment-587089796 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #27539: [SPARK-30786] [CORE] Fix Block replication failure propogation issue in BlockManager

AmplabJenkins commented on issue #27539: [SPARK-30786] [CORE] Fix Block replication failure propogation issue in BlockManager URL: https://github.com/apache/spark/pull/27539#issuecomment-587089837 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #27611: [SPARK-30793][SQL][2.4] Fix truncations of timestamps before the epoch to minutes and seconds

AmplabJenkins commented on issue #27611: [SPARK-30793][SQL][2.4] Fix truncations of timestamps before the epoch to minutes and seconds URL: https://github.com/apache/spark/pull/27611#issuecomment-587089784 Merged build finished. Test PASSed.

[GitHub] [spark] cloud-fan commented on issue #27539: [SPARK-30786] [CORE] Fix Block replication failure propogation issue in BlockManager

cloud-fan commented on issue #27539: [SPARK-30786] [CORE] Fix Block replication failure propogation issue in BlockManager URL: https://github.com/apache/spark/pull/27539#issuecomment-587089472 retest this please This is an

[GitHub] [spark] SparkQA commented on issue #27565: [SPARK-30791][SQL][PYTHON] Add 'sameSemantics' and 'sementicHash' methods in Dataset

SparkQA commented on issue #27565: [SPARK-30791][SQL][PYTHON] Add 'sameSemantics' and 'sementicHash' methods in Dataset URL: https://github.com/apache/spark/pull/27565#issuecomment-587089410 **[Test build #118572 has

[GitHub] [spark] SparkQA commented on issue #27611: [SPARK-30793][SQL][2.4] Fix truncations of timestamps before the epoch to minutes and seconds

SparkQA commented on issue #27611: [SPARK-30793][SQL][2.4] Fix truncations of timestamps before the epoch to minutes and seconds URL: https://github.com/apache/spark/pull/27611#issuecomment-587089423 **[Test build #118593 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #27608: [MINOR][SQL] Distinguish Cast and AnsiCast in toString

AmplabJenkins removed a comment on issue #27608: [MINOR][SQL] Distinguish Cast and AnsiCast in toString URL: https://github.com/apache/spark/pull/27608#issuecomment-587098045 Merged build finished. Test FAILed. This is an

[GitHub] [spark] SparkQA removed a comment on issue #27608: [MINOR][SQL] Distinguish Cast and AnsiCast in toString

SparkQA removed a comment on issue #27608: [MINOR][SQL] Distinguish Cast and AnsiCast in toString URL: https://github.com/apache/spark/pull/27608#issuecomment-587058773 **[Test build #118592 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #27266: [SPARK-22590][SQL] Copy sparkContext.localproperties to child thread in BroadcastExchangeExec.executionContext

AmplabJenkins removed a comment on issue #27266: [SPARK-22590][SQL] Copy sparkContext.localproperties to child thread in BroadcastExchangeExec.executionContext URL: https://github.com/apache/spark/pull/27266#issuecomment-587062182 Test FAILed. Refer to this link for build results

[GitHub] [spark] AmplabJenkins commented on issue #27565: [SPARK-30791][SQL][PYTHON] Add 'sameSemantics' and 'sementicHash' methods in Dataset

AmplabJenkins commented on issue #27565: [SPARK-30791][SQL][PYTHON] Add 'sameSemantics' and 'sementicHash' methods in Dataset URL: https://github.com/apache/spark/pull/27565#issuecomment-587090205 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27565: [SPARK-30791][SQL][PYTHON] Add 'sameSemantics' and 'sementicHash' methods in Dataset

AmplabJenkins commented on issue #27565: [SPARK-30791][SQL][PYTHON] Add 'sameSemantics' and 'sementicHash' methods in Dataset URL: https://github.com/apache/spark/pull/27565#issuecomment-587090196 Merged build finished. Test PASSed.

[GitHub] [spark] hvanhovell closed pull request #27558: [SPARK-30806][SQL]Evaluate once per group in UnboundedWindowFunctionFrame

hvanhovell closed pull request #27558: [SPARK-30806][SQL]Evaluate once per group in UnboundedWindowFunctionFrame URL: https://github.com/apache/spark/pull/27558 This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins removed a comment on issue #27558: [SPARK-30806][SQL]Evaluate once per group in UnboundedWindowFunctionFrame

AmplabJenkins removed a comment on issue #27558: [SPARK-30806][SQL]Evaluate once per group in UnboundedWindowFunctionFrame URL: https://github.com/apache/spark/pull/27558#issuecomment-587041919 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27558: [SPARK-30806][SQL]Evaluate once per group in UnboundedWindowFunctionFrame

AmplabJenkins removed a comment on issue #27558: [SPARK-30806][SQL]Evaluate once per group in UnboundedWindowFunctionFrame URL: https://github.com/apache/spark/pull/27558#issuecomment-587041928 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27608: [MINOR][SQL] Distinguish Cast and AnsiCast in toString

AmplabJenkins removed a comment on issue #27608: [MINOR][SQL] Distinguish Cast and AnsiCast in toString URL: https://github.com/apache/spark/pull/27608#issuecomment-587055765 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27608: [MINOR][SQL] Distinguish Cast and AnsiCast in toString

AmplabJenkins removed a comment on issue #27608: [MINOR][SQL] Distinguish Cast and AnsiCast in toString URL: https://github.com/apache/spark/pull/27608#issuecomment-587055753 Merged build finished. Test PASSed. This is an

[GitHub] [spark] afavaro opened a new pull request #27610: [SPARK-30856][SQL][PySpark] Fix SQLContext.getOrCreate() when SparkContext is restarted

afavaro opened a new pull request #27610: [SPARK-30856][SQL][PySpark] Fix SQLContext.getOrCreate() when SparkContext is restarted URL: https://github.com/apache/spark/pull/27610 ### What changes were proposed in this pull request? As discussed on the Jira ticket, this change

[GitHub] [spark] MaxGekk commented on issue #27543: [SPARK-30793][SQL] Fix truncations of timestamps before the epoch to minutes and seconds

MaxGekk commented on issue #27543: [SPARK-30793][SQL] Fix truncations of timestamps before the epoch to minutes and seconds URL: https://github.com/apache/spark/pull/27543#issuecomment-587089224 Here is the PR for 2.4: https://github.com/apache/spark/pull/27611

[GitHub] [spark] MaxGekk opened a new pull request #27611: [SPARK-30793][SQL][2.4] Fix truncations of timestamps before the epoch to minutes and seconds

MaxGekk opened a new pull request #27611: [SPARK-30793][SQL][2.4] Fix truncations of timestamps before the epoch to minutes and seconds URL: https://github.com/apache/spark/pull/27611 ### What changes were proposed in this pull request? In the PR (a backport of #27543), I propose to

[GitHub] [spark] AmplabJenkins commented on issue #27608: [MINOR][SQL] Distinguish Cast and AnsiCast in toString

AmplabJenkins commented on issue #27608: [MINOR][SQL] Distinguish Cast and AnsiCast in toString URL: https://github.com/apache/spark/pull/27608#issuecomment-587098045 Merged build finished. Test FAILed. This is an automated

[GitHub] [spark] AmplabJenkins commented on issue #27608: [MINOR][SQL] Distinguish Cast and AnsiCast in toString

AmplabJenkins commented on issue #27608: [MINOR][SQL] Distinguish Cast and AnsiCast in toString URL: https://github.com/apache/spark/pull/27608#issuecomment-587098055 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27607: [FOLLOW-UP][SPARK-15616][SQL] Sub Optimizer should include super.postHocOptimizationBatches

AmplabJenkins removed a comment on issue #27607: [FOLLOW-UP][SPARK-15616][SQL] Sub Optimizer should include super.postHocOptimizationBatches URL: https://github.com/apache/spark/pull/27607#issuecomment-587100344 Merged build finished. Test PASSed.

[GitHub] [spark] amuraru commented on issue #24618: [SPARK-27734][CORE][SQL] Add memory based thresholds for shuffle spill

amuraru commented on issue #24618: [SPARK-27734][CORE][SQL] Add memory based thresholds for shuffle spill URL: https://github.com/apache/spark/pull/24618#issuecomment-587100884 @dongjoon-hyun sorry for dropping the ball here. We have been running this patch in prod with very good

[GitHub] [spark] AmplabJenkins removed a comment on issue #27607: [FOLLOW-UP][SPARK-15616][SQL] Sub Optimizer should include super.postHocOptimizationBatches

AmplabJenkins removed a comment on issue #27607: [FOLLOW-UP][SPARK-15616][SQL] Sub Optimizer should include super.postHocOptimizationBatches URL: https://github.com/apache/spark/pull/27607#issuecomment-587100347 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins commented on issue #27050: [SPARK-30388][Core] Mark running map stages of finished job as finished, and cancel running tasks

AmplabJenkins commented on issue #27050: [SPARK-30388][Core] Mark running map stages of finished job as finished, and cancel running tasks URL: https://github.com/apache/spark/pull/27050#issuecomment-587103240 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27050: [SPARK-30388][Core] Mark running map stages of finished job as finished, and cancel running tasks

AmplabJenkins removed a comment on issue #27050: [SPARK-30388][Core] Mark running map stages of finished job as finished, and cancel running tasks URL: https://github.com/apache/spark/pull/27050#issuecomment-587103240 Merged build finished. Test FAILed.

[GitHub] [spark] cloud-fan commented on issue #27543: [SPARK-30793][SQL] Fix truncations of timestamps before the epoch to minutes and seconds

cloud-fan commented on issue #27543: [SPARK-30793][SQL] Fix truncations of timestamps before the epoch to minutes and seconds URL: https://github.com/apache/spark/pull/27543#issuecomment-587030669 to confirm, this bug doesn't exist in 2.4 as we switch the calendar in 3.0 only, right

[GitHub] [spark] srowen commented on a change in pull request #27600: [MINOR][ML] ML cleanup

srowen commented on a change in pull request #27600: [MINOR][ML] ML cleanup URL: https://github.com/apache/spark/pull/27600#discussion_r380226459 ## File path: mllib/src/main/scala/org/apache/spark/mllib/clustering/StreamingKMeans.scala ## @@ -95,7 +95,7 @@ class

[GitHub] [spark] srowen commented on a change in pull request #27600: [MINOR][ML] ML cleanup

srowen commented on a change in pull request #27600: [MINOR][ML] ML cleanup URL: https://github.com/apache/spark/pull/27600#discussion_r380225303 ## File path: mllib/src/main/scala/org/apache/spark/ml/classification/RandomForestClassifier.scala ## @@ -256,7 +256,7 @@

[GitHub] [spark] srowen commented on a change in pull request #27600: [MINOR][ML] ML cleanup

srowen commented on a change in pull request #27600: [MINOR][ML] ML cleanup URL: https://github.com/apache/spark/pull/27600#discussion_r380225926 ## File path: mllib/src/main/scala/org/apache/spark/ml/recommendation/ALS.scala ## @@ -1049,7 +1049,7 @@ object ALS extends

[GitHub] [spark] srowen commented on a change in pull request #27488: [SPARK-26580][SQL][ML][FOLLOW-UP] Throw exception when use untyped UDF by default

srowen commented on a change in pull request #27488: [SPARK-26580][SQL][ML][FOLLOW-UP] Throw exception when use untyped UDF by default URL: https://github.com/apache/spark/pull/27488#discussion_r380223797 ## File path: mllib/src/main/scala/org/apache/spark/ml/Transformer.scala

[GitHub] [spark] srowen commented on issue #27546: [SPARK-30773][ML]Support NativeBlas for level-1 routines

srowen commented on issue #27546: [SPARK-30773][ML]Support NativeBlas for level-1 routines URL: https://github.com/apache/spark/pull/27546#issuecomment-587035245 Yeah, the problem is that it could be a win in some cases, but harmful in others. It depends on what real-world Spark usage is

[GitHub] [spark] SparkQA removed a comment on issue #27266: [SPARK-22590][SQL] Copy sparkContext.localproperties to child thread in BroadcastExchangeExec.executionContext

SparkQA removed a comment on issue #27266: [SPARK-22590][SQL] Copy sparkContext.localproperties to child thread in BroadcastExchangeExec.executionContext URL: https://github.com/apache/spark/pull/27266#issuecomment-586998092 **[Test build #118585 has

[GitHub] [spark] SparkQA commented on issue #27266: [SPARK-22590][SQL] Copy sparkContext.localproperties to child thread in BroadcastExchangeExec.executionContext

SparkQA commented on issue #27266: [SPARK-22590][SQL] Copy sparkContext.localproperties to child thread in BroadcastExchangeExec.executionContext URL: https://github.com/apache/spark/pull/27266#issuecomment-587077274 **[Test build #118585 has

[GitHub] [spark] hvanhovell commented on issue #27558: [SPARK-30806][SQL]Evaluate once per group in UnboundedWindowFunctionFrame

hvanhovell commented on issue #27558: [SPARK-30806][SQL]Evaluate once per group in UnboundedWindowFunctionFrame URL: https://github.com/apache/spark/pull/27558#issuecomment-587090525 Merging to master/3.0. This is an

[GitHub] [spark] SparkQA removed a comment on issue #27050: [SPARK-30388][Core] Mark running map stages of finished job as finished, and cancel running tasks

SparkQA removed a comment on issue #27050: [SPARK-30388][Core] Mark running map stages of finished job as finished, and cancel running tasks URL: https://github.com/apache/spark/pull/27050#issuecomment-587026843 **[Test build #118590 has

[GitHub] [spark] SparkQA commented on issue #27589: [WIP][K8S] Jenkins IT health check

SparkQA commented on issue #27589: [WIP][K8S] Jenkins IT health check URL: https://github.com/apache/spark/pull/27589#issuecomment-587103307 **[Test build #118595 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/118595/testReport)** for PR 27589 at commit

[GitHub] [spark] AmplabJenkins commented on issue #27050: [SPARK-30388][Core] Mark running map stages of finished job as finished, and cancel running tasks

AmplabJenkins commented on issue #27050: [SPARK-30388][Core] Mark running map stages of finished job as finished, and cancel running tasks URL: https://github.com/apache/spark/pull/27050#issuecomment-587103247 Test FAILed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins removed a comment on issue #27581: [SPARK-11150][SQL][FOLLOWUP] Move sql/dynamicpruning to sql/execution/dynamicpruning

AmplabJenkins removed a comment on issue #27581: [SPARK-11150][SQL][FOLLOWUP] Move sql/dynamicpruning to sql/execution/dynamicpruning URL: https://github.com/apache/spark/pull/27581#issuecomment-587040197 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #27558: [SPARK-30806][SQL]Evaluate once per group in UnboundedWindowFunctionFrame

AmplabJenkins commented on issue #27558: [SPARK-30806][SQL]Evaluate once per group in UnboundedWindowFunctionFrame URL: https://github.com/apache/spark/pull/27558#issuecomment-587041919 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27581: [SPARK-11150][SQL][FOLLOWUP] Move sql/dynamicpruning to sql/execution/dynamicpruning

AmplabJenkins removed a comment on issue #27581: [SPARK-11150][SQL][FOLLOWUP] Move sql/dynamicpruning to sql/execution/dynamicpruning URL: https://github.com/apache/spark/pull/27581#issuecomment-587040215 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #27558: [SPARK-30806][SQL]Evaluate once per group in UnboundedWindowFunctionFrame

AmplabJenkins commented on issue #27558: [SPARK-30806][SQL]Evaluate once per group in UnboundedWindowFunctionFrame URL: https://github.com/apache/spark/pull/27558#issuecomment-587041928 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27608: [MINOR][SQL] Distinguish Cast and AnsiCast in toString

AmplabJenkins commented on issue #27608: [MINOR][SQL] Distinguish Cast and AnsiCast in toString URL: https://github.com/apache/spark/pull/27608#issuecomment-587055753 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] AmplabJenkins commented on issue #27608: [MINOR][SQL] Distinguish Cast and AnsiCast in toString

AmplabJenkins commented on issue #27608: [MINOR][SQL] Distinguish Cast and AnsiCast in toString URL: https://github.com/apache/spark/pull/27608#issuecomment-587055765 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #27266: [SPARK-22590][SQL] Copy sparkContext.localproperties to child thread in BroadcastExchangeExec.executionContext

SparkQA removed a comment on issue #27266: [SPARK-22590][SQL] Copy sparkContext.localproperties to child thread in BroadcastExchangeExec.executionContext URL: https://github.com/apache/spark/pull/27266#issuecomment-586984160 **[Test build #118581 has

[GitHub] [spark] SparkQA commented on issue #27266: [SPARK-22590][SQL] Copy sparkContext.localproperties to child thread in BroadcastExchangeExec.executionContext

SparkQA commented on issue #27266: [SPARK-22590][SQL] Copy sparkContext.localproperties to child thread in BroadcastExchangeExec.executionContext URL: https://github.com/apache/spark/pull/27266#issuecomment-587061676 **[Test build #118581 has

[GitHub] [spark] cloud-fan commented on issue #27543: [SPARK-30793][SQL] Fix truncations of timestamps before the epoch to minutes and seconds

cloud-fan commented on issue #27543: [SPARK-30793][SQL] Fix truncations of timestamps before the epoch to minutes and seconds URL: https://github.com/apache/spark/pull/27543#issuecomment-587068743 cool, thanks! This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #27266: [SPARK-22590][SQL] Copy sparkContext.localproperties to child thread in BroadcastExchangeExec.executionContext

AmplabJenkins removed a comment on issue #27266: [SPARK-22590][SQL] Copy sparkContext.localproperties to child thread in BroadcastExchangeExec.executionContext URL: https://github.com/apache/spark/pull/27266#issuecomment-587077853 Test FAILed. Refer to this link for build results

[GitHub] [spark] dongjoon-hyun commented on issue #27592: [SPARK-30840][CORE][SQL] Add version property for ConfigEntry and ConfigBuilder

dongjoon-hyun commented on issue #27592: [SPARK-30840][CORE][SQL] Add version property for ConfigEntry and ConfigBuilder URL: https://github.com/apache/spark/pull/27592#issuecomment-587090867 +1 for the idea and the current status for 3.1.0 (as described in the JIRA.) BTW, if we

[GitHub] [spark] dongjoon-hyun closed pull request #27492: [SPARK-30755][SQL] Update migration guide and add actionable exception for HIVE-15167

dongjoon-hyun closed pull request #27492: [SPARK-30755][SQL] Update migration guide and add actionable exception for HIVE-15167 URL: https://github.com/apache/spark/pull/27492 This is an automated message from the Apache

[GitHub] [spark] AmplabJenkins removed a comment on issue #27608: [MINOR][SQL] Distinguish Cast and AnsiCast in toString

AmplabJenkins removed a comment on issue #27608: [MINOR][SQL] Distinguish Cast and AnsiCast in toString URL: https://github.com/apache/spark/pull/27608#issuecomment-587098055 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #27607: [FOLLOW-UP][SPARK-15616][SQL] Sub Optimizer should include super.postHocOptimizationBatches

SparkQA commented on issue #27607: [FOLLOW-UP][SPARK-15616][SQL] Sub Optimizer should include super.postHocOptimizationBatches URL: https://github.com/apache/spark/pull/27607#issuecomment-587099722 **[Test build #118587 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #27050: [SPARK-30388][Core] Mark running map stages of finished job as finished, and cancel running tasks

AmplabJenkins removed a comment on issue #27050: [SPARK-30388][Core] Mark running map stages of finished job as finished, and cancel running tasks URL: https://github.com/apache/spark/pull/27050#issuecomment-587103247 Test FAILed. Refer to this link for build results (access rights to

[GitHub] [spark] MaxGekk opened a new pull request #27612: [SPARK-30857][SQL][2.4] Fix truncations of timestamps before the epoch to minutes and seconds

MaxGekk opened a new pull request #27612: [SPARK-30857][SQL][2.4] Fix truncations of timestamps before the epoch to minutes and seconds URL: https://github.com/apache/spark/pull/27612 ### What changes were proposed in this pull request? In the PR, I propose to replace `%` by

[GitHub] [spark] cloud-fan commented on issue #27543: [SPARK-30793][SQL] Fix truncations of timestamps before the epoch to minutes and seconds

cloud-fan commented on issue #27543: [SPARK-30793][SQL] Fix truncations of timestamps before the epoch to minutes and seconds URL: https://github.com/apache/spark/pull/27543#issuecomment-587030005 thanks, merging to master/3.0!

[GitHub] [spark] cloud-fan closed pull request #27543: [SPARK-30793][SQL] Fix truncations of timestamps before the epoch to minutes and seconds

cloud-fan closed pull request #27543: [SPARK-30793][SQL] Fix truncations of timestamps before the epoch to minutes and seconds URL: https://github.com/apache/spark/pull/27543 This is an automated message from the Apache Git

[GitHub] [spark] AmplabJenkins removed a comment on issue #27609: [WIP][SPARK-27733][CORE] Upgrade Avro to version 1.9.2

AmplabJenkins removed a comment on issue #27609: [WIP][SPARK-27733][CORE] Upgrade Avro to version 1.9.2 URL: https://github.com/apache/spark/pull/27609#issuecomment-587034069 Can one of the admins verify this patch? This is

[GitHub] [spark] AmplabJenkins commented on issue #27518: [WIP][SPARK-30768][SQL] Constraints should be inferred from inequality attributes

AmplabJenkins commented on issue #27518: [WIP][SPARK-30768][SQL] Constraints should be inferred from inequality attributes URL: https://github.com/apache/spark/pull/27518#issuecomment-587045960 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27518: [WIP][SPARK-30768][SQL] Constraints should be inferred from inequality attributes

AmplabJenkins removed a comment on issue #27518: [WIP][SPARK-30768][SQL] Constraints should be inferred from inequality attributes URL: https://github.com/apache/spark/pull/27518#issuecomment-587045950 Merged build finished. Test FAILed.

[GitHub] [spark] SparkQA removed a comment on issue #27518: [WIP][SPARK-30768][SQL] Constraints should be inferred from inequality attributes

SparkQA removed a comment on issue #27518: [WIP][SPARK-30768][SQL] Constraints should be inferred from inequality attributes URL: https://github.com/apache/spark/pull/27518#issuecomment-586930402 **[Test build #118570 has

[GitHub] [spark] AmplabJenkins commented on issue #27518: [WIP][SPARK-30768][SQL] Constraints should be inferred from inequality attributes

AmplabJenkins commented on issue #27518: [WIP][SPARK-30768][SQL] Constraints should be inferred from inequality attributes URL: https://github.com/apache/spark/pull/27518#issuecomment-587045950 Merged build finished. Test FAILed.

[GitHub] [spark] SparkQA commented on issue #27495: [SPARK-28880][SQL] Support ANSI nested bracketed comments

SparkQA commented on issue #27495: [SPARK-28880][SQL] Support ANSI nested bracketed comments URL: https://github.com/apache/spark/pull/27495#issuecomment-587052477 **[Test build #118561 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/118561/testReport)**

[GitHub] [spark] AmplabJenkins removed a comment on issue #27495: [SPARK-28880][SQL] Support ANSI nested bracketed comments

AmplabJenkins removed a comment on issue #27495: [SPARK-28880][SQL] Support ANSI nested bracketed comments URL: https://github.com/apache/spark/pull/27495#issuecomment-587054269 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27495: [SPARK-28880][SQL] Support ANSI nested bracketed comments

AmplabJenkins removed a comment on issue #27495: [SPARK-28880][SQL] Support ANSI nested bracketed comments URL: https://github.com/apache/spark/pull/27495#issuecomment-587054264 Merged build finished. Test PASSed. This is an

[GitHub] [spark] SparkQA commented on issue #27608: [MINOR][SQL] Distinguish Cast and AnsiCast in toString

SparkQA commented on issue #27608: [MINOR][SQL] Distinguish Cast and AnsiCast in toString URL: https://github.com/apache/spark/pull/27608#issuecomment-587058773 **[Test build #118592 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/118592/testReport)** for

[GitHub] [spark] AmplabJenkins removed a comment on issue #27266: [SPARK-22590][SQL] Copy sparkContext.localproperties to child thread in BroadcastExchangeExec.executionContext

AmplabJenkins removed a comment on issue #27266: [SPARK-22590][SQL] Copy sparkContext.localproperties to child thread in BroadcastExchangeExec.executionContext URL: https://github.com/apache/spark/pull/27266#issuecomment-587058430 Test FAILed. Refer to this link for build results

[GitHub] [spark] AmplabJenkins removed a comment on issue #27266: [SPARK-22590][SQL] Copy sparkContext.localproperties to child thread in BroadcastExchangeExec.executionContext

AmplabJenkins removed a comment on issue #27266: [SPARK-22590][SQL] Copy sparkContext.localproperties to child thread in BroadcastExchangeExec.executionContext URL: https://github.com/apache/spark/pull/27266#issuecomment-587062169 Merged build finished. Test FAILed.

[GitHub] [spark] MaxGekk commented on issue #27543: [SPARK-30793][SQL] Fix truncations of timestamps before the epoch to minutes and seconds

MaxGekk commented on issue #27543: [SPARK-30793][SQL] Fix truncations of timestamps before the epoch to minutes and seconds URL: https://github.com/apache/spark/pull/27543#issuecomment-587066710 @cloud-fan 2.4 **has** the same issue: ```sql $ spark-sql -S 20/02/17 08:12:28 INFO

[GitHub] [spark] cloud-fan commented on a change in pull request #27597: [SPARK-30844][SQL]Static partition should also follow StoreAssignmentPolicy when insert into table

cloud-fan commented on a change in pull request #27597: [SPARK-30844][SQL]Static partition should also follow StoreAssignmentPolicy when insert into table URL: https://github.com/apache/spark/pull/27597#discussion_r380289763 ## File path:

[GitHub] [spark] dongjoon-hyun commented on issue #27602: [MINOR] Update the PR template for adding a link to the configuration naming guideline

dongjoon-hyun commented on issue #27602: [MINOR] Update the PR template for adding a link to the configuration naming guideline URL: https://github.com/apache/spark/pull/27602#issuecomment-587087873 +1, LGTM. Thank you, @maropu , @cloud-fan , @HyukjinKwon .

  1   2   3   4   5   6   7   8   9   10   >