[jira] [Created] (SPARK-33857) Make Uuid and Shuffle support special seed in SQL

2020-12-19 Thread ulysses you (Jira)
ulysses you created SPARK-33857: --- Summary: Make Uuid and Shuffle support special seed in SQL Key: SPARK-33857 URL: https://issues.apache.org/jira/browse/SPARK-33857 Project: Spark Issue Type: I

[jira] [Commented] (SPARK-33856) Migrate ALTER TABLE ... RENAME TO PARTITION commands to the new resolution framework

2020-12-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17252346#comment-17252346 ] Apache Spark commented on SPARK-33856: -- User 'imback82' has created a pull request

[jira] [Assigned] (SPARK-33856) Migrate ALTER TABLE ... RENAME TO PARTITION commands to the new resolution framework

2020-12-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33856: Assignee: Apache Spark > Migrate ALTER TABLE ... RENAME TO PARTITION commands to the new

[jira] [Commented] (SPARK-33856) Migrate ALTER TABLE ... RENAME TO PARTITION commands to the new resolution framework

2020-12-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17252344#comment-17252344 ] Apache Spark commented on SPARK-33856: -- User 'imback82' has created a pull request

[jira] [Assigned] (SPARK-33856) Migrate ALTER TABLE ... RENAME TO PARTITION commands to the new resolution framework

2020-12-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33856: Assignee: (was: Apache Spark) > Migrate ALTER TABLE ... RENAME TO PARTITION commands

[jira] [Created] (SPARK-33856) Migrate ALTER TABLE ... RENAME TO PARTITION commands to the new resolution framework

2020-12-19 Thread Terry Kim (Jira)
Terry Kim created SPARK-33856: - Summary: Migrate ALTER TABLE ... RENAME TO PARTITION commands to the new resolution framework Key: SPARK-33856 URL: https://issues.apache.org/jira/browse/SPARK-33856 Projec

[jira] [Resolved] (SPARK-30600) Migrate ALTER VIEW SET/UNSET commands to the new resolution framework

2020-12-19 Thread Terry Kim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Terry Kim resolved SPARK-30600. --- Resolution: Duplicate Duplicate of https://issues.apache.org/jira/browse/SPARK-33714 > Migrate ALT

[jira] [Commented] (SPARK-33850) EXPLAIN FORMATTED doesn't show the plan for subqueries if AQE is enabled

2020-12-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17252341#comment-17252341 ] Apache Spark commented on SPARK-33850: -- User 'sarutak' has created a pull request f

[jira] [Commented] (SPARK-33850) EXPLAIN FORMATTED doesn't show the plan for subqueries if AQE is enabled

2020-12-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17252340#comment-17252340 ] Apache Spark commented on SPARK-33850: -- User 'sarutak' has created a pull request f

[jira] [Created] (SPARK-33855) Add spark job maximum created files limit configuration

2020-12-19 Thread Su Qilong (Jira)
Su Qilong created SPARK-33855: - Summary: Add spark job maximum created files limit configuration Key: SPARK-33855 URL: https://issues.apache.org/jira/browse/SPARK-33855 Project: Spark Issue Type:

[jira] [Commented] (SPARK-25548) In the PruneFileSourcePartitions optimizer, replace the nonPartitionOps field with true in the And(partitionOps, nonPartitionOps) to make the partition can be pruned

2020-12-19 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17252299#comment-17252299 ] Yuming Wang commented on SPARK-25548: - Could you check the master branch. This issue

[jira] [Updated] (SPARK-33798) Add new rule to push down the foldable expressions through CaseWhen/If

2020-12-19 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-33798: Summary: Add new rule to push down the foldable expressions through CaseWhen/If (was: Simplify Eq

[jira] [Assigned] (SPARK-33852) Use assertAnalysisError in HiveDDLSuite.scala

2020-12-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-33852: - Assignee: Terry Kim > Use assertAnalysisError in HiveDDLSuite.scala > -

[jira] [Resolved] (SPARK-33852) Use assertAnalysisError in HiveDDLSuite.scala

2020-12-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33852. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 30857 [https://

[jira] [Updated] (SPARK-33854) Use ListBuffer instead of Stack in SparkBuild.scala

2020-12-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33854: -- Affects Version/s: (was: 3.2.0) 3.1.0 > Use ListBuffer instead of S

[jira] [Assigned] (SPARK-33854) Use ListBuffer instead of Stack in SparkBuild.scala

2020-12-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-33854: - Assignee: William Hyun > Use ListBuffer instead of Stack in SparkBuild.scala >

[jira] [Resolved] (SPARK-33854) Use ListBuffer instead of Stack in SparkBuild.scala

2020-12-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33854. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30860 [https://

[jira] [Resolved] (SPARK-33850) EXPLAIN FORMATTED doesn't show the plan for subqueries if AQE is enabled

2020-12-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33850. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30855 [https://

[jira] [Assigned] (SPARK-33854) Use ListBuffer instead of Stack in SparkBuild.scala

2020-12-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33854: Assignee: Apache Spark > Use ListBuffer instead of Stack in SparkBuild.scala > --

[jira] [Commented] (SPARK-33854) Use ListBuffer instead of Stack in SparkBuild.scala

2020-12-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17252281#comment-17252281 ] Apache Spark commented on SPARK-33854: -- User 'williamhyun' has created a pull reque

[jira] [Assigned] (SPARK-33854) Use ListBuffer instead of Stack in SparkBuild.scala

2020-12-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33854: Assignee: (was: Apache Spark) > Use ListBuffer instead of Stack in SparkBuild.scala >

[jira] [Created] (SPARK-33854) Use ListBuffer instead of Stack in SparkBuild.scala

2020-12-19 Thread William Hyun (Jira)
William Hyun created SPARK-33854: Summary: Use ListBuffer instead of Stack in SparkBuild.scala Key: SPARK-33854 URL: https://issues.apache.org/jira/browse/SPARK-33854 Project: Spark Issue Typ

[jira] [Assigned] (SPARK-33853) EXPLAIN CODEGEN doesn't show subquery code

2020-12-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33853: Assignee: Kousuke Saruta (was: Apache Spark) > EXPLAIN CODEGEN doesn't show subquery cod

[jira] [Assigned] (SPARK-33853) EXPLAIN CODEGEN doesn't show subquery code

2020-12-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33853: Assignee: Apache Spark (was: Kousuke Saruta) > EXPLAIN CODEGEN doesn't show subquery cod

[jira] [Commented] (SPARK-33853) EXPLAIN CODEGEN doesn't show subquery code

2020-12-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17252277#comment-17252277 ] Apache Spark commented on SPARK-33853: -- User 'sarutak' has created a pull request f

[jira] [Assigned] (SPARK-33853) EXPLAIN CODEGEN doesn't show subquery code

2020-12-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33853: Assignee: Kousuke Saruta (was: Apache Spark) > EXPLAIN CODEGEN doesn't show subquery cod

[jira] [Created] (SPARK-33853) EXPLAIN CODEGEN doesn't show subquery code

2020-12-19 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-33853: -- Summary: EXPLAIN CODEGEN doesn't show subquery code Key: SPARK-33853 URL: https://issues.apache.org/jira/browse/SPARK-33853 Project: Spark Issue Type: Bu

[jira] [Commented] (SPARK-26341) Expose executor memory metrics at the stage level, in the Stages tab

2020-12-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17252270#comment-17252270 ] Apache Spark commented on SPARK-26341: -- User 'sarutak' has created a pull request f

[jira] [Commented] (SPARK-26341) Expose executor memory metrics at the stage level, in the Stages tab

2020-12-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17252269#comment-17252269 ] Apache Spark commented on SPARK-26341: -- User 'sarutak' has created a pull request f

[jira] [Assigned] (SPARK-33852) Use assertAnalysisError in HiveDDLSuite.scala

2020-12-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33852: Assignee: (was: Apache Spark) > Use assertAnalysisError in HiveDDLSuite.scala > -

[jira] [Commented] (SPARK-33852) Use assertAnalysisError in HiveDDLSuite.scala

2020-12-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17252267#comment-17252267 ] Apache Spark commented on SPARK-33852: -- User 'imback82' has created a pull request

[jira] [Assigned] (SPARK-33852) Use assertAnalysisError in HiveDDLSuite.scala

2020-12-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33852: Assignee: Apache Spark > Use assertAnalysisError in HiveDDLSuite.scala >

[jira] [Created] (SPARK-33852) Use assertAnalysisError in HiveDDLSuite.scala

2020-12-19 Thread Terry Kim (Jira)
Terry Kim created SPARK-33852: - Summary: Use assertAnalysisError in HiveDDLSuite.scala Key: SPARK-33852 URL: https://issues.apache.org/jira/browse/SPARK-33852 Project: Spark Issue Type: Test

[jira] [Commented] (SPARK-33829) ALTER TABLE ... RENAME TO should recreate cache for v2 tables.

2020-12-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17252255#comment-17252255 ] Apache Spark commented on SPARK-33829: -- User 'imback82' has created a pull request

[jira] [Created] (SPARK-33851) Push partial aggregates bellow exchanges

2020-12-19 Thread Tanel Kiis (Jira)
Tanel Kiis created SPARK-33851: -- Summary: Push partial aggregates bellow exchanges Key: SPARK-33851 URL: https://issues.apache.org/jira/browse/SPARK-33851 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-33850) EXPLAIN FORMATTED doesn't show the plan for subqueries if AQE is enabled

2020-12-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17252247#comment-17252247 ] Dongjoon Hyun commented on SPARK-33850: --- I verified this bug exists in Apache Spar

[jira] [Updated] (SPARK-33850) EXPLAIN FORMATTED doesn't show the plan for subqueries if AQE is enabled

2020-12-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33850: -- Affects Version/s: 3.1.0 3.0.0 3.0.1 > EXPLAIN F

[jira] [Commented] (SPARK-33850) EXPLAIN FORMATTED doesn't show the plan for subqueries if AQE is enabled

2020-12-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17252246#comment-17252246 ] Dongjoon Hyun commented on SPARK-33850: --- Thank you so much, [~sarutak]. I converte

[jira] [Updated] (SPARK-33850) EXPLAIN FORMATTED doesn't show the plan for subqueries if AQE is enabled

2020-12-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33850: -- Parent: SPARK-33828 Issue Type: Sub-task (was: Bug) > EXPLAIN FORMATTED doesn't show

[jira] [Commented] (SPARK-33850) EXPLAIN FORMATTED doesn't show the plan for subqueries if AQE is enabled

2020-12-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17252242#comment-17252242 ] Apache Spark commented on SPARK-33850: -- User 'sarutak' has created a pull request f

[jira] [Assigned] (SPARK-33850) EXPLAIN FORMATTED doesn't show the plan for subqueries if AQE is enabled

2020-12-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33850: Assignee: Apache Spark (was: Kousuke Saruta) > EXPLAIN FORMATTED doesn't show the plan f

[jira] [Assigned] (SPARK-33850) EXPLAIN FORMATTED doesn't show the plan for subqueries if AQE is enabled

2020-12-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33850: Assignee: Kousuke Saruta (was: Apache Spark) > EXPLAIN FORMATTED doesn't show the plan f

[jira] [Created] (SPARK-33850) EXPLAIN FORMATTED doesn't show the plan for subqueries if AQE is enabled

2020-12-19 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-33850: -- Summary: EXPLAIN FORMATTED doesn't show the plan for subqueries if AQE is enabled Key: SPARK-33850 URL: https://issues.apache.org/jira/browse/SPARK-33850 Project:

[jira] [Commented] (SPARK-33849) Unify v1 and v2 DROP TABLE tests

2020-12-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17252221#comment-17252221 ] Apache Spark commented on SPARK-33849: -- User 'MaxGekk' has created a pull request f

[jira] [Commented] (SPARK-33849) Unify v1 and v2 DROP TABLE tests

2020-12-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17252220#comment-17252220 ] Apache Spark commented on SPARK-33849: -- User 'MaxGekk' has created a pull request f

[jira] [Assigned] (SPARK-33849) Unify v1 and v2 DROP TABLE tests

2020-12-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33849: Assignee: Apache Spark > Unify v1 and v2 DROP TABLE tests > -

[jira] [Assigned] (SPARK-33849) Unify v1 and v2 DROP TABLE tests

2020-12-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33849: Assignee: (was: Apache Spark) > Unify v1 and v2 DROP TABLE tests > --

[jira] [Updated] (SPARK-33849) Unify v1 and v2 DROP TABLE tests

2020-12-19 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-33849: --- Description: Extract DROP TABLE tests to the common place to run them for V1 and v2 datasources. Som

[jira] [Created] (SPARK-33849) Unify v1 and v2 DROP TABLE tests

2020-12-19 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-33849: -- Summary: Unify v1 and v2 DROP TABLE tests Key: SPARK-33849 URL: https://issues.apache.org/jira/browse/SPARK-33849 Project: Spark Issue Type: Sub-task C

[jira] [Commented] (SPARK-33829) ALTER TABLE ... RENAME TO should recreate cache for v2 tables.

2020-12-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17252215#comment-17252215 ] Dongjoon Hyun commented on SPARK-33829: --- I converted this to a subtask of SPARK-33

[jira] [Updated] (SPARK-33829) ALTER TABLE ... RENAME TO should recreate cache for v2 tables.

2020-12-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33829: -- Parent: SPARK-33507 Issue Type: Sub-task (was: Improvement) > ALTER TABLE ... RENAME

[jira] [Updated] (SPARK-33843) Upgrade to Zstd 1.4.7

2020-12-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33843: -- Affects Version/s: (was: 3.2.0) > Upgrade to Zstd 1.4.7 > - > >

[jira] [Resolved] (SPARK-33843) Upgrade to Zstd 1.4.7

2020-12-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33843. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30848 [https://

[jira] [Assigned] (SPARK-33843) Upgrade to Zstd 1.4.7

2020-12-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-33843: - Assignee: Dongjoon Hyun > Upgrade to Zstd 1.4.7 > - > >

[jira] [Assigned] (SPARK-33518) Improve performance of ML ALS recommendForAll by GEMV

2020-12-19 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-33518: Assignee: zhengruifeng > Improve performance of ML ALS recommendForAll by GEMV >

[jira] [Resolved] (SPARK-33518) Improve performance of ML ALS recommendForAll by GEMV

2020-12-19 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-33518. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 30468 [https://gi

[jira] [Updated] (SPARK-33843) Upgrade to Zstd 1.4.7

2020-12-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33843: -- Issue Type: Bug (was: Improvement) > Upgrade to Zstd 1.4.7 > - > >

[jira] [Updated] (SPARK-33843) Upgrade to Zstd 1.4.7

2020-12-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33843: -- Affects Version/s: 3.1.0 > Upgrade to Zstd 1.4.7 > - > > K

[jira] [Comment Edited] (SPARK-33798) Simplify EqualTo(CaseWhen/If, Literal) always false

2020-12-19 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17252186#comment-17252186 ] Yuming Wang edited comment on SPARK-33798 at 12/19/20, 2:01 PM: --

[jira] [Commented] (SPARK-33798) Simplify EqualTo(CaseWhen/If, Literal) always false

2020-12-19 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17252186#comment-17252186 ] Yuming Wang commented on SPARK-33798: - {noformat} === Metrics of Analyzer/Optimizer

[jira] [Commented] (SPARK-33798) Simplify EqualTo(CaseWhen/If, Literal) always false

2020-12-19 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17252185#comment-17252185 ] Yuming Wang commented on SPARK-33798: - {noformat} === Metrics of Analyzer/Optimizer

[jira] [Updated] (SPARK-33848) Push the cast into (if / case) branches

2020-12-19 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-33848: Description: Push the cast into (if / case) branches. The use case is: {code:sql} create table t1

[jira] [Commented] (SPARK-33848) Push the cast into (if / case) branches

2020-12-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17252168#comment-17252168 ] Apache Spark commented on SPARK-33848: -- User 'wangyum' has created a pull request f

[jira] [Assigned] (SPARK-33848) Push the cast into (if / case) branches

2020-12-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33848: Assignee: (was: Apache Spark) > Push the cast into (if / case) branches > ---

[jira] [Commented] (SPARK-33848) Push the cast into (if / case) branches

2020-12-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17252167#comment-17252167 ] Apache Spark commented on SPARK-33848: -- User 'wangyum' has created a pull request f

[jira] [Assigned] (SPARK-33848) Push the cast into (if / case) branches

2020-12-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33848: Assignee: Apache Spark > Push the cast into (if / case) branches > --

[jira] [Created] (SPARK-33848) Push the cast into (if / case) branches

2020-12-19 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-33848: --- Summary: Push the cast into (if / case) branches Key: SPARK-33848 URL: https://issues.apache.org/jira/browse/SPARK-33848 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-33846) Include Comments for StructType toDDL function

2020-12-19 Thread Jacob Kim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jacob Kim updated SPARK-33846: -- Description: {{StructField.toDDL returns a DDL string including its comment. However, when there is a

[jira] [Commented] (SPARK-33635) Performance regression in Kafka read

2020-12-19 Thread Gabor Somogyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17252153#comment-17252153 ] Gabor Somogyi commented on SPARK-33635: --- {quote}Remember, based on all my testing,

[jira] [Commented] (SPARK-33795) gapply fails execution with rbind error

2020-12-19 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17252150#comment-17252150 ] Hyukjin Kwon commented on SPARK-33795: -- Yeah let's do that > gapply fails executio

[jira] [Commented] (SPARK-33847) Replace None of elseValue inside CaseWhen if all branches are FalseLiteral

2020-12-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17252145#comment-17252145 ] Apache Spark commented on SPARK-33847: -- User 'wangyum' has created a pull request f

[jira] [Assigned] (SPARK-33847) Replace None of elseValue inside CaseWhen if all branches are FalseLiteral

2020-12-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33847: Assignee: Apache Spark > Replace None of elseValue inside CaseWhen if all branches are Fa

[jira] [Commented] (SPARK-33847) Replace None of elseValue inside CaseWhen if all branches are FalseLiteral

2020-12-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17252144#comment-17252144 ] Apache Spark commented on SPARK-33847: -- User 'wangyum' has created a pull request f

[jira] [Assigned] (SPARK-33847) Replace None of elseValue inside CaseWhen if all branches are FalseLiteral

2020-12-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33847: Assignee: (was: Apache Spark) > Replace None of elseValue inside CaseWhen if all bran

[jira] [Assigned] (SPARK-33846) Include Comments for StructType toDDL function

2020-12-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33846: Assignee: (was: Apache Spark) > Include Comments for StructType toDDL function >

[jira] [Commented] (SPARK-33846) Include Comments for StructType toDDL function

2020-12-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17252142#comment-17252142 ] Apache Spark commented on SPARK-33846: -- User 'jacobhjkim' has created a pull reques

[jira] [Assigned] (SPARK-33846) Include Comments for StructType toDDL function

2020-12-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33846: Assignee: Apache Spark > Include Comments for StructType toDDL function > ---

[jira] [Commented] (SPARK-33846) Include Comments for StructType toDDL function

2020-12-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17252143#comment-17252143 ] Apache Spark commented on SPARK-33846: -- User 'jacobhjkim' has created a pull reques

[jira] [Updated] (SPARK-33847) Replace None of elseValue inside CaseWhen if all branches are FalseLiteral

2020-12-19 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-33847: Description: {code:scala} spark.sql("create table t1 using parquet as select id from range(10)") s

[jira] [Created] (SPARK-33847) Replace None of elseValue inside CaseWhen if all branches are FalseLiteral

2020-12-19 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-33847: --- Summary: Replace None of elseValue inside CaseWhen if all branches are FalseLiteral Key: SPARK-33847 URL: https://issues.apache.org/jira/browse/SPARK-33847 Project: Spa

[jira] [Commented] (SPARK-33795) gapply fails execution with rbind error

2020-12-19 Thread MvR (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17252139#comment-17252139 ] MvR commented on SPARK-33795: - [~gurwls223] Thanks for clarification! How can I close the cu