[jira] [Resolved] (SPARK-40378) What is React Native.

2022-09-07 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-40378. - Resolution: Invalid > What is React Native. > - > > Key: SPA

[jira] [Updated] (SPARK-40378) What is React Native.

2022-09-07 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-40378: Target Version/s: (was: 3.1.2) > What is React Native. > - > >

[jira] [Updated] (SPARK-40378) What is React Native.

2022-09-07 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-40378: Fix Version/s: (was: 3.1.3) > What is React Native. > - > >

[jira] [Commented] (SPARK-40351) Spark Sum increases the precision of DecimalType arguments by 10

2022-09-05 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17600535#comment-17600535 ] Yuming Wang commented on SPARK-40351: - https://github.com/apache/spark/blob/v3.3.0/s

[jira] [Created] (SPARK-40322) Fix all dead links

2022-09-03 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-40322: --- Summary: Fix all dead links Key: SPARK-40322 URL: https://issues.apache.org/jira/browse/SPARK-40322 Project: Spark Issue Type: Bug Components: Docume

[jira] [Comment Edited] (SPARK-33861) Simplify conditional in predicate

2022-09-03 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17599868#comment-17599868 ] Yuming Wang edited comment on SPARK-33861 at 9/3/22 8:54 AM: -

[jira] [Resolved] (SPARK-33861) Simplify conditional in predicate

2022-09-03 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-33861. - Resolution: Won't Fix Note that only 3.2.0, 3.2.1 and 3.3.0 include this optimization. We recove

[jira] [Reopened] (SPARK-33861) Simplify conditional in predicate

2022-09-03 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reopened SPARK-33861: - Assignee: (was: Yuming Wang) > Simplify conditional in predicate > ---

[jira] [Updated] (SPARK-33861) Simplify conditional in predicate

2022-09-03 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-33861: Fix Version/s: (was: 3.2.0) > Simplify conditional in predicate >

[jira] [Resolved] (SPARK-40312) Add missing configuration documentation in Spark History Server

2022-09-02 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-40312. - Fix Version/s: 3.4.0 Assignee: dzcxzl Resolution: Fixed > Add missing configurat

[jira] [Assigned] (SPARK-40228) Don't simplify multiLike if child is not attribute

2022-09-02 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-40228: --- Assignee: Yuming Wang > Don't simplify multiLike if child is not attribute > --

[jira] [Resolved] (SPARK-40228) Don't simplify multiLike if child is not attribute

2022-09-02 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-40228. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37672 [https://gith

[jira] [Commented] (SPARK-40303) The performance will be worse after codegen

2022-09-01 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17598831#comment-17598831 ] Yuming Wang commented on SPARK-40303: - cc [~cloud_fan] [~joshrosen] [~rednaxelafx]

[jira] [Created] (SPARK-40303) The performance will be worse after codegen

2022-09-01 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-40303: --- Summary: The performance will be worse after codegen Key: SPARK-40303 URL: https://issues.apache.org/jira/browse/SPARK-40303 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-40040) Push local limit to both sides if join condition is empty

2022-08-31 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-40040. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37475 [https://gith

[jira] [Assigned] (SPARK-40040) Push local limit to both sides if join condition is empty

2022-08-31 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-40040: --- Assignee: Yuming Wang > Push local limit to both sides if join condition is empty > ---

[jira] [Created] (SPARK-40283) Update mima's previousSparkVersion to 3.3.0

2022-08-30 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-40283: --- Summary: Update mima's previousSparkVersion to 3.3.0 Key: SPARK-40283 URL: https://issues.apache.org/jira/browse/SPARK-40283 Project: Spark Issue Type: Improve

[jira] [Resolved] (SPARK-39971) ANALYZE TABLE makes some queries run forever

2022-08-30 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-39971. - Resolution: Not A Problem > ANALYZE TABLE makes some queries run forever > -

[jira] [Assigned] (SPARK-40207) Specify the column name when the data type is not supported by datasource

2022-08-30 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-40207: --- Assignee: Yi kaifei (was: Apache Spark) > Specify the column name when the data type is no

[jira] [Resolved] (SPARK-40207) Specify the column name when the data type is not supported by datasource

2022-08-30 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-40207. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37574 [https://gith

[jira] [Resolved] (SPARK-34777) [UI] StagePage input size/records not show when records greater than zero

2022-08-29 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-34777. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 35498 [https://gith

[jira] [Assigned] (SPARK-34777) [UI] StagePage input size/records not show when records greater than zero

2022-08-29 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-34777: --- Assignee: Zhongwei Zhu > [UI] StagePage input size/records not show when records greater th

[jira] [Updated] (SPARK-40248) Use larger number of bits to build bloom filter

2022-08-28 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-40248: Component/s: SQL (was: Optimizer) > Use larger number of bits to build bloom

[jira] [Created] (SPARK-40248) Use larger number of bits to build bloom filter

2022-08-28 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-40248: --- Summary: Use larger number of bits to build bloom filter Key: SPARK-40248 URL: https://issues.apache.org/jira/browse/SPARK-40248 Project: Spark Issue Type: Im

[jira] [Resolved] (SPARK-40241) Correct the link of GenericUDTF

2022-08-27 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-40241. - Fix Version/s: 3.3.1 3.1.4 3.2.3 3.4.0

[jira] [Assigned] (SPARK-40241) Correct the link of GenericUDTF

2022-08-27 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-40241: --- Assignee: Ruifeng Zheng > Correct the link of GenericUDTF > ---

[jira] [Created] (SPARK-40243) Enhance Hive UDF support documentation

2022-08-27 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-40243: --- Summary: Enhance Hive UDF support documentation Key: SPARK-40243 URL: https://issues.apache.org/jira/browse/SPARK-40243 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-40228) Don't simplify multiLike if child is not attribute

2022-08-26 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-40228: --- Summary: Don't simplify multiLike if child is not attribute Key: SPARK-40228 URL: https://issues.apache.org/jira/browse/SPARK-40228 Project: Spark Issue Type:

[jira] [Updated] (SPARK-40223) Cannot alter table with locale tr

2022-08-25 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-40223: Description: How to reproduce this issue: {code:scala} test("Test update stats with locale tr")

[jira] [Created] (SPARK-40223) Cannot alter table with locale tr

2022-08-25 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-40223: --- Summary: Cannot alter table with locale tr Key: SPARK-40223 URL: https://issues.apache.org/jira/browse/SPARK-40223 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-40212) SparkSQL castPartValue does not properly handle byte & short

2022-08-24 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17584613#comment-17584613 ] Yuming Wang commented on SPARK-40212: - How to reproduce this issue? > SparkSQL cast

[jira] [Updated] (SPARK-40207) Specify the column name when the data type is not supported by datasource

2022-08-24 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-40207: Fix Version/s: (was: 3.4.0) > Specify the column name when the data type is not supported by d

[jira] [Resolved] (SPARK-39637) Involve excludedTpcdsQueries in plan related tests

2022-08-20 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-39637. - Resolution: Won't Fix > Involve excludedTpcdsQueries in plan related tests > ---

[jira] [Comment Edited] (SPARK-39915) Dataset.repartition(N) may not create N partitions

2022-08-20 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17582402#comment-17582402 ] Yuming Wang edited comment on SPARK-39915 at 8/20/22 10:41 PM: ---

[jira] [Commented] (SPARK-39915) Dataset.repartition(N) may not create N partitions

2022-08-20 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17582402#comment-17582402 ] Yuming Wang commented on SPARK-39915: - The reason is that it will return empty local

[jira] [Commented] (SPARK-39971) ANALYZE TABLE makes some queries run forever

2022-08-20 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17582211#comment-17582211 ] Yuming Wang commented on SPARK-39971: - It is difficult to read. Could you set spark.

[jira] [Resolved] (SPARK-40080) Adds additional EliminateSorts before LimitPushDown

2022-08-20 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-40080. - Resolution: Duplicate > Adds additional EliminateSorts before LimitPushDown > --

[jira] [Updated] (SPARK-40050) Enhance EliminateSorts to support removing sorts via LocalLimit

2022-08-19 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-40050: Summary: Enhance EliminateSorts to support removing sorts via LocalLimit (was: Eliminate the Sort

[jira] [Assigned] (SPARK-40050) Eliminate the Sort if there is a LocalLimit between Join and Sort

2022-08-19 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-40050: --- Assignee: Yuming Wang > Eliminate the Sort if there is a LocalLimit between Join and Sort >

[jira] [Resolved] (SPARK-40050) Eliminate the Sort if there is a LocalLimit between Join and Sort

2022-08-19 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-40050. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37519 [https://gith

[jira] [Resolved] (SPARK-40133) Regenerate excludedTpcdsQueries's golden files if regenerateGoldenFiles is true

2022-08-19 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-40133. - Fix Version/s: 3.4.0 Assignee: Yuming Wang Resolution: Fixed Resolved by https:/

[jira] [Created] (SPARK-40133) Regenerate excludedTpcdsQueries's golden files if regenerateGoldenFiles is true

2022-08-17 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-40133: --- Summary: Regenerate excludedTpcdsQueries's golden files if regenerateGoldenFiles is true Key: SPARK-40133 URL: https://issues.apache.org/jira/browse/SPARK-40133 Project

[jira] [Updated] (SPARK-40050) Eliminate the Sort if there is a LocalLimit between Join and Sort

2022-08-17 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-40050: Summary: Eliminate the Sort if there is a LocalLimit between Join and Sort (was: Eliminate sort i

[jira] [Updated] (SPARK-40080) Adds additional EliminateSorts before LimitPushDown

2022-08-16 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-40080: Summary: Adds additional EliminateSorts before LimitPushDown (was: Move EliminateSorts before Lim

[jira] [Created] (SPARK-40099) Merge adjacent CaseWhen branches if their values are the same

2022-08-15 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-40099: --- Summary: Merge adjacent CaseWhen branches if their values are the same Key: SPARK-40099 URL: https://issues.apache.org/jira/browse/SPARK-40099 Project: Spark

[jira] [Created] (SPARK-40080) Move EliminateSorts before LimitPushDown

2022-08-15 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-40080: --- Summary: Move EliminateSorts before LimitPushDown Key: SPARK-40080 URL: https://issues.apache.org/jira/browse/SPARK-40080 Project: Spark Issue Type: Improvemen

[jira] [Updated] (SPARK-40050) Eliminate sort if parent is local limit

2022-08-11 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-40050: Description: It seems we can remove Sort operator: {code:scala} val projectPlan = testRelation

[jira] [Created] (SPARK-40050) Eliminate sort if parent is local limit

2022-08-11 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-40050: --- Summary: Eliminate sort if parent is local limit Key: SPARK-40050 URL: https://issues.apache.org/jira/browse/SPARK-40050 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-40040) Push local limit to both sides if join condition is empty

2022-08-10 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-40040: Summary: Push local limit to both sides if join condition is empty (was: Push local limit through

[jira] [Created] (SPARK-40040) Push local limit through outer join if join condition is empty

2022-08-10 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-40040: --- Summary: Push local limit through outer join if join condition is empty Key: SPARK-40040 URL: https://issues.apache.org/jira/browse/SPARK-40040 Project: Spark

[jira] [Created] (SPARK-40017) Adjust advisory partition size in bytes based on the following operators

2022-08-09 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-40017: --- Summary: Adjust advisory partition size in bytes based on the following operators Key: SPARK-40017 URL: https://issues.apache.org/jira/browse/SPARK-40017 Project: Spark

[jira] [Created] (SPARK-39989) Support estimate column statistics if it is foldable expression

2022-08-05 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-39989: --- Summary: Support estimate column statistics if it is foldable expression Key: SPARK-39989 URL: https://issues.apache.org/jira/browse/SPARK-39989 Project: Spark

[jira] [Created] (SPARK-39978) Make filtered distinct count more accurate

2022-08-04 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-39978: --- Summary: Make filtered distinct count more accurate Key: SPARK-39978 URL: https://issues.apache.org/jira/browse/SPARK-39978 Project: Spark Issue Type: Improvem

[jira] [Updated] (SPARK-39978) Make filtered distinct count more accurate

2022-08-04 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-39978: Attachment: data_dim_001.snappy.parquet > Make filtered distinct count more accurate > ---

[jira] [Commented] (SPARK-39921) SkewJoin--Stream side skew in BroadcastJoin

2022-08-04 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17575108#comment-17575108 ] Yuming Wang commented on SPARK-39921: - +1. Would you like to file a PR? > SkewJoin-

[jira] [Commented] (SPARK-39971) ANALYZE TABLE makes some queries run forever

2022-08-04 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17575097#comment-17575097 ] Yuming Wang commented on SPARK-39971: - [~felipepessoto] Could you provide the query

[jira] [Resolved] (SPARK-39946) Upgrade jersey to 2.36

2022-08-02 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-39946. - Resolution: Duplicate > Upgrade jersey to 2.36 > -- > > Key:

[jira] [Assigned] (SPARK-39860) More expressions should extend Predicate

2022-07-30 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-39860: --- Assignee: Yuming Wang > More expressions should extend Predicate >

[jira] [Resolved] (SPARK-39860) More expressions should extend Predicate

2022-07-30 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-39860. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37274 [https://gith

[jira] [Commented] (SPARK-39896) The structural integrity of the plan is broken after UnwrapCastInBinaryComparison

2022-07-27 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17571950#comment-17571950 ] Yuming Wang commented on SPARK-39896: - cc [~fchen] > The structural integrity of th

[jira] [Created] (SPARK-39896) The structural integrity of the plan is broken after UnwrapCastInBinaryComparison

2022-07-27 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-39896: --- Summary: The structural integrity of the plan is broken after UnwrapCastInBinaryComparison Key: SPARK-39896 URL: https://issues.apache.org/jira/browse/SPARK-39896 Proje

[jira] [Comment Edited] (SPARK-39750) Enable spark.sql.cbo.enabled by default

2022-07-26 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17571308#comment-17571308 ] Yuming Wang edited comment on SPARK-39750 at 7/26/22 9:36 AM:

[jira] [Commented] (SPARK-39750) Enable spark.sql.cbo.enabled by default

2022-07-26 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17571308#comment-17571308 ] Yuming Wang commented on SPARK-39750: - A special case, this is part of tpc-ds q47: {

[jira] [Created] (SPARK-39860) More expressions should extend Predicate

2022-07-25 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-39860: --- Summary: More expressions should extend Predicate Key: SPARK-39860 URL: https://issues.apache.org/jira/browse/SPARK-39860 Project: Spark Issue Type: Improvemen

[jira] [Updated] (SPARK-39851) Improve join stats estimation if one side can keep uniqueness

2022-07-24 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-39851: Summary: Improve join stats estimation if one side can keep uniqueness (was: Fix join stats estim

[jira] [Created] (SPARK-39851) Fix join stats estimation if one side can keep uniqueness

2022-07-24 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-39851: --- Summary: Fix join stats estimation if one side can keep uniqueness Key: SPARK-39851 URL: https://issues.apache.org/jira/browse/SPARK-39851 Project: Spark Issue

[jira] [Resolved] (SPARK-39312) Use Parquet in predicate for Spark In filter

2022-07-15 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-39312. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36696 [https://gith

[jira] [Assigned] (SPARK-39312) Use Parquet in predicate for Spark In filter

2022-07-15 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-39312: --- Assignee: Huaxin Gao > Use Parquet in predicate for Spark In filter > -

[jira] [Commented] (SPARK-39753) Broadcast joins should pushdown join constraints as Filter to the larger relation

2022-07-12 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17566130#comment-17566130 ] Yuming Wang commented on SPARK-39753: - [~devict] So the build side needs to be execu

[jira] [Commented] (SPARK-39753) Broadcast joins should pushdown join constraints as Filter to the larger relation

2022-07-12 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17565410#comment-17565410 ] Yuming Wang commented on SPARK-39753: - [~devict] I do not think {{lhs.a == rhs.a}} c

[jira] [Updated] (SPARK-39752) Spark job failed with 10M rows data with Broken pipe error

2022-07-12 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-39752: Fix Version/s: (was: 3.0.2) > Spark job failed with 10M rows data with Broken pipe error > ---

[jira] [Created] (SPARK-39750) Enable spark.sql.cbo.enabled by default

2022-07-11 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-39750: --- Summary: Enable spark.sql.cbo.enabled by default Key: SPARK-39750 URL: https://issues.apache.org/jira/browse/SPARK-39750 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-39741) Support url encode/decode as built-in function

2022-07-11 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-39741: Fix Version/s: (was: 3.4.0) > Support url encode/decode as built-in function > ---

[jira] [Resolved] (SPARK-39667) Add another workaround when there is not enough memory to build and broadcast the table

2022-07-11 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-39667. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37069 [https://gith

[jira] [Assigned] (SPARK-39667) Add another workaround when there is not enough memory to build and broadcast the table

2022-07-11 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-39667: --- Assignee: Yuming Wang > Add another workaround when there is not enough memory to build and

[jira] [Resolved] (SPARK-39726) Change the default value of spark.sql.execution.topKSortFallbackThreshold to 800000

2022-07-10 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-39726. - Resolution: Not A Problem > Change the default value of spark.sql.execution.topKSortFallbackThre

[jira] [Resolved] (SPARK-39709) The result of executeCollect and doExecute of TakeOrderedAndProjectExec should be the same

2022-07-08 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-39709. - Resolution: Not A Bug > The result of executeCollect and doExecute of TakeOrderedAndProjectExec

[jira] [Created] (SPARK-39726) Change the default value of spark.sql.execution.topKSortFallbackThreshold to 800000

2022-07-08 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-39726: --- Summary: Change the default value of spark.sql.execution.topKSortFallbackThreshold to 80 Key: SPARK-39726 URL: https://issues.apache.org/jira/browse/SPARK-39726 Pro

[jira] [Created] (SPARK-39709) The result of executeCollect and doExecute of TakeOrderedAndProjectExec should be the same

2022-07-07 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-39709: --- Summary: The result of executeCollect and doExecute of TakeOrderedAndProjectExec should be the same Key: SPARK-39709 URL: https://issues.apache.org/jira/browse/SPARK-39709

[jira] [Created] (SPARK-39698) Use TakeOrderedAndProject if maxRows below the topKSortFallbackThreshold

2022-07-06 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-39698: --- Summary: Use TakeOrderedAndProject if maxRows below the topKSortFallbackThreshold Key: SPARK-39698 URL: https://issues.apache.org/jira/browse/SPARK-39698 Project: Spark

[jira] [Resolved] (SPARK-39606) Use child stats to estimate order operator

2022-07-05 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-39606. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36994 [https://gith

[jira] [Assigned] (SPARK-39606) Use child stats to estimate order operator

2022-07-05 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-39606: --- Assignee: Yuming Wang > Use child stats to estimate order operator > --

[jira] [Created] (SPARK-39667) Add another workaround when there is not enough memory to build and broadcast the table

2022-07-03 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-39667: --- Summary: Add another workaround when there is not enough memory to build and broadcast the table Key: SPARK-39667 URL: https://issues.apache.org/jira/browse/SPARK-39667

[jira] [Assigned] (SPARK-39631) Update FilterPushdownBenchmark results

2022-07-03 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-39631: --- Assignee: Yuming Wang > Update FilterPushdownBenchmark results > --

[jira] [Resolved] (SPARK-39631) Update FilterPushdownBenchmark results

2022-07-03 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-39631. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37022 [https://gith

[jira] [Created] (SPARK-39655) Add a config to limit CartesianProductExec's partition number

2022-07-01 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-39655: --- Summary: Add a config to limit CartesianProductExec's partition number Key: SPARK-39655 URL: https://issues.apache.org/jira/browse/SPARK-39655 Project: Spark

[jira] [Created] (SPARK-39642) Improve Expand statistics estimation

2022-06-30 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-39642: --- Summary: Improve Expand statistics estimation Key: SPARK-39642 URL: https://issues.apache.org/jira/browse/SPARK-39642 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-39640) Improve window statistics estimation

2022-06-30 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-39640: --- Summary: Improve window statistics estimation Key: SPARK-39640 URL: https://issues.apache.org/jira/browse/SPARK-39640 Project: Spark Issue Type: Test

[jira] [Updated] (SPARK-39639) Fix possible null pointer in MySQLDialect listIndexes

2022-06-30 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-39639: Fix Version/s: (was: 3.4.0) > Fix possible null pointer in MySQLDialect listIndexes >

[jira] [Created] (SPARK-39637) Involve excludedTpcdsQueries in plan related tests

2022-06-29 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-39637: --- Summary: Involve excludedTpcdsQueries in plan related tests Key: SPARK-39637 URL: https://issues.apache.org/jira/browse/SPARK-39637 Project: Spark Issue Type:

[jira] [Created] (SPARK-39631) Update FilterPushdownBenchmark results

2022-06-28 Thread Yuming Wang (Jira)
Title: Message Title Yuming Wang created a

[jira] [Resolved] (SPARK-39604) Miss UT for DerbyDialet's getCatalystType

2022-06-27 Thread Yuming Wang (Jira)
Title: Message Title Yuming Wang resolved

[jira] [Assigned] (SPARK-39604) Miss UT for DerbyDialet's getCatalystType

2022-06-27 Thread Yuming Wang (Jira)
Title: Message Title Yuming Wang assigned

[jira] [Created] (SPARK-39606) Use child stats to estimate order operator

2022-06-26 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-39606: --- Summary: Use child stats to estimate order operator Key: SPARK-39606 URL: https://issues.apache.org/jira/browse/SPARK-39606 Project: Spark Issue Type: Improvem

[jira] [Updated] (SPARK-39605) PySpark df.count() operation works fine on DBR 7.3 LTS but fails in DBR 10.4 LTS

2022-06-26 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-39605: Fix Version/s: (was: 3.0.1) > PySpark df.count() operation works fine on DBR 7.3 LTS but fails

[jira] [Updated] (SPARK-39605) PySpark df.count() operation works fine on DBR 7.3 LTS but fails in DBR 10.4 LTS

2022-06-26 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-39605: Target Version/s: (was: 3.2.1) > PySpark df.count() operation works fine on DBR 7.3 LTS but fail

[jira] [Created] (SPARK-39600) Enhance pushdown limit through window

2022-06-25 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-39600: --- Summary: Enhance pushdown limit through window Key: SPARK-39600 URL: https://issues.apache.org/jira/browse/SPARK-39600 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-39447) Only non-broadcast query stage can propagate empty relation

2022-06-23 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-39447. - Resolution: Duplicate > Only non-broadcast query stage can propagate empty relation > --

[jira] [Resolved] (SPARK-39449) Propagate empty relation through Window

2022-06-23 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-39449. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36848 [https://gith

[jira] [Assigned] (SPARK-39449) Propagate empty relation through Window

2022-06-23 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-39449: --- Assignee: Yuming Wang > Propagate empty relation through Window > -

<    2   3   4   5   6   7   8   9   10   11   >