[jira] [Created] (SPARK-44719) NoClassDefFoundError when using Hive UDF

Yuming Wang created SPARK-44719: --- Summary: NoClassDefFoundError when using Hive UDF Key: SPARK-44719 URL: https://issues.apache.org/jira/browse/SPARK-44719 Project: Spark Issue Type: Bug

[jira] [Updated] (HIVE-27581) Backport jackson upgrade related patch to branch-2.3

[ https://issues.apache.org/jira/browse/HIVE-27581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated HIVE-27581: --- Description: 2.9.4 -> 2.9.5:

[jira] [Updated] (HIVE-27581) Backport jackson upgrade related patch to branch-2.3

[ https://issues.apache.org/jira/browse/HIVE-27581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated HIVE-27581: --- Description: 2.9.4 -> 2.9.5:

[jira] [Created] (HIVE-27581) Backport jackson upgrade related patch to branch-2.3

Yuming Wang created HIVE-27581: -- Summary: Backport jackson upgrade related patch to branch-2.3 Key: HIVE-27581 URL: https://issues.apache.org/jira/browse/HIVE-27581 Project: Hive Issue Type:

[jira] [Created] (HIVE-27580) Backport HIVE-20071: Migrate to jackson 2.x and prevent usage

Yuming Wang created HIVE-27580: -- Summary: Backport HIVE-20071: Migrate to jackson 2.x and prevent usage Key: HIVE-27580 URL: https://issues.apache.org/jira/browse/HIVE-27580 Project: Hive

[jira] [Created] (HIVE-27579) Backport HIVE-18433: Upgrade version of com.fasterxml.jackson

Yuming Wang created HIVE-27579: -- Summary: Backport HIVE-18433: Upgrade version of com.fasterxml.jackson Key: HIVE-27579 URL: https://issues.apache.org/jira/browse/HIVE-27579 Project: Hive

[jira] [Resolved] (SPARK-42500) ConstantPropagation support more cases

[ https://issues.apache.org/jira/browse/SPARK-42500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-42500. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 42038

[jira] [Assigned] (SPARK-42500) ConstantPropagation support more cases

[ https://issues.apache.org/jira/browse/SPARK-42500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-42500: --- Assignee: Tongwei > ConstantPropagation support more cases >

[jira] [Updated] (SPARK-44662) SPIP: Improving performance of BroadcastHashJoin queries with stream side join key on non partition columns

[ https://issues.apache.org/jira/browse/SPARK-44662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-44662: Target Version/s: (was: 3.3.3) > SPIP: Improving performance of BroadcastHashJoin queries with

[jira] [Updated] (SPARK-44662) SPIP: Improving performance of BroadcastHashJoin queries with stream side join key on non partition columns

[ https://issues.apache.org/jira/browse/SPARK-44662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-44662: Fix Version/s: (was: 3.3.3) > SPIP: Improving performance of BroadcastHashJoin queries with

[jira] [Assigned] (SPARK-44675) Increase ReservedCodeCacheSize for release build

[ https://issues.apache.org/jira/browse/SPARK-44675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-44675: --- Assignee: Yuming Wang > Increase ReservedCodeCacheSize for release build >

[jira] [Resolved] (SPARK-44675) Increase ReservedCodeCacheSize for release build

[ https://issues.apache.org/jira/browse/SPARK-44675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-44675. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 42344

[jira] [Created] (SPARK-44675) Increase ReservedCodeCacheSize for release build

Yuming Wang created SPARK-44675: --- Summary: Increase ReservedCodeCacheSize for release build Key: SPARK-44675 URL: https://issues.apache.org/jira/browse/SPARK-44675 Project: Spark Issue Type:

[jira] [Commented] (SPARK-44654) In subquery cannot perform partition pruning

[ https://issues.apache.org/jira/browse/SPARK-44654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17750739#comment-17750739 ] Yuming Wang commented on SPARK-44654: - Another way is convert join to filter if maximum number of

[jira] [Created] (SPARK-44651) Make do-release-docker.sh compatible with Mac m2

Yuming Wang created SPARK-44651: --- Summary: Make do-release-docker.sh compatible with Mac m2 Key: SPARK-44651 URL: https://issues.apache.org/jira/browse/SPARK-44651 Project: Spark Issue Type:

[jira] [Updated] (SPARK-38506) Push partial aggregation through join

[ https://issues.apache.org/jira/browse/SPARK-38506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-38506: Description: Please see

[jira] [Assigned] (SPARK-44562) Add OptimizeOneRowRelationSubquery in batch of Subquery

[ https://issues.apache.org/jira/browse/SPARK-44562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-44562: --- Assignee: Yuming Wang > Add OptimizeOneRowRelationSubquery in batch of Subquery >

[jira] [Resolved] (SPARK-44562) Add OptimizeOneRowRelationSubquery in batch of Subquery

[ https://issues.apache.org/jira/browse/SPARK-44562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-44562. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 42180

[jira] [Resolved] (SPARK-44598) spark 3.2+ can not read hive table with hbase serde when hbase StorefileSize is 0

[ https://issues.apache.org/jira/browse/SPARK-44598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-44598. - Resolution: Not A Problem > spark 3.2+ can not read hive table with hbase serde when hbase

[jira] [Reopened] (SPARK-44598) spark 3.2+ can not read hive table with hbase serde when hbase StorefileSize is 0

[ https://issues.apache.org/jira/browse/SPARK-44598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reopened SPARK-44598: - > spark 3.2+ can not read hive table with hbase serde when hbase StorefileSize > is 0 >

[jira] [Commented] (SPARK-44598) spark 3.2+ can not read hive table with hbase serde when hbase StorefileSize is 0

[ https://issues.apache.org/jira/browse/SPARK-44598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17749418#comment-17749418 ] Yuming Wang commented on SPARK-44598: - How to reproduce this issue? > spark 3.2+ can not read hive

[jira] [Assigned] (SPARK-44454) HiveShim getTablesByType support fallback

[ https://issues.apache.org/jira/browse/SPARK-44454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-44454: --- Assignee: dzcxzl > HiveShim getTablesByType support fallback >

[jira] [Resolved] (SPARK-44454) HiveShim getTablesByType support fallback

[ https://issues.apache.org/jira/browse/SPARK-44454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-44454. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 42033

[jira] [Updated] (SPARK-44513) Upgrade snappy-java to 1.1.10.3

[ https://issues.apache.org/jira/browse/SPARK-44513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-44513: Fix Version/s: 3.4.2 > Upgrade snappy-java to 1.1.10.3 > --- > >

[jira] [Created] (SPARK-44562) Add OptimizeOneRowRelationSubquery in batch of Subquery

Yuming Wang created SPARK-44562: --- Summary: Add OptimizeOneRowRelationSubquery in batch of Subquery Key: SPARK-44562 URL: https://issues.apache.org/jira/browse/SPARK-44562 Project: Spark Issue

[jira] [Resolved] (SPARK-44466) Exclude configs starting with SPARK_DRIVER_PREFIX and SPARK_EXECUTOR_PREFIX from modifiedConfigs

[ https://issues.apache.org/jira/browse/SPARK-44466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-44466. - Fix Version/s: 3.5.0 4.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-44466) Exclude configs starting with SPARK_DRIVER_PREFIX and SPARK_EXECUTOR_PREFIX from modifiedConfigs

[ https://issues.apache.org/jira/browse/SPARK-44466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-44466: --- Assignee: Yuming Wang > Exclude configs starting with SPARK_DRIVER_PREFIX and

[jira] [Commented] (SPARK-44527) Simplify BinaryComparison if its children contain ScalarSubquery with empty output

[ https://issues.apache.org/jira/browse/SPARK-44527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17746488#comment-17746488 ] Yuming Wang commented on SPARK-44527: - https://github.com/apache/spark/pull/42129 > Simplify

[jira] [Created] (SPARK-44527) Simplify BinaryComparison if its children contain ScalarSubquery with empty output

Yuming Wang created SPARK-44527: --- Summary: Simplify BinaryComparison if its children contain ScalarSubquery with empty output Key: SPARK-44527 URL: https://issues.apache.org/jira/browse/SPARK-44527

[jira] [Updated] (SPARK-44523) Filter's maxRows/maxRowsPerPartition is 0 if condition is FalseLiteral

[ https://issues.apache.org/jira/browse/SPARK-44523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-44523: Summary: Filter's maxRows/maxRowsPerPartition is 0 if condition is FalseLiteral (was: Filter's

[jira] [Commented] (SPARK-44523) Filter's maxRows should be 0 if condition is FalseLiteral

[ https://issues.apache.org/jira/browse/SPARK-44523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17746290#comment-17746290 ] Yuming Wang commented on SPARK-44523: - https://github.com/apache/spark/pull/42126 > Filter's

[jira] [Created] (SPARK-44523) Filter's maxRows should be 0 if condition is FalseLiteral

Yuming Wang created SPARK-44523: --- Summary: Filter's maxRows should be 0 if condition is FalseLiteral Key: SPARK-44523 URL: https://issues.apache.org/jira/browse/SPARK-44523 Project: Spark

[jira] [Updated] (SPARK-44514) Optimize join if maximum number of rows on one side is 1

[ https://issues.apache.org/jira/browse/SPARK-44514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-44514: Summary: Optimize join if maximum number of rows on one side is 1 (was: Rewrite the join to

[jira] [Commented] (SPARK-44514) Rewrite the join to filter if one side maximum number of rows is 1

[ https://issues.apache.org/jira/browse/SPARK-44514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17746143#comment-17746143 ] Yuming Wang commented on SPARK-44514: - https://github.com/apache/spark/pull/42114 > Rewrite the

[jira] [Created] (SPARK-44514) Rewrite the join to filter if one side maximum number of rows is 1

Yuming Wang created SPARK-44514: --- Summary: Rewrite the join to filter if one side maximum number of rows is 1 Key: SPARK-44514 URL: https://issues.apache.org/jira/browse/SPARK-44514 Project: Spark

[jira] [Updated] (SPARK-44466) Exclude configs starting with SPARK_DRIVER_PREFIX and SPARK_EXECUTOR_PREFIX from modifiedConfigs

[ https://issues.apache.org/jira/browse/SPARK-44466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-44466: Summary: Exclude configs starting with SPARK_DRIVER_PREFIX and SPARK_EXECUTOR_PREFIX from

[jira] [Updated] (SPARK-44493) Extract pushable predicates from disjunctive predicates

[ https://issues.apache.org/jira/browse/SPARK-44493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-44493: Attachment: before.png > Extract pushable predicates from disjunctive predicates >

[jira] [Created] (SPARK-44493) Extract pushable predicates from disjunctive predicates

Yuming Wang created SPARK-44493: --- Summary: Extract pushable predicates from disjunctive predicates Key: SPARK-44493 URL: https://issues.apache.org/jira/browse/SPARK-44493 Project: Spark Issue

[jira] [Updated] (SPARK-44493) Extract pushable predicates from disjunctive predicates

[ https://issues.apache.org/jira/browse/SPARK-44493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-44493: Description: Example: {code:sql} select count(*) from db.very_large_table where

[jira] [Updated] (SPARK-44493) Extract pushable predicates from disjunctive predicates

[ https://issues.apache.org/jira/browse/SPARK-44493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-44493: Attachment: after.png > Extract pushable predicates from disjunctive predicates >

[jira] [Commented] (SPARK-44466) Update initialSessionOptions to the value after supplementation

[ https://issues.apache.org/jira/browse/SPARK-44466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17744040#comment-17744040 ] Yuming Wang commented on SPARK-44466: - https://github.com/apache/spark/pull/42049 > Update

[jira] [Updated] (SPARK-44466) Update initialSessionOptions to the value after supplementation

[ https://issues.apache.org/jira/browse/SPARK-44466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-44466: Description: Should not include this value: !screenshot-1.png! > Update initialSessionOptions

[jira] [Updated] (SPARK-44466) Update initialSessionOptions to the value after supplementation

[ https://issues.apache.org/jira/browse/SPARK-44466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-44466: Attachment: screenshot-1.png > Update initialSessionOptions to the value after supplementation >

[jira] [Created] (SPARK-44466) Update initialSessionOptions to the value after supplementation

Yuming Wang created SPARK-44466: --- Summary: Update initialSessionOptions to the value after supplementation Key: SPARK-44466 URL: https://issues.apache.org/jira/browse/SPARK-44466 Project: Spark

[jira] [Commented] (SPARK-44448) Wrong results for dense_rank() <= k from InferWindowGroupLimit and DenseRankLimitIterator

[ https://issues.apache.org/jira/browse/SPARK-8?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17743592#comment-17743592 ] Yuming Wang commented on SPARK-8: - cc [~beliefer] > Wrong results for dense_rank() <= k from

[jira] [Updated] (SPARK-44448) Wrong results for dense_rank() <= k from InferWindowGroupLimit and DenseRankLimitIterator

[ https://issues.apache.org/jira/browse/SPARK-8?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-8: Target Version/s: 3.5.0 > Wrong results for dense_rank() <= k from InferWindowGroupLimit and >

[jira] [Updated] (SPARK-44444) Enabled ANSI mode by default

[ https://issues.apache.org/jira/browse/SPARK-4?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-4: Description: To avoid data issue. > Enabled ANSI mode by default > >

[jira] [Created] (SPARK-44444) Enabled ANSI mode by default

Yuming Wang created SPARK-4: --- Summary: Enabled ANSI mode by default Key: SPARK-4 URL: https://issues.apache.org/jira/browse/SPARK-4 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-44415) Upgrade snappy-java to 1.1.10.2

[ https://issues.apache.org/jira/browse/SPARK-44415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-44415. - Fix Version/s: 4.0.0 3.4.2 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-44415) Upgrade snappy-java to 1.1.10.2

[ https://issues.apache.org/jira/browse/SPARK-44415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-44415: --- Assignee: Yuming Wang > Upgrade snappy-java to 1.1.10.2 > ---

[jira] [Created] (SPARK-44430) Enhance error message when option or property key is invalid

Yuming Wang created SPARK-44430: --- Summary: Enhance error message when option or property key is invalid Key: SPARK-44430 URL: https://issues.apache.org/jira/browse/SPARK-44430 Project: Spark

[jira] [Created] (SPARK-44429) Make MsSqlServerIntegrationSuite robust in ANSI mode

Yuming Wang created SPARK-44429: --- Summary: Make MsSqlServerIntegrationSuite robust in ANSI mode Key: SPARK-44429 URL: https://issues.apache.org/jira/browse/SPARK-44429 Project: Spark Issue

[jira] [Created] (SPARK-44415) Upgrade snappy-java to 1.1.10.2

Yuming Wang created SPARK-44415: --- Summary: Upgrade snappy-java to 1.1.10.2 Key: SPARK-44415 URL: https://issues.apache.org/jira/browse/SPARK-44415 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-44251) Potential for incorrect results or NPE when full outer USING join has null key value

[ https://issues.apache.org/jira/browse/SPARK-44251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-44251: Fix Version/s: 3.5.0 (was: 4.0.0) > Potential for incorrect results or NPE

[jira] [Resolved] (SPARK-44251) Potential for incorrect results or NPE when full outer USING join has null key value

[ https://issues.apache.org/jira/browse/SPARK-44251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-44251. - Fix Version/s: 3.3.3 4.0.0 3.4.2 Resolution: Fixed

[jira] [Assigned] (SPARK-44251) Potential for incorrect results or NPE when full outer USING join has null key value

[ https://issues.apache.org/jira/browse/SPARK-44251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-44251: --- Assignee: Bruce Robbins > Potential for incorrect results or NPE when full outer USING

[jira] [Commented] (SPARK-44339) spark3-shell errors org.apache.hadoop.hive.ql.metadata.HiveException: Unable to fetch table . Permission denied: user [AD user] does not have [SELECT]

[ https://issues.apache.org/jira/browse/SPARK-44339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17741340#comment-17741340 ] Yuming Wang commented on SPARK-44339: - It seems it's cloudera spark issue. > spark3-shell errors

[jira] [Resolved] (SPARK-44185) Inconsistent path qualifying between catalog and data operations

[ https://issues.apache.org/jira/browse/SPARK-44185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-44185. - Fix Version/s: 3.5.0 Assignee: Kent Yao Resolution: Fixed Issue resolved by

[jira] [Commented] (SPARK-44213) CTAS missing the child info on UI when groupSQLSubExecutionEnabled is enabled

[ https://issues.apache.org/jira/browse/SPARK-44213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17737770#comment-17737770 ] Yuming Wang commented on SPARK-44213: - Related issue ticket: SPARK-41752. > CTAS missing the child

[jira] [Commented] (SPARK-44213) CTAS missing the child info on UI when groupSQLSubExecutionEnabled is enabled

[ https://issues.apache.org/jira/browse/SPARK-44213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17737768#comment-17737768 ] Yuming Wang commented on SPARK-44213: - cc [~linhongliu-db] > CTAS missing the child info on UI when

[jira] [Updated] (SPARK-44213) CTAS missing the child info on UI when groupSQLSubExecutionEnabled is enabled

[ https://issues.apache.org/jira/browse/SPARK-44213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-44213: Description: {code:sql} create table tbl using parquet as select t1.id from range(10) as t1 join

[jira] [Updated] (SPARK-44213) CTAS missing the child info on UI when groupSQLSubExecutionEnabled is enabled

[ https://issues.apache.org/jira/browse/SPARK-44213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-44213: Attachment: screenshot-1.png > CTAS missing the child info on UI when groupSQLSubExecutionEnabled

[jira] [Created] (SPARK-44213) CTAS missing the child info on UI when groupSQLSubExecutionEnabled is enabled

Yuming Wang created SPARK-44213: --- Summary: CTAS missing the child info on UI when groupSQLSubExecutionEnabled is enabled Key: SPARK-44213 URL: https://issues.apache.org/jira/browse/SPARK-44213 Project:

[jira] [Updated] (SPARK-44213) CTAS missing the child info on UI when groupSQLSubExecutionEnabled is enabled

[ https://issues.apache.org/jira/browse/SPARK-44213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-44213: Attachment: enabled.png > CTAS missing the child info on UI when groupSQLSubExecutionEnabled is

[jira] [Commented] (MRESOLVER-216) [ERROR] Malformed \uxxxx encoding.

[ https://issues.apache.org/jira/browse/MRESOLVER-216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17737579#comment-17737579 ] Yuming Wang commented on MRESOLVER-216: --- Try: {{grep -lrnw ~/.m2 -e '\u'| xargs rm}} >

[jira] [Commented] (SPARK-42260) Log when the K8s Exec Pods Allocator Stalls

[ https://issues.apache.org/jira/browse/SPARK-42260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17737563#comment-17737563 ] Yuming Wang commented on SPARK-42260: - Remove the target version since 3.4.1 is released. > Log

[jira] [Updated] (SPARK-42260) Log when the K8s Exec Pods Allocator Stalls

[ https://issues.apache.org/jira/browse/SPARK-42260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-42260: Target Version/s: (was: 3.4.1) > Log when the K8s Exec Pods Allocator Stalls >

[jira] [Updated] (SPARK-44025) CSV Table Read Error with CharType(length) column

[ https://issues.apache.org/jira/browse/SPARK-44025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-44025: Target Version/s: (was: 3.4.1) > CSV Table Read Error with CharType(length) column >

[jira] [Resolved] (SPARK-44168) Add Apache Spark 3.4.1 Dockerfiles

[ https://issues.apache.org/jira/browse/SPARK-44168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-44168. - Fix Version/s: 3.4.1 Resolution: Fixed > Add Apache Spark 3.4.1 Dockerfiles >

[jira] [Commented] (SPARK-43816) Spark Corrupts Data In-Transit for High Volume (> 20 TB/hr) of Data

[ https://issues.apache.org/jira/browse/SPARK-43816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17736811#comment-17736811 ] Yuming Wang commented on SPARK-43816: - [~saiallu2020] This is similar to

[jira] [Commented] (SPARK-44114) Upgrade built-in Hive to 3+

[ https://issues.apache.org/jira/browse/SPARK-44114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17735557#comment-17735557 ] Yuming Wang commented on SPARK-44114: - There is a lot of work to upgrade Hive, but the user

[jira] [Commented] (SPARK-43339) LEFT JOIN is treated as INNER JOIN when being in a middle of double join

[ https://issues.apache.org/jira/browse/SPARK-43339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17733780#comment-17733780 ] Yuming Wang commented on SPARK-43339: - This is not a bug. The final result is correct.

[jira] [Resolved] (SPARK-43339) LEFT JOIN is treated as INNER JOIN when being in a middle of double join

[ https://issues.apache.org/jira/browse/SPARK-43339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-43339. - Resolution: Not A Problem It is optimized by EliminateOuterJoin. > LEFT JOIN is treated as

[jira] [Commented] (SPARK-43816) Spark Corrupts Data In-Transit for High Volume (> 20 TB/hr) of Data

[ https://issues.apache.org/jira/browse/SPARK-43816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17733690#comment-17733690 ] Yuming Wang commented on SPARK-43816: - You can also set another config:

[jira] [Updated] (SPARK-44080) Update Spark SQL config default value for thriftserver

[ https://issues.apache.org/jira/browse/SPARK-44080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-44080: Description: To support updating the Spark SQL config default value for new connections without

[jira] [Assigned] (SPARK-44070) Bump snappy-java 1.1.10.1

[ https://issues.apache.org/jira/browse/SPARK-44070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-44070: --- Assignee: Cheng Pan > Bump snappy-java 1.1.10.1 > - > >

[jira] [Resolved] (SPARK-44070) Bump snappy-java 1.1.10.1

[ https://issues.apache.org/jira/browse/SPARK-44070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-44070. - Fix Version/s: 3.5.0 3.4.1 Resolution: Fixed Issue resolved by pull

[jira] [Commented] (SPARK-44080) Update Spark SQL config default value for thriftserver

[ https://issues.apache.org/jira/browse/SPARK-44080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17733556#comment-17733556 ] Yuming Wang commented on SPARK-44080: - https://github.com/apache/spark/pull/41630 > Update Spark

[jira] [Created] (SPARK-44080) Update Spark SQL config default value for thriftserver

Yuming Wang created SPARK-44080: --- Summary: Update Spark SQL config default value for thriftserver Key: SPARK-44080 URL: https://issues.apache.org/jira/browse/SPARK-44080 Project: Spark Issue

[jira] [Assigned] (SPARK-44072) Update the incorrect sql example of insert table documentation

[ https://issues.apache.org/jira/browse/SPARK-44072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-44072: --- Assignee: Yang Zhang > Update the incorrect sql example of insert table documentation >

[jira] [Updated] (SPARK-44072) Update the incorrect sql example of insert table documentation

[ https://issues.apache.org/jira/browse/SPARK-44072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-44072: Fix Version/s: (was: 3.4.1) (was: 3.3.3) > Update the incorrect sql

[jira] [Updated] (SPARK-44072) Update the incorrect sql example of insert table documentation

[ https://issues.apache.org/jira/browse/SPARK-44072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-44072: Fix Version/s: 3.3.3 3.4.1 > Update the incorrect sql example of insert table

[jira] [Assigned] (SPARK-44040) Incorrect result after count distinct

[ https://issues.apache.org/jira/browse/SPARK-44040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-44040: --- Assignee: Yuming Wang > Incorrect result after count distinct >

[jira] [Resolved] (SPARK-44040) Incorrect result after count distinct

[ https://issues.apache.org/jira/browse/SPARK-44040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-44040. - Fix Version/s: 3.3.3 3.5.0 3.4.1 Resolution: Fixed

[jira] [Resolved] (SPARK-44031) Upgrade silencer to 1.7.13

[ https://issues.apache.org/jira/browse/SPARK-44031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-44031. - Fix Version/s: 3.5.0 Assignee: Dongjoon Hyun Resolution: Fixed > Upgrade

[jira] [Commented] (SPARK-44058) Remove deprecated API usage in HiveShim.scala

[ https://issues.apache.org/jira/browse/SPARK-44058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17732851#comment-17732851 ] Yuming Wang commented on SPARK-44058: - This is used to connect Hive metastore 0.12. > Remove

[jira] [Commented] (SPARK-44058) Remove deprecated API usage in HiveShim.scala

[ https://issues.apache.org/jira/browse/SPARK-44058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17732806#comment-17732806 ] Yuming Wang commented on SPARK-44058: - For Hive 0.13 and later, we use

[jira] [Updated] (SPARK-44053) Update ORC to 1.8.4

[ https://issues.apache.org/jira/browse/SPARK-44053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-44053: Affects Version/s: 3.5.0 (was: 3.4.1) > Update ORC to 1.8.4 >

[jira] [Commented] (SPARK-44048) Remove sql-migration-old.md

[ https://issues.apache.org/jira/browse/SPARK-44048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17732336#comment-17732336 ] Yuming Wang commented on SPARK-44048: - https://github.com/apache/spark/pull/41583 > Remove

[jira] [Created] (SPARK-44048) Remove sql-migration-old.md

Yuming Wang created SPARK-44048: --- Summary: Remove sql-migration-old.md Key: SPARK-44048 URL: https://issues.apache.org/jira/browse/SPARK-44048 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-38162) Optimize one row plan in normal and AQE Optimizer

[ https://issues.apache.org/jira/browse/SPARK-38162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-38162: --- Assignee: XiDuo You > Optimize one row plan in normal and AQE Optimizer >

[jira] [Updated] (SPARK-44040) Incorrect result after count distinct

[ https://issues.apache.org/jira/browse/SPARK-44040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-44040: Affects Version/s: 3.3.2 > Incorrect result after count distinct >

[jira] [Commented] (SPARK-44040) Incorrect result after count distinct

[ https://issues.apache.org/jira/browse/SPARK-44040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17732170#comment-17732170 ] Yuming Wang commented on SPARK-44040: - https://github.com/apache/spark/pull/41576 > Incorrect

[jira] [Commented] (SPARK-44040) Incorrect result after count distinct

[ https://issues.apache.org/jira/browse/SPARK-44040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17732159#comment-17732159 ] Yuming Wang commented on SPARK-44040: - Thanks for reporting this bug. We will fix it soon. >

[jira] [Updated] (SPARK-44040) Incorrect result after count distinct

[ https://issues.apache.org/jira/browse/SPARK-44040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-44040: Target Version/s: 3.4.1 > Incorrect result after count distinct >

[jira] [Updated] (SPARK-44025) CSV Table Read Error with CharType(length) column

[ https://issues.apache.org/jira/browse/SPARK-44025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-44025: Target Version/s: 3.4.1 > CSV Table Read Error with CharType(length) column >

[jira] [Created] (SPARK-44021) Add a config to make it do not generate too many partitions

Yuming Wang created SPARK-44021: --- Summary: Add a config to make it do not generate too many partitions Key: SPARK-44021 URL: https://issues.apache.org/jira/browse/SPARK-44021 Project: Spark

[jira] [Resolved] (SPARK-43866) Partition filter condition should pushed down to metastore query if it is equivalence Predicate

[ https://issues.apache.org/jira/browse/SPARK-43866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-43866. - Resolution: Workaround > Partition filter condition should pushed down to metastore query if it

[jira] [Updated] (SPARK-43273) Support lz4raw compression codec for Parquet

[ https://issues.apache.org/jira/browse/SPARK-43273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-43273: Priority: Major (was: Trivial) > Support lz4raw compression codec for Parquet >

[jira] [Commented] (SPARK-43273) Support writing Parquet files with lz4raw compression

[ https://issues.apache.org/jira/browse/SPARK-43273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17730383#comment-17730383 ] Yuming Wang commented on SPARK-43273: - https://github.com/apache/spark/pull/41507 > Support writing

<    1   2   3   4   5   6   7   8   9   10   >