[
https://issues.apache.org/jira/browse/SPARK-49491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-49491:
Description:
scala 2.13.8:
{noformat}
OpenJDK 64-Bit Server VM 1.8.0_382-b05 on Mac OS X 14.5
App
[
https://issues.apache.org/jira/browse/SPARK-49491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-49491:
Summary: Replace AnyRefMap with HashMap (was: Replace HashMap with LongMap
or AnyRefMap)
> Repla
[
https://issues.apache.org/jira/browse/SPARK-49627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-49627:
Attachment: t1.gz.parquet
> Run SortMergeJoin in batch
> --
>
>
[
https://issues.apache.org/jira/browse/SPARK-49627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-49627:
Attachment: t2.snappy.parquet
> Run SortMergeJoin in batch
> --
>
>
Yuming Wang created SPARK-49627:
---
Summary: Run SortMergeJoin in batch
Key: SPARK-49627
URL: https://issues.apache.org/jira/browse/SPARK-49627
Project: Spark
Issue Type: Improvement
Co
Yuming Wang created SPARK-49604:
---
Summary: GROUP_BY_POS_OUT_OF_RANGE if group by Literal
Key: SPARK-49604
URL: https://issues.apache.org/jira/browse/SPARK-49604
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-49537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-49537:
Description:
Error message:
{noformat}
org.apache.hive.service.cli.HiveSQLException: Error running
[
https://issues.apache.org/jira/browse/SPARK-49537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-49537:
Attachment: diable CBO.png
> Incorrect Join stats estimate
> -
>
>
Yuming Wang created SPARK-49537:
---
Summary: Incorrect Join stats estimate
Key: SPARK-49537
URL: https://issues.apache.org/jira/browse/SPARK-49537
Project: Spark
Issue Type: Bug
Compone
[
https://issues.apache.org/jira/browse/SPARK-49522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17880053#comment-17880053
]
Yuming Wang commented on SPARK-49522:
-
Please upgrade your Spark version
> when col
[
https://issues.apache.org/jira/browse/SPARK-49522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-49522:
Fix Version/s: (was: 3.4.2)
> when column added with '+' for many times(>30) , the driver proc
Yuming Wang created SPARK-49507:
---
Summary: Fix Expected only partition pruning predicates exception
Key: SPARK-49507
URL: https://issues.apache.org/jira/browse/SPARK-49507
Project: Spark
Issue
Yuming Wang created SPARK-49500:
---
Summary: NullPointerException in UnwrapCastInBinaryComparison
Key: SPARK-49500
URL: https://issues.apache.org/jira/browse/SPARK-49500
Project: Spark
Issue Type
[
https://issues.apache.org/jira/browse/SPARK-49491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17878686#comment-17878686
]
Yuming Wang edited comment on SPARK-49491 at 9/3/24 2:46 AM:
-
[
https://issues.apache.org/jira/browse/SPARK-49491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17878686#comment-17878686
]
Yuming Wang commented on SPARK-49491:
-
LongMap vs HashMap
{code:scala}
import sc
[
https://issues.apache.org/jira/browse/SPARK-49491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17878593#comment-17878593
]
Yuming Wang commented on SPARK-49491:
-
But there is a regression in Scala 2.13:
ht
[
https://issues.apache.org/jira/browse/SPARK-49491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-49491:
Description:
JDK 1.8:
{noformat}
OpenJDK 64-Bit Server VM 1.8.0_382-b05 on Mac OS X 14.5
Apple M2
[
https://issues.apache.org/jira/browse/SPARK-49491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-49491:
Description:
JDK 1.8:
{noformat}
OpenJDK 64-Bit Server VM 1.8.0_382-b05 on Mac OS X 14.5
Apple M2
Yuming Wang created SPARK-49491:
---
Summary: Replace HashMap with LongMap or AnyRefMap
Key: SPARK-49491
URL: https://issues.apache.org/jira/browse/SPARK-49491
Project: Spark
Issue Type: Improveme
[
https://issues.apache.org/jira/browse/SPARK-49489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-49489:
Target Version/s: 4.0.0
> 'TTransportException: MaxMessageSize reached' occurs if get a table with
[
https://issues.apache.org/jira/browse/SPARK-49489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-49489:
Description:
{noformat}
org.apache.thrift.transport.TTransportException: MaxMessageSize reached
at
[
https://issues.apache.org/jira/browse/SPARK-49489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-49489:
Description:
org.apache.thrift.transport.TTransportException: MaxMessageSize reached
at
org.apach
[
https://issues.apache.org/jira/browse/SPARK-49489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-49489:
Attachment: Internal fix.png
> 'TTransportException: MaxMessageSize reached' occurs if get a table
[
https://issues.apache.org/jira/browse/SPARK-49489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17878495#comment-17878495
]
Yuming Wang commented on SPARK-49489:
-
cc [~chengpan]
> 'TTransportException: MaxMe
Yuming Wang created SPARK-49489:
---
Summary: 'TTransportException: MaxMessageSize reached' occurs if
get a table with a large number of partitions
Key: SPARK-49489
URL: https://issues.apache.org/jira/browse/SPARK-494
[
https://issues.apache.org/jira/browse/SPARK-49472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17878472#comment-17878472
]
Yuming Wang commented on SPARK-49472:
-
Thank you [~Ngone51] . We will fix this inter
[
https://issues.apache.org/jira/browse/SPARK-49472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang resolved SPARK-49472.
-
Resolution: Not A Bug
> Resubmit the task on executor decommission
> ---
[
https://issues.apache.org/jira/browse/SPARK-49472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17878467#comment-17878467
]
Yuming Wang commented on SPARK-49472:
-
Thanks [~Ngone51]. Our workflow is:
# Decomm
[
https://issues.apache.org/jira/browse/SPARK-49472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17878031#comment-17878031
]
Yuming Wang commented on SPARK-49472:
-
[https://github.com/apache/spark/blob/b2f9aab
[
https://issues.apache.org/jira/browse/SPARK-49472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-49472:
Description:
The task re-run many times and can't complete for a long running stage if
both {{spar
[
https://issues.apache.org/jira/browse/SPARK-49472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-49472:
Description:
The task re-run many times and can't complete for a long running stage if
both {{spar
[
https://issues.apache.org/jira/browse/SPARK-49472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-49472:
Description:
The task re-run many times and can't complete for a long running stage if
both {{spar
[
https://issues.apache.org/jira/browse/SPARK-49472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-49472:
Description:
The task re-run many times and can't complete for a long running stage if
both {{spar
[
https://issues.apache.org/jira/browse/SPARK-49472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-49472:
Description:
The task re-run many times and can't complete for a long running stage if
both {{spar
[
https://issues.apache.org/jira/browse/SPARK-49472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-49472:
Attachment: (was: screenshot-1.png)
> Resubmit the task on executor decommission
> ---
[
https://issues.apache.org/jira/browse/SPARK-49472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-49472:
Attachment: screenshot-1.png
> Resubmit the task on executor decommission
> --
[
https://issues.apache.org/jira/browse/SPARK-49472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-49472:
Description:
The task re-run many times and can't complete for a long running stage if
both {{spar
[
https://issues.apache.org/jira/browse/SPARK-49472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-49472:
Attachment: task.png
> Resubmit the task on executor decommission
> --
[
https://issues.apache.org/jira/browse/SPARK-49472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-49472:
Attachment: (was: screenshot-1.png)
> Resubmit the task on executor decommission
> ---
[
https://issues.apache.org/jira/browse/SPARK-49472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-49472:
Description:
The task re-run many times and can't complete for a long running stage if
both {{spar
[
https://issues.apache.org/jira/browse/SPARK-49472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-49472:
Attachment: stage.png
> Resubmit the task on executor decommission
> -
Yuming Wang created SPARK-49472:
---
Summary: Resubmit the task on executor decommission
Key: SPARK-49472
URL: https://issues.apache.org/jira/browse/SPARK-49472
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-49472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-49472:
Attachment: screenshot-1.png
> Resubmit the task on executor decommission
> --
[
https://issues.apache.org/jira/browse/SPARK-43242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang resolved SPARK-43242.
-
Fix Version/s: 4.0.0
Assignee: Zhang Liang
Resolution: Fixed
> diagnoseCorruptio
[
https://issues.apache.org/jira/browse/SPARK-49333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-49333:
Affects Version/s: 3.5.0
> Shutdown timeout thread while cleaning up SparkExecuteStatementOperatio
[
https://issues.apache.org/jira/browse/SPARK-49333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang resolved SPARK-49333.
-
Fix Version/s: 4.0.0
3.5.3
Resolution: Fixed
Issue resolved by pull re
[
https://issues.apache.org/jira/browse/SPARK-49333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang reassigned SPARK-49333:
---
Assignee: Yuming Wang
> Shutdown timeout thread while cleaning up SparkExecuteStatementOper
[
https://issues.apache.org/jira/browse/SPARK-47471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-47471:
Parent: SPARK-27561
Issue Type: Sub-task (was: Improvement)
> Support order-insensitive l
[
https://issues.apache.org/jira/browse/SPARK-49333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-49333:
Summary: Shutdown the timeout thread while cleaning up
SparkExecuteStatementOperation (was: Shutd
Yuming Wang created SPARK-49333:
---
Summary: Shutdown the timeout thread while cleanup
SparkExecuteStatementOperation
Key: SPARK-49333
URL: https://issues.apache.org/jira/browse/SPARK-49333
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-49333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-49333:
Summary: Shutdown timeout thread while cleaning up
SparkExecuteStatementOperation (was: Shutdown
[
https://issues.apache.org/jira/browse/SPARK-49091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17870329#comment-17870329
]
Yuming Wang commented on SPARK-49091:
-
Before revert SPARK-41914:
{noformat}
num
[
https://issues.apache.org/jira/browse/SPARK-49091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-49091:
Description:
Please apply this patch([^SPARK-49091.patch]) to reproduce this issue. This
issue ma
[
https://issues.apache.org/jira/browse/SPARK-49091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-49091:
Description:
Please apply this patch([^SPARK-49091.patch]) to reproduce this issue. This
issue ma
[
https://issues.apache.org/jira/browse/SPARK-49091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-49091:
Description:
Please apply this patch([^SPARK-49091.patch]) to reproduce this issue. This
issue ma
[
https://issues.apache.org/jira/browse/SPARK-49091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-49091:
Description:
Please apply this patch([^SPARK-49091.patch]) to reproduce this issue. This
issue ma
[
https://issues.apache.org/jira/browse/SPARK-49091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-49091:
Description:
Please apply this patch([^SPARK-49091.patch]) to reproduce this issue. This
issue ma
[
https://issues.apache.org/jira/browse/SPARK-49091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-49091:
Description:
Please apply this patch([^SPARK-49091.patch]) to reproduce this issue. This
issue ma
[
https://issues.apache.org/jira/browse/SPARK-49091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-49091:
Attachment: driver heap.png
> Some broadcasts cannot be cleared from memory storage
>
[
https://issues.apache.org/jira/browse/SPARK-49091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-49091:
Description:
Please apply this patch([^SPARK-49091.patch]) to reproduce this issue.
Before SPARK-
[
https://issues.apache.org/jira/browse/SPARK-49091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-49091:
Description:
Please apply this patch([^SPARK-49091.patch]) to reproduce this issue.
was:Plea
[
https://issues.apache.org/jira/browse/SPARK-49091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-49091:
Description: Please apply this path [^SPARK-49091.patch] (was:
)
> Some broadcasts cannot be c
[
https://issues.apache.org/jira/browse/SPARK-49091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-49091:
Attachment: SPARK-49091.patch
> Some broadcasts cannot be cleared from memory storage
> --
Yuming Wang created SPARK-49091:
---
Summary: Some broadcasts cannot be cleared from memory storage
Key: SPARK-49091
URL: https://issues.apache.org/jira/browse/SPARK-49091
Project: Spark
Issue Typ
Yuming Wang created SPARK-48709:
---
Summary: varchar resolution mismatch for DataSourceV2 CTAS
Key: SPARK-48709
URL: https://issues.apache.org/jira/browse/SPARK-48709
Project: Spark
Issue Type: B
[
https://issues.apache.org/jira/browse/SPARK-48660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-48660:
Description:
How to reproduce:
{code:sql}
CREATE TABLE order_history_version_audit_rno (
eventi
[
https://issues.apache.org/jira/browse/SPARK-48660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-48660:
Description:
How to reproduce:
{code:sql}
CREATE TABLE order_history_version_audit_rno (
eventi
Yuming Wang created SPARK-48660:
---
Summary: The result of explain is incorrect for CreateTableAsSelect
Key: SPARK-48660
URL: https://issues.apache.org/jira/browse/SPARK-48660
Project: Spark
Issu
Yuming Wang created SPARK-48617:
---
Summary: Try to schedule tasks to the same executor
Key: SPARK-48617
URL: https://issues.apache.org/jira/browse/SPARK-48617
Project: Spark
Issue Type: Improvem
[
https://issues.apache.org/jira/browse/SPARK-48173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-48173:
Fix Version/s: 3.5.2
> CheckAnalsis should see the entire query plan
> ---
[
https://issues.apache.org/jira/browse/SPARK-47471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-47471:
Component/s: SQL
(was: Block Manager)
> Support order-insensitive lateral col
Yuming Wang created SPARK-47471:
---
Summary: Support order-insensitive lateral column alias
Key: SPARK-47471
URL: https://issues.apache.org/jira/browse/SPARK-47471
Project: Spark
Issue Type: Impr
Yuming Wang created SPARK-47459:
---
Summary: Cancel running stage if the result is empty relation
Key: SPARK-47459
URL: https://issues.apache.org/jira/browse/SPARK-47459
Project: Spark
Issue Type
[
https://issues.apache.org/jira/browse/SPARK-47459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-47459:
Attachment: task stack trace.png
> Cancel running stage if the result is empty relation
>
Yuming Wang created SPARK-47441:
---
Summary: Do not add log link for unmanaged AM in Spark UI
Key: SPARK-47441
URL: https://issues.apache.org/jira/browse/SPARK-47441
Project: Spark
Issue Type: Bu
[
https://issues.apache.org/jira/browse/SPARK-47222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17821923#comment-17821923
]
Yuming Wang commented on SPARK-47222:
-
https://github.com/apache/spark/pull/45329
>
Yuming Wang created SPARK-47222:
---
Summary: fileCompressionFactor should be applied to the size of
the table
Key: SPARK-47222
URL: https://issues.apache.org/jira/browse/SPARK-47222
Project: Spark
Yuming Wang created SPARK-46885:
---
Summary: Push down filters through TypedFilter
Key: SPARK-46885
URL: https://issues.apache.org/jira/browse/SPARK-46885
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-40609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang resolved SPARK-40609.
-
Fix Version/s: 4.0.0
Resolution: Duplicate
Issue fixed by SPARK-46219.
> Casts types acc
[
https://issues.apache.org/jira/browse/SPARK-46219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-46219:
Summary: Unwrap cast in join predicates (was: Unwrapp cast in join
predicates)
> Unwrap cast in
Yuming Wang created SPARK-46219:
---
Summary: Unwrapp cast in join predicates
Key: SPARK-46219
URL: https://issues.apache.org/jira/browse/SPARK-46219
Project: Spark
Issue Type: New Feature
[
https://issues.apache.org/jira/browse/SPARK-46069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang resolved SPARK-46069.
-
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 43982
[https://gith
[
https://issues.apache.org/jira/browse/SPARK-46069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang reassigned SPARK-46069:
---
Assignee: Wan Kun
> Support unwrap timestamp type to date type
> --
[
https://issues.apache.org/jira/browse/SPARK-43228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang resolved SPARK-43228.
-
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 44128
[https://gith
[
https://issues.apache.org/jira/browse/SPARK-43228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang reassigned SPARK-43228:
---
Assignee: Yuming Wang
> Join keys also match PartitioningCollection
> -
[
https://issues.apache.org/jira/browse/SPARK-46122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-46122:
Summary: Disable spark.sql.legacy.createHiveTableByDefault by default
(was: Enable spark.sql.lega
Yuming Wang created SPARK-46122:
---
Summary: Enable spark.sql.legacy.createHiveTableByDefault by
default
Key: SPARK-46122
URL: https://issues.apache.org/jira/browse/SPARK-46122
Project: Spark
Is
Yuming Wang created SPARK-46119:
---
Summary: Override toString method for UnresolvedAlias
Key: SPARK-46119
URL: https://issues.apache.org/jira/browse/SPARK-46119
Project: Spark
Issue Type: Improv
[
https://issues.apache.org/jira/browse/SPARK-46102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-46102:
Summary: Prune keys or values from Generate if it is a map type (was:
Prune keys or values from G
Yuming Wang created SPARK-46102:
---
Summary: Prune keys or values from Generate if it is a map type.
Key: SPARK-46102
URL: https://issues.apache.org/jira/browse/SPARK-46102
Project: Spark
Issue T
[
https://issues.apache.org/jira/browse/SPARK-46097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17789619#comment-17789619
]
Yuming Wang commented on SPARK-46097:
-
https://github.com/apache/spark/pull/44009
>
Yuming Wang created SPARK-46097:
---
Summary: Push down limit 1 though Union and Aggregate
Key: SPARK-46097
URL: https://issues.apache.org/jira/browse/SPARK-46097
Project: Spark
Issue Type: Improv
[
https://issues.apache.org/jira/browse/SPARK-45954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-45954:
Summary: Avoid generating redundant ShuffleExchangeExec node (was: Remove
redundant shuffles)
>
Yuming Wang created SPARK-45954:
---
Summary: Remove redundant shuffles
Key: SPARK-45954
URL: https://issues.apache.org/jira/browse/SPARK-45954
Project: Spark
Issue Type: Improvement
Com
[
https://issues.apache.org/jira/browse/SPARK-45947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-45947:
Description:
We should set the view name to
sparkSession.sparkContext.setJobDescription("xxx")
[
https://issues.apache.org/jira/browse/SPARK-45947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-45947:
Description:
Need to sparkSession.sparkContext.setJobDescription("xxx")
!screenshot-1.png!
> S
Yuming Wang created SPARK-45947:
---
Summary: Set a human readable description for Dataset api
Key: SPARK-45947
URL: https://issues.apache.org/jira/browse/SPARK-45947
Project: Spark
Issue Type: Im
[
https://issues.apache.org/jira/browse/SPARK-45947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-45947:
Attachment: screenshot-1.png
> Set a human readable description for Dataset api
>
[
https://issues.apache.org/jira/browse/SPARK-45915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-45915:
Summary: Treat decimal(x, 0) the same as IntegralType in PromoteStrings
(was: Unwrap cast in pred
Yuming Wang created SPARK-45915:
---
Summary: Unwrap cast in predicate
Key: SPARK-45915
URL: https://issues.apache.org/jira/browse/SPARK-45915
Project: Spark
Issue Type: Improvement
Comp
1 - 100 of 1204 matches
Mail list logo
