[
https://issues.apache.org/jira/browse/SPARK-44719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17752049#comment-17752049
]
Manu Zhang commented on SPARK-44719:
Is there a 2.3.10 release?
> NoClassDefFoundEr
[
https://issues.apache.org/jira/browse/SPARK-43510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Manu Zhang updated SPARK-43510:
---
Summary: Spark application hangs when YarnAllocator adds running executors
after processing complete
[
https://issues.apache.org/jira/browse/SPARK-43510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Manu Zhang updated SPARK-43510:
---
Description:
I see application hangs when containers are preempted immediately after
allocation as
[
https://issues.apache.org/jira/browse/SPARK-43510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Manu Zhang updated SPARK-43510:
---
Summary: Spark application hangs when YarnAllocator adding running
executors after processing comple
[
https://issues.apache.org/jira/browse/SPARK-43510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Manu Zhang updated SPARK-43510:
---
Description:
I see application hangs when containers are preempted immediately after
allocation as
Manu Zhang created SPARK-43510:
--
Summary: Spark application hangs when YarnAllocator processing
completed containers before updating internal state
Key: SPARK-43510
URL: https://issues.apache.org/jira/browse/SPARK-43
[
https://issues.apache.org/jira/browse/SPARK-39430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17700074#comment-17700074
]
Manu Zhang commented on SPARK-39430:
We are using Spark 3.1.1.
All the UI pages are
Manu Zhang created SPARK-39672:
--
Summary: NotExists subquery failed with conflicting attributes
Key: SPARK-39672
URL: https://issues.apache.org/jira/browse/SPARK-39672
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-30696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17557794#comment-17557794
]
Manu Zhang commented on SPARK-30696:
[~maxgekk], any update on this?
I find another
Manu Zhang created SPARK-39344:
--
Summary: Only disable bucketing when autoBucketedScan is enabled
if bucket columns are not in scan output
Key: SPARK-39344
URL: https://issues.apache.org/jira/browse/SPARK-39344
[
https://issues.apache.org/jira/browse/SPARK-39278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Manu Zhang updated SPARK-39278:
---
Description:
Before [https://github.com/apache/spark/pull/23698,]
The precedence of configuring Had
Manu Zhang created SPARK-39278:
--
Summary: Alternative configs of Hadoop Filesystems to access break
backward compatibility
Key: SPARK-39278
URL: https://issues.apache.org/jira/browse/SPARK-39278
Project:
[
https://issues.apache.org/jira/browse/SPARK-39238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Manu Zhang updated SPARK-39238:
---
Description:
The result of following SQL is 1.00 while 1. is expected
{code:java
[
https://issues.apache.org/jira/browse/SPARK-39238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Manu Zhang updated SPARK-39238:
---
Description:
The result of following SQL is 1.00 while 1. is expected
{code:java
Manu Zhang created SPARK-39238:
--
Summary: Decimal precision loss from applying
WidenSetOperationTypes before DecimalPrecision
Key: SPARK-39238
URL: https://issues.apache.org/jira/browse/SPARK-39238
Proj
[
https://issues.apache.org/jira/browse/SPARK-38211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Manu Zhang updated SPARK-38211:
---
Summary: Add SQL migration guide on restoring loose upcast from string
(was: Add SQL migration guid
Manu Zhang created SPARK-38211:
--
Summary: Add SQL migration guide on preserving loose upcast
Key: SPARK-38211
URL: https://issues.apache.org/jira/browse/SPARK-38211
Project: Spark
Issue Type: I
Manu Zhang created SPARK-38207:
--
Summary: Add bucketed scan behavior change to migration guide
Key: SPARK-38207
URL: https://issues.apache.org/jira/browse/SPARK-38207
Project: Spark
Issue Type:
Manu Zhang created SPARK-37633:
--
Summary: Unwrap cast should skip if downcast failed with ansi
enabled
Key: SPARK-37633
URL: https://issues.apache.org/jira/browse/SPARK-37633
Project: Spark
Iss
[
https://issues.apache.org/jira/browse/SPARK-34714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17450236#comment-17450236
]
Manu Zhang commented on SPARK-34714:
FYI, this was resolved by https://issues.apache
[
https://issues.apache.org/jira/browse/SPARK-31646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17445558#comment-17445558
]
Manu Zhang commented on SPARK-31646:
Only very shortly and by a small amount which I
[
https://issues.apache.org/jira/browse/SPARK-31646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17420688#comment-17420688
]
Manu Zhang commented on SPARK-31646:
{quote}So I will try to derive numBackLoggedCon
[
https://issues.apache.org/jira/browse/SPARK-31646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17416656#comment-17416656
]
Manu Zhang commented on SPARK-31646:
[~yzhangal],
Please check this comment
[http
[
https://issues.apache.org/jira/browse/SPARK-31646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17416656#comment-17416656
]
Manu Zhang edited comment on SPARK-31646 at 9/17/21, 12:40 PM:
---
[
https://issues.apache.org/jira/browse/SPARK-31646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17416147#comment-17416147
]
Manu Zhang commented on SPARK-31646:
[~yzhangal], please check
[https://github.com/
[
https://issues.apache.org/jira/browse/SPARK-35160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Manu Zhang updated SPARK-35160:
---
Description:
Currently, when running on YARN and failing to get Hive delegation token, a
Spark SQL
[
https://issues.apache.org/jira/browse/SPARK-32083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17334443#comment-17334443
]
Manu Zhang commented on SPARK-32083:
This issue has been fixed in https://issues.apa
[
https://issues.apache.org/jira/browse/SPARK-35160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17331114#comment-17331114
]
Manu Zhang commented on SPARK-35160:
[~hyukjin.kwon],
Thanks for reminder. I've add
[
https://issues.apache.org/jira/browse/SPARK-35160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Manu Zhang updated SPARK-35160:
---
Description:
Currently, when running on YARN and failing to get Hive delegation token, a
Spark SQL
Manu Zhang created SPARK-35160:
--
Summary: Spark application submitted despite failing to get Hive
delegation token
Key: SPARK-35160
URL: https://issues.apache.org/jira/browse/SPARK-35160
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-32698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Manu Zhang resolved SPARK-32698.
Resolution: Won't Do
> Do not fall back to default parallelism if the minimum number of coalesced
[
https://issues.apache.org/jira/browse/SPARK-32932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Manu Zhang updated SPARK-32932:
---
Description:
With AQE, local shuffle reader breaks users' repartitioning for dynamic
partition over
[
https://issues.apache.org/jira/browse/SPARK-32932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Manu Zhang updated SPARK-32932:
---
Priority: Major (was: Minor)
> AQE local shuffle reader breaks repartitioning for dynamic partition
[
https://issues.apache.org/jira/browse/SPARK-32932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Manu Zhang updated SPARK-32932:
---
Description:
With AQE, local shuffle reader breaks users' repartitioning for dynamic
partition over
[
https://issues.apache.org/jira/browse/SPARK-32932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Manu Zhang updated SPARK-32932:
---
Summary: AQE local shuffle reader breaks repartitioning for dynamic
partition overwrite (was: AQE l
Manu Zhang created SPARK-32932:
--
Summary: AQE local reader optimizer breaks repartitioning for
dynamic partition overwrite
Key: SPARK-32932
URL: https://issues.apache.org/jira/browse/SPARK-32932
Project:
[
https://issues.apache.org/jira/browse/SPARK-32753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Manu Zhang updated SPARK-32753:
---
Priority: Major (was: Minor)
> Deduplicating and repartitioning the same column create duplicate ro
[
https://issues.apache.org/jira/browse/SPARK-32753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Manu Zhang updated SPARK-32753:
---
Description:
To reproduce:
{code:java}
spark.range(10).union(spark.range(10)).createOrReplaceTempVie
Manu Zhang created SPARK-32753:
--
Summary: Deduplicating and repartitioning the same column create
duplicate rows with AQE
Key: SPARK-32753
URL: https://issues.apache.org/jira/browse/SPARK-32753
Project:
Manu Zhang created SPARK-32698:
--
Summary: Do not fall back to default parallelism if the minimum
number of coalesced partitions is not set in AQE
Key: SPARK-32698
URL: https://issues.apache.org/jira/browse/SPARK-3269
Manu Zhang created SPARK-32083:
--
Summary: Unnecessary tasks are launched when input is empty with
AQE
Key: SPARK-32083
URL: https://issues.apache.org/jira/browse/SPARK-32083
Project: Spark
Issu
Manu Zhang created SPARK-31942:
--
Summary: Revert SPARK-31864 Adjust AQE skew join trigger condition
Key: SPARK-31942
URL: https://issues.apache.org/jira/browse/SPARK-31942
Project: Spark
Issue T
[
https://issues.apache.org/jira/browse/SPARK-31870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Manu Zhang updated SPARK-31870:
---
Summary: AdaptiveQueryExecSuite: "Do not optimize skew join if introduce
additional shuffle" test ha
Manu Zhang created SPARK-31870:
--
Summary: AdaptiveQueryExecSuite: "Do not optimize skew join if
introduce additional shuffle" test doesn't optimize skew join at all
Key: SPARK-31870
URL: https://issues.apache.org/jir
[
https://issues.apache.org/jira/browse/SPARK-30331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Manu Zhang updated SPARK-30331:
---
Parent: SPARK-31412
Issue Type: Sub-task (was: Bug)
> The final AdaptiveSparkPlan event is
[
https://issues.apache.org/jira/browse/SPARK-31658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Manu Zhang updated SPARK-31658:
---
Parent: SPARK-31412
Issue Type: Sub-task (was: Improvement)
> SQL UI doesn't show write com
Manu Zhang created SPARK-31658:
--
Summary: SQL UI doesn't show write commands of AQE plan
Key: SPARK-31658
URL: https://issues.apache.org/jira/browse/SPARK-31658
Project: Spark
Issue Type: Improv
Manu Zhang created SPARK-31646:
--
Summary: Remove unused registeredConnections counter from
ShuffleMetrics
Key: SPARK-31646
URL: https://issues.apache.org/jira/browse/SPARK-31646
Project: Spark
Manu Zhang created SPARK-31611:
--
Summary: Register NettyMemoryMetrics into Node Manager's metrics
system
Key: SPARK-31611
URL: https://issues.apache.org/jira/browse/SPARK-31611
Project: Spark
I
[
https://issues.apache.org/jira/browse/SPARK-31219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Manu Zhang updated SPARK-31219:
---
Description:
Recently, we find our YarnShuffleService has a lot of [half-open
connections|https://b
Manu Zhang created SPARK-31219:
--
Summary: YarnShuffleService doesn't close idle netty channel
Key: SPARK-31219
URL: https://issues.apache.org/jira/browse/SPARK-31219
Project: Spark
Issue Type: I
[
https://issues.apache.org/jira/browse/SPARK-31047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Manu Zhang updated SPARK-31047:
---
Component/s: (was: Input/Output)
SQL
> Improve file listing for ViewFileSystem
Manu Zhang created SPARK-31047:
--
Summary: Improve file listing for ViewFileSystem
Key: SPARK-31047
URL: https://issues.apache.org/jira/browse/SPARK-31047
Project: Spark
Issue Type: Improvement
Manu Zhang created SPARK-30331:
--
Summary: The final AdaptiveSparkPlan event is not marked with
`isFinalPlan=true`
Key: SPARK-30331
URL: https://issues.apache.org/jira/browse/SPARK-30331
Project: Spark
Manu Zhang created SPARK-30217:
--
Summary: Improve partition pruning rule to enforce idempotence
Key: SPARK-30217
URL: https://issues.apache.org/jira/browse/SPARK-30217
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-29793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16983339#comment-16983339
]
Manu Zhang commented on SPARK-29793:
[~maryannxue],
Is the {{AdaptiveSparkPlan(isFi
[
https://issues.apache.org/jira/browse/SPARK-29792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16983155#comment-16983155
]
Manu Zhang edited comment on SPARK-29792 at 11/27/19 4:05 AM:
[
https://issues.apache.org/jira/browse/SPARK-29792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16983155#comment-16983155
]
Manu Zhang commented on SPARK-29792:
I find most metrics are missing from SQL execut
[
https://issues.apache.org/jira/browse/SPARK-29792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Manu Zhang updated SPARK-29792:
---
Attachment: image-2019-11-27-11-46-01-587.png
> SQL metrics cannot be updated to subqueries in AQE
>
[
https://issues.apache.org/jira/browse/SPARK-29792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Manu Zhang updated SPARK-29792:
---
Attachment: (was: image-2019-11-27-11-46-01-587.png)
> SQL metrics cannot be updated to subqueri
[
https://issues.apache.org/jira/browse/SPARK-28531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16977109#comment-16977109
]
Manu Zhang commented on SPARK-28531:
[~manifoldQAQ],
I saw the PR was closed. What'
[
https://issues.apache.org/jira/browse/SPARK-27689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16897948#comment-16897948
]
Manu Zhang commented on SPARK-27689:
[~lambda], [~hyukjin.kwon], [~yumwang],
This i
[
https://issues.apache.org/jira/browse/SPARK-22063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16892595#comment-16892595
]
Manu Zhang edited comment on SPARK-22063 at 7/28/19 4:19 AM:
-
[
https://issues.apache.org/jira/browse/SPARK-22063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16892595#comment-16892595
]
Manu Zhang edited comment on SPARK-22063 at 7/25/19 9:41 AM:
-
[
https://issues.apache.org/jira/browse/SPARK-22063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16892595#comment-16892595
]
Manu Zhang commented on SPARK-22063:
Is there any update in this thread ? Which lint
[
https://issues.apache.org/jira/browse/SPARK-26977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16775783#comment-16775783
]
Manu Zhang commented on SPARK-26977:
I'd love to
> Warn against subclassing scala.A
Manu Zhang created SPARK-26977:
--
Summary: Warn against subclassing scala.App doesn't work
Key: SPARK-26977
URL: https://issues.apache.org/jira/browse/SPARK-26977
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-15041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16616243#comment-16616243
]
Manu Zhang commented on SPARK-15041:
Is there a plan to add such strategies as min/m
[
https://issues.apache.org/jira/browse/SPARK-12837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16165674#comment-16165674
]
Manu Zhang commented on SPARK-12837:
[~todd_leo], please check out [executor side
br
69 matches
Mail list logo