[
https://issues.apache.org/jira/browse/SPARK-44110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17735978#comment-17735978
]
Snoot.io commented on SPARK-44110:
--
User 'snmvaughan' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-44132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17735976#comment-17735976
]
Bruce Robbins commented on SPARK-44132:
---
[~steven.aerts] Go for it!
> nesting full outer joins
[
https://issues.apache.org/jira/browse/SPARK-44132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17735973#comment-17735973
]
Steven Aerts commented on SPARK-44132:
--
[~bersprockets] I did not think of that.
Are you already
[
https://issues.apache.org/jira/browse/SPARK-44132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17735944#comment-17735944
]
Bruce Robbins edited comment on SPARK-44132 at 6/22/23 1:51 AM:
You may
[
https://issues.apache.org/jira/browse/SPARK-44132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17735944#comment-17735944
]
Bruce Robbins commented on SPARK-44132:
---
You may have this figured out already, but in case not,
[
https://issues.apache.org/jira/browse/SPARK-44078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Herman van Hövell resolved SPARK-44078.
---
Fix Version/s: 3.5.0
Assignee: Venkata Sai Akhil Gudesa
Resolution:
[
https://issues.apache.org/jira/browse/SPARK-44136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-44136:
Assignee: Bo Gao
> StateManager may get materialized in executor instead of driver in
>
[
https://issues.apache.org/jira/browse/SPARK-44136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-44136.
--
Fix Version/s: 3.5.0
3.4.1
Resolution: Fixed
Issue resolved by pull
Anton Okolnychyi created SPARK-44139:
Summary: Discard completely pushed down filters in group-based
MERGE operations
Key: SPARK-44139
URL: https://issues.apache.org/jira/browse/SPARK-44139
[
https://issues.apache.org/jira/browse/SPARK-43710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-43710:
Assignee: Haejoon Lee
> Support functions.date_part for Spark Connect
>
[
https://issues.apache.org/jira/browse/SPARK-44128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
BingKun Pan updated SPARK-44128:
Summary: Upgrade netty from 4.1.92 to 4.1.93 (was: Upgrade netty from
4.1.92 to 4.1.94)
>
[
https://issues.apache.org/jira/browse/SPARK-44136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17735926#comment-17735926
]
Jungtaek Lim commented on SPARK-44136:
--
PR: https://github.com/apache/spark/pull/41693
>
[
https://issues.apache.org/jira/browse/SPARK-44138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Anton Okolnychyi updated SPARK-44138:
-
Summary: Prohibit non-deterministic expressions, subqueries and aggregates
in MERGE
Anton Okolnychyi created SPARK-44138:
Summary: Prohibit non-deterministic conditions, subqueries and
aggregates in MERGE conditions
Key: SPARK-44138
URL: https://issues.apache.org/jira/browse/SPARK-44138
John Haberstroh created SPARK-44137:
---
Summary: Change handling of iterable objects for on field in joins
Key: SPARK-44137
URL: https://issues.apache.org/jira/browse/SPARK-44137
Project: Spark
Bo Gao created SPARK-44136:
--
Summary: StateManager may get materialized in executor instead of
driver in FlatMapGroupsWithStateExec
Key: SPARK-44136
URL: https://issues.apache.org/jira/browse/SPARK-44136
[
https://issues.apache.org/jira/browse/SPARK-44133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-44133:
-
Assignee: Hyukjin Kwon
> Upgrade MyPy from 0.920 to 0.982
>
[
https://issues.apache.org/jira/browse/SPARK-44133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-44133.
---
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request 41690
[
https://issues.apache.org/jira/browse/SPARK-39375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17735876#comment-17735876
]
Michael Allman commented on SPARK-39375:
To be clear, Spark Connect will be an alternative or
[
https://issues.apache.org/jira/browse/SPARK-42962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17735867#comment-17735867
]
Wei Liu commented on SPARK-42962:
-
Closing this as it's duplicate with SPARK-42940. Please kindly reopen
[
https://issues.apache.org/jira/browse/SPARK-42962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei Liu resolved SPARK-42962.
-
Resolution: Duplicate
> Allow access to stopped streaming queries
>
[
https://issues.apache.org/jira/browse/SPARK-42941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17735866#comment-17735866
]
Wei Liu commented on SPARK-42941:
-
Hmmm this is actually still in progress. I was thinking two PRs could
[
https://issues.apache.org/jira/browse/SPARK-42941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wei Liu reopened SPARK-42941:
-
> Add support for streaming listener in Python
>
>
>
[
https://issues.apache.org/jira/browse/SPARK-43915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk reassigned SPARK-43915:
Assignee: jiaan.geng
> Assign names to the error class _LEGACY_ERROR_TEMP_[2438-2445]
>
[
https://issues.apache.org/jira/browse/SPARK-43915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk resolved SPARK-43915.
--
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request 41553
[
https://issues.apache.org/jira/browse/SPARK-43924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17735789#comment-17735789
]
Ignite TC Bot commented on SPARK-43924:
---
User 'panbingkun' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-44135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ramakrishna updated SPARK-44135:
Description:
I have a spark application that is deployed using k8s and it is of version
3.3.2
[
https://issues.apache.org/jira/browse/SPARK-44135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ramakrishna updated SPARK-44135:
Priority: Blocker (was: Critical)
> Upgrade to spark 3.4.0 from 3.3.2 gives Exception in thread
[
https://issues.apache.org/jira/browse/SPARK-44135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ramakrishna updated SPARK-44135:
Issue Type: Bug (was: Improvement)
> Upgrade to spark 3.4.0 from 3.3.2 gives Exception in thread
[
https://issues.apache.org/jira/browse/SPARK-44135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ramakrishna updated SPARK-44135:
Description:
I have a spark application that is deployed using k8s and it is of version
3.3.2
[
https://issues.apache.org/jira/browse/SPARK-44135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ramakrishna updated SPARK-44135:
Description:
I have a spark application that is deployed using k8s and it is of version
3.3.2
[
https://issues.apache.org/jira/browse/SPARK-44135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ramakrishna updated SPARK-44135:
Component/s: Spark Core
(was: Shuffle)
> Upgrade to spark 3.4.0 from 3.3.2
[
https://issues.apache.org/jira/browse/SPARK-44135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ramakrishna updated SPARK-44135:
Affects Version/s: (was: 3.2.0)
> Upgrade to spark 3.4.0 from 3.3.2 gives Exception in thread
[
https://issues.apache.org/jira/browse/SPARK-44135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ramakrishna updated SPARK-44135:
Description:
I have a spark application that is deployed using k8s and it is of version
3.3.2
[
https://issues.apache.org/jira/browse/SPARK-44135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ramakrishna updated SPARK-44135:
Description: (was: In our production environment,
_finalizeShuffleMerge_ processing took
Ramakrishna created SPARK-44135:
---
Summary: Upgrade to spark 3.4.0 from 3.3.2 gives Exception in
thread "main" java.nio.file.NoSuchFileException: , although jar is present in
the location
Key: SPARK-44135
URL:
[
https://issues.apache.org/jira/browse/SPARK-44056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk reassigned SPARK-44056:
Assignee: Rob Reeves
> Improve error message when UDF execution fails
>
[
https://issues.apache.org/jira/browse/SPARK-44056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk resolved SPARK-44056.
--
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request 41599
[
https://issues.apache.org/jira/browse/SPARK-44109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-44109.
---
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request 41676
[
https://issues.apache.org/jira/browse/SPARK-44109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-44109:
-
Assignee: Wan Kun
> Remove duplicate preferred locations of each RDD partition
>
[
https://issues.apache.org/jira/browse/SPARK-44042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17735747#comment-17735747
]
Amanda Liu commented on SPARK-44042:
[~ste...@apache.org] thank you for the comment! i agree that
Thomas Graves created SPARK-44134:
-
Summary: Can't set resources (GPU/FPGA) to 0 when they are set to
positive value in spark-defaults.conf
Key: SPARK-44134
URL: https://issues.apache.org/jira/browse/SPARK-44134
[
https://issues.apache.org/jira/browse/SPARK-44134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17735746#comment-17735746
]
Thomas Graves commented on SPARK-44134:
---
I'm working on a fix for this
> Can't set resources
[
https://issues.apache.org/jira/browse/SPARK-41599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17735743#comment-17735743
]
Xieming Li commented on SPARK-41599:
Hi, [~ste...@apache.org], Thank you very much for your advice.
[
https://issues.apache.org/jira/browse/SPARK-42740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jiaan.geng resolved SPARK-42740.
Resolution: Resolved
> Fix the bug that pushdown offset or paging is invalid for some built-in
>
[
https://issues.apache.org/jira/browse/SPARK-42740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17735688#comment-17735688
]
jiaan.geng commented on SPARK-42740:
Resolved by https://github.com/apache/spark/pull/40359
> Fix
[
https://issues.apache.org/jira/browse/SPARK-44042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17735646#comment-17735646
]
Steve Loughran commented on SPARK-44042:
* you can create an independent git repo for this (ASF
[
https://issues.apache.org/jira/browse/SPARK-43903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17735623#comment-17735623
]
ASF GitHub Bot commented on SPARK-43903:
User 'xinrong-meng' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-43903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng resolved SPARK-43903.
---
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request 41603
[
https://issues.apache.org/jira/browse/SPARK-43903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng reassigned SPARK-43903:
-
Assignee: Xinrong Meng
> Improve ArrayType input support in Arrow Python UDF
>
Hyukjin Kwon created SPARK-44133:
Summary: Upgrade MyPy from 0.920 to 0.982
Key: SPARK-44133
URL: https://issues.apache.org/jira/browse/SPARK-44133
Project: Spark
Issue Type: Task
[
https://issues.apache.org/jira/browse/SPARK-44132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steven Aerts updated SPARK-44132:
-
Description:
We are seeing issues with the code generator when querying java bean encoded
data
[
https://issues.apache.org/jira/browse/SPARK-44132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steven Aerts updated SPARK-44132:
-
Description:
We are seeing issues with the code generator when querying java bean encoded
data
[
https://issues.apache.org/jira/browse/SPARK-44132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steven Aerts updated SPARK-44132:
-
Summary: nesting full outer joins confuses code generator (was: nesting
full outer joins
[
https://issues.apache.org/jira/browse/SPARK-44004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk updated SPARK-44004:
-
Fix Version/s: 3.5.0
(was: 4.0.0)
> Assign name & improve error message for
[
https://issues.apache.org/jira/browse/SPARK-44004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk reassigned SPARK-44004:
Assignee: Haejoon Lee
> Assign name & improve error message for frequent LEGACY errors.
>
[
https://issues.apache.org/jira/browse/SPARK-44004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk resolved SPARK-44004.
--
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 41504
Steven Aerts created SPARK-44132:
Summary: nesting full outer joins confuses confuses code generator
Key: SPARK-44132
URL: https://issues.apache.org/jira/browse/SPARK-44132
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-44107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng reopened SPARK-44107:
---
> Hide unsupported Column methods from auto-completion
>
[
https://issues.apache.org/jira/browse/SPARK-44107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng resolved SPARK-44107.
---
Resolution: Fixed
> Hide unsupported Column methods from auto-completion
>
[
https://issues.apache.org/jira/browse/SPARK-44107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17735566#comment-17735566
]
Ruifeng Zheng commented on SPARK-44107:
---
resolved in https://github.com/apache/spark/pull/41675
>
[
https://issues.apache.org/jira/browse/SPARK-44107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng resolved SPARK-44107.
---
Resolution: Resolved
> Hide unsupported Column methods from auto-completion
>
[
https://issues.apache.org/jira/browse/SPARK-44106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng resolved SPARK-44106.
---
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request 41674
[
https://issues.apache.org/jira/browse/SPARK-44106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng reassigned SPARK-44106:
-
Assignee: Ruifeng Zheng
> Add `__repr__` for `GroupedData`
>
[
https://issues.apache.org/jira/browse/SPARK-44114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17735557#comment-17735557
]
Yuming Wang commented on SPARK-44114:
-
There is a lot of work to upgrade Hive, but the user
[
https://issues.apache.org/jira/browse/SPARK-43511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-43511.
--
Fix Version/s: 3.5.0
Resolution: Fixed
Issue resolved by pull request 41558
[
https://issues.apache.org/jira/browse/SPARK-43511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-43511:
Assignee: Bo Gao
> Implemented State APIs for Spark Connect Scala
>
67 matches
Mail list logo