[
https://issues.apache.org/jira/browse/SPARK-44939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-44939.
---
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 42645
[
https://issues.apache.org/jira/browse/SPARK-44939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-44939:
-
Assignee: Dongjoon Hyun
> Support Java 21 in SparkR SystemRequirements
>
[
https://issues.apache.org/jira/browse/SPARK-44452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yang Jie resolved SPARK-44452.
--
Resolution: Won't Fix
Arrow 13.0 has already been released, this fix is no longer needed.
> Ignore
[
https://issues.apache.org/jira/browse/SPARK-44939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17758356#comment-17758356
]
Hudson commented on SPARK-44939:
User 'dongjoon-hyun' has created a pull request for this issue:
Dongjoon Hyun created SPARK-44939:
-
Summary: Support Java 21 in SparkR SystemRequirements
Key: SPARK-44939
URL: https://issues.apache.org/jira/browse/SPARK-44939
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-44936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-44936.
---
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 42638
[
https://issues.apache.org/jira/browse/SPARK-44936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-44936:
-
Assignee: Dongjoon Hyun
> Simplify the log when Spark HybridStore hits the memory
[
https://issues.apache.org/jira/browse/SPARK-44900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17758316#comment-17758316
]
Varun Nalla commented on SPARK-44900:
-
[~yao] Thanks for the comment. However we can't release as
[
https://issues.apache.org/jira/browse/SPARK-44900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17758315#comment-17758315
]
Kent Yao commented on SPARK-44900:
--
How about releasing the cached rdds if you never touch it again
>
[
https://issues.apache.org/jira/browse/SPARK-44820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17758314#comment-17758314
]
BingKun Pan commented on SPARK-44820:
-
Let me try to investigate it.
> Switch languages
Cheng Pan created SPARK-44938:
-
Summary: Change default value of spark.sql.maxSinglePartitionBytes
to 128m
Key: SPARK-44938
URL: https://issues.apache.org/jira/browse/SPARK-44938
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-44903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng resolved SPARK-44903.
---
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 42596
[
https://issues.apache.org/jira/browse/SPARK-44903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng reassigned SPARK-44903:
-
Assignee: Yang Jie
> Refine docstring of `approx_count_distinct`
>
[
https://issues.apache.org/jira/browse/SPARK-42017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng resolved SPARK-42017.
---
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 42608
[
https://issues.apache.org/jira/browse/SPARK-44750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng resolved SPARK-44750.
---
Fix Version/s: 3.5.0
4.0.0
Resolution: Fixed
Issue resolved by
[
https://issues.apache.org/jira/browse/SPARK-6373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17758289#comment-17758289
]
Hasnain Lakhani commented on SPARK-6373:
FYI: I filed
Hasnain Lakhani created SPARK-44937:
---
Summary: Add SSL/TLS support for RPC and Shuffle communications
Key: SPARK-44937
URL: https://issues.apache.org/jira/browse/SPARK-44937
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-44935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-44935:
-
Assignee: Dongjoon Hyun
> Fix `RELEASE` file to have the correct information in Docker
[
https://issues.apache.org/jira/browse/SPARK-44935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-44935.
---
Fix Version/s: 3.3.4
3.5.0
4.0.0
[
https://issues.apache.org/jira/browse/SPARK-44936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-44936:
--
Description:
*BEFORE*
{code}
23/08/23 22:40:34 INFO FsHistoryProvider: Failed to create
Dongjoon Hyun created SPARK-44936:
-
Summary: Simplify the log when Spark HybridStore hits the memory
limit
Key: SPARK-44936
URL: https://issues.apache.org/jira/browse/SPARK-44936
Project: Spark
Dongjoon Hyun created SPARK-44935:
-
Summary: Fix `RELEASE` file to have the correct information in
Docker images
Key: SPARK-44935
URL: https://issues.apache.org/jira/browse/SPARK-44935
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-44934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wen Yuen Pang updated SPARK-44934:
--
Description:
When running the query
{code:java}
with cte as (
select c1, c1, c2, c3 from t
Wen Yuen Pang created SPARK-44934:
-
Summary: PushdownPredicatesAndPruneColumnsForCTEDef creates
invalid plan when called over CTE with duplicate attributes
Key: SPARK-44934
URL:
[
https://issues.apache.org/jira/browse/SPARK-44933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
eddie baggott updated SPARK-44933:
--
Description:
During a migration from spark 2.4.4 to spark 3.4.0 I have noticed slower
eddie baggott created SPARK-44933:
-
Summary: Spark structured streaming performance regression in
latency times reading/writing to kafka since 3.0.2
Key: SPARK-44933
URL:
[
https://issues.apache.org/jira/browse/SPARK-44906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-44906:
--
Affects Version/s: 4.0.0
(was: 3.4.1)
> Make
[
https://issues.apache.org/jira/browse/SPARK-44906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-44906:
--
Summary: Make Kubernetes[Driver|Executor]Conf.annotations substitute
annotations instead of
[
https://issues.apache.org/jira/browse/SPARK-44906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-44906:
--
Priority: Minor (was: Major)
> Make Kubernetes[Driver|Executor]Conf.annotations substitute
[
https://issues.apache.org/jira/browse/SPARK-44906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-44906.
---
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 42600
[
https://issues.apache.org/jira/browse/SPARK-44906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-44906:
-
Assignee: Binjie Yang
> Move substituteAppNExecIds logic into
[
https://issues.apache.org/jira/browse/SPARK-44884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17758167#comment-17758167
]
Steve Loughran commented on SPARK-44884:
i'm not trying to replicate it; i have too many other
[
https://issues.apache.org/jira/browse/SPARK-44900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17758161#comment-17758161
]
Varun Nalla commented on SPARK-44900:
-
[~yao] , is there a way I could prioritize this issue as it's
[
https://issues.apache.org/jira/browse/SPARK-44816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Herman van Hövell reassigned SPARK-44816:
-
Assignee: Niranjan Jayakar
> Cryptic error message when UDF associated class
[
https://issues.apache.org/jira/browse/SPARK-44816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Herman van Hövell resolved SPARK-44816.
---
Fix Version/s: 3.5.0
Resolution: Fixed
> Cryptic error message when UDF
[
https://issues.apache.org/jira/browse/SPARK-44861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Herman van Hövell resolved SPARK-44861.
---
Fix Version/s: 3.5.0
Resolution: Fixed
> [CONNECT] jsonignore
[
https://issues.apache.org/jira/browse/SPARK-44861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Herman van Hövell reassigned SPARK-44861:
-
Assignee: Jean-Francois Desjeans Gauthier
> [CONNECT] jsonignore
[
https://issues.apache.org/jira/browse/SPARK-23887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17758145#comment-17758145
]
Bryan Qiang commented on SPARK-23887:
-
Hello folks, I'm wondering what's the final decision on this.
[
https://issues.apache.org/jira/browse/SPARK-44932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bryan Qiang updated SPARK-44932:
Summary: Continuous Structured Streaming not reporting streaming metrics
(was: Continuous
Bryan Qiang created SPARK-44932:
---
Summary: Continuous Structured Streaming
Key: SPARK-44932
URL: https://issues.apache.org/jira/browse/SPARK-44932
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-44900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Varun Nalla updated SPARK-44900:
Priority: Blocker (was: Critical)
> Cached DataFrame keeps growing
>
[
https://issues.apache.org/jira/browse/SPARK-44931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17758107#comment-17758107
]
GridGain Integration commented on SPARK-44931:
--
User 'grundprinzip' has created a pull
[
https://issues.apache.org/jira/browse/SPARK-44549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-44549.
-
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 42383
[
https://issues.apache.org/jira/browse/SPARK-44549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-44549:
---
Assignee: Andrey Gubichev
> Support correlated references under window functions
>
[
https://issues.apache.org/jira/browse/SPARK-44914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yang Jie reassigned SPARK-44914:
Assignee: Bjørn Jørgensen
> Upgrade Apache ivy to 2.5.2
>
>
>
[
https://issues.apache.org/jira/browse/SPARK-44914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yang Jie resolved SPARK-44914.
--
Fix Version/s: 3.5.0
4.0.0
Resolution: Fixed
Issue resolved by pull request
Martin Grund created SPARK-44931:
Summary: Fix JSON Serailization for Spark Connect Event Listener
Key: SPARK-44931
URL: https://issues.apache.org/jira/browse/SPARK-44931
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-44908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Weichen Xu resolved SPARK-44908.
Fix Version/s: 3.5.0
4.0.0
Resolution: Fixed
Issue resolved by pull
[
https://issues.apache.org/jira/browse/SPARK-44846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17757899#comment-17757899
]
ASF GitHub Bot commented on SPARK-44846:
User 'zml1206' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-44923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17757897#comment-17757897
]
ASF GitHub Bot commented on SPARK-44923:
User 'panbingkun' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-44923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17757898#comment-17757898
]
ASF GitHub Bot commented on SPARK-44923:
User 'panbingkun' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-44923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng reassigned SPARK-44923:
-
Assignee: BingKun Pan
> Some directories should be cleared when regenerating files
>
[
https://issues.apache.org/jira/browse/SPARK-44923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng resolved SPARK-44923.
---
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 42622
[
https://issues.apache.org/jira/browse/SPARK-44928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17757894#comment-17757894
]
ASF GitHub Bot commented on SPARK-44928:
User 'HyukjinKwon' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-44930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17757893#comment-17757893
]
ASF GitHub Bot commented on SPARK-44930:
User 'ConeyLiu' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-44930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xianyang Liu updated SPARK-44930:
-
Description: Currently, ApplyFunctionExpression is unfoldable because
inherits the default
[
https://issues.apache.org/jira/browse/SPARK-44219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17757892#comment-17757892
]
ASF GitHub Bot commented on SPARK-44219:
User 'YannisSismanis' has created a pull request for
[
https://issues.apache.org/jira/browse/SPARK-44930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xianyang Liu updated SPARK-44930:
-
Description: Currently, ApplyFunctionExpression is unfoldable because
inherits the default
Xianyang Liu created SPARK-44930:
Summary: Deterministic ApplyFunctionExpression should be foldable
Key: SPARK-44930
URL: https://issues.apache.org/jira/browse/SPARK-44930
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-44928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-44928:
-
Description:
{code}
from pyspark.sql import functions as F
{code}
isn’t very Pythonic - it
[
https://issues.apache.org/jira/browse/SPARK-44927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon deleted SPARK-44927:
-
> Replace the module alias 'sf' instead of 'F' in pyspark.sql import functions
>
[
https://issues.apache.org/jira/browse/SPARK-44926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon deleted SPARK-44926:
-
> Replace the module alias 'sf' instead of 'F' in pyspark.sql import functions
>
Kent Yao created SPARK-44929:
Summary: Truncate log output for console appender in tests
Key: SPARK-44929
URL: https://issues.apache.org/jira/browse/SPARK-44929
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-44871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Peter Toth updated SPARK-44871:
---
Fix Version/s: 3.5.0
> Fix PERCENTILE_DISC behaviour
> -
>
>
Hyukjin Kwon created SPARK-44926:
Summary: Replace the module alias 'sf' instead of 'F' in
pyspark.sql import functions
Key: SPARK-44926
URL: https://issues.apache.org/jira/browse/SPARK-44926
Hyukjin Kwon created SPARK-44928:
Summary: Replace the module alias 'sf' instead of 'F' in
pyspark.sql import functions
Key: SPARK-44928
URL: https://issues.apache.org/jira/browse/SPARK-44928
Hyukjin Kwon created SPARK-44927:
Summary: Replace the module alias 'sf' instead of 'F' in
pyspark.sql import functions
Key: SPARK-44927
URL: https://issues.apache.org/jira/browse/SPARK-44927
[
https://issues.apache.org/jira/browse/SPARK-44871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk updated SPARK-44871:
-
Fix Version/s: 4.0.0
> Fix PERCENTILE_DISC behaviour
> -
>
>
[
https://issues.apache.org/jira/browse/SPARK-44871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk updated SPARK-44871:
-
Fix Version/s: 3.3.4
> Fix PERCENTILE_DISC behaviour
> -
>
>
[
https://issues.apache.org/jira/browse/SPARK-42905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17757858#comment-17757858
]
zhangzhenhao edited comment on SPARK-42905 at 8/23/23 7:35 AM:
---
minimal
[
https://issues.apache.org/jira/browse/SPARK-44909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Weichen Xu resolved SPARK-44909.
Fix Version/s: 3.5.0
4.0.0
Resolution: Fixed
Issue resolved by pull
[
https://issues.apache.org/jira/browse/SPARK-42905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17757858#comment-17757858
]
zhangzhenhao commented on SPARK-42905:
--
minimal reproducible example, the result is incorrect and
[
https://issues.apache.org/jira/browse/SPARK-44909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Weichen Xu reassigned SPARK-44909:
--
Assignee: Weichen Xu
> Skip starting torch distributor log streaming server when it is not
[
https://issues.apache.org/jira/browse/SPARK-44899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng reassigned SPARK-44899:
-
Assignee: Allison Wang
> Refine the docstring of `DataFrame.collect`
>
[
https://issues.apache.org/jira/browse/SPARK-44899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng resolved SPARK-44899.
---
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 42592
[
https://issues.apache.org/jira/browse/SPARK-44921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kent Yao resolved SPARK-44921.
--
Fix Version/s: 3.5.0
4.0.0
Resolution: Fixed
Issue resolved by pull request
[
https://issues.apache.org/jira/browse/SPARK-44920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17757826#comment-17757826
]
Hudson commented on SPARK-44920:
User 'JoshRosen' has created a pull request for this issue:
77 matches
Mail list logo