Deng Ziming created SPARK-45736:
---
Summary: Use \s+ as separator when testing Kafka source or network
source
Key: SPARK-45736
URL: https://issues.apache.org/jira/browse/SPARK-45736
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-45713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-45713.
-
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 43566
[https://gith
[
https://issues.apache.org/jira/browse/SPARK-45713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-45713:
---
Assignee: Allison Wang
> Support registering Python data sources
>
[
https://issues.apache.org/jira/browse/SPARK-45730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-45730:
---
Labels: pull-request-available (was: )
> [CORE] Make ReloadingX509TrustManagerSuite less fl
[
https://issues.apache.org/jira/browse/SPARK-45735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-45735:
---
Labels: pull-request-available (was: )
> Reenable CatalogTests without Spark Connect
>
Hyukjin Kwon created SPARK-45735:
Summary: Reenable CatalogTests without Spark Connect
Key: SPARK-45735
URL: https://issues.apache.org/jira/browse/SPARK-45735
Project: Spark
Issue Type: New F
[
https://issues.apache.org/jira/browse/SPARK-45729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-45729.
--
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 43587
[https://gi
[
https://issues.apache.org/jira/browse/SPARK-45729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-45729:
Assignee: Amanda Liu
> Fix PySpark testing guide links
> ---
[
https://issues.apache.org/jira/browse/SPARK-45727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jungtaek Lim resolved SPARK-45727.
--
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 43588
[https://gi
[
https://issues.apache.org/jira/browse/SPARK-45592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-45592.
-
Fix Version/s: 4.0.0
3.5.1
Resolution: Fixed
Issue resolved by pull re
Yang Jie created SPARK-45734:
Summary: Upgrade commons-io to 2.15.0
Key: SPARK-45734
URL: https://issues.apache.org/jira/browse/SPARK-45734
Project: Spark
Issue Type: Improvement
Compon
[
https://issues.apache.org/jira/browse/SPARK-45733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-45733:
---
Labels: pull-request-available (was: )
> Classify errors into different classes and support
Alice Sayutina created SPARK-45733:
--
Summary: Classify errors into different classes and support
different retry policies.
Key: SPARK-45733
URL: https://issues.apache.org/jira/browse/SPARK-45733
Proj
[
https://issues.apache.org/jira/browse/SPARK-45728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-45728.
---
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 43589
[https://
[
https://issues.apache.org/jira/browse/SPARK-45728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-45728:
-
Assignee: Dongjoon Hyun
> Upgrade `kubernetes-client` to 6.9.1
> --
[
https://issues.apache.org/jira/browse/SPARK-45732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-45732:
---
Labels: pull-request-available (was: )
> Upgrade commons-text to 1.11.0
> -
BingKun Pan created SPARK-45732:
---
Summary: Upgrade commons-text to 1.11.0
Key: SPARK-45732
URL: https://issues.apache.org/jira/browse/SPARK-45732
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-45282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17781171#comment-17781171
]
koert kuipers commented on SPARK-45282:
---
last time i checked this issue was still
[
https://issues.apache.org/jira/browse/SPARK-44512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-44512:
--
Fix Version/s: (was: 3.4.2)
> dataset.sort.select.write.partitionBy sorts wrong column
> -
[
https://issues.apache.org/jira/browse/SPARK-44512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-44512:
--
Target Version/s: 3.4.2
> dataset.sort.select.write.partitionBy sorts wrong column
> -
[
https://issues.apache.org/jira/browse/SPARK-44512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17781169#comment-17781169
]
Dongjoon Hyun commented on SPARK-44512:
---
Hi, All. Is this correctness issue valid
[
https://issues.apache.org/jira/browse/SPARK-45282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17781168#comment-17781168
]
Dongjoon Hyun commented on SPARK-45282:
---
Let me increase the priority to `Blocker`
[
https://issues.apache.org/jira/browse/SPARK-44512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-44512:
--
Fix Version/s: 3.4.2
> dataset.sort.select.write.partitionBy sorts wrong column
>
[
https://issues.apache.org/jira/browse/SPARK-45282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-45282:
--
Priority: Blocker (was: Major)
> Join loses records for cached datasets
> ---
[
https://issues.apache.org/jira/browse/SPARK-45282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-45282:
--
Target Version/s: 3.4.2
> Join loses records for cached datasets
> ---
[
https://issues.apache.org/jira/browse/SPARK-45282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17781167#comment-17781167
]
Dongjoon Hyun commented on SPARK-45282:
---
Hi, All
Is this correctness issue still v
[
https://issues.apache.org/jira/browse/SPARK-45245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-45245.
--
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 43023
[https://gi
[
https://issues.apache.org/jira/browse/SPARK-45245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-45245:
Assignee: Raghu Angadi
> PythonWorkerFactory create gets stuck in case of worker failures
[
https://issues.apache.org/jira/browse/SPARK-45506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-45506:
Assignee: Vsevolod Stepanov
> Support ivy URIs in SparkConnect addArtifact
>
[
https://issues.apache.org/jira/browse/SPARK-45506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-45506.
--
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 43354
[https://gi
Chao Sun created SPARK-45731:
Summary: Update partition statistics with ANALYZE TABLE command
Key: SPARK-45731
URL: https://issues.apache.org/jira/browse/SPARK-45731
Project: Spark
Issue Type: Im
[
https://issues.apache.org/jira/browse/SPARK-45652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated SPARK-45652:
-
Description:
When the number of input partitions become 0 after dynamic filtering, in
{{BatchScanExec}}
[
https://issues.apache.org/jira/browse/SPARK-45729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-45729:
---
Labels: pull-request-available (was: )
> Fix PySpark testing guide links
>
Hasnain Lakhani created SPARK-45730:
---
Summary: [CORE] Make ReloadingX509TrustManagerSuite less flaky
Key: SPARK-45730
URL: https://issues.apache.org/jira/browse/SPARK-45730
Project: Spark
I
Amanda Liu created SPARK-45729:
--
Summary: Fix PySpark testing guide links
Key: SPARK-45729
URL: https://issues.apache.org/jira/browse/SPARK-45729
Project: Spark
Issue Type: Sub-task
Co
[
https://issues.apache.org/jira/browse/SPARK-45728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-45728:
---
Labels: pull-request-available (was: )
> Upgrade `kubernetes-client` to 6.9.1
> ---
[
https://issues.apache.org/jira/browse/SPARK-45727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17781093#comment-17781093
]
Anish Shrigondekar commented on SPARK-45727:
[https://github.com/apache/spar
Dongjoon Hyun created SPARK-45728:
-
Summary: Upgrade `kubernetes-client` to 6.9.1
Key: SPARK-45728
URL: https://issues.apache.org/jira/browse/SPARK-45728
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-45644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17781091#comment-17781091
]
Bruce Robbins commented on SPARK-45644:
---
You can turn on display of the generated
[
https://issues.apache.org/jira/browse/SPARK-45726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-45726:
---
Labels: pull-request-available (was: )
> Make Dataset.collectResult private
> -
Yihong He created SPARK-45726:
-
Summary: Make Dataset.collectResult private
Key: SPARK-45726
URL: https://issues.apache.org/jira/browse/SPARK-45726
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-45691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yang Jie resolved SPARK-45691.
--
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 43576
[https://github.com
[
https://issues.apache.org/jira/browse/SPARK-45690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yang Jie resolved SPARK-45690.
--
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 43576
[https://github.com
[
https://issues.apache.org/jira/browse/SPARK-45691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yang Jie reassigned SPARK-45691:
Assignee: Yang Jie
> Clean up the deprecated API usage related to
> `RightProjection/LeftProje
[
https://issues.apache.org/jira/browse/SPARK-45689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yang Jie reassigned SPARK-45689:
Assignee: Yang Jie
> Clean up the deprecated API usage related to `StringContext/StringOps`
> -
[
https://issues.apache.org/jira/browse/SPARK-45689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yang Jie resolved SPARK-45689.
--
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 43576
[https://github.com
[
https://issues.apache.org/jira/browse/SPARK-45724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yang Jie resolved SPARK-45724.
--
Resolution: Not A Problem
> Add a separate LogAppender for tests that need to print
> `RuleExecutor.d
[
https://issues.apache.org/jira/browse/SPARK-45725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-45725:
---
Labels: pull-request-available (was: )
> remove the non-default IN subquery runtime filter
Wenchen Fan created SPARK-45725:
---
Summary: remove the non-default IN subquery runtime filter
Key: SPARK-45725
URL: https://issues.apache.org/jira/browse/SPARK-45725
Project: Spark
Issue Type: I
[
https://issues.apache.org/jira/browse/SPARK-45694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17781022#comment-17781022
]
Tengfei Huang commented on SPARK-45694:
---
Hi [~LuciferYang], I will work on this.
[
https://issues.apache.org/jira/browse/SPARK-45681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kent Yao reassigned SPARK-45681:
Assignee: Kent Yao
> Clone a js version of UIUtils.errorMessageCell to for consistent error
> pa
[
https://issues.apache.org/jira/browse/SPARK-45681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kent Yao resolved SPARK-45681.
--
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 43547
[https://github.com
[
https://issues.apache.org/jira/browse/SPARK-45522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17781012#comment-17781012
]
HiuFung commented on SPARK-45522:
-
[~LuciferYang] Sweet, can you assign this to me?
I w
[
https://issues.apache.org/jira/browse/SPARK-45522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17781007#comment-17781007
]
Yang Jie commented on SPARK-45522:
--
[~HF] I'm very glad you're interested in this work.
[
https://issues.apache.org/jira/browse/SPARK-45724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yang Jie updated SPARK-45724:
-
Summary: Add a separate LogAppender for tests that need to print
`RuleExecutor.dumpTimeSpent()` to avoid
[
https://issues.apache.org/jira/browse/SPARK-45724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-45724:
---
Labels: pull-request-available (was: )
> Add a separate LogAppender for tests that need to
Yang Jie created SPARK-45724:
Summary: Add a separate LogAppender for tests that need to print
`RuleExecutor.dumpTimeSpent()` to avoid truncation of Metrics information.
Key: SPARK-45724
URL: https://issues.apache.org
[
https://issues.apache.org/jira/browse/SPARK-44319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17780994#comment-17780994
]
HiuFung commented on SPARK-44319:
-
[~LuciferYang]
Hi, by checking on the migration gui
[
https://issues.apache.org/jira/browse/SPARK-45722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17780965#comment-17780965
]
Alexey Dmitriev edited comment on SPARK-45722 at 10/30/23 11:27 AM:
--
[
https://issues.apache.org/jira/browse/SPARK-45722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17780965#comment-17780965
]
Alexey Dmitriev commented on SPARK-45722:
-
turning off spark.sql.analyzer.failAm
[
https://issues.apache.org/jira/browse/SPARK-45723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-45723:
Assignee: Ruifeng Zheng
> Catalog methods avoid pandas conversion
> -
[
https://issues.apache.org/jira/browse/SPARK-45723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-45723.
--
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 43583
[https://gi
[
https://issues.apache.org/jira/browse/SPARK-45722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Alexey Dmitriev updated SPARK-45722:
Description:
I have following code, which I expect to work
{code:java}
from pyspark.sql im
[
https://issues.apache.org/jira/browse/SPARK-45722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Alexey Dmitriev updated SPARK-45722:
Description:
I have following code, which I expect to work
{code:java}
from pyspark.sql im
[
https://issues.apache.org/jira/browse/SPARK-45722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17780942#comment-17780942
]
Alexey Dmitriev commented on SPARK-45722:
-
I think the type of the merge should
[
https://issues.apache.org/jira/browse/SPARK-45722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Alexey Dmitriev updated SPARK-45722:
Description:
I have following code, which I expect to work
```
from pyspark.sql import Sp
[
https://issues.apache.org/jira/browse/SPARK-45722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Alexey Dmitriev updated SPARK-45722:
Description:
I have following code:
```
from pyspark.sql import SparkSession
session = Sp
Alexey Dmitriev created SPARK-45722:
---
Summary: False positive when cheking for ambigious columns
Key: SPARK-45722
URL: https://issues.apache.org/jira/browse/SPARK-45722
Project: Spark
Issu
[
https://issues.apache.org/jira/browse/SPARK-45722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Alexey Dmitriev updated SPARK-45722:
Environment:
py3.11
pyspark 3.4.0
was:
py3.11
pyspark 3.4.0
I have following co
[
https://issues.apache.org/jira/browse/SPARK-44124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17780929#comment-17780929
]
Lantao Jin commented on SPARK-44124:
Thanks, I created three sub-tasks so far. [~Jun
[
https://issues.apache.org/jira/browse/SPARK-45700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-45700:
---
Labels: pull-request-available (was: )
> Fix `The outer reference in this type test cannot
Lantao Jin created SPARK-45721:
--
Summary: Upgrade AWS SDK to v2 for Hadoop dependency
Key: SPARK-45721
URL: https://issues.apache.org/jira/browse/SPARK-45721
Project: Spark
Issue Type: Sub-task
Lantao Jin created SPARK-45719:
--
Summary: Upgrade AWS SDK to v2 for Kubernetes integration tests
Key: SPARK-45719
URL: https://issues.apache.org/jira/browse/SPARK-45719
Project: Spark
Issue Type
[
https://issues.apache.org/jira/browse/SPARK-45592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot reassigned SPARK-45592:
--
Assignee: Apache Spark
> AQE and InMemoryTableScanExec correctness bug
>
[
https://issues.apache.org/jira/browse/SPARK-45718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-45718:
---
Labels: pull-request-available (was: )
> Remove remaining deprecated Pandas APIs from Spark
Haejoon Lee created SPARK-45718:
---
Summary: Remove remaining deprecated Pandas APIs from Spark 3.4.0
Key: SPARK-45718
URL: https://issues.apache.org/jira/browse/SPARK-45718
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-45683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-45683:
---
Labels: pull-request-available (was: )
> Fix `method any2stringadd in object Predef is depr
77 matches
Mail list logo