Kent Yao created SPARK-53415:
Summary: Simply options for builtin FileFormats
Key: SPARK-53415
URL: https://issues.apache.org/jira/browse/SPARK-53415
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-53414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-53414:
---
Labels: pull-request-available (was: )
> Add tests for Arrow UDF with profiler
> --
[
https://issues.apache.org/jira/browse/SPARK-53412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-53412:
---
Labels: pull-request-available (was: )
> Upgrade Volcano to 1.12.2
> --
Dongjoon Hyun created SPARK-53412:
-
Summary: Upgrade Volcano to 1.12.2
Key: SPARK-53412
URL: https://issues.apache.org/jira/browse/SPARK-53412
Project: Spark
Issue Type: Sub-task
Co
[
https://issues.apache.org/jira/browse/SPARK-53413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-53413:
---
Labels: pull-request-available (was: )
> Shuffle cleanup doesnot happen for commands
>
Ruifeng Zheng created SPARK-53414:
-
Summary: Add tests for Arrow UDF with profiler
Key: SPARK-53414
URL: https://issues.apache.org/jira/browse/SPARK-53414
Project: Spark
Issue Type: Sub-task
Karuppayya created SPARK-53413:
--
Summary: Shuffle cleanup doesnot happen for commands
Key: SPARK-53413
URL: https://issues.apache.org/jira/browse/SPARK-53413
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-53411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-53411.
---
Fix Version/s: kubernetes-operator-0.5.0
Resolution: Fixed
Issue resolved by pull req
[
https://issues.apache.org/jira/browse/SPARK-51168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-51168:
-
Assignee: Cheng Pan
> Upgrade Hadoop to 3.4.2
>
>
>
[
https://issues.apache.org/jira/browse/SPARK-53411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-53411:
---
Labels: pull-request-available (was: )
> Upgrade the minimum K8s version to v1.32
> ---
[
https://issues.apache.org/jira/browse/SPARK-53410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-53410.
---
Fix Version/s: kubernetes-operator-0.5.0
Resolution: Fixed
Issue resolved by pull req
[
https://issues.apache.org/jira/browse/SPARK-53411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-53411:
-
Assignee: Dongjoon Hyun
> Upgrade the minimum K8s version to v1.32
> --
[
https://issues.apache.org/jira/browse/SPARK-53409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-53409.
---
Fix Version/s: kubernetes-operator-0.5.0
Resolution: Fixed
Issue resolved by pull req
Dongjoon Hyun created SPARK-53411:
-
Summary: Upgrade the minimum K8s version to v1.32
Key: SPARK-53411
URL: https://issues.apache.org/jira/browse/SPARK-53411
Project: Spark
Issue Type: Sub-ta
[
https://issues.apache.org/jira/browse/SPARK-53410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-53410:
-
Assignee: Dongjoon Hyun
> Improve `merge_spark_pr.py` to accept PR numbers as a CLI arg
Dongjoon Hyun created SPARK-53410:
-
Summary: Improve `merge_spark_pr.py` to accept PR numbers as a CLI
argument
Key: SPARK-53410
URL: https://issues.apache.org/jira/browse/SPARK-53410
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-53410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-53410:
---
Labels: pull-request-available (was: )
> Improve `merge_spark_pr.py` to accept PR numbers a
[
https://issues.apache.org/jira/browse/SPARK-53409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-53409:
-
Assignee: Dongjoon Hyun
> Upgrade `Gradle` to 9.0.0
> -
>
>
[
https://issues.apache.org/jira/browse/SPARK-53409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-53409:
---
Labels: pull-request-available (was: )
> Upgrade `Gradle` to 9.0.0
> --
Dongjoon Hyun created SPARK-53409:
-
Summary: Upgrade `Gradle` to 9.0.0
Key: SPARK-53409
URL: https://issues.apache.org/jira/browse/SPARK-53409
Project: Spark
Issue Type: Sub-task
Co
[
https://issues.apache.org/jira/browse/SPARK-53407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-53407.
---
Fix Version/s: kubernetes-operator-0.5.0
Resolution: Fixed
Issue resolved by pull req
[
https://issues.apache.org/jira/browse/SPARK-53408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-53408:
---
Labels: pull-request-available (was: )
> Clean up unused functions from `QueryCompilationEr
[
https://issues.apache.org/jira/browse/SPARK-53407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-53407:
-
Assignee: Dongjoon Hyun
> Use `baseDirectory` instead of `baseDir`
> --
[
https://issues.apache.org/jira/browse/SPARK-53408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yang Jie updated SPARK-53408:
-
Summary: Clean up unused functions from `QueryCompilationErrors` (was:
Clean up unused function from `Q
Yang Jie created SPARK-53408:
Summary: Clean up unused function from `QueryCompilationErrors`
Key: SPARK-53408
URL: https://issues.apache.org/jira/browse/SPARK-53408
Project: Spark
Issue Type: Im
Dongjoon Hyun created SPARK-53407:
-
Summary: Use `baseDirectory` instead of `baseDir`
Key: SPARK-53407
URL: https://issues.apache.org/jira/browse/SPARK-53407
Project: Spark
Issue Type: Sub-ta
[
https://issues.apache.org/jira/browse/SPARK-53407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-53407:
---
Labels: pull-request-available (was: )
> Use `baseDirectory` instead of `baseDir`
> ---
[
https://issues.apache.org/jira/browse/SPARK-53397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng resolved SPARK-53397.
---
Fix Version/s: 4.1.0
Resolution: Fixed
Issue resolved by pull request 52001
[https://
[
https://issues.apache.org/jira/browse/SPARK-53397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng reassigned SPARK-53397:
-
Assignee: Marko Ilic
> Fix UDTF test with collations
> -
>
[
https://issues.apache.org/jira/browse/SPARK-53245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-53245:
-
Assignee: Attila Mészáros
> Update Java Operator SDK version to 5.1.2
> ---
[
https://issues.apache.org/jira/browse/SPARK-53245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-53245.
---
Fix Version/s: kubernetes-operator-0.5.0
Resolution: Fixed
Issue resolved by pull req
[
https://issues.apache.org/jira/browse/SPARK-53245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-53245:
---
Labels: pull-request-available (was: )
> Update Java Operator SDK version to 5.1.2
> --
[
https://issues.apache.org/jira/browse/SPARK-53404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-53404:
---
Labels: pull-request-available (was: )
> Make `Build` step to verify test compilation too
>
[
https://issues.apache.org/jira/browse/SPARK-53404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-53404.
---
Fix Version/s: connect-swift-0.4.0
Resolution: Fixed
Issue resolved by pull request 2
[
https://issues.apache.org/jira/browse/SPARK-53404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-53404:
-
Assignee: Dongjoon Hyun
> Make `Build` step to verify test compilation too
> --
[
https://issues.apache.org/jira/browse/SPARK-53406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shujing Yang updated SPARK-53406:
-
Parent: SPARK-53400
Issue Type: Sub-task (was: New Feature)
> Support Shuffle Spec in D
[
https://issues.apache.org/jira/browse/SPARK-53401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shujing Yang updated SPARK-53401:
-
Parent: SPARK-53400
Issue Type: Sub-task (was: New Feature)
> Enable Direct Passthrough
[
https://issues.apache.org/jira/browse/SPARK-53402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shujing Yang updated SPARK-53402:
-
Parent: SPARK-53400
Issue Type: Sub-task (was: New Feature)
> Support Direct Passthroug
[
https://issues.apache.org/jira/browse/SPARK-53401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shujing Yang updated SPARK-53401:
-
Epic Link: (was: SPARK-53400)
> Enable Direct Passthrough Partitioning in the DataFrame API
[
https://issues.apache.org/jira/browse/SPARK-53402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shujing Yang updated SPARK-53402:
-
Epic Link: (was: SPARK-53400)
> Support Direct Passthrough Partitioning in Spark Connect
> -
[
https://issues.apache.org/jira/browse/SPARK-53400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shujing Yang updated SPARK-53400:
-
Issue Type: New Feature (was: Epic)
> Support Direct Passthrough Partitioning in the DataFrame
[
https://issues.apache.org/jira/browse/SPARK-53406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shujing Yang updated SPARK-53406:
-
Epic Link: (was: SPARK-53400)
> Support Shuffle Spec in Direct Partition ID Pass Through
> -
[
https://issues.apache.org/jira/browse/SPARK-53401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-53401:
---
Labels: pull-request-available (was: )
> Enable Direct Passthrough Partitioning in the Data
Shujing Yang created SPARK-53406:
Summary: Support Shuffle Spec in Direct Partition ID Pass Through
Key: SPARK-53406
URL: https://issues.apache.org/jira/browse/SPARK-53406
Project: Spark
Issu
[
https://issues.apache.org/jira/browse/SPARK-53405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-53405:
---
Labels: pull-request-available (was: )
> Add metrics recording for latency of Spark app sta
Zhou JIANG created SPARK-53405:
--
Summary: Add metrics recording for latency of Spark app state
transition
Key: SPARK-53405
URL: https://issues.apache.org/jira/browse/SPARK-53405
Project: Spark
Dongjoon Hyun created SPARK-53404:
-
Summary: Make `Build` step to verify test compilation too
Key: SPARK-53404
URL: https://issues.apache.org/jira/browse/SPARK-53404
Project: Spark
Issue Type
Xinrong Meng created SPARK-53403:
Summary: Improve add/sub tests under ANSI
Key: SPARK-53403
URL: https://issues.apache.org/jira/browse/SPARK-53403
Project: Spark
Issue Type: Sub-task
Shujing Yang created SPARK-53402:
Summary: Support Direct Passthrough Partitioning in Spark Connect
Key: SPARK-53402
URL: https://issues.apache.org/jira/browse/SPARK-53402
Project: Spark
Issu
Shujing Yang created SPARK-53401:
Summary: Enable Direct Passthrough Partitioning in the DataFrame
API
Key: SPARK-53401
URL: https://issues.apache.org/jira/browse/SPARK-53401
Project: Spark
Shujing Yang created SPARK-53400:
Summary: Support Direct Passthrough Partitioning in the DataFrame
API
Key: SPARK-53400
URL: https://issues.apache.org/jira/browse/SPARK-53400
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-53348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-53348:
--
Fix Version/s: 4.0.1
> Always persist ANSI value when creating a view or assume it when queryi
[
https://issues.apache.org/jira/browse/SPARK-53390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xinrong Meng resolved SPARK-53390.
--
Assignee: Xinrong Meng
Resolution: Resolved
Resolved by https://github.com/apache/spark/
[
https://issues.apache.org/jira/browse/SPARK-53389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xinrong Meng updated SPARK-53389:
-
Description: Improve test coverage, and possible improvements exposed by
the newly added tests.
[
https://issues.apache.org/jira/browse/SPARK-53390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xinrong Meng updated SPARK-53390:
-
Summary: Raise error when bools with None `astype` to ints under ANSI
(was: Improve tests of `a
[
https://issues.apache.org/jira/browse/SPARK-53389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xinrong Meng updated SPARK-53389:
-
Summary: Improvements for Pandas API on Spark under ANSI (was: Improve
ANSI test coverage for P
[
https://issues.apache.org/jira/browse/SPARK-53399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-53399:
---
Labels: pull-request-available (was: )
> Improve CollapseProject
> ---
[
https://issues.apache.org/jira/browse/SPARK-5?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-5:
---
Labels: pull-request-available (was: )
> Enable StateDataSource with state checkpoint v2 (o
Peter Toth created SPARK-53399:
--
Summary: Improve CollapseProject
Key: SPARK-53399
URL: https://issues.apache.org/jira/browse/SPARK-53399
Project: Spark
Issue Type: Bug
Components: SQL
[
https://issues.apache.org/jira/browse/SPARK-53294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18016598#comment-18016598
]
Anish Shrigondekar commented on SPARK-53294:
PR merged here: https://github.
[
https://issues.apache.org/jira/browse/SPARK-53294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Anish Shrigondekar reassigned SPARK-53294:
--
Assignee: Dylan Wong
> Enable StateDataSource with state checkpoint v2 (only
[
https://issues.apache.org/jira/browse/SPARK-53294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Anish Shrigondekar resolved SPARK-53294.
Fix Version/s: 4.1.0
Resolution: Fixed
> Enable StateDataSource with state
[
https://issues.apache.org/jira/browse/SPARK-53294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Anish Shrigondekar closed SPARK-53294.
--
> Enable StateDataSource with state checkpoint v2 (only batchId option)
>
[
https://issues.apache.org/jira/browse/SPARK-53398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-53398:
---
Labels: pull-request-available (was: )
> Ensure that RocksDBMemoryManager metrics reporting
Eric Marnadi created SPARK-53398:
Summary: Ensure that RocksDBMemoryManager metrics reporting
doesn't throw a NullPointerException
Key: SPARK-53398
URL: https://issues.apache.org/jira/browse/SPARK-53398
[
https://issues.apache.org/jira/browse/SPARK-52777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-52777.
-
Fix Version/s: 4.1.0
Resolution: Fixed
Issue resolved by pull request 51458
[https://gith
[
https://issues.apache.org/jira/browse/SPARK-52777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-52777:
---
Assignee: Karuppayya
> Enable shuffle cleanup mode configuration in Spark SQL
> ---
[
https://issues.apache.org/jira/browse/SPARK-53392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng resolved SPARK-53392.
---
Fix Version/s: 4.1.0
Resolution: Fixed
Issue resolved by pull request 52137
[https://
[
https://issues.apache.org/jira/browse/SPARK-53397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-53397:
---
Labels: pull-request-available (was: )
> Fix UDTF test with collations
> --
Marko Ilic created SPARK-53397:
--
Summary: Fix UDTF test with collations
Key: SPARK-53397
URL: https://issues.apache.org/jira/browse/SPARK-53397
Project: Spark
Issue Type: Improvement
C
[
https://issues.apache.org/jira/browse/SPARK-53392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng reassigned SPARK-53392:
-
Assignee: Ruifeng Zheng
> Move SpecializedArray handling to connect-common
> --
[
https://issues.apache.org/jira/browse/SPARK-53395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng resolved SPARK-53395.
---
Fix Version/s: 4.1.0
Resolution: Fixed
Issue resolved by pull request 52141
[https://
[
https://issues.apache.org/jira/browse/SPARK-53391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kent Yao resolved SPARK-53391.
--
Fix Version/s: 4.1.0
Resolution: Fixed
Issue resolved by pull request 52136
[https://github.com
[
https://issues.apache.org/jira/browse/SPARK-53391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kent Yao reassigned SPARK-53391:
Assignee: Kent Yao
> Remove unused PrimitiveKeyOpenHashMap
>
[
https://issues.apache.org/jira/browse/SPARK-53395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng reassigned SPARK-53395:
-
Assignee: Ruifeng Zheng
> Add tests for combinations of different scalar UDFs
> ---
[
https://issues.apache.org/jira/browse/SPARK-53393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng resolved SPARK-53393.
---
Fix Version/s: 4.1.0
Resolution: Fixed
Issue resolved by pull request 52138
[https://
[
https://issues.apache.org/jira/browse/SPARK-53393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng reassigned SPARK-53393:
-
Assignee: Ruifeng Zheng
> Disable memory profiler for Arrow Scalar Iterator UDFs
>
[
https://issues.apache.org/jira/browse/SPARK-52858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng reassigned SPARK-52858:
-
Assignee: Ruifeng Zheng
> Retry SBT compilation when OOM
>
[
https://issues.apache.org/jira/browse/SPARK-52858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng resolved SPARK-52858.
---
Resolution: Not A Problem
> Retry SBT compilation when OOM
> --
[
https://issues.apache.org/jira/browse/SPARK-53396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-53396:
---
Labels: pull-request-available (was: )
> Improve error message when input of `GetStructFiel
Mihailo Timotic created SPARK-53396:
---
Summary: Improve error message when input of `GetStructField` is
not `StructType`
Key: SPARK-53396
URL: https://issues.apache.org/jira/browse/SPARK-53396
Projec
[
https://issues.apache.org/jira/browse/SPARK-53395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-53395:
---
Labels: pull-request-available (was: )
> Add tests for combinations of different scalar UDF
Ruifeng Zheng created SPARK-53395:
-
Summary: Add tests for combinations of different scalar UDFs
Key: SPARK-53395
URL: https://issues.apache.org/jira/browse/SPARK-53395
Project: Spark
Issue T
83 matches
Mail list logo