[jira] [Resolved] (SPARK-48844) Avoid throw UNSUPPORTED_DATASOURCE_FOR_DIRECT_QUERY when path is empty

[ https://issues.apache.org/jira/browse/SPARK-48844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48844. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47267 [https://

[jira] [Created] (SPARK-48855) Make ExecutorPodsAllocatorSuite independent from default allocation batch size

Dongjoon Hyun created SPARK-48855: - Summary: Make ExecutorPodsAllocatorSuite independent from default allocation batch size Key: SPARK-48855 URL: https://issues.apache.org/jira/browse/SPARK-48855 Proj

[jira] [Resolved] (SPARK-48786) Define Config Loading Framework for Spark Operator Controller

[ https://issues.apache.org/jira/browse/SPARK-48786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48786. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull req

[jira] [Assigned] (SPARK-48786) Define Config Loading Framework for Spark Operator Controller

[ https://issues.apache.org/jira/browse/SPARK-48786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-48786: - Assignee: Zhou JIANG > Define Config Loading Framework for Spark Operator Controller >

[jira] [Assigned] (SPARK-48803) Throw internal error in OrcDeserializer to align with ParquetWriteSupport

[ https://issues.apache.org/jira/browse/SPARK-48803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-48803: - Assignee: Kent Yao > Throw internal error in OrcDeserializer to align with ParquetWrite

[jira] [Resolved] (SPARK-48803) Throw internal error in OrcDeserializer to align with ParquetWriteSupport

[ https://issues.apache.org/jira/browse/SPARK-48803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48803. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47208 [https://

[jira] [Resolved] (SPARK-48837) In CountVectorizer, only read binary parameter once per transform, not once per row

[ https://issues.apache.org/jira/browse/SPARK-48837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48837. --- Resolution: Fixed Issue resolved by pull request 47258 [https://github.com/apache/spark/pull

[jira] [Updated] (SPARK-48801) Upgrade `kubernetes-client` to 6.13.1

[ https://issues.apache.org/jira/browse/SPARK-48801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48801: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Improvement) > Upgrade `kubernetes-cli

[jira] [Resolved] (SPARK-48801) Upgrade `kubernetes-client` to 6.13.1

[ https://issues.apache.org/jira/browse/SPARK-48801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48801. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47206 [https://

[jira] [Assigned] (SPARK-48801) Upgrade `kubernetes-client` to 6.13.1

[ https://issues.apache.org/jira/browse/SPARK-48801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-48801: - Assignee: BingKun Pan > Upgrade `kubernetes-client` to 6.13.1 > ---

[jira] [Assigned] (SPARK-48787) Upgrade Kafka to 3.7.1

[ https://issues.apache.org/jira/browse/SPARK-48787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-48787: - Assignee: BingKun Pan > Upgrade Kafka to 3.7.1 > -- > >

[jira] [Updated] (SPARK-48787) Upgrade Kafka to 3.7.1

[ https://issues.apache.org/jira/browse/SPARK-48787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48787: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Improvement) > Upgrade Kafka to 3.7.1

[jira] [Resolved] (SPARK-48787) Upgrade Kafka to 3.7.1

[ https://issues.apache.org/jira/browse/SPARK-48787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48787. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47191 [https://

[jira] [Resolved] (SPARK-48679) Upgrade checkstyle and spotbugs version

[ https://issues.apache.org/jira/browse/SPARK-48679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48679. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull req

[jira] [Resolved] (SPARK-48554) Use R 4.4.0 in `windows` R GitHub Action Windows job

[ https://issues.apache.org/jira/browse/SPARK-48554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48554. --- Fix Version/s: 4.0.0 Assignee: BingKun Pan Resolution: Fixed > Use R 4.4.0 i

[jira] [Resolved] (SPARK-48177) Upgrade `Parquet` to 1.14.1

[ https://issues.apache.org/jira/browse/SPARK-48177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48177. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46447 [https://

[jira] [Commented] (SPARK-48292) Revert [SPARK-39195][SQL] Spark OutputCommitCoordinator should abort stage when committed file not consistent with task status

[ https://issues.apache.org/jira/browse/SPARK-48292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17861276#comment-17861276 ] Dongjoon Hyun commented on SPARK-48292: --- This is backported via the following. - h

[jira] [Updated] (SPARK-48292) Revert [SPARK-39195][SQL] Spark OutputCommitCoordinator should abort stage when committed file not consistent with task status

[ https://issues.apache.org/jira/browse/SPARK-48292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48292: -- Fix Version/s: 3.4.4 > Revert [SPARK-39195][SQL] Spark OutputCommitCoordinator should abort st

[jira] [Updated] (SPARK-48292) Revert [SPARK-39195][SQL] Spark OutputCommitCoordinator should abort stage when committed file not consistent with task status

[ https://issues.apache.org/jira/browse/SPARK-48292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48292: -- Fix Version/s: 3.5.2 > Revert [SPARK-39195][SQL] Spark OutputCommitCoordinator should abort st

[jira] [Resolved] (SPARK-48757) Make `IndexShuffleBlockResolver` have explicit constructors

[ https://issues.apache.org/jira/browse/SPARK-48757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48757. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47148 [https://

[jira] [Updated] (SPARK-48757) Make `IndexShuffleBlockResolver` have explicit constructors

[ https://issues.apache.org/jira/browse/SPARK-48757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48757: -- Description: Although `IndexShuffleBlockResolver` is `private` and there is no contract to ke

[jira] [Updated] (SPARK-48757) Make `IndexShuffleBlockResolver` have explicit constructors

[ https://issues.apache.org/jira/browse/SPARK-48757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48757: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Improvement) > Make `IndexShuffleBlock

[jira] [Assigned] (SPARK-48757) Make `IndexShuffleBlockResolver` have explicit constructors

[ https://issues.apache.org/jira/browse/SPARK-48757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-48757: - Assignee: Dongjoon Hyun > Make `IndexShuffleBlockResolver` have explicit constructors >

[jira] [Created] (SPARK-48757) Make `IndexShuffleBlockResolver` have explicit constructors

Dongjoon Hyun created SPARK-48757: - Summary: Make `IndexShuffleBlockResolver` have explicit constructors Key: SPARK-48757 URL: https://issues.apache.org/jira/browse/SPARK-48757 Project: Spark

[jira] [Updated] (SPARK-47046) Apache Spark 4.0.0 Dependency Audit and Cleanup

[ https://issues.apache.org/jira/browse/SPARK-47046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47046: -- Labels: releasenotes (was: pull-request-available releasenotes) > Apache Spark 4.0.0 Dependen

[jira] [Resolved] (SPARK-48642) False reported SparkOutOfMemoryError caused by killing task on spilling

[ https://issues.apache.org/jira/browse/SPARK-48642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48642. --- Fix Version/s: 3.4.4 3.5.2 4.0.0 Resolution: Fix

[jira] [Assigned] (SPARK-48642) False reported SparkOutOfMemoryError caused by killing task on spilling

[ https://issues.apache.org/jira/browse/SPARK-48642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-48642: - Assignee: Cheng Pan > False reported SparkOutOfMemoryError caused by killing task on sp

[jira] [Resolved] (SPARK-48606) Upgrade `google-java-format` to 1.22.0

[ https://issues.apache.org/jira/browse/SPARK-48606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48606. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull req

[jira] [Assigned] (SPARK-48606) Upgrade `google-java-format` to 1.22.0

[ https://issues.apache.org/jira/browse/SPARK-48606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-48606: - Assignee: Dongjoon Hyun > Upgrade `google-java-format` to 1.22.0 >

[jira] [Created] (SPARK-48606) Upgrade `google-java-format` to 1.22.0

Dongjoon Hyun created SPARK-48606: - Summary: Upgrade `google-java-format` to 1.22.0 Key: SPARK-48606 URL: https://issues.apache.org/jira/browse/SPARK-48606 Project: Spark Issue Type: Improvem

[jira] [Updated] (SPARK-48554) Use R 4.4.0 in `windows` R GitHub Action Window job

[ https://issues.apache.org/jira/browse/SPARK-48554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48554: -- Summary: Use R 4.4.0 in `windows` R GitHub Action Window job (was: Use R 4.4.0 in `windows` R

[jira] [Updated] (SPARK-48554) Use R 4.4.0 in `windows` R GitHub Action Windows job

[ https://issues.apache.org/jira/browse/SPARK-48554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48554: -- Summary: Use R 4.4.0 in `windows` R GitHub Action Windows job (was: Use R 4.4.0 in `windows`

[jira] [Resolved] (SPARK-48528) Refine K8s Operator `merge_spark_pr.py` to use `kubernetes-operator-x.y.z` versions

[ https://issues.apache.org/jira/browse/SPARK-48528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48528. --- Fix Version/s: kubernetes-operator-0.1.0 Assignee: Dongjoon Hyun Resolution:

[jira] [Resolved] (SPARK-48531) Fix `Black` target version to Python 3.9

[ https://issues.apache.org/jira/browse/SPARK-48531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48531. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46867 [https://

[jira] [Assigned] (SPARK-48531) Fix `Black` target version to Python 3.9

[ https://issues.apache.org/jira/browse/SPARK-48531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-48531: - Assignee: Dongjoon Hyun > Fix `Black` target version to Python 3.9 > --

[jira] [Updated] (SPARK-48531) Fix `Black` target version to Python 3.9

[ https://issues.apache.org/jira/browse/SPARK-48531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48531: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Improvement) > Fix `Black` target vers

[jira] [Created] (SPARK-48531) Fix `Black` target version to Python 3.9

Dongjoon Hyun created SPARK-48531: - Summary: Fix `Black` target version to Python 3.9 Key: SPARK-48531 URL: https://issues.apache.org/jira/browse/SPARK-48531 Project: Spark Issue Type: Improv

[jira] [Updated] (SPARK-48528) Refine K8s Operator `merge_spark_pr.py` to use `kubernetes-operator-x.y.z` versions

[ https://issues.apache.org/jira/browse/SPARK-48528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48528: -- Summary: Refine K8s Operator `merge_spark_pr.py` to use `kubernetes-operator-x.y.z` versions

[jira] [Assigned] (SPARK-48382) Add controller / reconciler module to operator

[ https://issues.apache.org/jira/browse/SPARK-48382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-48382: - Assignee: Zhou JIANG > Add controller / reconciler module to operator > ---

[jira] [Created] (SPARK-48528) Refine K8s Operator `merge_spark_pr.py` to use `kubernetes-operator-x.y.z` version only

Dongjoon Hyun created SPARK-48528: - Summary: Refine K8s Operator `merge_spark_pr.py` to use `kubernetes-operator-x.y.z` version only Key: SPARK-48528 URL: https://issues.apache.org/jira/browse/SPARK-48528

[jira] [Updated] (SPARK-48326) Use the official Apache Spark 4.0.0-preview1

[ https://issues.apache.org/jira/browse/SPARK-48326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48326: -- Fix Version/s: kubernetes-operator-0.1.0 (was: 4.0.0) > Use the officia

[jira] [Updated] (SPARK-48326) Use the official Apache Spark 4.0.0-preview1

[ https://issues.apache.org/jira/browse/SPARK-48326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48326: -- Summary: Use the official Apache Spark 4.0.0-preview1 (was: Upgrade submission worker base Sp

[jira] [Assigned] (SPARK-48326) Upgrade submission worker base Spark version to 4.0.0-preview2

[ https://issues.apache.org/jira/browse/SPARK-48326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-48326: - Assignee: Dongjoon Hyun > Upgrade submission worker base Spark version to 4.0.0-preview

[jira] [Resolved] (SPARK-48326) Upgrade submission worker base Spark version to 4.0.0-preview2

[ https://issues.apache.org/jira/browse/SPARK-48326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48326. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 13 [https://git

[jira] [Resolved] (SPARK-48394) Cleanup mapIdToMapIndex on mapoutput unregister

[ https://issues.apache.org/jira/browse/SPARK-48394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48394. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46706 [https://

[jira] [Assigned] (SPARK-48394) Cleanup mapIdToMapIndex on mapoutput unregister

[ https://issues.apache.org/jira/browse/SPARK-48394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-48394: - Assignee: wuyi > Cleanup mapIdToMapIndex on mapoutput unregister >

[jira] [Resolved] (SPARK-48407) Teradata: Document Type Conversion rules between Spark SQL and teradata

[ https://issues.apache.org/jira/browse/SPARK-48407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48407. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46728 [https://

[jira] [Resolved] (SPARK-48325) Always specify messages in ExecutorRunner.killProcess

[ https://issues.apache.org/jira/browse/SPARK-48325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48325. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46641 [https://

[jira] [Resolved] (SPARK-48381) Update `YuniKorn` docs with v1.5.1

[ https://issues.apache.org/jira/browse/SPARK-48381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48381. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46690 [https://

[jira] [Assigned] (SPARK-48381) Update `YuniKorn` docs with v1.5.1

[ https://issues.apache.org/jira/browse/SPARK-48381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-48381: - Assignee: Dongjoon Hyun > Update `YuniKorn` docs with v1.5.1 >

[jira] [Created] (SPARK-48381) Update `YuniKorn` docs with v1.5.1

Dongjoon Hyun created SPARK-48381: - Summary: Update `YuniKorn` docs with v1.5.1 Key: SPARK-48381 URL: https://issues.apache.org/jira/browse/SPARK-48381 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-48329) Enable `spark.sql.sources.v2.bucketing.pushPartValues.enabled` by default

[ https://issues.apache.org/jira/browse/SPARK-48329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48329: -- Summary: Enable `spark.sql.sources.v2.bucketing.pushPartValues.enabled` by default (was: Defa

[jira] [Updated] (SPARK-48329) Default spark.sql.sources.v2.bucketing.pushPartValues.enabled to true

[ https://issues.apache.org/jira/browse/SPARK-48329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48329: -- Parent Issue: SPARK-44111 (was: SPARK-37375) > Default spark.sql.sources.v2.bucketing.pushPar

[jira] [Resolved] (SPARK-48329) Default spark.sql.sources.v2.bucketing.pushPartValues.enabled to true

[ https://issues.apache.org/jira/browse/SPARK-48329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48329. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46673 [https://

[jira] [Assigned] (SPARK-48329) Default spark.sql.sources.v2.bucketing.pushPartValues.enabled to true

[ https://issues.apache.org/jira/browse/SPARK-48329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-48329: - Assignee: Szehon Ho > Default spark.sql.sources.v2.bucketing.pushPartValues.enabled to

[jira] [Resolved] (SPARK-48328) Upgrade `Arrow` to 16.1.0

[ https://issues.apache.org/jira/browse/SPARK-48328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48328. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46646 [https://

[jira] [Assigned] (SPARK-48017) Add Spark application submission worker for operator

[ https://issues.apache.org/jira/browse/SPARK-48017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-48017: - Assignee: Zhou JIANG > Add Spark application submission worker for operator > -

[jira] [Resolved] (SPARK-48017) Add Spark application submission worker for operator

[ https://issues.apache.org/jira/browse/SPARK-48017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48017. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 10 [https://git

[jira] [Resolved] (SPARK-48256) Add a rule to check file headers for the java side, and fix inconsistent files

[ https://issues.apache.org/jira/browse/SPARK-48256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48256. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46557 [https://

[jira] [Assigned] (SPARK-48256) Add a rule to check file headers for the java side, and fix inconsistent files

[ https://issues.apache.org/jira/browse/SPARK-48256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-48256: - Assignee: BingKun Pan > Add a rule to check file headers for the java side, and fix inc

[jira] [Assigned] (SPARK-48218) TransportClientFactory.createClient may NPE cause FetchFailedException

[ https://issues.apache.org/jira/browse/SPARK-48218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-48218: - Assignee: dzcxzl > TransportClientFactory.createClient may NPE cause FetchFailedExcepti

[jira] [Resolved] (SPARK-48218) TransportClientFactory.createClient may NPE cause FetchFailedException

[ https://issues.apache.org/jira/browse/SPARK-48218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48218. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46506 [https://

[jira] [Resolved] (SPARK-48049) Upgrade Scala to 2.13.14

[ https://issues.apache.org/jira/browse/SPARK-48049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48049. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46288 [https://

[jira] [Resolved] (SPARK-48285) Update docs for size function and sizeOfNull configuration

[ https://issues.apache.org/jira/browse/SPARK-48285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48285. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46592 [https://

[jira] [Commented] (SPARK-48238) Spark fail to start due to class o.a.h.yarn.server.webproxy.amfilter.AmIpFilter is not a jakarta.servlet.Filter

[ https://issues.apache.org/jira/browse/SPARK-48238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17846701#comment-17846701 ] Dongjoon Hyun commented on SPARK-48238: --- Hi, [~chengpan] and [~HF] and [~cloud_fan

[jira] [Updated] (SPARK-48238) Spark fail to start due to class o.a.h.yarn.server.webproxy.amfilter.AmIpFilter is not a jakarta.servlet.Filter

[ https://issues.apache.org/jira/browse/SPARK-48238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48238: -- Description: I tested the latest master branch, it failed to start on YARN mode {code:java} de

[jira] [Resolved] (SPARK-48279) Upgrade ORC to 2.0.1

[ https://issues.apache.org/jira/browse/SPARK-48279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48279. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46587 [https://

[jira] [Updated] (SPARK-48231) Remove unused CodeHaus Jackson dependencies

[ https://issues.apache.org/jira/browse/SPARK-48231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48231: -- Parent: (was: SPARK-47046) Issue Type: Bug (was: Sub-task) > Remove unused CodeHa

[jira] [Updated] (SPARK-48230) Remove unused jodd-core

[ https://issues.apache.org/jira/browse/SPARK-48230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48230: -- Parent: (was: SPARK-47046) Issue Type: Bug (was: Sub-task) > Remove unused jodd-c

[jira] [Updated] (SPARK-48237) After executing `test-dependencies.sh`, the dir `dev/pr-deps` should be deleted

[ https://issues.apache.org/jira/browse/SPARK-48237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48237: -- Issue Type: Bug (was: Improvement) > After executing `test-dependencies.sh`, the dir `dev/pr-

[jira] [Assigned] (SPARK-48237) After executing `test-dependencies.sh`, the dir `dev/pr-deps` should be deleted

[ https://issues.apache.org/jira/browse/SPARK-48237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-48237: - Assignee: BingKun Pan > After executing `test-dependencies.sh`, the dir `dev/pr-deps` s

[jira] [Resolved] (SPARK-48237) After executing `test-dependencies.sh`, the dir `dev/pr-deps` should be deleted

[ https://issues.apache.org/jira/browse/SPARK-48237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48237. --- Fix Version/s: 3.4.4 3.5.2 4.0.0 Resolution: Fix

[jira] [Resolved] (SPARK-48236) Add `commons-lang:commons-lang:2.6` back to support legacy Hive UDF jars

[ https://issues.apache.org/jira/browse/SPARK-48236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48236. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46528 [https://

[jira] [Commented] (SPARK-48230) Remove unused jodd-core

[ https://issues.apache.org/jira/browse/SPARK-48230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17845522#comment-17845522 ] Dongjoon Hyun commented on SPARK-48230: --- We will revisit this dependency. > Remov

[jira] [Updated] (SPARK-48230) Remove unused jodd-core

[ https://issues.apache.org/jira/browse/SPARK-48230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48230: -- Fix Version/s: (was: 4.0.0) > Remove unused jodd-core > --- > >

[jira] [Resolved] (SPARK-48144) canPlanAsBroadcastHashJoin should respect shuffle join hints

[ https://issues.apache.org/jira/browse/SPARK-48144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48144. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46401 [https://

[jira] [Assigned] (SPARK-48144) canPlanAsBroadcastHashJoin should respect shuffle join hints

[ https://issues.apache.org/jira/browse/SPARK-48144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-48144: - Assignee: Fredrik Klauß > canPlanAsBroadcastHashJoin should respect shuffle join hints

[jira] [Assigned] (SPARK-47441) Do not add log link for unmanaged AM in Spark UI

[ https://issues.apache.org/jira/browse/SPARK-47441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47441: - Assignee: Yuming Wang > Do not add log link for unmanaged AM in Spark UI >

[jira] [Resolved] (SPARK-47441) Do not add log link for unmanaged AM in Spark UI

[ https://issues.apache.org/jira/browse/SPARK-47441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47441. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45565 [https://

[jira] [Assigned] (SPARK-48235) Directly pass join instead of all arguments to getBroadcastBuildSide and getShuffleHashJoinBuildSide

[ https://issues.apache.org/jira/browse/SPARK-48235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-48235: - Assignee: Fredrik Klauß (was: Dongjoon Hyun) > Directly pass join instead of all argum

[jira] [Updated] (SPARK-48235) Directly pass join instead of all arguments to getBroadcastBuildSide and getShuffleHashJoinBuildSide

[ https://issues.apache.org/jira/browse/SPARK-48235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48235: -- Reporter: Fredrik Klauß (was: Dongjoon Hyun) > Directly pass join instead of all arguments to

[jira] [Resolved] (SPARK-48235) Directly pass join instead of all arguments to getBroadcastBuildSide and getShuffleHashJoinBuildSide

[ https://issues.apache.org/jira/browse/SPARK-48235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48235. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46525 [https://

[jira] [Assigned] (SPARK-48235) Directly pass join instead of all arguments to getBroadcastBuildSide and getShuffleHashJoinBuildSide

[ https://issues.apache.org/jira/browse/SPARK-48235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-48235: - Assignee: Dongjoon Hyun > Directly pass join instead of all arguments to getBroadcastBu

[jira] [Created] (SPARK-48235) Directly pass join instead of all arguments to getBroadcastBuildSide and getShuffleHashJoinBuildSide

Dongjoon Hyun created SPARK-48235: - Summary: Directly pass join instead of all arguments to getBroadcastBuildSide and getShuffleHashJoinBuildSide Key: SPARK-48235 URL: https://issues.apache.org/jira/browse/SPARK-4

[jira] [Resolved] (SPARK-48230) Remove unused jodd-core

[ https://issues.apache.org/jira/browse/SPARK-48230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48230. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46520 [https://

[jira] [Assigned] (SPARK-48231) Remove unused CodeHaus Jackson dependencies

[ https://issues.apache.org/jira/browse/SPARK-48231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-48231: - Assignee: Cheng Pan > Remove unused CodeHaus Jackson dependencies > ---

[jira] [Assigned] (SPARK-48230) Remove unused jodd-core

[ https://issues.apache.org/jira/browse/SPARK-48230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-48230: - Assignee: Cheng Pan > Remove unused jodd-core > --- > >

[jira] [Updated] (SPARK-48231) Remove unused CodeHaus Jackson dependencies

[ https://issues.apache.org/jira/browse/SPARK-48231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48231: -- Parent: SPARK-47046 Issue Type: Sub-task (was: Improvement) > Remove unused CodeHaus

[jira] [Resolved] (SPARK-47847) Deprecate spark.network.remoteReadNioBufferConversion

[ https://issues.apache.org/jira/browse/SPARK-47847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47847. --- Fix Version/s: 3.5.2 4.0.0 Resolution: Fixed Issue resolved by pul

[jira] [Assigned] (SPARK-47847) Deprecate spark.network.remoteReadNioBufferConversion

[ https://issues.apache.org/jira/browse/SPARK-47847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47847: - Assignee: Cheng Pan > Deprecate spark.network.remoteReadNioBufferConversion > -

[jira] [Updated] (SPARK-47847) Deprecate spark.network.remoteReadNioBufferConversion

[ https://issues.apache.org/jira/browse/SPARK-47847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47847: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Improvement) > Deprecate spark.network

[jira] [Updated] (SPARK-48230) Remove unused jodd-core

[ https://issues.apache.org/jira/browse/SPARK-48230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48230: -- Parent: SPARK-47046 Issue Type: Sub-task (was: Improvement) > Remove unused jodd-core

[jira] [Updated] (SPARK-48094) Reduce GitHub Action usage according to ASF project allowance

[ https://issues.apache.org/jira/browse/SPARK-48094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48094: -- Description: h2. ASF INFRA POLICY - [https://infra.apache.org/github-actions-policy.html] h2

[jira] [Resolved] (SPARK-48201) Docstrings of the pyspark DataStream Reader methods are inaccurate

[ https://issues.apache.org/jira/browse/SPARK-48201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48201. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46416 [https://

[jira] [Assigned] (SPARK-48201) Docstrings of the pyspark DataStream Reader methods are inaccurate

[ https://issues.apache.org/jira/browse/SPARK-48201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-48201: - Assignee: Chloe He > Docstrings of the pyspark DataStream Reader methods are inaccurate

[jira] [Resolved] (SPARK-48228) Implement the missing function validation in ApplyInXXX

[ https://issues.apache.org/jira/browse/SPARK-48228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48228. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46519 [https://

[jira] [Assigned] (SPARK-48228) Implement the missing function validation in ApplyInXXX

[ https://issues.apache.org/jira/browse/SPARK-48228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-48228: - Assignee: Ruifeng Zheng > Implement the missing function validation in ApplyInXXX > ---

[jira] [Resolved] (SPARK-48224) Disable variant from being a part of a map key

[ https://issues.apache.org/jira/browse/SPARK-48224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48224. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46516 [https://

[jira] [Assigned] (SPARK-48224) Disable variant from being a part of a map key

[ https://issues.apache.org/jira/browse/SPARK-48224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-48224: - Assignee: Harsh Motwani > Disable variant from being a part of a map key >

[jira] [Updated] (SPARK-48163) Disable `SparkConnectServiceSuite.SPARK-43923: commands send events - get_resources_command`

[ https://issues.apache.org/jira/browse/SPARK-48163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48163: -- Parent: (was: SPARK-44111) Issue Type: Bug (was: Sub-task) > Disable `SparkConnec

<    4   5   6   7   8   9   10   11   12   13   >