issues  

Messages by Date

• 2026/04/23 [jira] [Updated] (SPARK-54090) AssertDataframeEqual carries rows when showing differences ASF GitHub Bot (Jira)
• 2026/04/23 [jira] [Updated] (SPARK-56605) PATH related small cleanup ASF GitHub Bot (Jira)
• 2026/04/23 [jira] [Created] (SPARK-56605) PATH related small cleanup Serge Rielau (Jira)
• 2026/04/23 [jira] [Assigned] (SPARK-56604) Promote `KubernetesDriverBuilder` to `Stable` Dongjoon Hyun (Jira)
• 2026/04/23 [jira] [Resolved] (SPARK-56604) Promote `KubernetesDriverBuilder` to `Stable` Dongjoon Hyun (Jira)
• 2026/04/23 [jira] [Assigned] (SPARK-56520) Persist PATH for VIEWs, FUNCTIONS, expose with DESCRIBE Wenchen Fan (Jira)
• 2026/04/23 [jira] [Resolved] (SPARK-56520) Persist PATH for VIEWs, FUNCTIONS, expose with DESCRIBE Wenchen Fan (Jira)
• 2026/04/23 [jira] [Assigned] (SPARK-53652) Codegen For MergeRowExec L. C. Hsieh (Jira)
• 2026/04/23 [jira] [Resolved] (SPARK-53652) Codegen For MergeRowExec L. C. Hsieh (Jira)
• 2026/04/23 [jira] [Updated] (SPARK-56599) SPIP: Write schema narrowing for column-level UPDATE in DSv2 Anurag Mantripragada (Jira)
• 2026/04/23 [jira] [Updated] (SPARK-56599) SPIP: Write schema narrowing for column-level UPDATE in DSv2 ASF GitHub Bot (Jira)
• 2026/04/23 [jira] [Resolved] (SPARK-39660) Support v2 DESCRIBE TABLE .. PARTITION L. C. Hsieh (Jira)
• 2026/04/23 [jira] [Assigned] (SPARK-39660) Support v2 DESCRIBE TABLE .. PARTITION L. C. Hsieh (Jira)
• 2026/04/23 [jira] [Assigned] (SPARK-56602) Promote `KubernetesVolumeUtils` to `Stable` Dongjoon Hyun (Jira)
• 2026/04/23 [jira] [Resolved] (SPARK-56602) Promote `KubernetesVolumeUtils` to `Stable` Dongjoon Hyun (Jira)
• 2026/04/23 [jira] [Updated] (SPARK-56604) Promote `KubernetesDriverBuilder` to `Stable` ASF GitHub Bot (Jira)
• 2026/04/23 [jira] [Created] (SPARK-56604) Promote `KubernetesDriverBuilder` to `Stable` Dongjoon Hyun (Jira)
• 2026/04/23 [jira] [Updated] (SPARK-48076) Promote `KubernetesVolumeUtils` to `DeveloperApi` Dongjoon Hyun (Jira)
• 2026/04/23 [jira] [Updated] (SPARK-56163) Move `uploadFileToHadoopCompatibleFS` to Utils Dongjoon Hyun (Jira)
• 2026/04/23 [jira] [Updated] (SPARK-56490) Add Java-friendly `KubernetesConf.createDriverConf` Dongjoon Hyun (Jira)
• 2026/04/23 [jira] [Updated] (SPARK-56303) Add Java-friendly factory methods to `JavaMainAppResource` Dongjoon Hyun (Jira)
• 2026/04/23 [jira] [Updated] (SPARK-56300) Add Java-friendly factory method to `KubernetesDriverSpec` Dongjoon Hyun (Jira)
• 2026/04/23 [jira] [Updated] (SPARK-56491) Add `ReadOnlySparkConf.getAllAsJavaMap` Dongjoon Hyun (Jira)
• 2026/04/23 [jira] [Updated] (SPARK-56601) Promote `KubernetesClientUtils` to `Stable` Dongjoon Hyun (Jira)
• 2026/04/23 [jira] [Updated] (SPARK-56600) Promote `SparkPod` to `Stable` Dongjoon Hyun (Jira)
• 2026/04/23 [jira] [Updated] (SPARK-56590) Add Java-friendly getters for driver resources of KubernetesDriverSpec Dongjoon Hyun (Jira)
• 2026/04/23 [jira] [Updated] (SPARK-56574) Add Java-friendly `KubernetesDriverSpec.getSystemPropertiesAsJavaMap` Dongjoon Hyun (Jira)
• 2026/04/23 [jira] [Updated] (SPARK-56602) Promote `KubernetesVolumeUtils` to `Stable` Dongjoon Hyun (Jira)
• 2026/04/23 [jira] [Created] (SPARK-56603) Improve K8s Resource Manager API Dongjoon Hyun (Jira)
• 2026/04/23 [jira] [Resolved] (SPARK-56601) Promote `KubernetesClientUtils` to `Stable` Dongjoon Hyun (Jira)
• 2026/04/23 [jira] [Assigned] (SPARK-56601) Promote `KubernetesClientUtils` to `Stable` Dongjoon Hyun (Jira)
• 2026/04/23 [jira] [Resolved] (SPARK-56600) Promote `SparkPod` to `Stable` Dongjoon Hyun (Jira)
• 2026/04/23 [jira] [Assigned] (SPARK-56600) Promote `SparkPod` to `Stable` Dongjoon Hyun (Jira)
• 2026/04/23 [jira] [Updated] (SPARK-56324) Add worker specification & gRPC UDF service as possible code paths to PySpark ASF GitHub Bot (Jira)
• 2026/04/23 [jira] [Updated] (SPARK-56602) Promote `KubernetesVolumeUtils` to `Stable` ASF GitHub Bot (Jira)
• 2026/04/23 [jira] [Created] (SPARK-56602) Promote `KubernetesVolumeUtils` to `Stable` Dongjoon Hyun (Jira)
• 2026/04/23 [jira] [Updated] (SPARK-56601) Promote `KubernetesClientUtils` to `Stable` ASF GitHub Bot (Jira)
• 2026/04/23 [jira] [Created] (SPARK-56601) Promote `KubernetesClientUtils` to `Stable` Dongjoon Hyun (Jira)
• 2026/04/23 [jira] [Updated] (SPARK-56570) PlanMerger fix and code cleanup Peter Toth (Jira)
• 2026/04/23 [jira] [Updated] (SPARK-56570) PlanMerger correctness fix and code cleanup Peter Toth (Jira)
• 2026/04/23 [jira] [Updated] (SPARK-56600) Promote `SparkPod` to `Stable` ASF GitHub Bot (Jira)
• 2026/04/23 [jira] [Created] (SPARK-56600) Promote `SparkPod` to `Stable` Dongjoon Hyun (Jira)
• 2026/04/23 [jira] [Updated] (SPARK-56588) Dynamic partition overwrite (partitionOverwriteMode=DYNAMIC) behaves as append for Spark 4.1+ and HDFS Dongjoon Hyun (Jira)
• 2026/04/23 [jira] [Assigned] (SPARK-56592) Skip upgrading setuptools in K8s PySpark Dockerfile Dongjoon Hyun (Jira)
• 2026/04/23 [jira] [Resolved] (SPARK-56592) Skip upgrading setuptools in K8s PySpark Dockerfile Dongjoon Hyun (Jira)
• 2026/04/23 [jira] [Resolved] (SPARK-56590) Add Java-friendly getters for driver resources of KubernetesDriverSpec Dongjoon Hyun (Jira)
• 2026/04/23 [jira] [Assigned] (SPARK-56590) Add Java-friendly getters for driver resources of KubernetesDriverSpec Dongjoon Hyun (Jira)
• 2026/04/23 [jira] [Resolved] (SPARK-56571) Upgrade `Apache DataFusion Comet` to 0.15.0 Dongjoon Hyun (Jira)
• 2026/04/23 [jira] [Updated] (SPARK-56429) Explain the differences between nullValue and emptyValue when reading CSV Xiang Li (Jira)
• 2026/04/23 [jira] [Commented] (SPARK-56588) Dynamic partition overwrite (partitionOverwriteMode=DYNAMIC) behaves as append for Spark 4.1+ and HDFS Dongjoon Hyun (Jira)
• 2026/04/23 [jira] [Assigned] (SPARK-34914) Local scheduler backend support update token Cheng Pan (Jira)
• 2026/04/23 [jira] [Resolved] (SPARK-34914) Local scheduler backend support update token Cheng Pan (Jira)
• 2026/04/23 [jira] [Created] (SPARK-56599) SPIP: Write schema narrowing for column-level UPDATE in DSv2 Anurag Mantripragada (Jira)
• 2026/04/23 [jira] [Created] (SPARK-56598) Custom metrics support for TruncatableTable Ziya Mukhtarov (Jira)
• 2026/04/23 [jira] [Updated] (SPARK-56587) Show table name in WriteDelta UI node ASF GitHub Bot (Jira)
• 2026/04/23 [jira] [Created] (SPARK-56597) Default enablement of spark.io.encryption.enabled in spark apache operator leads to oom on spark jobs migrated from kubeflow one Nicolas Fraison (Jira)
• 2026/04/23 [jira] [Updated] (SPARK-55952) Post Process for CDC query: drop carry-overs ASF GitHub Bot (Jira)
• 2026/04/23 [jira] [Updated] (SPARK-56568) Add id() to DSv2 Column to detect drop-and-re-add columns at refresh time ASF GitHub Bot (Jira)
• 2026/04/23 [jira] [Reopened] (SPARK-55278) SPIP: Language-agnostic UDF Protocol for Spark Haiyang Sun (Jira)
• 2026/04/23 [jira] [Created] (SPARK-56596) Enable single-pass analyzer dual runs in CI Mihailo Timotic (Jira)
• 2026/04/23 [jira] [Created] (SPARK-56595) Move non-anyfun helpers from QueryTest to QueryTestBase Ruifeng Zheng (Jira)
• 2026/04/23 [jira] [Updated] (SPARK-56594) Add time_bucket scalar function for interval-based timestamp bucketing Jira
• 2026/04/23 [jira] [Updated] (SPARK-56594) Add time_bucket scalar function for interval-based timestamp bucketing Jira
• 2026/04/23 [jira] [Updated] (SPARK-55668) Change Data Capture (CDC) Support ASF GitHub Bot (Jira)
• 2026/04/23 [jira] [Created] (SPARK-56594) Add time_bucket scalar function for interval-based timestamp bucketing Jira
• 2026/04/23 [jira] [Comment Edited] (SPARK-56593) [k8s] [hive-thriftserver] when i set spark.kubernetes.allocation.driver.readinessTimeout=600s , the driver pod is stuck for 10 minutes which is unreasonable. zuotingbing (Jira)
• 2026/04/23 [jira] [Updated] (SPARK-56593) [k8s] [hive-thriftserver] when i set spark.kubernetes.allocation.driver.readinessTimeout=600s , the driver pod is stuck for 10 minutes which is unreasonable. zuotingbing (Jira)
• 2026/04/23 [jira] [Comment Edited] (SPARK-56593) [k8s] [hive-thriftserver] when i set spark.kubernetes.allocation.driver.readinessTimeout=600s , the driver pod is stuck for 10 minutes which is unreasonable. zuotingbing (Jira)
• 2026/04/23 [jira] [Updated] (SPARK-56593) [k8s] [hive-thriftserver] when i set spark.kubernetes.allocation.driver.readinessTimeout=600s , the driver pod is stuck for 10 minutes which is unreasonable. zuotingbing (Jira)
• 2026/04/23 [jira] [Commented] (SPARK-56593) [k8s] [hive-thriftserver] when i set spark.kubernetes.allocation.driver.readinessTimeout=600s , the driver pod is stuck for 10 minutes which is unreasonable. zuotingbing (Jira)
• 2026/04/23 [jira] [Updated] (SPARK-56593) [k8s] [hive-thriftserver] when i set spark.kubernetes.allocation.driver.readinessTimeout=600s , the driver pod is stuck for 10 minutes which is unreasonable. zuotingbing (Jira)
• 2026/04/23 [jira] [Updated] (SPARK-56593) [k8s] [hive-thriftserver] when i set spark.kubernetes.allocation.driver.readinessTimeout=600s , the driver pod is stuck for 10 minutes which is unreasonable. zuotingbing (Jira)
• 2026/04/23 [jira] [Updated] (SPARK-56593) [k8s] [hive-thriftserver] when i set spark.kubernetes.allocation.driver.readinessTimeout=600s , the driver pod is stuck for 10 minutes which is unreasonable. zuotingbing (Jira)
• 2026/04/23 [jira] [Updated] (SPARK-56593) [k8s] [hive-thriftserver] when i set spark.kubernetes.allocation.driver.readinessTimeout=600s , the driver pod is stuck for 10 minutes which is unreasonable. zuotingbing (Jira)
• 2026/04/23 [jira] [Created] (SPARK-56593) [k8s] [sql][hive-thriftserver] when i set spark.kubernetes.allocation.driver.readinessTimeout=600s , the driver pod is stuck for 10 minutes which is unreasonable. zuotingbing (Jira)
• 2026/04/23 [jira] [Resolved] (SPARK-56569) Add WINDOW_FUNCTION_FRAME_NOT_ORDERED error to replace _LEGACY_ERROR_TEMP_1037 Wenchen Fan (Jira)
• 2026/04/23 [jira] [Assigned] (SPARK-56569) Add WINDOW_FUNCTION_FRAME_NOT_ORDERED error to replace _LEGACY_ERROR_TEMP_1037 Wenchen Fan (Jira)
• 2026/04/23 [jira] [Resolved] (SPARK-56567) Fix array_insert handling of Int.MinValue position Wenchen Fan (Jira)
• 2026/04/23 [jira] [Assigned] (SPARK-56567) Fix array_insert handling of Int.MinValue position Wenchen Fan (Jira)
• 2026/04/23 [jira] [Updated] (SPARK-56592) Skip upgrading setuptools in K8s PySpark Dockerfile ASF GitHub Bot (Jira)
• 2026/04/22 [jira] [Created] (SPARK-56592) Skip upgrading setuptools in K8s PySpark Dockerfile Cheng Pan (Jira)
• 2026/04/22 [jira] [Comment Edited] (SPARK-49079) Spark jobs failing with UnknownHostException on executors if driver readiness timeout elapsed zuotingbing (Jira)
• 2026/04/22 [jira] [Updated] (SPARK-56571) Upgrade `Apache DataFusion Comet` to 0.15.0 ASF GitHub Bot (Jira)
• 2026/04/22 [jira] [Created] (SPARK-56591) Remove redundant QueryTest mixin from SharedSparkSession subclasses Ruifeng Zheng (Jira)
• 2026/04/22 [jira] [Updated] (SPARK-56589) Use Virtual Threads for BlockManagerMasterEndpoint ask thread pool ASF GitHub Bot (Jira)
• 2026/04/22 [jira] [Updated] (SPARK-56590) Add Java-friendly getters for driver resources of KubernetesDriverSpec ASF GitHub Bot (Jira)
• 2026/04/22 [jira] [Created] (SPARK-56590) Add Java-friendly getters for driver resources of KubernetesDriverSpec Dongjoon Hyun (Jira)
• 2026/04/22 [jira] [Updated] (SPARK-56589) Use Virtual Threads for BlockManagerMasterEndpoint ask thread pool Noritaka Sekiyama (Jira)
• 2026/04/22 [jira] [Updated] (SPARK-56589) Use Virtual Threads for BlockManagerMasterEndpoint ask thread pool Noritaka Sekiyama (Jira)
• 2026/04/22 [jira] [Created] (SPARK-56589) Use Virtual Threads for BlockManagerMasterEndpoint ask thread pool Noritaka Sekiyama (Jira)
• 2026/04/22 [jira] [Resolved] (SPARK-56582) Upgrade `snowflake-jdbc` to 4.1.0 Dongjoon Hyun (Jira)
• 2026/04/22 [jira] [Assigned] (SPARK-56582) Upgrade `snowflake-jdbc` to 4.1.0 Dongjoon Hyun (Jira)
• 2026/04/22 [jira] [Assigned] (SPARK-56580) Upgrade `netty-tcnative` to 2.0.76.Final Dongjoon Hyun (Jira)
• 2026/04/22 [jira] [Resolved] (SPARK-56580) Upgrade `netty-tcnative` to 2.0.76.Final Dongjoon Hyun (Jira)
• 2026/04/22 [jira] [Assigned] (SPARK-56578) Upgrade `versions-maven-plugin` to 2.21.0 Dongjoon Hyun (Jira)
• 2026/04/22 [jira] [Resolved] (SPARK-56578) Upgrade `versions-maven-plugin` to 2.21.0 Dongjoon Hyun (Jira)
• 2026/04/22 [jira] [Updated] (SPARK-56588) Dynamic partition overwrite (partitionOverwriteMode=DYNAMIC) behaves as append for Spark 4.1+ and HDFS Kazuyuki Tanimura (Jira)
• 2026/04/22 [jira] [Created] (SPARK-56588) Dynamic partition overwrite (partitionOverwriteMode=DYNAMIC) behaves as append for Spark 4.1+ and HDFS Kazuyuki Tanimura (Jira)
• 2026/04/22 [jira] [Resolved] (SPARK-56551) DSv2 DELETE Operation Metrics Anton Okolnychyi (Jira)
• 2026/04/22 [jira] [Assigned] (SPARK-56551) DSv2 DELETE Operation Metrics Anton Okolnychyi (Jira)
• 2026/04/22 [jira] [Assigned] (SPARK-56585) Replace SparkPlanTest with QueryTest Ruifeng Zheng (Jira)
• 2026/04/22 [jira] [Resolved] (SPARK-56585) Replace SparkPlanTest with QueryTest Ruifeng Zheng (Jira)
• 2026/04/22 [jira] [Created] (SPARK-56587) Show table name in WriteDelta UI node Yuming Wang (Jira)
• 2026/04/22 [jira] [Updated] (SPARK-56565) Retry flaky python foreachBatch termination test Hyukjin Kwon (Jira)
• 2026/04/22 [jira] [Reopened] (SPARK-56565) Retry flaky python foreachBatch termination test Hyukjin Kwon (Jira)
• 2026/04/22 [jira] [Commented] (SPARK-56565) Retry flaky python foreachBatch termination test Jira
• 2026/04/22 [jira] [Updated] (SPARK-56586) Retry flaky test 'python foreachBatch process: process terminates after query is stopped' ASF GitHub Bot (Jira)
• 2026/04/22 [jira] [Assigned] (SPARK-56581) Upgrade `maven-jar-plugin` to 3.5.0 Dongjoon Hyun (Jira)
• 2026/04/22 [jira] [Resolved] (SPARK-56581) Upgrade `maven-jar-plugin` to 3.5.0 Dongjoon Hyun (Jira)
• 2026/04/22 [jira] [Created] (SPARK-56586) Retry flaky test 'python foreachBatch process: process terminates after query is stopped' Ruifeng Zheng (Jira)
• 2026/04/22 [jira] [Resolved] (SPARK-56579) Upgrade `scala-maven-plugin` to 4.9.10 Dongjoon Hyun (Jira)
• 2026/04/22 [jira] [Assigned] (SPARK-56579) Upgrade `scala-maven-plugin` to 4.9.10 Dongjoon Hyun (Jira)
• 2026/04/22 [jira] [Resolved] (SPARK-52018) Remove `jar` and `class` files from Apache Spark git repository keeping all affected tests enabled Kousuke Saruta (Jira)
• 2026/04/22 [jira] [Resolved] (SPARK-56352) Remove pre-built test JAR and class files from the repository Kousuke Saruta (Jira)
• 2026/04/22 [jira] [Resolved] (SPARK-56556) Reject `.jar` and `.class` files in CI Kousuke Saruta (Jira)
• 2026/04/22 [jira] [Resolved] (SPARK-56521) Support PartitionPredicate in runtime filters Wenchen Fan (Jira)
• 2026/04/22 [jira] [Assigned] (SPARK-56521) Support PartitionPredicate in runtime filters Wenchen Fan (Jira)
• 2026/04/22 [jira] [Updated] (SPARK-56585) Replace SparkPlanTest with QueryTest ASF GitHub Bot (Jira)
• 2026/04/22 [jira] [Created] (SPARK-56585) Replace SparkPlanTest with QueryTest Ruifeng Zheng (Jira)
• 2026/04/22 [jira] [Updated] (SPARK-56477) Refactor SQL_GROUPED_MAP_PANDAS_UDF to be self-contained in read_udfs ASF GitHub Bot (Jira)
• 2026/04/22 [jira] [Resolved] (SPARK-56577) Upgrade `ap-loader` to 4.3-13 Dongjoon Hyun (Jira)
• 2026/04/22 [jira] [Assigned] (SPARK-56577) Upgrade `ap-loader` to 4.3-13 Dongjoon Hyun (Jira)
• 2026/04/22 [jira] [Updated] (SPARK-56584) Generalize RESULT_TYPE_MISMATCH_FOR_ARROW_UDF error class and remove dead SCHEMA_MISMATCH_FOR_ARROW_PYTHON_UDF ASF GitHub Bot (Jira)
• 2026/04/22 [jira] [Updated] (SPARK-56584) Generalize RESULT_TYPE_MISMATCH_FOR_ARROW_UDF error class and remove dead SCHEMA_MISMATCH_FOR_ARROW_PYTHON_UDF Yicong Huang (Jira)
• 2026/04/22 [jira] [Created] (SPARK-56584) Generalize RESULT_TYPE_MISMATCH_FOR_ARROW_UDF error class and remove dead SCHEMA_MISMATCH_FOR_ARROW_PYTHON_UDF Yicong Huang (Jira)
• 2026/04/22 [jira] [Updated] (SPARK-56583) Skip `pip` upgrade and use `--break-system-packages` to avoid PEP 668 error in PySpark Dockerfile Dongjoon Hyun (Jira)
• 2026/04/22 [jira] [Assigned] (SPARK-56565) Retry flaky python foreachBatch termination test Hyukjin Kwon (Jira)
• 2026/04/22 [jira] [Resolved] (SPARK-56565) Retry flaky python foreachBatch termination test Hyukjin Kwon (Jira)
• 2026/04/22 [jira] [Resolved] (SPARK-56576) Upgrade `dev.ludovic.netlib` to 3.2.0 Dongjoon Hyun (Jira)
• 2026/04/22 [jira] [Assigned] (SPARK-56576) Upgrade `dev.ludovic.netlib` to 3.2.0 Dongjoon Hyun (Jira)
• 2026/04/22 [jira] [Resolved] (SPARK-56574) Add Java-friendly `KubernetesDriverSpec.getSystemPropertiesAsJavaMap` Dongjoon Hyun (Jira)
• 2026/04/22 [jira] [Assigned] (SPARK-56574) Add Java-friendly `KubernetesDriverSpec.getSystemPropertiesAsJavaMap` Dongjoon Hyun (Jira)
• 2026/04/22 [jira] [Resolved] (SPARK-56563) Merge SparkPlanTest into QueryTest/QueryTestBase Hyukjin Kwon (Jira)
• 2026/04/22 [jira] [Assigned] (SPARK-56547) Improve error message when DataFrame column is referenced from a wrong DataFrame Hyukjin Kwon (Jira)
• 2026/04/22 [jira] [Resolved] (SPARK-56547) Improve error message when DataFrame column is referenced from a wrong DataFrame Hyukjin Kwon (Jira)
• 2026/04/22 [jira] [Updated] (SPARK-56547) Improve error message when DataFrame column is referenced from a wrong DataFrame ASF GitHub Bot (Jira)
• 2026/04/22 [jira] [Assigned] (SPARK-56563) Merge SparkPlanTest into QueryTest/QueryTestBase Hyukjin Kwon (Jira)
• 2026/04/22 [jira] [Resolved] (SPARK-56583) Skip `pip` upgrade and use `--break-system-packages` to avoid PEP 668 error in PySpark Dockerfile Dongjoon Hyun (Jira)
• 2026/04/22 [jira] [Updated] (SPARK-56583) Skip `pip` upgrade and use `--break-system-packages` to avoid PEP 668 error in PySpark Dockerfile Dongjoon Hyun (Jira)
• 2026/04/22 [jira] [Assigned] (SPARK-56583) Skip `pip` upgrade and use `--break-system-packages` to avoid PEP 668 error in PySpark Dockerfile Dongjoon Hyun (Jira)
• 2026/04/22 [jira] [Assigned] (SPARK-31561) Add QUALIFY Clause L. C. Hsieh (Jira)
• 2026/04/22 [jira] [Resolved] (SPARK-31561) Add QUALIFY Clause L. C. Hsieh (Jira)
• 2026/04/22 [jira] [Updated] (SPARK-56572) Inject the Spark session into python pipeline code ASF GitHub Bot (Jira)
• 2026/04/22 [jira] [Updated] (SPARK-56583) Use `--break-system-packages` to avoid PEP 668 error in PySpark Dockerfile ASF GitHub Bot (Jira)
• 2026/04/22 [jira] [Created] (SPARK-56583) Use `--break-system-packages` to avoid PEP 668 error in PySpark Dockerfile Dongjoon Hyun (Jira)
• 2026/04/22 [jira] [Updated] (SPARK-56573) Bigger default tablesample seed to reduce collision Stanley Yao (Jira)
• 2026/04/22 [jira] [Updated] (SPARK-56582) Upgrade `snowflake-jdbc` to 4.1.0 ASF GitHub Bot (Jira)
• 2026/04/22 [jira] [Created] (SPARK-56582) Upgrade `snowflake-jdbc` to 4.1.0 Dongjoon Hyun (Jira)
• 2026/04/22 [jira] [Created] (SPARK-56581) Upgrade `maven-jar-plugin` to 3.5.0 Dongjoon Hyun (Jira)
• 2026/04/22 [jira] [Updated] (SPARK-56581) Upgrade `maven-jar-plugin` to 3.5.0 ASF GitHub Bot (Jira)
• 2026/04/22 [jira] [Updated] (SPARK-56580) Upgrade `netty-tcnative` to 2.0.76.Final ASF GitHub Bot (Jira)
• 2026/04/22 [jira] [Created] (SPARK-56580) Upgrade `netty-tcnative` to 2.0.76.Final Dongjoon Hyun (Jira)
• 2026/04/22 [jira] [Updated] (SPARK-56579) Upgrade `scala-maven-plugin` to 4.9.10 ASF GitHub Bot (Jira)
• 2026/04/22 [jira] [Created] (SPARK-56579) Upgrade `scala-maven-plugin` to 4.9.10 Dongjoon Hyun (Jira)
• 2026/04/22 [jira] [Updated] (SPARK-56578) Upgrade `versions-maven-plugin` to 2.21.0 ASF GitHub Bot (Jira)
• 2026/04/22 [jira] [Created] (SPARK-56578) Upgrade `versions-maven-plugin` to 2.21.0 Dongjoon Hyun (Jira)
• 2026/04/22 [jira] [Updated] (SPARK-56577) Upgrade `ap-loader` to 4.3-13 ASF GitHub Bot (Jira)
• 2026/04/22 [jira] [Created] (SPARK-56577) Upgrade `ap-loader` to 4.3-13 Dongjoon Hyun (Jira)
• 2026/04/22 [jira] [Updated] (SPARK-56576) Upgrade `dev.ludovic.netlib` to 3.2.0 ASF GitHub Bot (Jira)
• 2026/04/22 [jira] [Created] (SPARK-56576) Upgrade `dev.ludovic.netlib` to 3.2.0 Dongjoon Hyun (Jira)
• 2026/04/22 [jira] [Created] (SPARK-56575) Extract scheduleResubmit() helper to remove identical code blocks Xingbo Jiang (Jira)
• 2026/04/22 [jira] [Updated] (SPARK-56574) Add Java-friendly `KubernetesDriverSpec.getSystemPropertiesAsJavaMap` ASF GitHub Bot (Jira)
• 2026/04/22 [jira] [Created] (SPARK-56574) Add Java-friendly `KubernetesDriverSpec.getSystemPropertiesAsJavaMap` Dongjoon Hyun (Jira)
• 2026/04/22 [jira] [Updated] (SPARK-56572) Inject the Spark session into python pipeline code Andreas Neumann (Jira)
• 2026/04/22 [jira] [Created] (SPARK-56573) Bigger default tablesample seed to reduce collision Stanley Yao (Jira)
• 2026/04/22 [jira] [Created] (SPARK-56572) Inject the Spark session into python pipeline code Andreas Neumann (Jira)
• 2026/04/22 [jira] [Updated] (SPARK-56115) Introduce crds.install to Helm Chart ASF GitHub Bot (Jira)
• 2026/04/22 [jira] [Updated] (SPARK-56570) PlanMerger code cleanup ASF GitHub Bot (Jira)
• 2026/04/22 [jira] [Assigned] (SPARK-56571) Upgrade `Apache DataFusion Comet` to 0.15.0 Dongjoon Hyun (Jira)
• 2026/04/22 [jira] [Created] (SPARK-56571) Upgrade `Apache DataFusion Comet` to 0.15.0 Dongjoon Hyun (Jira)
• 2026/04/22 [jira] [Created] (SPARK-56570) PlanMerger code cleanup Peter Toth (Jira)
• 2026/04/22 [jira] [Updated] (SPARK-56565) Retry flaky python foreachBatch termination test ASF GitHub Bot (Jira)
• 2026/04/22 [jira] [Updated] (SPARK-46830) Introducing collation concept into Spark ASF GitHub Bot (Jira)
• 2026/04/22 [jira] [Resolved] (SPARK-56566) ransformWithState silently drops user timers registered at or below the previous batch's lower bound Jungtaek Lim (Jira)
• 2026/04/22 [jira] [Assigned] (SPARK-56566) ransformWithState silently drops user timers registered at or below the previous batch's lower bound Jungtaek Lim (Jira)
• 2026/04/22 [jira] [Assigned] (SPARK-56410) Add bounded k-way merge support in UnsafeExternalSorter Yang Jie (Jira)
• 2026/04/22 [jira] [Resolved] (SPARK-56410) Add bounded k-way merge support in UnsafeExternalSorter Yang Jie (Jira)
• 2026/04/22 [jira] [Updated] (SPARK-56569) Add WINDOW_FUNCTION_FRAME_NOT_ORDERED error to replace _LEGACY_ERROR_TEMP_1037 ASF GitHub Bot (Jira)
• 2026/04/22 [jira] [Updated] (SPARK-56569) Add WINDOW_FUNCTION_FRAME_NOT_ORDERED error to replace _LEGACY_ERROR_TEMP_1037 Petar Nikic (Jira)
• 2026/04/22 [jira] [Created] (SPARK-56569) Add WINDOW_FUNCTION_FRAME_NOT_ORDERED to replace _LEGACY_ERROR_TEMP_1037 Petar Nikic (Jira)
• 2026/04/22 [jira] [Created] (SPARK-56568) Add id() to DSv2 Column to detect drop-and-re-add columns at refresh time Thang Long Vu (Jira)
• 2026/04/22 [jira] [Updated] (SPARK-56567) Fix array_insert handling of Int.MinValue position ASF GitHub Bot (Jira)
• 2026/04/22 [jira] [Created] (SPARK-56567) Fix array_insert handling of Int.MinValue position Akash Nayar (Jira)
• 2026/04/21 [jira] [Commented] (SPARK-36950) Normalize semi-structured data into tabular tables. Jira
• 2026/04/21 [jira] [Updated] (SPARK-46367) PartitioningPreservingUnaryExecNode breaks KeyGroupedPartitioning ASF GitHub Bot (Jira)
• 2026/04/21 [jira] [Commented] (SPARK-45910) Numerical output of MulticlassClassificationEvaluator does not coincide with expected output Jira
• 2026/04/21 [jira] [Updated] (SPARK-56566) ransformWithState silently drops user timers registered at or below the previous batch's lower bound ASF GitHub Bot (Jira)
• 2026/04/21 [jira] [Created] (SPARK-56566) ransformWithState silently drops user timers registered at or below the previous batch's lower bound Jungtaek Lim (Jira)
• 2026/04/21 [jira] [Commented] (SPARK-56566) ransformWithState silently drops user timers registered at or below the previous batch's lower bound Jungtaek Lim (Jira)
• 2026/04/21 [jira] [Commented] (SPARK-46367) PartitioningPreservingUnaryExecNode breaks KeyGroupedPartitioning Naveen Kumar Kumar Puppala (Jira)
• 2026/04/21 [jira] [Comment Edited] (SPARK-46367) PartitioningPreservingUnaryExecNode breaks KeyGroupedPartitioning Naveen Kumar Kumar Puppala (Jira)
• 2026/04/21 [jira] [Created] (SPARK-56565) Retry flaky python foreachBatch termination test Ruifeng Zheng (Jira)
• 2026/04/21 [jira] [Commented] (SPARK-46367) PartitioningPreservingUnaryExecNode breaks KeyGroupedPartitioning Naveen Kumar Kumar Puppala (Jira)
• 2026/04/21 [jira] [Updated] (SPARK-56563) Merge SparkPlanTest into QueryTest/QueryTestBase ASF GitHub Bot (Jira)
• 2026/04/21 [jira] [Assigned] (SPARK-55608) Refactor SQL_GROUPED_MAP_ARROW_UDF and SQL_GROUPED_MAP_ARROW_ITER_UDF Ruifeng Zheng (Jira)
• 2026/04/21 [jira] [Resolved] (SPARK-55608) Refactor SQL_GROUPED_MAP_ARROW_UDF and SQL_GROUPED_MAP_ARROW_ITER_UDF Ruifeng Zheng (Jira)
• 2026/04/21 [jira] [Resolved] (SPARK-56562) Benchmark SQL_GROUPED_AGG_PANDAS_UDF Ruifeng Zheng (Jira)
• 2026/04/21 [jira] [Assigned] (SPARK-56562) Benchmark SQL_GROUPED_AGG_PANDAS_UDF Ruifeng Zheng (Jira)
• 2026/04/21 [jira] [Comment Edited] (SPARK-56564) V2 DataSource write path throws SparkException instead of CommitDeniedException, causing spurious stage failures with speculation Dan Wu (Jira)
• 2026/04/21 [jira] [Commented] (SPARK-56564) V2 DataSource write path throws SparkException instead of CommitDeniedException, causing spurious stage failures with speculation Dan Wu (Jira)

• Earlier messages