issues

Messages by Date

2026/09/02 [jira] [Commented] (SPARK-59171) [SQL] SchemaPruning is not idempotent when a query reads _metadata and a VARIANT column is only referenced below a nondeterministic filter Felipe (Jira)
2026/09/02 [jira] [Created] (SPARK-59171) [SQL] SchemaPruning is not idempotent when a query reads _metadata and a VARIANT column is only referenced below a nondeterministic filter Felipe (Jira)
2026/09/02 [jira] [Updated] (SPARK-59170) Align SQL function groupings across APIs and documentation ASF GitHub Bot (Jira)
2026/09/02 [jira] [Updated] (SPARK-59050) SPJ one-side shuffle with out-of-set keys produces wrong results in multi-joins XiDuo You (Jira)
2026/09/02 [jira] [Updated] (SPARK-59154) Optimize decision tree model transform closures Ruifeng Zheng (Jira)
2026/09/02 [jira] [Created] (SPARK-59170) Align SQL function groupings across APIs and documentation Ruifeng Zheng (Jira)
2026/09/02 [jira] [Commented] (SPARK-59153) SPJ one-side shuffle with out-of-set keys must not satisfy a global sort Hemanth Boyina (Jira)
2026/09/02 [jira] [Created] (SPARK-59169) Log a warning when KVStoreProtobufSerializer falls back to JSON SerDe Cheng Pan (Jira)
2026/09/02 [jira] [Updated] (SPARK-59050) SPJ one-side shuffle with out-of-set keys produces wrong results in multi-joins XiDuo You (Jira)
2026/09/02 [jira] [Updated] (SPARK-59050) SPJ one-side shuffle with out-of-set keys produces wrong results in multi-joins XiDuo You (Jira)
2026/09/02 [jira] [Resolved] (SPARK-58836) Thread dump flame graph resources return 404 behind a web proxy Jira
2026/09/02 [jira] [Assigned] (SPARK-58836) Thread dump flame graph resources return 404 behind a web proxy Jira
2026/09/02 [jira] [Updated] (SPARK-59168) Avoid NoSuchElementException on missing keys in KVStore reads and writes ASF GitHub Bot (Jira)
2026/09/02 [jira] [Updated] (SPARK-59166) Split FunctionRegistry initialization into helper methods ASF GitHub Bot (Jira)
2026/09/02 [jira] [Created] (SPARK-59168) Avoid NoSuchElementException on missing keys in KVStore reads and writes XiDuo You (Jira)
2026/09/02 [jira] [Assigned] (SPARK-59166) Split FunctionRegistry initialization into helper methods Ruifeng Zheng (Jira)
2026/09/02 [jira] [Resolved] (SPARK-59166) Split FunctionRegistry initialization into helper methods Ruifeng Zheng (Jira)
2026/09/02 [jira] [Resolved] (SPARK-59123) Avoid per-key intermediate collections in KeyedPartitioning.projectKeys and reduceKeys Peter Toth (Jira)
2026/09/02 [jira] [Assigned] (SPARK-59123) Avoid per-key intermediate collections in KeyedPartitioning.projectKeys and reduceKeys Peter Toth (Jira)
2026/09/01 [jira] [Assigned] (SPARK-59148) Skip test_nested_dataframes in the Spark Connect compatibility test Yang Jie (Jira)
2026/09/01 [jira] [Assigned] (SPARK-59162) Replace BLAS calls with while loops in GBT models Ruifeng Zheng (Jira)
2026/09/01 [jira] [Resolved] (SPARK-59162) Replace BLAS calls with while loops in GBT models Ruifeng Zheng (Jira)
2026/09/01 [jira] [Resolved] (SPARK-59148) Skip test_nested_dataframes in the Spark Connect compatibility test Yang Jie (Jira)
2026/09/01 [jira] [Updated] (SPARK-59148) Skip test_nested_dataframes in the Spark Connect compatibility test Yang Jie (Jira)
2026/09/01 [jira] [Updated] (SPARK-59167) Add an end-to-end Spark Connect client benchmark harness (Rust drop-in vs reference PySpark) ASF GitHub Bot (Jira)
2026/09/01 [jira] [Created] (SPARK-59167) Add an end-to-end Spark Connect client benchmark harness (Rust drop-in vs reference PySpark) Hyukjin Kwon (Jira)
2026/09/01 [jira] [Updated] (SPARK-59164) Support nested column schema evolution ASF GitHub Bot (Jira)
2026/09/01 [jira] [Created] (SPARK-59166) Split FunctionRegistry initialization into helper methods Ruifeng Zheng (Jira)
2026/09/01 [jira] [Created] (SPARK-59165) SCD2 Ignore-null support; Introduce version map in `_cdc_metadata` Anish Mahto (Jira)
2026/09/01 [jira] [Created] (SPARK-59164) Support nested column schema evolution Anish Mahto (Jira)
2026/09/01 [jira] [Updated] (SPARK-59163) Reuse projected table state options across table loading and cache lookup ASF GitHub Bot (Jira)
2026/09/01 [jira] [Updated] (SPARK-59163) Reuse projected table state options across table loading and cache lookup Yan Yan (Jira)
2026/09/01 [jira] [Created] (SPARK-59163) Reuse projected table state options across table loading and cache lookup Yan Yan (Jira)
2026/09/01 [jira] [Updated] (SPARK-59162) Replace BLAS calls with while loops in GBT models ASF GitHub Bot (Jira)
2026/09/01 [jira] [Created] (SPARK-59162) Replace BLAS calls with while loops in GBT models Ruifeng Zheng (Jira)
2026/09/01 [jira] [Updated] (SPARK-59045) Fix SPJ throw ClassCastException with different data type transforms XiDuo You (Jira)
2026/09/01 [jira] [Updated] (SPARK-59152) Create CountVectorizer broadcast per transform Ruifeng Zheng (Jira)
2026/09/01 [jira] [Assigned] (SPARK-59152) Create CountVectorizer broadcast per transform Ruifeng Zheng (Jira)
2026/09/01 [jira] [Resolved] (SPARK-59152) Create CountVectorizer broadcast per transform Ruifeng Zheng (Jira)
2026/09/01 [jira] [Updated] (SPARK-59161) Run the Redis-backed integration tests in CI ASF GitHub Bot (Jira)
2026/09/01 [jira] [Created] (SPARK-59161) Run the Redis-backed integration tests in CI L. C. Hsieh (Jira)
2026/09/01 [jira] [Updated] (SPARK-59160) The currentStageId initialized to 0, in the AdaptiveSparkPlanExec constructor, may clash with existing stageIDs in the AdaptiveExecutionContext ASF GitHub Bot (Jira)
2026/09/01 [jira] [Created] (SPARK-59160) The currentStageId initialized to 0, in the AdaptiveSparkPlanExec constructor, may clash with existing stageIDs in the AdaptiveExecutionContext Asif (Jira)
2026/09/01 [jira] [Resolved] (SPARK-59158) Import docs, Helm chart, deployment examples, and Dockerfile into Spark Connect Gateway L. C. Hsieh (Jira)
2026/09/01 [jira] [Updated] (SPARK-59136) Make the active Spark Connect client identifiable (pyspark-client-rust vs the reference client) Hyukjin Kwon (Jira)
2026/09/01 [jira] [Updated] (SPARK-59136) Make the active Spark Connect client identifiable (pyspark-client-rust vs the reference client) Hyukjin Kwon (Jira)
2026/09/01 [jira] [Resolved] (SPARK-59136) Make the active Spark Connect client identifiable (pyspark-client-rust vs the reference client) Holden Karau (Jira)
2026/09/01 [jira] [Updated] (SPARK-58735) "size(array)" forces full read of nested array columns and prevents column pruning for Parquet/Delta arrays ASF GitHub Bot (Jira)
2026/09/01 [jira] [Assigned] (SPARK-52387) Migrate to use the official Apache Arrow Swift package Dongjoon Hyun (Jira)
2026/09/01 [jira] [Resolved] (SPARK-59159) Remove `queriesForSpark4Only` from `SQLTests` Dongjoon Hyun (Jira)
2026/09/01 [jira] [Assigned] (SPARK-59159) Remove `queriesForSpark4Only` from `SQLTests` Dongjoon Hyun (Jira)
2026/09/01 [jira] [Assigned] (SPARK-59156) Add `MacOS` integration test with Apache Spark `4.3.0` RC1 Dongjoon Hyun (Jira)
2026/09/01 [jira] [Updated] (SPARK-59159) Remove `queriesForSpark4Only` from `SQLTests` ASF GitHub Bot (Jira)
2026/09/01 [jira] [Created] (SPARK-59159) Remove `queriesForSpark4Only` from `SQLTests` Dongjoon Hyun (Jira)
2026/09/01 [jira] [Assigned] (SPARK-59157) Upgrade `grpc-swift-2` to 2.4.3 Dongjoon Hyun (Jira)
2026/09/01 [jira] [Resolved] (SPARK-59156) Add `MacOS` integration test with Apache Spark `4.3.0` RC1 Dongjoon Hyun (Jira)
2026/09/01 [jira] [Resolved] (SPARK-59157) Upgrade `grpc-swift-2` to 2.4.3 Dongjoon Hyun (Jira)
2026/09/01 [jira] [Updated] (SPARK-59158) Import docs, Helm chart, deployment examples, and Dockerfile into Spark Connect Gateway ASF GitHub Bot (Jira)
2026/09/01 [jira] [Created] (SPARK-59158) Import docs, Helm chart, deployment examples, and Dockerfile into Spark Connect Gateway L. C. Hsieh (Jira)
2026/09/01 [jira] [Updated] (SPARK-59157) Upgrade `grpc-swift-2` to 2.4.3 ASF GitHub Bot (Jira)
2026/09/01 [jira] [Created] (SPARK-59157) Upgrade `grpc-swift-2` to 2.4.3 Dongjoon Hyun (Jira)
2026/09/01 [jira] [Assigned] (SPARK-59155) Support `TIME(p)` precision in `createDataFrame` Dongjoon Hyun (Jira)
2026/09/01 [jira] [Updated] (SPARK-58926) Driver pod SPARK_USER should reflect --proxy-user when set Dongjoon Hyun (Jira)
2026/09/01 [jira] [Updated] (SPARK-57242) Avoid unbounded TaskMemoryManager page allocation retries after allocator OOM Dongjoon Hyun (Jira)
2026/09/01 [jira] [Updated] (SPARK-59156) Add `MacOS` integration test with Apache Spark `4.3.0` RC1 ASF GitHub Bot (Jira)
2026/09/01 [jira] [Resolved] (SPARK-58926) Driver pod SPARK_USER should reflect --proxy-user when set Dongjoon Hyun (Jira)
2026/09/01 [jira] [Created] (SPARK-59156) Add `MacOS` integration test with Apache Spark `4.3.0` RC1 Dongjoon Hyun (Jira)
2026/09/01 [jira] [Resolved] (SPARK-59155) Support `TIME(p)` precision in `createDataFrame` Dongjoon Hyun (Jira)
2026/09/01 [jira] [Commented] (SPARK-58970) Add SupportsReportCatalogStatistics interface to fix pre-pushdown computeStats on DSv2 relations Hemanth Boyina (Jira)
2026/09/01 [jira] [Assigned] (SPARK-58926) Driver pod SPARK_USER should reflect --proxy-user when set Dongjoon Hyun (Jira)
2026/09/01 [jira] [Updated] (SPARK-58926) Driver pod SPARK_USER should reflect --proxy-user when set Dongjoon Hyun (Jira)
2026/09/01 [jira] [Updated] (SPARK-59123) Avoid per-key intermediate collections in KeyedPartitioning.projectKeys and reduceKeys Dongjoon Hyun (Jira)
2026/09/01 [jira] [Updated] (SPARK-59155) Support `TIME(p)` precision in `createDataFrame` ASF GitHub Bot (Jira)
2026/09/01 [jira] [Created] (SPARK-59155) Support `TIME(p)` precision in `createDataFrame` Dongjoon Hyun (Jira)
2026/09/01 [jira] [Updated] (SPARK-59123) Avoid per-key intermediate collections in KeyedPartitioning.projectKeys and reduceKeys Dongjoon Hyun (Jira)
2026/09/01 [jira] [Updated] (SPARK-57242) Avoid unbounded TaskMemoryManager page allocation retries after allocator OOM Dongjoon Hyun (Jira)
2026/09/01 [jira] [Updated] (SPARK-57242) Avoid unbounded TaskMemoryManager page allocation retries after allocator OOM Dongjoon Hyun (Jira)
2026/09/01 [jira] [Resolved] (SPARK-59145) Import gateway binary crate into Spark Connect Gateway L. C. Hsieh (Jira)
2026/09/01 [jira] [Commented] (SPARK-56223) Polish type annotations for pyspark Dongjoon Hyun (Jira)
2026/09/01 [jira] [Updated] (SPARK-59154) Optimize tree classification models to reduce transform closure size ASF GitHub Bot (Jira)
2026/09/01 [jira] [Created] (SPARK-59154) Optimize tree classification models to reduce transform closure size Ruifeng Zheng (Jira)
2026/09/01 [jira] [Created] (SPARK-59153) SPJ one-side shuffle with out-of-set keys must not satisfy a global sort Dongjoon Hyun (Jira)
2026/09/01 [jira] [Updated] (SPARK-59152) Create CountVectorizer broadcast per transform ASF GitHub Bot (Jira)
2026/09/01 [jira] [Created] (SPARK-59152) Create CountVectorizer broadcast per transform Ruifeng Zheng (Jira)
2026/09/01 [jira] [Updated] (SPARK-58968) Fix data correctness issue when SPJ allowKeysSubsetOfPartitionKeys Peter Toth (Jira)
2026/09/01 [jira] [Assigned] (SPARK-58968) Fix data correctness issue when SPJ allowKeysSubsetOfPartitionKeys Peter Toth (Jira)
2026/09/01 [jira] [Resolved] (SPARK-58968) Fix data correctness issue when SPJ allowKeysSubsetOfPartitionKeys Peter Toth (Jira)
2026/09/01 [jira] [Created] (SPARK-59151) Variant aggregation- canonicalisation Aleksandr Chernousov (Jira)
2026/09/01 [jira] [Updated] (SPARK-59151) Variant aggregation- canonicalization Aleksandr Chernousov (Jira)
2026/09/01 [jira] [Updated] (SPARK-59019) Excluding RewriteWithExpression causes an INTERNAL_ERROR for a legal BETWEEN query Peter Toth (Jira)
2026/09/01 [jira] [Created] (SPARK-59150) VARIANT datatype aggregation Aleksandr Chernousov (Jira)
2026/09/01 [jira] [Resolved] (SPARK-47397) count_distinct ignores null values Jira
2026/09/01 [jira] [Resolved] (SPARK-39897) StackOverflowError in TaskMemoryManager Peter Toth (Jira)
2026/09/01 [jira] [Updated] (SPARK-59086) Extract common build env setup into composite action ASF GitHub Bot (Jira)
2026/09/01 [jira] [Resolved] (SPARK-59045) Fix SPJ throw ClassCastException with different data type transforms XiDuo You (Jira)
2026/09/01 [jira] [Updated] (SPARK-59149) Use isEmpty instead of size == 0 in OrcUtils ASF GitHub Bot (Jira)
2026/09/01 [jira] [Resolved] (SPARK-59057) Make KeyedPartitioning's narrowing flag mean actual key collapse Peter Toth (Jira)
2026/09/01 [jira] [Updated] (SPARK-59144) Plain SQL/JSON constructor function calls bypass routine resolution ASF GitHub Bot (Jira)
2026/09/01 [jira] [Commented] (SPARK-59149) Use isEmpty instead of size == 0 in OrcUtils Jira
2026/09/01 [jira] [Created] (SPARK-59149) Use isEmpty instead of size == 0 in OrcUtils Jira
2026/09/01 [jira] [Updated] (SPARK-59121) Fix wrong results when a storage-partitioned join reduces the partition keys of both sides ASF GitHub Bot (Jira)
2026/09/01 [jira] [Assigned] (SPARK-59045) Fix SPJ throw ClassCastException with different data type transforms XiDuo You (Jira)
2026/09/01 [jira] [Updated] (SPARK-59148) Skip test_nested_dataframes in the Spark Connect compatibility test ASF GitHub Bot (Jira)
2026/09/01 [jira] [Created] (SPARK-59148) Skip test_nested_dataframes in the Spark Connect compatibility test Yang Jie (Jira)
2026/09/01 [jira] [Resolved] (SPARK-58775) [UI] Filtering SQL metrics causes rows with total/min/med/max stats to be blank Jira
2026/09/01 [jira] [Commented] (SPARK-58775) [UI] Filtering SQL metrics causes rows with total/min/med/max stats to be blank Jira
2026/09/01 [jira] [Assigned] (SPARK-59079) Use Option.when in LiveEntity Jira
2026/09/01 [jira] [Resolved] (SPARK-59079) Use Option.when in LiveEntity Jira
2026/09/01 [jira] [Created] (SPARK-59147) Nested SELECT * EXCEPT turns NULL structs into non-NULL structs Joel Robin (Jira)
2026/09/01 [jira] [Created] (SPARK-59146) [SQL] Pipe SET do not retain qualified access to affected source columns Joel Robin (Jira)
2026/09/01 [jira] [Updated] (SPARK-59141) Columnar UnionExec ignores outputPartitioning and returns wrong results ASF GitHub Bot (Jira)
2026/09/01 [jira] [Updated] (SPARK-59141) Columnar UnionExec ignores outputPartitioning and returns wrong results Yang Jie (Jira)
2026/09/01 [jira] [Assigned] (SPARK-59057) Make KeyedPartitioning's narrowing flag mean actual key collapse Peter Toth (Jira)
2026/09/01 [jira] [Assigned] (SPARK-58847) Collation-aware hash aggregation Jira
2026/09/01 [jira] [Resolved] (SPARK-58847) Collation-aware hash aggregation Jira
2026/09/01 [jira] [Updated] (SPARK-59145) Import gateway binary crate into Spark Connect Gateway ASF GitHub Bot (Jira)
2026/09/01 [jira] [Created] (SPARK-59145) Import gateway binary crate into Spark Connect Gateway L. C. Hsieh (Jira)
2026/09/01 [jira] [Resolved] (SPARK-59103) Import scg-proxy crate into Spark Connect Gateway L. C. Hsieh (Jira)
2026/08/31 [jira] [Updated] (SPARK-59144) Plain SQL/JSON constructor function calls bypass routine resolution Ganesha S (Jira)
2026/08/31 [jira] [Resolved] (SPARK-59143) Close remaining PySpark 4.2.0 Spark Connect public-API parity gaps in the Rust drop-in (connect submodule import paths and minor signatures) Hyukjin Kwon (Jira)
2026/08/31 [jira] [Assigned] (SPARK-59143) Close remaining PySpark 4.2.0 Spark Connect public-API parity gaps in the Rust drop-in (connect submodule import paths and minor signatures) Hyukjin Kwon (Jira)
2026/08/31 [jira] [Updated] (SPARK-59142) Verify streamId when matching stream fetch responses to callbacks in TransportResponseHandler ZequnLin (Jira)
2026/08/31 [jira] [Created] (SPARK-59144) Plain SQL/JSON constructor function calls bypass routine resolution Ganesha S (Jira)
2026/08/31 [jira] [Updated] (SPARK-59014) DataSourceV2 refresh validation misses a data column that hides a captured metadata column ASF GitHub Bot (Jira)
2026/08/31 [jira] [Updated] (SPARK-59142) Verify streamId when matching stream fetch responses to callbacks in TransportResponseHandler ASF GitHub Bot (Jira)
2026/08/31 [jira] [Updated] (SPARK-59143) Close remaining PySpark 4.2.0 Spark Connect public-API parity gaps in the Rust drop-in (connect submodule import paths and minor signatures) ASF GitHub Bot (Jira)
2026/08/31 [jira] [Created] (SPARK-59143) Close remaining PySpark 4.2.0 Spark Connect public-API parity gaps in the Rust drop-in (connect submodule import paths and minor signatures) Hyukjin Kwon (Jira)
2026/08/31 [jira] [Created] (SPARK-59142) Verify streamId when matching stream fetch responses to callbacks in TransportResponseHandler ZequnLin (Jira)
2026/08/31 [jira] [Created] (SPARK-59141) Columnar UnionExec ignores outputPartitioning and returns wrong results Yang Jie (Jira)
2026/08/31 [jira] [Assigned] (SPARK-59140) Close PySpark 4.2.0 public-API parity gaps in the Rust drop-in client Hyukjin Kwon (Jira)
2026/08/31 [jira] [Resolved] (SPARK-57205) Declare SCAN_MERGING on the built-in file sources Yang Jie (Jira)
2026/08/31 [jira] [Assigned] (SPARK-57205) Declare SCAN_MERGING on the built-in file sources Yang Jie (Jira)
2026/08/31 [jira] [Resolved] (SPARK-59140) Close PySpark 4.2.0 public-API parity gaps in the Rust drop-in client Hyukjin Kwon (Jira)
2026/08/31 [jira] [Updated] (SPARK-59140) Close PySpark 4.2.0 public-API parity gaps in the Rust drop-in client ASF GitHub Bot (Jira)
2026/08/31 [jira] [Resolved] (SPARK-59133) Add tests for pa.Table.from_pandas Ruifeng Zheng (Jira)
2026/08/31 [jira] [Assigned] (SPARK-59133) Add tests for pa.Table.from_pandas Ruifeng Zheng (Jira)
2026/08/31 [jira] [Resolved] (SPARK-59040) Assign a name to the error condition _LEGACY_ERROR_TEMP_1166,1167 Yang Jie (Jira)
2026/08/31 [jira] [Assigned] (SPARK-59040) Assign a name to the error condition _LEGACY_ERROR_TEMP_1166,1167 Yang Jie (Jira)
2026/08/31 [jira] [Assigned] (SPARK-59128) Upgrade mariadb-java-client from 3.5.7 to 3.5.10 Yang Jie (Jira)
2026/08/31 [jira] [Resolved] (SPARK-59128) Upgrade mariadb-java-client from 3.5.7 to 3.5.10 Yang Jie (Jira)
2026/08/31 [jira] [Assigned] (SPARK-58730) Support the ANSI SQL/JSON JSON_ARRAY constructor function Wenchen Fan (Jira)
2026/08/31 [jira] [Resolved] (SPARK-58730) Support the ANSI SQL/JSON JSON_ARRAY constructor function Wenchen Fan (Jira)
2026/08/31 [jira] [Created] (SPARK-59140) Close PySpark 4.2.0 public-API parity gaps in the Rust drop-in client Hyukjin Kwon (Jira)
2026/08/31 [jira] [Assigned] (SPARK-59134) Use native Spark function for NumPy frexp Ruifeng Zheng (Jira)
2026/08/31 [jira] [Resolved] (SPARK-59134) Use native Spark function for NumPy frexp Ruifeng Zheng (Jira)
2026/08/31 [jira] [Resolved] (SPARK-59093) Fix incorrect results and arithmetic errors in floor division Ruifeng Zheng (Jira)
2026/08/31 [jira] [Assigned] (SPARK-59093) Fix incorrect results and arithmetic errors in floor division Ruifeng Zheng (Jira)
2026/08/31 [jira] [Resolved] (SPARK-59048) Optimize ProbabilisticClassificationModel by reducing closure size and accelerating transform Ruifeng Zheng (Jira)
2026/08/31 [jira] [Assigned] (SPARK-59048) Optimize ProbabilisticClassificationModel by reducing closure size and accelerating transform Ruifeng Zheng (Jira)
2026/08/31 [jira] [Updated] (SPARK-59138) Preserve reliably-stored shuffle map outputs on executor loss ASF GitHub Bot (Jira)
2026/08/31 [jira] [Updated] (SPARK-59014) DataSourceV2 refresh validation misses a data column that hides a captured metadata column Yan Yan (Jira)
2026/08/31 [jira] [Resolved] (SPARK-59139) Rust Spark Connect client cannot connect to a TLS-secured server that requires token authentication Hyukjin Kwon (Jira)
2026/08/31 [jira] [Updated] (SPARK-59139) Rust Spark Connect client cannot connect to a TLS-secured server that requires token authentication ASF GitHub Bot (Jira)
2026/08/31 [jira] [Assigned] (SPARK-59139) Rust Spark Connect client cannot connect to a TLS-secured server that requires token authentication Hyukjin Kwon (Jira)
2026/08/31 [jira] [Created] (SPARK-59139) Rust Spark Connect client cannot connect to a TLS-secured server that requires token authentication Hyukjin Kwon (Jira)
2026/08/31 [jira] [Created] (SPARK-59138) Preserve reliably-stored shuffle map outputs on executor loss Venkata krishnan Sowrirajan (Jira)
2026/08/31 [jira] [Updated] (SPARK-52832) Fix oracle dialect identifier quoting Holden Karau (Jira)
2026/08/31 [jira] [Commented] (SPARK-44462) Fix the session passed to foreachBatch. Jungtaek Lim (Jira)
2026/08/31 [jira] [Updated] (SPARK-44462) Fix the session passed to foreachBatch. Jungtaek Lim (Jira)
2026/08/31 [jira] [Updated] (SPARK-59136) Make the active Spark Connect client identifiable (pyspark-client-rust vs the reference client) Hyukjin Kwon (Jira)
2026/08/31 [jira] [Updated] (SPARK-58626) Transpilation: avoid duplication of input parameters for evaluation Holden Karau (Jira)
2026/08/31 [jira] [Assigned] (SPARK-58626) Transpilation: avoid duplication of input parameters for evaluation Holden Karau (Jira)
2026/08/31 [jira] [Resolved] (SPARK-59137) Update offline tests for the reference __module__ on catalog classes and PythonEvalType (follow-up of SPARK-59117) Hyukjin Kwon (Jira)
2026/08/31 [jira] [Assigned] (SPARK-59137) Update offline tests for the reference __module__ on catalog classes and PythonEvalType (follow-up of SPARK-59117) Hyukjin Kwon (Jira)
2026/08/31 [jira] [Updated] (SPARK-59137) Update offline tests for the reference __module__ on catalog classes and PythonEvalType (follow-up of SPARK-59117) ASF GitHub Bot (Jira)
2026/08/31 [jira] [Created] (SPARK-59137) Update offline tests for the reference __module__ on catalog classes and PythonEvalType (follow-up of SPARK-59117) Hyukjin Kwon (Jira)
2026/08/31 [jira] [Updated] (SPARK-59136) Make the active Spark Connect client identifiable (pyspark-client-rust vs the reference client) ASF GitHub Bot (Jira)
2026/08/31 [jira] [Created] (SPARK-59136) Make the active Spark Connect client identifiable (pyspark-client-rust vs the reference client) Hyukjin Kwon (Jira)
2026/08/31 [jira] [Created] (SPARK-59128) Upgrade mariadb-java-client from 3.5.7 to 3.5.10 Yang Jie (Jira)
2026/08/31 [jira] [Updated] (SPARK-59127) AQE enabled: cached count() and collect() results disagree Yuan Yusi (Jira)
2026/08/31 [jira] [Updated] (SPARK-59133) Add tests for pa.Table.from_pandas ASF GitHub Bot (Jira)
2026/08/31 [jira] [Resolved] (SPARK-59094) Ignore late successes from invalidated barrier shuffle attempts Chao Sun (Jira)
2026/08/31 [jira] [Created] (SPARK-59135) Spark Connect command streams fail on valid non-dictionary ExecutePlan responses Haoyan Geng (Jira)
2026/08/31 [jira] [Created] (SPARK-59132) FileType: A new data type to simplify handling of unstructured data in Spark Burak Yavuz (Jira)
2026/08/31 [jira] [Updated] (SPARK-59133) Add tests for pa.Table.from_pandas Haotian Sun (Jira)
2026/08/31 [jira] [Updated] (SPARK-59134) Use native Spark function for NumPy frexp ASF GitHub Bot (Jira)
2026/08/31 [jira] [Created] (SPARK-59134) Use native Spark function for NumPy frexp Haotian Sun (Jira)
2026/08/31 [jira] [Created] (SPARK-59133) Add tests for pa.Table.from_pandas Haotian Sun (Jira)
2026/08/31 [jira] [Assigned] (SPARK-59094) Ignore late successes from invalidated barrier shuffle attempts Chao Sun (Jira)
2026/08/31 [jira] [Created] (SPARK-59131) Add a fetch-failure threshold before marking an executor failed Ganesha S (Jira)
2026/08/31 [jira] [Created] (SPARK-59130) Add variant_pick expression Bojana Zecevic (Jira)
2026/08/31 [jira] [Updated] (SPARK-59120) Fix ClassCastException in a storage-partitioned join whose partition keys were reduced Peter Toth (Jira)
2026/08/31 [jira] [Commented] (SPARK-48423) Unable to write MLPipeline to blob storage using .option attribute Jira
2026/08/31 [jira] [Updated] (SPARK-59129) Assign a name to the error condition _LEGACY_ERROR_TEMP_2033 ASF GitHub Bot (Jira)
2026/08/31 [jira] [Created] (SPARK-59129) Assign a name to the error condition _LEGACY_ERROR_TEMP_2033 Dieter Kling (Jira)
2026/08/31 [jira] [Created] (SPARK-59127) Incorrect count() result on cached sampled DataFrame when AQE is enabled Incorrect count() result on cached sampled DataFrame when AQE is enabled Yuan Yusi (Jira)
2026/08/31 [jira] [Resolved] (SPARK-59120) Fix ClassCastException in a storage-partitioned join whose partition keys were reduced Peter Toth (Jira)
2026/08/31 [jira] [Updated] (SPARK-59009) InMemoryRelation.newInstance() does not remap outputOrdering, causing NoSuchElementException during canonicalization Peter Toth (Jira)
2026/08/31 [jira] [Resolved] (SPARK-59019) Excluding RewriteWithExpression causes an INTERNAL_ERROR for a legal BETWEEN query Peter Toth (Jira)
2026/08/31 [jira] [Updated] (SPARK-59128) Upgrade mariadb-java-client from 3.5.7 to 3.5.10 ASF GitHub Bot (Jira)
2026/08/31 [jira] [Assigned] (SPARK-59120) Fix ClassCastException in a storage-partitioned join whose partition keys were reduced Peter Toth (Jira)
2026/08/31 [jira] [Updated] (SPARK-54918) Array operations do not normalize -0.0 to 0.0 Peter Toth (Jira)
2026/08/31 [jira] [Updated] (SPARK-58837) Fine-grained Spark Connect Python loggers ASF GitHub Bot (Jira)
2026/08/31 [jira] [Updated] (SPARK-59126) AQE adaptive join conversion drops a final ORDER BY Yuan Yusi (Jira)
2026/08/31 [jira] [Assigned] (SPARK-59019) Excluding RewriteWithExpression causes an INTERNAL_ERROR for a legal BETWEEN query Peter Toth (Jira)
2026/08/31 [jira] [Updated] (SPARK-59009) InMemoryRelation.newInstance() does not remap outputOrdering, causing NoSuchElementException during canonicalization Peter Toth (Jira)
2026/08/31 [jira] [Created] (SPARK-59126) AQE adaptive join conversion drops a final ORDER BY Yuan Yusi (Jira)
2026/08/30 [jira] [Updated] (SPARK-59125) Spark Connect sends cleanup RPC after the session is released ASF GitHub Bot (Jira)
2026/08/30 [jira] [Updated] (SPARK-59125) Spark Connect sends cleanup RPC after the session is released Kaicheng Zhou (Jira)
2026/08/30 [jira] [Created] (SPARK-59125) Spark Connect sends cleanup RPC after the session is released Kaicheng Zhou (Jira)