issues

Messages by Date

2026/04/01 [jira] [Updated] (SPARK-56319) ShuffleExternalSorter should reuse write buffer ASF GitHub Bot (Jira)
2026/04/01 [jira] [Created] (SPARK-56319) ShuffleExternalSorter should reuse write buffer Xianming Lei (Jira)
2026/04/01 [jira] [Updated] (SPARK-56317) GetJsonObjectEvaluator should reuse output buffer ASF GitHub Bot (Jira)
2026/04/01 [jira] [Updated] (SPARK-56318) Upgrade jackson-core to fix GHSA-72hv-8253-57qq ASF GitHub Bot (Jira)
2026/04/01 [jira] [Created] (SPARK-56318) Upgrade jackson-core to fix GHSA-72hv-8253-57qq Manu Zhang (Jira)
2026/04/01 [jira] [Created] (SPARK-56317) GetJsonObjectEvaluator should reuse output buffer Xianming Lei (Jira)
2026/03/31 [jira] [Updated] (SPARK-56158) [CORE] Add ActiveProcessorCount JVM option support for local mode ASF GitHub Bot (Jira)
2026/03/31 [jira] [Updated] (SPARK-54055) Spark Connect sessions leak pyspark UDF daemon processes and threads ASF GitHub Bot (Jira)
2026/03/31 [jira] [Created] (SPARK-56316) Support static partition overwrite for V2 file tables (SupportsOverwriteV2) Yang Jie (Jira)
2026/03/31 [jira] [Updated] (SPARK-56315) Pre-aggregate before Expand to reduce data amplification for multiple COUNT(DISTINCT) ASF GitHub Bot (Jira)
2026/03/31 [jira] [Created] (SPARK-56315) Pre-aggregate before Expand to reduce data amplification for multiple COUNT(DISTINCT) Yang Jie (Jira)
2026/03/31 [jira] [Updated] (SPARK-56178) MSCK REPAIR TABLE for V2 file tables ASF GitHub Bot (Jira)
2026/03/31 [jira] [Updated] (SPARK-56177) V2 file bucketing write support ASF GitHub Bot (Jira)
2026/03/31 [jira] [Assigned] (SPARK-56313) Add type hint for rddsample.py Ruifeng Zheng (Jira)
2026/03/31 [jira] [Resolved] (SPARK-56313) Add type hint for rddsample.py Ruifeng Zheng (Jira)
2026/03/31 [jira] [Resolved] (SPARK-56271) Fix type hint for _globals.py Ruifeng Zheng (Jira)
2026/03/31 [jira] [Assigned] (SPARK-56271) Fix type hint for _globals.py Ruifeng Zheng (Jira)
2026/03/31 [jira] [Updated] (SPARK-56314) Avoid uncessary RDD->DataFrame conversion in `SQLTestData` ASF GitHub Bot (Jira)
2026/03/31 [jira] [Created] (SPARK-56314) Avoid uncessary RDD->DataFrame conversion in `SQLTestData` Ruifeng Zheng (Jira)
2026/03/31 [jira] [Resolved] (SPARK-56311) Add type hint for daemon.py Ruifeng Zheng (Jira)
2026/03/31 [jira] [Assigned] (SPARK-56311) Add type hint for daemon.py Ruifeng Zheng (Jira)
2026/03/31 [jira] [Updated] (SPARK-56189) Refactor SQL_WINDOW_AGG_ARROW_UDF ASF GitHub Bot (Jira)
2026/03/31 [jira] [Updated] (SPARK-56313) Add type hint for rddsample.py ASF GitHub Bot (Jira)
2026/03/31 [jira] [Created] (SPARK-56313) Add type hint for rddsample.py Tian Gao (Jira)
2026/03/31 [jira] [Updated] (SPARK-56312) Refactor SQL_COGROUPED_MAP_ARROW_UDF to use ArrowStreamSerializer Yicong Huang (Jira)
2026/03/31 [jira] [Updated] (SPARK-56312) Add ASV micro-benchmarks for SQL_COGROUPED_MAP_ARROW_UDF Yicong Huang (Jira)
2026/03/31 [jira] [Created] (SPARK-56312) Refactor SQL_WINDOW_AGG_ARROW_UDF to use ArrowStreamSerializer Yicong Huang (Jira)
2026/03/31 [jira] [Updated] (SPARK-56311) Add type hint for daemon.py ASF GitHub Bot (Jira)
2026/03/31 [jira] [Created] (SPARK-56311) Add type hint for daemon.py Tian Gao (Jira)
2026/03/31 [jira] [Resolved] (SPARK-56274) Simplify `SparkClusterSubmissionWorker.getResourceSpec` Dongjoon Hyun (Jira)
2026/03/31 [jira] [Created] (SPARK-56309) Upgrade `log4j` to 2.25.4 Dongjoon Hyun (Jira)
2026/03/31 [jira] [Updated] (SPARK-56274) Simplify `SparkClusterSubmissionWorker.getResourceSpec` Dongjoon Hyun (Jira)
2026/03/31 [jira] [Assigned] (SPARK-56307) Upgrade `log4j` to 2.25.4 Dongjoon Hyun (Jira)
2026/03/31 [jira] [Assigned] (SPARK-49543) Support v2 SHOW COLLATIONS Dongjoon Hyun (Jira)
2026/03/31 [jira] [Resolved] (SPARK-49543) Support v2 SHOW COLLATIONS Dongjoon Hyun (Jira)
2026/03/31 [jira] [Resolved] (SPARK-56307) Upgrade `log4j` to 2.25.4 Dongjoon Hyun (Jira)
2026/03/31 [jira] [Updated] (SPARK-56310) Handle pandas 3 string dtype in DataFrame.toPandas ASF GitHub Bot (Jira)
2026/03/31 [jira] [Created] (SPARK-56310) Handle pandas 3 string dtype in DataFrame.toPandas Takuya Ueshin (Jira)
2026/03/31 [jira] [Resolved] (SPARK-56309) Upgrade `log4j` to 2.25.4 Dongjoon Hyun (Jira)
2026/03/31 [jira] [Assigned] (SPARK-56309) Upgrade `log4j` to 2.25.4 Dongjoon Hyun (Jira)
2026/03/31 [jira] [Updated] (SPARK-56309) Upgrade `log4j` to 2.25.4 ASF GitHub Bot (Jira)
2026/03/31 [jira] [Updated] (SPARK-55715) Keep `outputOrdering` when grouping storage partitions ASF GitHub Bot (Jira)
2026/03/31 [jira] [Assigned] (SPARK-56274) Fix redundant SparkConf set() call in SparkClusterSubmissionWorker Dongjoon Hyun (Jira)
2026/03/31 [jira] [Assigned] (SPARK-56308) Remove invalid `log4j2.contextSelector` from test `log4j2.properties` Dongjoon Hyun (Jira)
2026/03/31 [jira] [Resolved] (SPARK-56308) Remove invalid `log4j2.contextSelector` from test `log4j2.properties` Dongjoon Hyun (Jira)
2026/03/31 [jira] [Updated] (SPARK-56306) Fix collation-aware PIVOT in Spark ASF GitHub Bot (Jira)
2026/03/31 [jira] [Updated] (SPARK-55109) RaiseError(xyz).sql is broken in 4.0 ASF GitHub Bot (Jira)
2026/03/31 [jira] [Updated] (SPARK-56308) Remove invalid `log4j2.contextSelector` from test `log4j2.properties` ASF GitHub Bot (Jira)
2026/03/31 [jira] [Created] (SPARK-56308) Remove invalid `log4j2.contextSelector` from test `log4j2.properties` Dongjoon Hyun (Jira)
2026/03/31 [jira] [Assigned] (SPARK-51988) Do file checksum verification on read for RocksDB zip file which is currently being skipped Anish Shrigondekar (Jira)
2026/03/31 [jira] [Updated] (SPARK-56307) Upgrade `log4j` to 2.25.4 ASF GitHub Bot (Jira)
2026/03/31 [jira] [Created] (SPARK-56307) Upgrade `log4j` to 2.25.4 Dongjoon Hyun (Jira)
2026/03/31 [jira] [Created] (SPARK-56306) Fix collation-aware PIVOT in Spark Akash Nayar (Jira)
2026/03/31 [jira] [Resolved] (SPARK-51988) Do file checksum verification on read for RocksDB zip file which is currently being skipped Anish Shrigondekar (Jira)
2026/03/31 [jira] [Created] (SPARK-56305) Fix collation-aware PIVOT in Spark Stefan Kandic (Jira)
2026/03/31 [jira] [Assigned] (SPARK-56235) TaskSetManager.executorLost() O(N) scan over taskInfos causes DriverEndpoint thread stall with large task counts Chao Sun (Jira)
2026/03/31 [jira] [Resolved] (SPARK-56235) TaskSetManager.executorLost() O(N) scan over taskInfos causes DriverEndpoint thread stall with large task counts Chao Sun (Jira)
2026/03/31 [jira] [Resolved] (SPARK-56241) Derive outputOrdering from KeyedPartitioning Peter Toth (Jira)
2026/03/31 [jira] [Assigned] (SPARK-56241) Derive outputOrdering from KeyedPartitioning Peter Toth (Jira)
2026/03/31 [jira] [Assigned] (SPARK-56074) Improve AGENTS.md with inline build/test commands, PR workflow, and dev notes Wenchen Fan (Jira)
2026/03/31 [jira] [Resolved] (SPARK-56074) Improve AGENTS.md with inline build/test commands, PR workflow, and dev notes Wenchen Fan (Jira)
2026/03/31 [jira] [Commented] (SPARK-56287) Improve Spark History Server Scalability Kousuke Saruta (Jira)
2026/03/31 [jira] [Assigned] (SPARK-56137) Restore regression tests for SQL tab client-side DataTables migration Dongjoon Hyun (Jira)
2026/03/31 [jira] [Updated] (SPARK-56137) Add regression tests for SQL tab DataTables migration Dongjoon Hyun (Jira)
2026/03/31 [jira] [Resolved] (SPARK-56137) Restore regression tests for SQL tab client-side DataTables migration Dongjoon Hyun (Jira)
2026/03/31 [jira] [Updated] (SPARK-56279) Enable zero-copy sendfile for FileRegion in native Netty transports Dongjoon Hyun (Jira)
2026/03/31 [jira] [Updated] (SPARK-56279) Enable zero-copy sendfile for FileRegion in native Netty transports Dongjoon Hyun (Jira)
2026/03/31 [jira] [Updated] (SPARK-56279) Enable native sendfile for file-backed shuffle Dongjoon Hyun (Jira)
2026/03/31 [jira] [Resolved] (SPARK-56303) Add Java-friendly factory methods to `JavaMainAppResource` Dongjoon Hyun (Jira)
2026/03/31 [jira] [Assigned] (SPARK-56303) Add Java-friendly factory methods to `JavaMainAppResource` Dongjoon Hyun (Jira)
2026/03/31 [jira] [Updated] (SPARK-56303) Add Java-friendly factory methods to `JavaMainAppResource` Dongjoon Hyun (Jira)
2026/03/31 [jira] [Updated] (SPARK-56303) Add Java-friendly factory methods to `JavaMainAppResource` Dongjoon Hyun (Jira)
2026/03/31 [jira] [Updated] (SPARK-56303) Use `SparkLauncher.NO_RESOURCE` instead of `Option.empty()` in `SparkAppSubmissionWorker` Dongjoon Hyun (Jira)
2026/03/31 [jira] [Created] (SPARK-56304) V2 ifPartitionNotExists support for file table INSERT INTO Yang Jie (Jira)
2026/03/31 [jira] [Commented] (SPARK-35416) Support PersistentVolumeClaim Reuse Romain Manni-Bucau (Jira)
2026/03/31 [jira] [Updated] (SPARK-56233) V2 streaming write for FileTable Yang Jie (Jira)
2026/03/31 [jira] [Updated] (SPARK-56232) V2 streaming read for FileTable Yang Jie (Jira)
2026/03/31 [jira] [Updated] (SPARK-56231) Bucket pruning and bucket join optimization for V2 file read path Yang Jie (Jira)
2026/03/31 [jira] [Updated] (SPARK-56230) DEFAULT column value support for V2 write commands Yang Jie (Jira)
2026/03/31 [jira] [Updated] (SPARK-56303) Use `SparkLauncher.NO_RESOURCE` instead of `Option.empty()` in `SparkAppSubmissionWorker` ASF GitHub Bot (Jira)
2026/03/31 [jira] [Resolved] (SPARK-56300) Add Java-friendly factory method to `KubernetesDriverSpec` Dongjoon Hyun (Jira)
2026/03/31 [jira] [Assigned] (SPARK-56300) Add Java-friendly factory method to `KubernetesDriverSpec` Dongjoon Hyun (Jira)
2026/03/31 [jira] [Resolved] (SPARK-56301) Fix typos in error-conditions.json Dongjoon Hyun (Jira)
2026/03/31 [jira] [Updated] (SPARK-56137) Restore regression tests for SQL tab client-side DataTables migration ASF GitHub Bot (Jira)
2026/03/31 [jira] [Created] (SPARK-56303) Use `SparkLauncher.NO_RESOURCE` instead of `Option.empty()` in `SparkAppSubmissionWorker` Dongjoon Hyun (Jira)
2026/03/31 [jira] [Assigned] (SPARK-56301) Fix typos in error-conditions.json Dongjoon Hyun (Jira)
2026/03/31 [jira] [Assigned] (SPARK-56155) collect_list sql() includes RESPECT NULLS Wenchen Fan (Jira)
2026/03/30 [jira] [Created] (SPARK-56302) Free memories as soon as possible to reduce memory pressure handling large task results Tengfei Huang (Jira)
2026/03/30 [jira] [Updated] (SPARK-56302) Free memories as soon as possible to reduce memory pressure handling large task results ASF GitHub Bot (Jira)
2026/03/30 [jira] [Resolved] (SPARK-56155) collect_list sql() includes RESPECT NULLS Wenchen Fan (Jira)
2026/03/30 [jira] [Resolved] (SPARK-53209) Add ActiveProcessorCount JVM option to YARN executor and AM Cheng Pan (Jira)
2026/03/30 [jira] [Assigned] (SPARK-53209) Add ActiveProcessorCount JVM option to YARN executor and AM Cheng Pan (Jira)
2026/03/30 [jira] [Assigned] (SPARK-56120) Benchmark SQL_WINDOW_AGG_ARROW_UDF Ruifeng Zheng (Jira)
2026/03/30 [jira] [Resolved] (SPARK-56120) Benchmark SQL_WINDOW_AGG_ARROW_UDF Ruifeng Zheng (Jira)
2026/03/30 [jira] [Updated] (SPARK-56176) V2-native ANALYZE TABLE and ANALYZE COLUMN for file tables ASF GitHub Bot (Jira)
2026/03/30 [jira] [Assigned] (SPARK-56272) Add type hint for install.py Ruifeng Zheng (Jira)
2026/03/30 [jira] [Resolved] (SPARK-56272) Add type hint for install.py Ruifeng Zheng (Jira)
2026/03/30 [jira] [Resolved] (SPARK-49793) Enable PredictBatchUDFTests.test_caching for NumPy 2 Ruifeng Zheng (Jira)
2026/03/30 [jira] [Updated] (SPARK-56301) Fix typos in error-conditions.json ASF GitHub Bot (Jira)
2026/03/30 [jira] [Created] (SPARK-56301) Fix typos in error-conditions.json Ruifeng Zheng (Jira)
2026/03/30 [jira] [Assigned] (SPARK-56298) Enable `spark.master.rest.virtualThread.enabled` by default Dongjoon Hyun (Jira)
2026/03/30 [jira] [Resolved] (SPARK-56298) Enable `spark.master.rest.virtualThread.enabled` by default Dongjoon Hyun (Jira)
2026/03/30 [jira] [Updated] (SPARK-56300) Add Java-friendly factory method to `KubernetesDriverSpec` ASF GitHub Bot (Jira)
2026/03/30 [jira] [Created] (SPARK-56300) Add Java-friendly factory method to `KubernetesDriverSpec` Dongjoon Hyun (Jira)
2026/03/30 [jira] [Assigned] (SPARK-56299) Fix `Dockerfile` for `jdeps` to use 21 Dongjoon Hyun (Jira)
2026/03/30 [jira] [Resolved] (SPARK-56299) Fix `Dockerfile` for `jdeps` to use 21 Dongjoon Hyun (Jira)
2026/03/30 [jira] [Updated] (SPARK-56299) Fix `Dockerfile` for `jdeps` to use 21 ASF GitHub Bot (Jira)
2026/03/30 [jira] [Created] (SPARK-56299) Fix `Dockerfile` for `jdeps` to use 21 Dongjoon Hyun (Jira)
2026/03/30 [jira] [Assigned] (SPARK-56297) Use Virtual Threads (JEP 444) for unbounded reconciliation thread pool Dongjoon Hyun (Jira)
2026/03/30 [jira] [Resolved] (SPARK-56297) Use Virtual Threads (JEP 444) for unbounded reconciliation thread pool Dongjoon Hyun (Jira)
2026/03/30 [jira] [Updated] (SPARK-49793) Enable PredictBatchUDFTests.test_caching for NumPy 2 ASF GitHub Bot (Jira)
2026/03/30 [jira] [Updated] (SPARK-56298) Enable `spark.master.rest.virtualThread.enabled` by default ASF GitHub Bot (Jira)
2026/03/30 [jira] [Created] (SPARK-56298) Enable `spark.master.rest.virtualThread.enabled` by default Dongjoon Hyun (Jira)
2026/03/30 [jira] [Updated] (SPARK-56297) Use Virtual Threads (JEP 444) for unbounded reconciliation thread pool ASF GitHub Bot (Jira)
2026/03/30 [jira] [Created] (SPARK-56297) Use Virtual Threads (JEP 444) for unbounded reconciliation thread pool Dongjoon Hyun (Jira)
2026/03/30 [jira] [Commented] (SPARK-56240) Add NettyTransportBenchmark for Netty transport layer performance evaluation Dongjoon Hyun (Jira)
2026/03/30 [jira] [Updated] (SPARK-56240) Add NettyTransportBenchmark for Netty transport layer performance evaluation Dongjoon Hyun (Jira)
2026/03/30 [jira] [Updated] (SPARK-56296) Pivot createTableLike to pass full TableInfo including schema, partitioning, constraints, and owner ASF GitHub Bot (Jira)
2026/03/30 [jira] [Assigned] (SPARK-56296) Pivot createTableLike to pass full TableInfo including schema, partitioning, constraints, and owner L. C. Hsieh (Jira)
2026/03/30 [jira] [Created] (SPARK-56296) Pivot createTableLike to pass full TableInfo including schema, partitioning, constraints, and owner L. C. Hsieh (Jira)
2026/03/30 [jira] [Updated] (SPARK-56295) Include java error classes on Python side ASF GitHub Bot (Jira)
2026/03/30 [jira] [Created] (SPARK-56295) Include java error classes on Python side Tian Gao (Jira)
2026/03/30 [jira] [Commented] (SPARK-56248) Python TransformWithState stateful processor serialization improvements Jason Teoh (Jira)
2026/03/30 [jira] [Updated] (SPARK-56248) Python TransformWithState stateful processor serialization: remove unnecessary row construction Jason Teoh (Jira)
2026/03/30 [jira] [Comment Edited] (SPARK-56248) Python TransformWithState stateful processor serialization improvements Jason Teoh (Jira)
2026/03/30 [jira] [Assigned] (SPARK-56291) Make BaseStateSummary a sealed interface Dongjoon Hyun (Jira)
2026/03/30 [jira] [Resolved] (SPARK-56294) Apply exhaustive `switch` for `ResourceRetainPolicy` and `ClusterStateSummary` Dongjoon Hyun (Jira)
2026/03/30 [jira] [Assigned] (SPARK-56294) Apply exhaustive `switch` for `ResourceRetainPolicy` and `ClusterStateSummary` Dongjoon Hyun (Jira)
2026/03/30 [jira] [Updated] (SPARK-49543) Support v2 SHOW COLLATIONS ASF GitHub Bot (Jira)
2026/03/30 [jira] [Created] (SPARK-56294) Apply exhaustive `switch` for `ResourceRetainPolicy` and `ClusterStateSummary` Dongjoon Hyun (Jira)
2026/03/30 [jira] [Created] (SPARK-56292) Make `(App|Cluster)ReconcileStep` abstract classes `sealed` Dongjoon Hyun (Jira)
2026/03/30 [jira] [Updated] (SPARK-56294) Apply exhaustive `switch` for `ResourceRetainPolicy` and `ClusterStateSummary` ASF GitHub Bot (Jira)
2026/03/30 [jira] [Assigned] (SPARK-56293) Make `BaseAppDriverObserver` abstract class `sealed` Dongjoon Hyun (Jira)
2026/03/30 [jira] [Resolved] (SPARK-56293) Make `BaseAppDriverObserver` abstract class `sealed` Dongjoon Hyun (Jira)
2026/03/30 [jira] [Updated] (SPARK-56293) Make `BaseAppDriverObserver` abstract class `sealed` ASF GitHub Bot (Jira)
2026/03/30 [jira] [Updated] (SPARK-56291) Make BaseStateSummary a sealed interface ASF GitHub Bot (Jira)
2026/03/30 [jira] [Assigned] (SPARK-56292) Make `(App|Cluster)ReconcileStep` abstract classes `sealed` Dongjoon Hyun (Jira)
2026/03/30 [jira] [Resolved] (SPARK-56292) Make `(App|Cluster)ReconcileStep` abstract classes `sealed` Dongjoon Hyun (Jira)
2026/03/30 [jira] [Created] (SPARK-56293) Make `BaseAppDriverObserver` abstract class `sealed` Dongjoon Hyun (Jira)
2026/03/30 [jira] [Updated] (SPARK-56292) Make `(App|Cluster)ReconcileStep` abstract classes `sealed` ASF GitHub Bot (Jira)
2026/03/30 [jira] [Created] (SPARK-56291) Make BaseStateSummary a sealed interface Dongjoon Hyun (Jira)
2026/03/30 [jira] [Resolved] (SPARK-56291) Make BaseStateSummary a sealed interface Dongjoon Hyun (Jira)
2026/03/30 [jira] [Resolved] (SPARK-56290) Rename `build-macos-26-swift(62 -> 63)` in CI Dongjoon Hyun (Jira)
2026/03/30 [jira] [Assigned] (SPARK-56290) Rename `build-macos-26-swift(62 -> 63)` in CI Dongjoon Hyun (Jira)
2026/03/30 [jira] [Updated] (SPARK-56290) Rename `build-macos-26-swift(62 -> 63)` in CI ASF GitHub Bot (Jira)
2026/03/30 [jira] [Created] (SPARK-56290) Rename `build-macos-26-swift(62 -> 63)` in CI Dongjoon Hyun (Jira)
2026/03/30 [jira] [Assigned] (SPARK-56289) Upgrade minimum Java runtime version to 21 Dongjoon Hyun (Jira)
2026/03/30 [jira] [Resolved] (SPARK-56289) Upgrade minimum Java runtime version to 21 Dongjoon Hyun (Jira)
2026/03/30 [jira] [Assigned] (SPARK-56288) Upgrade `gRPC Swift NIO Transport` to 2.6.2 Dongjoon Hyun (Jira)
2026/03/30 [jira] [Assigned] (SPARK-56204) Strip `Alias` wrappers from inline table row expressions in parser Wenchen Fan (Jira)
2026/03/30 [jira] [Resolved] (SPARK-56288) Upgrade `gRPC Swift NIO Transport` to 2.6.2 Dongjoon Hyun (Jira)
2026/03/30 [jira] [Resolved] (SPARK-56204) Strip `Alias` wrappers from inline table row expressions in parser Wenchen Fan (Jira)
2026/03/30 [jira] [Updated] (SPARK-56289) Upgrade minimum Java runtime version to 21 ASF GitHub Bot (Jira)
2026/03/30 [jira] [Created] (SPARK-56289) Upgrade minimum Java runtime version to 21 Dongjoon Hyun (Jira)
2026/03/30 [jira] [Updated] (SPARK-56288) Upgrade `gRPC Swift NIO Transport` to 2.6.2 ASF GitHub Bot (Jira)
2026/03/30 [jira] [Created] (SPARK-56288) Upgrade `gRPC Swift NIO Transport` to 2.6.2 Dongjoon Hyun (Jira)
2026/03/30 [jira] [Updated] (SPARK-55793) Support multiple log directories in SHS Dongjoon Hyun (Jira)
2026/03/30 [jira] [Updated] (SPARK-54857) Add test ensuring user name and app name in historypage get escaped Dongjoon Hyun (Jira)
2026/03/30 [jira] [Updated] (SPARK-56044) HistoryServerDiskManager does not delete app store on release when app is not in active map Dongjoon Hyun (Jira)
2026/03/30 [jira] [Commented] (SPARK-56287) Improve Spark History Server Scalability Dongjoon Hyun (Jira)
2026/03/30 [jira] [Commented] (SPARK-56287) Improve Spark History Server Scalability Dongjoon Hyun (Jira)
2026/03/30 [jira] [Updated] (SPARK-56287) Improve Spark History Server Scalability Dongjoon Hyun (Jira)
2026/03/30 [jira] [Resolved] (SPARK-56287) Improve Spark History Server Scalability Dongjoon Hyun (Jira)
2026/03/30 [jira] [Updated] (SPARK-55793) Add multiple log directories support to SHS Dongjoon Hyun (Jira)
2026/03/30 [jira] [Updated] (SPARK-55864) Add more tests for SHS multiple log directories feature Dongjoon Hyun (Jira)
2026/03/30 [jira] [Assigned] (SPARK-56287) Improve Spark History Server Scalability Dongjoon Hyun (Jira)
2026/03/30 [jira] [Updated] (SPARK-56287) Improve Spark History Server Scalability Dongjoon Hyun (Jira)
2026/03/30 [jira] [Updated] (SPARK-56278) Populate accurate metadata immediately during on-demand loading in SHS Dongjoon Hyun (Jira)
2026/03/30 [jira] [Updated] (SPARK-56234) Support disabling log directory scanning by path pattern in SHS Dongjoon Hyun (Jira)
2026/03/30 [jira] [Created] (SPARK-56287) Improve Spark History Server Scalability Dongjoon Hyun (Jira)
2026/03/30 [jira] [Resolved] (SPARK-56234) Support disabling log directory scanning by path pattern in SHS Dongjoon Hyun (Jira)
2026/03/30 [jira] [Assigned] (SPARK-56234) Support disabling log directory scanning by path pattern in SHS Dongjoon Hyun (Jira)
2026/03/30 [jira] [Updated] (SPARK-56253) Make spark.read.json accept DataFrame input ASF GitHub Bot (Jira)
2026/03/30 [jira] [Updated] (SPARK-56286) Add DataFrame.dataQuality API for column profiling in PySpark ASF GitHub Bot (Jira)
2026/03/30 [jira] [Assigned] (SPARK-56279) Enable native sendfile for file-backed shuffle Yang Jie (Jira)
2026/03/30 [jira] [Resolved] (SPARK-56279) Enable native sendfile for file-backed shuffle Yang Jie (Jira)
2026/03/30 [jira] [Created] (SPARK-56286) Add DataFrame.dataQuality API for column profiling in PySpark Sougata Pandit (Jira)
2026/03/30 [jira] [Updated] (SPARK-53504) Types framework David Milicevic (Jira)
2026/03/30 [jira] [Updated] (SPARK-53504) Types framework David Milicevic (Jira)
2026/03/30 [jira] [Assigned] (SPARK-56256) Implement SparkSession.emptyDataFrame in Python Ruifeng Zheng (Jira)
2026/03/30 [jira] [Resolved] (SPARK-56256) Implement SparkSession.emptyDataFrame in Python Ruifeng Zheng (Jira)
2026/03/30 [jira] [Assigned] (SPARK-56270) Fix the type hint and import check for find_spark_home Ruifeng Zheng (Jira)
2026/03/30 [jira] [Resolved] (SPARK-56270) Fix the type hint and import check for find_spark_home Ruifeng Zheng (Jira)
2026/03/30 [jira] [Resolved] (SPARK-56278) Populate accurate metadata immediately during on-demand loading in SHS Kousuke Saruta (Jira)
2026/03/30 [jira] [Commented] (SPARK-55278) SPIP: Language-agnostic UDF Protocol for Spark Haiyang Sun (Jira)
2026/03/30 [jira] [Updated] (SPARK-56174) Complete V2 file write path for DataFrame API (ErrorIfExists/Ignore, partitioned writes) ASF GitHub Bot (Jira)
2026/03/30 [jira] [Resolved] (SPARK-56285) Add `minimize` to `shadowJar` task Dongjoon Hyun (Jira)
2026/03/30 [jira] [Assigned] (SPARK-56285) Add `minimize` to `shadowJar` task Dongjoon Hyun (Jira)
2026/03/30 [jira] [Updated] (SPARK-56285) Add `minimize` to `shadowJar` task ASF GitHub Bot (Jira)
2026/03/30 [jira] [Created] (SPARK-56285) Add `minimize` to `shadowJar` task Dongjoon Hyun (Jira)
2026/03/30 [jira] [Assigned] (SPARK-56283) Exclude HDFS/YARN UI resources Dongjoon Hyun (Jira)
2026/03/30 [jira] [Resolved] (SPARK-56283) Exclude HDFS/YARN UI resources Dongjoon Hyun (Jira)
2026/03/30 [jira] [Created] (SPARK-56284) Key worker abstraction for language-agnostic UDF protocol Haiyang Sun (Jira)
2026/03/30 [jira] [Updated] (SPARK-56283) Exclude HDFS/YARN UI resources ASF GitHub Bot (Jira)
2026/03/30 [jira] [Created] (SPARK-56283) Exclude HDFS/YARN UI resources Dongjoon Hyun (Jira)
2026/03/30 [jira] [Resolved] (SPARK-56282) Exclude unnecessary `avro` dependency Dongjoon Hyun (Jira)
2026/03/30 [jira] [Assigned] (SPARK-56282) Exclude unnecessary `avro` dependency Dongjoon Hyun (Jira)
2026/03/29 [jira] [Updated] (SPARK-56251) Avoid loading all data to memory by default for PostgresSQL jdbc connector ASF GitHub Bot (Jira)
2026/03/29 [jira] [Updated] (SPARK-56282) Exclude unnecessary `avro` dependency ASF GitHub Bot (Jira)
2026/03/29 [jira] [Created] (SPARK-56282) Exclude unnecessary `avro` dependency Dongjoon Hyun (Jira)