Messages by Thread
-
[jira] [Created] (SPARK-60632) LIKE/RLIKE expensive heuristic checks the wrong operand and loses filter pushdown
L. C. Hsieh (Jira)
-
[jira] [Created] (SPARK-60631) Upgrade `scala-parallel-collections` to 1.3.0
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-60572) Preserve NULL string day counts in date arithmetic
Hyukjin Kwon (Jira)
-
[jira] [Resolved] (SPARK-60572) Preserve NULL string day counts in date arithmetic
Hyukjin Kwon (Jira)
-
[jira] [Created] (SPARK-60629) Upgrade `commons-codec` to 1.23.0
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-60603) Shuffle service leaks canonical local dir cache entries and canonicalizes the index path on every fetch
L. C. Hsieh (Jira)
-
[jira] [Updated] (SPARK-60630) Upgrade Java Operator SDK to 5.6.3
ASF GitHub Bot (Jira)
-
[jira] [Updated] (SPARK-60620) Report parse_sql start, length, and queryContext as Unicode code points
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-60630) Upgrade Java Operator SDK to 5.6.3
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-60624) Resolve SQL script cursors in parse_sql ANALYZE
ASF GitHub Bot (Jira)
-
[jira] [Updated] (SPARK-60622) Overlay supplied relations, variables, and parameter markers in parse_sql ANALYZE
ASF GitHub Bot (Jira)
-
[jira] [Updated] (SPARK-60623) Analyze SQL scripts in parse_sql without executing them
ASF GitHub Bot (Jira)
-
[jira] [Updated] (SPARK-60627) Do not slice an Arrow batch whose slice positions overflow int in `SliceRecordsArrowOutputProcessorImpl`
ASF GitHub Bot (Jira)
-
[jira] [Assigned] (SPARK-60626) Upgrade Spark to 4.2.1
Dongjoon Hyun (Jira)
-
[jira] [Created] (SPARK-60628) Upgrade lz4-java to 1.12.1
Dongjoon Hyun (Jira)
-
[jira] [Created] (SPARK-60627) Do not slice an Arrow batch whose slice positions overflow int in `SliceRecordsArrowOutputProcessorImpl`
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-60625) Separate session-catalog SHOW goldens from V2 catalog coverage
Jira
-
[jira] [Updated] (SPARK-60608) Apply the class allowlist to nested model readers
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-60625) Separate session-catalog SHOW goldens from V2 catalog coverage
Jira
-
[jira] [Created] (SPARK-60621) Add ANALYZE mode to parse_sql
Serge Rielau (Jira)
-
[jira] [Created] (SPARK-60624) Resolve SQL script cursors in parse_sql ANALYZE
Serge Rielau (Jira)
-
[jira] [Created] (SPARK-60620) Report parse_sql start, length, and queryContext as Unicode code points
Serge Rielau (Jira)
-
[jira] [Resolved] (SPARK-60616) Publish Apache Spark 4.1.4 to docker registry
Jira
-
[jira] [Updated] (SPARK-60049) Keep each method's bytecode size in the codegen compile cache to avoid the trial's second compile
ASF GitHub Bot (Jira)
-
[jira] [Updated] (SPARK-60619) Use Apache Spark 4.0.5, 4.1.4, and 4.2.1 instead of RCs
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-60541) Per-partition runtime bloom filters for storage-partitioned joins
ASF GitHub Bot (Jira)
-
[jira] [Updated] (SPARK-60616) Publish Apache Spark 4.1.4 to docker registry
ASF GitHub Bot (Jira)
-
[jira] [Updated] (SPARK-60617) Publish Apache Spark 4.0.5 to docker registry
ASF GitHub Bot (Jira)
-
[jira] [Resolved] (SPARK-60583) Add golden tests for SHOW commands
Jira
-
[jira] [Updated] (SPARK-60618) Skip the pass-through GroupPartitionsExec in a storage-partitioned join's alignment
ASF GitHub Bot (Jira)
-
[jira] [Commented] (SPARK-60616) Publish Apache Spark 4.1.4 to docker registry
Jira
-
[jira] [Commented] (SPARK-60617) Publish Apache Spark 4.0.5 to docker registry
Jira
-
[jira] [Created] (SPARK-60616) Publish Apache Spark 4.1.4 to docker registry
Jira
-
[jira] [Created] (SPARK-60618) Skip the pass-through GroupPartitionsExec in a storage-partitioned join's alignment
XiDuo You (Jira)
-
[jira] [Updated] (SPARK-60615) Restore PR labeler (without `pull_request_target`)
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-60615) Restore PR labeler (without `pull_request_target`)
Nicholas Chammas (Jira)
-
[jira] [Assigned] (SPARK-60542) Support nanosecond-precision timestamps in percentile, median, percentile_cont and percentile_disc
Jira
-
[jira] [Updated] (SPARK-60614) Share scalar SQL variable assignment helpers
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-60614) Share scalar SQL variable assignment helpers
Jira
-
[jira] [Updated] (SPARK-60613) Add an init response to the Python worker socket protocol
Yicong Huang (Jira)
-
[jira] [Created] (SPARK-60613) Add an init response to the Python worker socket protocol
Yicong Huang (Jira)
-
[jira] [Updated] (SPARK-60612) Remove unnecessary dump execution in SparkAsyncProfiler
ASF GitHub Bot (Jira)
-
[jira] [Reopened] (SPARK-60591) Ignore RUSTSEC-2026-0387 (crypto-bigint) in cargo audit and track it until a fix is reachable
L. C. Hsieh (Jira)
-
[jira] [Created] (SPARK-60611) Add a Spark Connect programming guide
Lisa Cao (Jira)
-
[jira] [Created] (SPARK-60610) FileSourceScanExec.bucketedScan re-reads spark.sql.sources.bucketing.enabled on the copy made at stage creation
Naveen Kumar Puppala (Jira)
-
[jira] [Updated] (SPARK-60607) Decode Arrow day-time intervals as timedelta in the Rust Spark Connect client
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-60590) Update webpki-roots, rustls-webpki and tokio in Cargo.lock to pick up recent RustSec advisories
L. C. Hsieh (Jira)
-
[jira] [Created] (SPARK-60604) Add sampling profiler for Python UDFs
Tian Gao (Jira)
-
[jira] [Created] (SPARK-60608) Apply the class allowlist to nested model readers
Ruifeng Zheng (Jira)
-
[jira] [Created] (SPARK-60609) Handle list returned by SimpleDataSourceStreamReader.read() in offset validation for backward compatibility
Vinod KC (Jira)
-
[jira] [Commented] (SPARK-60609) Handle list returned by SimpleDataSourceStreamReader.read() in offset validation for backward compatibility
Vinod KC (Jira)
-
[jira] [Updated] (SPARK-60609) Handle list returned by SimpleDataSourceStreamReader.read() in offset validation for backward compatibility
Vinod KC (Jira)
-
[jira] [Updated] (SPARK-60606) Build local Arrow input one column at a time in Spark Connect Rust
DB Tsai (Jira)
-
[jira] [Updated] (SPARK-60506) [ML][MLLIB][PYTHON] Say deprecated APIs will be removed in the future
ASF GitHub Bot (Jira)
-
[jira] [Commented] (SPARK-60584) unpersist() waits for unrelated cache materializations to complete
Samuel Shpuntoff (Jira)
-
[jira] [Created] (SPARK-60607) Decode Arrow day-time intervals as timedelta in the Rust Spark Connect client
DB Tsai (Jira)
-
[jira] [Updated] (SPARK-60606) Reduce local input allocations and Int64 decoding overhead in Spark Connect Rust
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-60606) Reduce local input allocations and Int64 decoding overhead in Spark Connect Rust
DB Tsai (Jira)
-
[jira] [Updated] (SPARK-38951) Aggregate aliases override field names in ResolveAggregateFunctions
ASF GitHub Bot (Jira)
-
[jira] [Assigned] (SPARK-60437) Fix stale API references in the Data Source V2 docs page and add connector walkthrough and migration sections
Szehon Ho (Jira)
-
[jira] [Resolved] (SPARK-60437) Fix stale API references in the Data Source V2 docs page and add connector walkthrough and migration sections
Szehon Ho (Jira)
-
[jira] [Created] (SPARK-60603) Shuffle service leaks canonical local dir cache entries and canonicalizes the index path on every fetch
L. C. Hsieh (Jira)
-
[jira] [Created] (SPARK-60605) levenshtein returns a wrong value instead of NULL for a NULL threshold
Matthew Ball (Jira)
-
[jira] [Updated] (SPARK-60604) Add sampling profiler for Python UDFs
Tian Gao (Jira)
-
[jira] [Created] (SPARK-60600) approx_top_k returns a count below the exact count when a partial sketch was purged to zero items
Yaoxuan Wu (Jira)
-
[jira] [Updated] (SPARK-60603) Shuffle service leaks canonical local dir cache entries and canonicalizes the index path on every fetch
L. C. Hsieh (Jira)
-
[jira] [Updated] (SPARK-60586) Extract a shared Python and Arrow converter for Spark Connect Rust
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-60592) Fix flaky CSP compliance ui-tests caused by the default Jest timeout
Matthew Ball (Jira)
-
[jira] [Updated] (SPARK-60602) Do not evaluate throwable filter conditions ahead of the conditions before them when pushing filters through a projection
L. C. Hsieh (Jira)
-
[jira] [Created] (SPARK-60602) Do not evaluate throwable filter conditions ahead of the conditions before them when pushing filters through a projection
L. C. Hsieh (Jira)
-
[jira] [Updated] (SPARK-60597) Keep the output of a top-level join on a hidden USING join key in the single-pass resolver
ASF GitHub Bot (Jira)
-
[jira] [Updated] (SPARK-60601) Detect keys that recur across epochs in the adaptive partial aggregation spill check
Wenchen Fan (Jira)
-
[jira] [Created] (SPARK-60601) Detect keys that recur across epochs in the adaptive partial aggregation spill check
Wenchen Fan (Jira)
-
[jira] [Updated] (SPARK-60599) Avoid building per-row argument tuples when evaluating Arrow-optimized Python UDFs
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-60599) Avoid building per-row argument tuples when evaluating Arrow-optimized Python UDFs
Tian Gao (Jira)
-
[jira] [Created] (SPARK-60594) Python UDTF with TABLE(t) PARTITION BY k puts every row with a NaN key into its own partition
Yaoxuan Wu (Jira)
-
[jira] [Assigned] (SPARK-60585) Share immutable field names across decoded rows in the Rust Spark Connect client
Hyukjin Kwon (Jira)
-
[jira] [Created] (SPARK-60596) Upgrade PyO3 to 0.30.1 in the Spark Connect Rust client
DB Tsai (Jira)
-
[jira] [Updated] (SPARK-60593) add "analyze" option to parse_sql()
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-60593) add "analyze" option to parse_sql()
Serge Rielau (Jira)
-
[jira] [Created] (SPARK-60595) percentile_disc returns the wrong value when n * p is not exact in floating point (e.g. p = 0.28 over 25 rows)
Yaoxuan Wu (Jira)
-
[jira] [Created] (SPARK-60597) Keep the output of a top-level join on a hidden USING join key in the single-pass resolver
Dejan Krakovic (Jira)
-
[jira] [Created] (SPARK-60598) Parquet aggregate pushdown returns MIN/MAX/COUNT of the wrong column when a nested column precedes it
Yaoxuan Wu (Jira)
-
[jira] [Updated] (SPARK-60596) Upgrade PyO3 to 0.30.1 in the Spark Connect Rust client
DB Tsai (Jira)
-
[jira] [Updated] (SPARK-60591) Ignore RUSTSEC-2026-0387 (crypto-bigint) in cargo audit and track it until a fix is reachable
ASF GitHub Bot (Jira)
-
[jira] [Updated] (SPARK-60592) Fix flaky CSP compliance ui-tests caused by the default Jest timeout
Matthew Ball (Jira)
-
[jira] [Resolved] (SPARK-60546) Reject subtraction of nanosecond-precision timestamps
Jira
-
[jira] [Resolved] (SPARK-60585) Share immutable field names across decoded rows in the Rust Spark Connect client
Hyukjin Kwon (Jira)
-
[jira] [Assigned] (SPARK-60546) Reject subtraction of nanosecond-precision timestamps
Jira
-
[jira] [Closed] (SPARK-60588) Share nested struct field names in the Rust Spark Connect client
DB Tsai (Jira)
-
[jira] [Resolved] (SPARK-60588) Share nested struct field names in the Rust Spark Connect client
DB Tsai (Jira)
-
[jira] [Created] (SPARK-60591) Ignore RUSTSEC-2026-0387 (crypto-bigint) in cargo audit and track it until a fix is reachable
L. C. Hsieh (Jira)
-
[jira] [Updated] (SPARK-60590) Update webpki-roots, rustls-webpki and tokio in Cargo.lock to pick up recent RustSec advisories
ASF GitHub Bot (Jira)
-
[jira] [Updated] (SPARK-60588) Share nested struct field names in the Rust Spark Connect client
DB Tsai (Jira)
-
[jira] [Resolved] (SPARK-60526) Use the Apache product name, fix docs that point outside the repository, and tidy the Dockerfile before the first release
L. C. Hsieh (Jira)
-
[jira] [Assigned] (SPARK-60526) Use the Apache product name, fix docs that point outside the repository, and tidy the Dockerfile before the first release
L. C. Hsieh (Jira)
-
[jira] [Updated] (SPARK-60589) Add native fixed-width file (FWF) data source
Sean Pavlak (Jira)
-
[jira] [Created] (SPARK-60589) Add native fixed-width file (FWF) data source
Sean Pavlak (Jira)
-
[jira] [Created] (SPARK-60588) Share nested struct field names in the Rust Spark Connect client
DB Tsai (Jira)
-
[jira] [Updated] (SPARK-60587) Assign a name to the error condition _LEGACY_ERROR_TEMP_1080
Matthew Ball (Jira)
-
[jira] [Created] (SPARK-60587) Assign a name to the error condition _LEGACY_ERROR_TEMP_1080
Matthew Ball (Jira)
-
[jira] [Updated] (SPARK-60585) Share immutable field names across decoded rows in the Rust Spark Connect client
DB Tsai (Jira)
-
[jira] [Created] (SPARK-60586) Extract a shared Python and Arrow converter for Spark Connect Rust
DB Tsai (Jira)
-
[jira] [Comment Edited] (SPARK-60584) unpersist() waits for unrelated cache materializations to complete
Samuel Shpuntoff (Jira)
-
[jira] [Updated] (SPARK-60584) unpersist() waits for unrelated cache materializations to complete
Samuel Shpuntoff (Jira)
-
[jira] [Created] (SPARK-60585) Share immutable field names across decoded rows in the Rust Spark Connect client
DB Tsai (Jira)
-
[jira] [Created] (SPARK-60584) unpersist() waits for unrelated cache materializations to complete
Samuel Shpuntoff (Jira)
-
[jira] [Assigned] (SPARK-60581) Delete LogInfo of deleted attempts in FsHistoryProvider.deleteAttemptLogs
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-60549) Share immutable logical plans and expressions in Spark Connect Rust
Hyukjin Kwon (Jira)
-
[jira] [Resolved] (SPARK-60549) Share immutable logical plans and expressions in Spark Connect Rust
Hyukjin Kwon (Jira)
-
[jira] [Resolved] (SPARK-60581) Delete LogInfo of deleted attempts in FsHistoryProvider.deleteAttemptLogs
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-60569) Push down filters on scalar subqueries merged by `MergeSubplans`
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-60569) Push down filters on scalar subqueries merged by `MergeSubplans`
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-59243) Splice nested SQL/JSON constructors reached through routed or qualified JSON_ARRAY calls
ASF GitHub Bot (Jira)
-
[jira] [Assigned] (SPARK-60571) Set the task result size accumulator in place in TaskResultGetter
Wenchen Fan (Jira)
-
[jira] [Updated] (SPARK-60571) Set the task result size accumulator in place in TaskResultGetter
Wenchen Fan (Jira)
-
[jira] [Resolved] (SPARK-60571) Set the task result size accumulator in place in TaskResultGetter
Wenchen Fan (Jira)
-
[jira] [Resolved] (SPARK-60570) Add AccumulatorContext.getOrNull to avoid an Option per driver-side accumulator lookup
Wenchen Fan (Jira)
-
[jira] [Assigned] (SPARK-60570) Add AccumulatorContext.getOrNull to avoid an Option per driver-side accumulator lookup
Wenchen Fan (Jira)
-
[jira] [Updated] (SPARK-60570) Add AccumulatorContext.getOrNull to avoid an Option per driver-side accumulator lookup
ASF GitHub Bot (Jira)
-
[jira] [Updated] (SPARK-60583) Add golden tests for SHOW commands
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-60583) Add golden tests for SHOW commands
Jira
-
[jira] [Resolved] (SPARK-60580) Fix NPE in History Server for listing entries
Kousuke Saruta (Jira)
-
[jira] [Assigned] (SPARK-60580) Fix NPE in History Server for listing entries
Kousuke Saruta (Jira)
-
[jira] [Created] (SPARK-60579) Fix ORDER BY returning rows in the wrong order when a storage-partitioned layout cannot be reordered
Peter Toth (Jira)
-
[jira] [Assigned] (SPARK-60532) Chain UDF functions in EvalTypeHandler and enforce single-UDF handlers in the base
Yicong Huang (Jira)
-
[jira] [Assigned] (SPARK-60465) Late-materialization storage-filter pushdown for data source V2 scans
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-60504) spark-shell ignores --remote and connects to localhost instead, when spark.api.mode=connect is set
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-60580) Fix NPE in History Server for listing entries
Kousuke Saruta (Jira)
-
[jira] [Resolved] (SPARK-60577) Fix `ClassCastException` of `IN` filters with scalar subqueries in V1 file source scans
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-60582) Use resolved keys for DataFrame ASOF sort-merge joins
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-60582) Use resolved keys for DataFrame ASOF sort-merge joins
Jira
-
[jira] [Updated] (SPARK-60581) Delete LogInfo of deleted attempts in FsHistoryProvider.deleteAttemptLogs
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-60581) Delete LogInfo of deleted attempts in FsHistoryProvider.deleteAttemptLogs
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-58988) Fix PartitioningCollection invariant violation exception when allowKeysSubsetOfPartitionKeys
Peter Toth (Jira)
-
[jira] [Updated] (SPARK-60578) Migrate build status workflow off of `pull_request_target` trigger
Nicholas Chammas (Jira)
-
[jira] [Created] (SPARK-60578) Migrate notify workflow off of `pull_request_target` trigger
Nicholas Chammas (Jira)
-
[jira] [Resolved] (SPARK-59118) We should warn when people attempt to use non-supported "doAs" in Spark Thriftserver
Wenchen Fan (Jira)
-
[jira] [Resolved] (SPARK-59293) Fix update_build_status.yml to map non-standard workflow run conclusions
Wenchen Fan (Jira)
-
[jira] [Assigned] (SPARK-59293) Fix update_build_status.yml to map non-standard workflow run conclusions
Wenchen Fan (Jira)
-
[jira] [Commented] (SPARK-60460) Fix storage-partitioned join failures over a nested join that shuffles one side
Peter Toth (Jira)
-
[jira] [Updated] (SPARK-60580) Fix NPE in History Server for listing entries
ASF GitHub Bot (Jira)
-
[jira] [Resolved] (SPARK-60465) Late-materialization storage-filter pushdown for data source V2 scans
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-60532) Chain UDF functions in EvalTypeHandler and enforce single-UDF handlers in the base
Yicong Huang (Jira)