Messages by Date
-
2026/11/20
[jira] [Updated] (SPARK-62138) Label SPARK-58971 rank parameters as 5.0.0 instead of 4.4.0
ASF GitHub Bot (Jira) via issues
-
2026/11/20
[jira] [Resolved] (SPARK-62110) Fix DSv2 generated columns storing wrong values when they compare a CHAR column with a string literal
Dongjoon Hyun (Jira) via issues
-
2026/11/20
[jira] [Assigned] (SPARK-62110) Fix DSv2 generated columns storing wrong values when they compare a CHAR column with a string literal
Dongjoon Hyun (Jira) via issues
-
2026/11/20
[jira] [Updated] (SPARK-62137) Fix query failures by filter pushdown ahead of a throwable condition of an as-of or external lookup join
ASF GitHub Bot (Jira) via issues
-
2026/11/20
[jira] [Assigned] (SPARK-62095) Fix wrong results by generators such as explode when an outer join makes their input nullable
Dongjoon Hyun (Jira) via issues
-
2026/11/20
[jira] [Resolved] (SPARK-62095) Fix wrong results by generators such as explode when an outer join makes their input nullable
Dongjoon Hyun (Jira) via issues
-
2026/11/20
[jira] [Updated] (SPARK-61671) Add SparkSession.listFiles and SparkSession.listArchives for Spark Connect
Dongjoon Hyun (Jira) via issues
-
2026/11/20
[jira] [Created] (SPARK-62137) Fix query failures by filter pushdown ahead of a throwable condition of an as-of or external lookup join
Dongjoon Hyun (Jira) via issues
-
2026/11/20
[jira] [Created] (SPARK-62136) MsSqlServer dialect pushes down CAST from FLOAT, DOUBLE and BOOLEAN to STRING and returns wrong results
Alek Jarmov (Jira) via issues
-
2026/11/20
[jira] [Updated] (SPARK-62120) Return candidate positions from SupportsExternalLookup.selectLookupPredicates
Dongjoon Hyun (Jira) via issues
-
2026/11/20
[jira] [Updated] (SPARK-62120) Return candidate positions from SupportsExternalLookup.selectLookupPredicates
Dongjoon Hyun (Jira) via issues
-
2026/11/20
[jira] [Commented] (SPARK-62120) Return candidate positions from SupportsExternalLookup.selectLookupPredicates
Dongjoon Hyun (Jira) via issues
-
2026/11/20
[jira] [Updated] (SPARK-62120) Return candidate positions from SupportsExternalLookup.selectLookupPredicates
Dongjoon Hyun (Jira) via issues
-
2026/11/20
[jira] [Updated] (SPARK-61931) SPIP: Add the OBJECT data type
Serge Rielau (Jira) via issues
-
2026/11/20
[jira] [Updated] (SPARK-61279) Keep GroupedPartitionCoalescer's groups out of tasks and improve its location choice
Peter Toth (Jira) via issues
-
2026/11/20
[jira] [Updated] (SPARK-61279) Keep GroupedPartitionCoalescer's groups out of tasks and improve its location choice
Peter Toth (Jira) via issues
-
2026/11/20
[jira] [Resolved] (SPARK-62100) Fix INTERNAL_ERROR by DataFrameWriterV2 when an outer join makes a value for a NOT NULL column of a DSv2 table nullable
Dongjoon Hyun (Jira) via issues
-
2026/11/20
[jira] [Assigned] (SPARK-62100) Fix INTERNAL_ERROR by DataFrameWriterV2 when an outer join makes a value for a NOT NULL column of a DSv2 table nullable
Dongjoon Hyun (Jira) via issues
-
2026/11/20
[jira] [Resolved] (SPARK-60341) Support internal metadata columns in changelog reads
Wenchen Fan (Jira) via issues
-
2026/11/20
[jira] [Updated] (SPARK-58001) Improve UNSUPPORTED_EXPR_FOR_OPERATOR error message
Dongjoon Hyun (Jira) via issues
-
2026/11/20
[jira] [Assigned] (SPARK-60341) Support internal metadata columns in changelog reads
Wenchen Fan (Jira) via issues
-
2026/11/20
[jira] [Updated] (SPARK-61506) Mark a CALL as bound only after BindProcedures binds it
Dongjoon Hyun (Jira) via issues
-
2026/11/20
[jira] [Created] (SPARK-62135) Give the client of Spark Connect, pyspark.sql.connect.client.core, PySpark's docstrings as help() shows them, and compare the docstrings of every module
Hyukjin Kwon (Jira) via issues
-
2026/11/20
[jira] [Assigned] (SPARK-61437) Fix query errors by ConstantPropagation judging filter conditions over the aliases of a projection below as they are
Dongjoon Hyun (Jira) via issues
-
2026/11/20
[jira] [Resolved] (SPARK-61437) Fix query errors by ConstantPropagation judging filter conditions over the aliases of a projection below as they are
Dongjoon Hyun (Jira) via issues
-
2026/11/20
[jira] [Updated] (SPARK-62134) Move the client of the Python client into pyspark.sql.connect.client.core, of PySpark's layout and names of the package and its core
ASF GitHub Bot (Jira) via issues
-
2026/11/20
[jira] [Created] (SPARK-62134) Move the client of the Python client into pyspark.sql.connect.client.core, of PySpark's layout and names of the package and its core
Hyukjin Kwon (Jira) via issues
-
2026/11/20
[jira] [Assigned] (SPARK-62091) Fix query failures by filter pushdown ahead of a throwable condition of an inner, semi or anti join
Dongjoon Hyun (Jira) via issues
-
2026/11/20
[jira] [Resolved] (SPARK-62091) Fix query failures by filter pushdown ahead of a throwable condition of an inner, semi or anti join
Dongjoon Hyun (Jira) via issues
-
2026/11/20
[jira] [Resolved] (SPARK-62113) Fix MERGE failing analysis when its only clause is NOT MATCHED with a NULL condition
Dongjoon Hyun (Jira) via issues
-
2026/11/20
[jira] [Assigned] (SPARK-62113) Fix MERGE failing analysis when its only clause is NOT MATCHED with a NULL condition
Dongjoon Hyun (Jira) via issues
-
2026/11/20
[jira] [Resolved] (SPARK-62106) Deduplicate Python UDF calls over equal aggregates and repeated nondeterministic calls
Dongjoon Hyun (Jira) via issues
-
2026/11/20
[jira] [Assigned] (SPARK-62106) Deduplicate Python UDF calls over equal aggregates and repeated nondeterministic calls
Dongjoon Hyun (Jira) via issues
-
2026/11/20
[jira] [Created] (SPARK-62133) V2Aggregator ignores BoundFunction.isDeterministic()
Yang Jie (Jira) via issues
-
2026/11/20
[jira] [Assigned] (SPARK-62124) Scale every copy of a BIN BY DISTRIBUTE column
Wenchen Fan (Jira) via issues
-
2026/11/20
[jira] [Resolved] (SPARK-62124) Scale every copy of a BIN BY DISTRIBUTE column
Wenchen Fan (Jira) via issues
-
2026/11/20
[jira] [Assigned] (SPARK-62132) Decode the -bin values of the metadata of a response as gRPC core does, and fail a call of undecodable status details as grpcio does, in the Python client
Hyukjin Kwon (Jira) via issues
-
2026/11/20
[jira] [Resolved] (SPARK-62132) Decode the -bin values of the metadata of a response as gRPC core does, and fail a call of undecodable status details as grpcio does, in the Python client
Hyukjin Kwon (Jira) via issues
-
2026/11/20
[jira] [Resolved] (SPARK-62130) Decode the responses of the server within upb's limit of nested messages, of PySpark's error, without a crash at any depth or on threads of small stacks
Hyukjin Kwon (Jira) via issues
-
2026/11/20
[jira] [Assigned] (SPARK-62130) Decode the responses of the server within upb's limit of nested messages, of PySpark's error, without a crash at any depth or on threads of small stacks
Hyukjin Kwon (Jira) via issues
-
2026/11/20
[jira] [Resolved] (SPARK-60321) Avoid intermediate copies of byte-array-backed strings in Parquet writes
Cheng Pan (Jira) via issues
-
2026/11/20
[jira] [Assigned] (SPARK-62129) Raise the exceptions of the reads of a client's attributes by their calls, and read them strictly for the requests of a failure, as PySpark does, in the Python client
Hyukjin Kwon (Jira) via issues
-
2026/11/20
[jira] [Resolved] (SPARK-62129) Raise the exceptions of the reads of a client's attributes by their calls, and read them strictly for the requests of a failure, as PySpark does, in the Python client
Hyukjin Kwon (Jira) via issues
-
2026/11/20
[jira] [Created] (SPARK-62132) Decode the -bin values of the metadata of a response as gRPC core does, and fail a call of undecodable status details as grpcio does, in the Python client
Hyukjin Kwon (Jira) via issues
-
2026/11/20
[jira] [Assigned] (SPARK-61954) Support configurable intermediate storage levels in BisectingKMeans
Ruifeng Zheng (Jira) via issues
-
2026/11/20
[jira] [Resolved] (SPARK-61954) Support configurable intermediate storage levels in BisectingKMeans
Ruifeng Zheng (Jira) via issues
-
2026/11/20
[jira] [Updated] (SPARK-61954) Support configurable intermediate storage levels in BisectingKMeans
Ruifeng Zheng (Jira) via issues
-
2026/11/20
[jira] [Updated] (SPARK-61954) Support configurable intermediate storage levels in BisectingKMeans
Ruifeng Zheng (Jira) via issues
-
2026/11/20
[jira] [Updated] (SPARK-62132) Decode the -bin values of the metadata of a response as gRPC core does, and fail a call of undecodable status details as grpcio does, in the Python client
ASF GitHub Bot (Jira) via issues
-
2026/11/20
[jira] [Updated] (SPARK-62124) Scale every copy of a BIN BY DISTRIBUTE column
ASF GitHub Bot (Jira) via issues
-
2026/11/20
[jira] [Resolved] (SPARK-62128) Read a grpc-status-details-bin that is not valid base64 as grpcio does, of the errors of grpc_status's from_call, in the Python client
Hyukjin Kwon (Jira) via issues
-
2026/11/20
[jira] [Assigned] (SPARK-62128) Read a grpc-status-details-bin that is not valid base64 as grpcio does, of the errors of grpc_status's from_call, in the Python client
Hyukjin Kwon (Jira) via issues
-
2026/11/20
[jira] [Created] (SPARK-62131) GraphFrames IterativeCheckpointer
Sem Sinchenko (Jira) via issues
-
2026/11/20
[jira] [Created] (SPARK-62130) Decode the responses of the server within upb's limit of nested messages, of PySpark's error, without a crash at any depth or on threads of small stacks
Hyukjin Kwon (Jira) via issues
-
2026/11/20
[jira] [Updated] (SPARK-62130) Decode the responses of the server within upb's limit of nested messages, of PySpark's error, without a crash at any depth or on threads of small stacks
ASF GitHub Bot (Jira) via issues
-
2026/11/20
[jira] [Updated] (SPARK-61776) GraphFrames Core Interfaces
Ruifeng Zheng (Jira) via issues
-
2026/11/20
[jira] [Assigned] (SPARK-61776) GraphFrames Core Interfaces
Ruifeng Zheng (Jira) via issues
-
2026/11/20
[jira] [Resolved] (SPARK-61776) GraphFrames Core Interfaces
Ruifeng Zheng (Jira) via issues
-
2026/11/20
[jira] [Updated] (SPARK-61776) GraphFrames Core Interfaces
Ruifeng Zheng (Jira) via issues
-
2026/11/20
[jira] [Created] (SPARK-62129) Raise the exceptions of the reads of a client's attributes by their calls, and read them strictly for the requests of a failure, as PySpark does, in the Python client
Hyukjin Kwon (Jira) via issues
-
2026/11/20
[jira] [Updated] (SPARK-62124) Scale every copy of a BIN BY DISTRIBUTE column
Nikolina Vraneš (Jira) via issues
-
2026/11/20
[jira] [Updated] (SPARK-62129) Raise the exceptions of the reads of a client's attributes by their calls, and read them strictly for the requests of a failure, as PySpark does, in the Python client
ASF GitHub Bot (Jira) via issues
-
2026/11/20
[jira] [Commented] (SPARK-61972) UNION ALL of different CHAR lengths changes filtered rows when branches are reversed
Shivadarshan (Jira) via issues
-
2026/11/20
[jira] [Updated] (SPARK-61972) UNION ALL of different CHAR lengths changes filtered rows when branches are reversed
ASF GitHub Bot (Jira) via issues
-
2026/11/20
[jira] [Updated] (SPARK-62128) Read a grpc-status-details-bin that is not valid base64 as grpcio does, of the errors of grpc_status's from_call, in the Python client
ASF GitHub Bot (Jira) via issues
-
2026/11/20
[jira] [Created] (SPARK-62128) Read a grpc-status-details-bin that is not valid base64 as grpcio does, of the errors of grpc_status's from_call, in the Python client
Hyukjin Kwon (Jira) via issues
-
2026/11/20
[jira] [Created] (SPARK-62127) Extract SQL function input inlining helpers from Analyzer
Marko Radoicic (Jira) via issues
-
2026/11/20
[jira] [Assigned] (SPARK-62123) Make the connections, retries and errors of the Rust transport grpcio's, of its codes, texts and limits, in the Python client
Hyukjin Kwon (Jira) via issues
-
2026/11/20
[jira] [Updated] (SPARK-62125) Avoid intermediate copies of binary values in Parquet writes
ASF GitHub Bot (Jira) via issues
-
2026/11/20
[jira] [Updated] (SPARK-62127) Extract SQL function input inlining helpers from Analyzer
ASF GitHub Bot (Jira) via issues
-
2026/11/20
[jira] [Updated] (SPARK-62098) Apply per-partition runtime bloom filters in the scan of the application side
ASF GitHub Bot (Jira) via issues
-
2026/11/20
[jira] [Updated] (SPARK-62126) Add SQL UDF tests for scalar functions in join conditions
ASF GitHub Bot (Jira) via issues
-
2026/11/20
[jira] [Created] (SPARK-62126) Add SQL UDF tests for scalar functions in join conditions
Marko Radoicic (Jira) via issues
-
2026/11/20
[jira] [Created] (SPARK-62125) Avoid intermediate copies of binary values in Parquet writes
Saath (Jira) via issues
-
2026/11/20
[jira] [Updated] (SPARK-60321) Avoid intermediate copies of byte-array-backed strings in Parquet writes
Saath (Jira) via issues
-
2026/11/20
[jira] [Created] (SPARK-62124) Scale every copy of a BIN BY DISTRIBUTE column
Nikolina Vraneš (Jira) via issues
-
2026/11/20
[jira] [Resolved] (SPARK-62123) Make the connections, retries and errors of the Rust transport grpcio's, of its codes, texts and limits, in the Python client
Hyukjin Kwon (Jira) via issues
-
2026/11/20
[jira] [Created] (SPARK-62123) Make the connections, retries and errors of the Rust transport grpcio's, of its codes, texts and limits, in the Python client
Hyukjin Kwon (Jira) via issues
-
2026/11/20
[jira] [Updated] (SPARK-62122) Converting a compact decimal with a negative scale to an integral type fails with ArrayIndexOutOfBoundsException
ASF GitHub Bot (Jira) via issues
-
2026/11/20
[jira] [Updated] (SPARK-62123) Make the connections, retries and errors of the Rust transport grpcio's, of its codes, texts and limits, in the Python client
ASF GitHub Bot (Jira) via issues
-
2026/11/20
[jira] [Updated] (SPARK-62122) Converting a compact decimal with a negative scale to an integral type fails with ArrayIndexOutOfBoundsException
Dustin Smith (Jira) via issues
-
2026/11/20
[jira] [Assigned] (SPARK-61858) Add whole-stage codegen for BIN BY
Wenchen Fan (Jira) via issues
-
2026/11/20
[jira] [Updated] (SPARK-62122) Converting a compact decimal with a negative scale to an integral type fails with ArrayIndexOutOfBoundsException
Dustin Smith (Jira) via issues
-
2026/11/20
[jira] [Created] (SPARK-62122) Fail with ArrayIndexOutOfBoundsException when converting a compact decimal with a negative scale to an integral type
Dustin Smith (Jira) via issues
-
2026/11/20
[jira] [Resolved] (SPARK-61858) Add whole-stage codegen for BIN BY
Wenchen Fan (Jira) via issues
-
2026/11/20
[jira] [Updated] (SPARK-61858) Add whole-stage codegen for BIN BY
Wenchen Fan (Jira) via issues
-
2026/11/20
[jira] [Updated] (SPARK-61970) Nested CHAR table field misses a short string literal
ASF GitHub Bot (Jira) via issues
-
2026/11/20
[jira] [Updated] (SPARK-61966) QUALIFY resolves a SELECT alias before a same-named input column
ASF GitHub Bot (Jira) via issues
-
2026/11/19
[jira] [Updated] (SPARK-62121) [ML] KMeans auto solver always selects the row solver because preferBlockSolver sums feature indices
shuxu Wan (Jira) via issues
-
2026/11/19
[jira] [Updated] (SPARK-62121) [ML] KMeans auto solver always selects the row solver because preferBlockSolver sums feature indices
ASF GitHub Bot (Jira) via issues
-
2026/11/19
[jira] [Updated] (SPARK-62118) Allow emitting literal non-BMP Unicode characters in JSON expression output
Minreng Wu (Jira) via issues
-
2026/11/19
[jira] [Created] (SPARK-62121) [ML] KMeans auto solver always selects the row solver because preferBlockSolver sums feature indices
shuxu Wan (Jira) via issues
-
2026/11/19
[jira] [Updated] (SPARK-61812) Storage-partitioned join passes a decimal argument of more precision than its partition transform declares, which the write path's cast can change
ASF GitHub Bot (Jira) via issues
-
2026/11/19
[jira] [Assigned] (SPARK-62116) Skip the placeholder search of the plans built in Python when their bytes do not hold the type URL of a placeholder
Hyukjin Kwon (Jira) via issues
-
2026/11/19
[jira] [Resolved] (SPARK-62116) Skip the placeholder search of the plans built in Python when their bytes do not hold the type URL of a placeholder
Hyukjin Kwon (Jira) via issues
-
2026/11/19
[jira] [Updated] (SPARK-62120) Return candidate positions from SupportsExternalLookup.selectLookupPredicates
ASF GitHub Bot (Jira) via issues
-
2026/11/19
[jira] [Updated] (SPARK-62120) Return candidate positions from SupportsExternalLookup.selectLookupPredicates
L. C. Hsieh (Jira) via issues
-
2026/11/19
[jira] [Created] (SPARK-62120) Return candidate positions from SupportsExternalLookup.selectLookupPredicates
L. C. Hsieh (Jira) via issues
-
2026/11/19
[jira] [Updated] (SPARK-62091) Fix query failures by filter pushdown ahead of a throwable condition of an inner, semi or anti join
Dongjoon Hyun (Jira) via issues
-
2026/11/19
[jira] [Updated] (SPARK-60557) Support CHANGES for parenthesized STREAM relations
Uroš Bojanić (Jira) via issues
-
2026/11/19
[jira] [Assigned] (SPARK-60557) Support CHANGES for parenthesized STREAM relations
Uroš Bojanić (Jira) via issues
-
2026/11/19
[jira] [Resolved] (SPARK-60557) Support CHANGES for parenthesized STREAM relations
Uroš Bojanić (Jira) via issues
-
2026/11/19
[jira] [Updated] (SPARK-62091) Fix query failures when `PushPredicateThroughJoin` moves a filter condition that can fail ahead of a throwable condition of an inner, left semi or left anti join
Dongjoon Hyun (Jira) via issues
-
2026/11/19
[jira] [Resolved] (SPARK-62117) Give the SparkSession of Spark Connect and its Builder PySpark's docstrings as help() shows them
Hyukjin Kwon (Jira) via issues
-
2026/11/19
[jira] [Assigned] (SPARK-62117) Give the SparkSession of Spark Connect and its Builder PySpark's docstrings as help() shows them
Hyukjin Kwon (Jira) via issues
-
2026/11/19
[jira] [Updated] (SPARK-62119) Label SPARK-61671 and SPARK-61850 configs, APIs and migration note as 4.5.0 instead of 4.4.0
ASF GitHub Bot (Jira) via issues
-
2026/11/19
[jira] [Created] (SPARK-62119) Label SPARK-61671 and SPARK-61850 configs, APIs and migration note as 4.5.0 instead of 4.4.0
L. C. Hsieh (Jira) via issues
-
2026/11/19
[jira] [Updated] (SPARK-62119) Label SPARK-61671 and SPARK-61850 configs, APIs and migration note as 4.5.0 instead of 4.4.0
L. C. Hsieh (Jira) via issues
-
2026/11/19
[jira] [Created] (SPARK-62118) Allow emitting literal non-BMP Unicode characters in JSON expression output
Minreng Wu (Jira) via issues
-
2026/11/19
[jira] [Updated] (SPARK-62117) Give the SparkSession of Spark Connect and its Builder PySpark's docstrings as help() shows them
ASF GitHub Bot (Jira) via issues
-
2026/11/19
[jira] [Resolved] (SPARK-62115) Give the Connect DataFrame and the classic pyspark.sql.DataFrame PySpark's docstrings as help() shows them
Hyukjin Kwon (Jira) via issues
-
2026/11/19
[jira] [Assigned] (SPARK-62115) Give the Connect DataFrame and the classic pyspark.sql.DataFrame PySpark's docstrings as help() shows them
Hyukjin Kwon (Jira) via issues
-
2026/11/19
[jira] [Updated] (SPARK-62116) Skip the placeholder search of the plans built in Python when their bytes do not hold the type URL of a placeholder
ASF GitHub Bot (Jira) via issues
-
2026/11/19
[jira] [Assigned] (SPARK-61589) Define NULL semantics for KLL quantile and rank getter arrays
Wenchen Fan (Jira) via issues
-
2026/11/19
[jira] [Resolved] (SPARK-61589) Define NULL semantics for KLL quantile and rank getter arrays
Wenchen Fan (Jira) via issues
-
2026/11/19
[jira] [Updated] (SPARK-61589) Define NULL semantics for KLL quantile and rank getter arrays
Wenchen Fan (Jira) via issues
-
2026/11/19
[jira] [Created] (SPARK-62117) Give the SparkSession of Spark Connect and its Builder PySpark's docstrings as help() shows them
Hyukjin Kwon (Jira) via issues
-
2026/11/19
[jira] [Resolved] (SPARK-62114) Make the attributes and thread-local state of SparkConnectClient, and the lifetime of a session, PySpark's, of plain attributes that the requests read when they are built, in the Python client
Hyukjin Kwon (Jira) via issues
-
2026/11/19
[jira] [Assigned] (SPARK-62114) Make the attributes and thread-local state of SparkConnectClient, and the lifetime of a session, PySpark's, of plain attributes that the requests read when they are built, in the Python client
Hyukjin Kwon (Jira) via issues
-
2026/11/19
[jira] [Updated] (SPARK-62103) Make assertNullMapKeyFailure protected
ASF GitHub Bot (Jira) via issues
-
2026/11/19
[jira] [Updated] (SPARK-62105) Make the NOT NULL assertion in `RuntimeNullChecksV2Writes` overridable
ASF GitHub Bot (Jira) via issues
-
2026/11/19
[jira] [Updated] (SPARK-62115) Give the Connect DataFrame and the classic pyspark.sql.DataFrame PySpark's docstrings as help() shows them
ASF GitHub Bot (Jira) via issues
-
2026/11/19
[jira] [Created] (SPARK-62115) Give the Connect DataFrame and the classic pyspark.sql.DataFrame PySpark's docstrings as help() shows them
Hyukjin Kwon (Jira) via issues
-
2026/11/19
[jira] [Created] (SPARK-62116) Skip the placeholder search of the plans built in Python when their bytes do not hold the type URL of a placeholder
Hyukjin Kwon (Jira) via issues
-
2026/11/19
[jira] [Assigned] (SPARK-62111) Make the pickles and copies of DataFrames, Columns and table arguments carry their UDF functions and Python plans, which each request builds and pickles again, as PySpark does
Hyukjin Kwon (Jira) via issues
-
2026/11/19
[jira] [Resolved] (SPARK-62111) Make the pickles and copies of DataFrames, Columns and table arguments carry their UDF functions and Python plans, which each request builds and pickles again, as PySpark does
Hyukjin Kwon (Jira) via issues
-
2026/11/19
[jira] [Resolved] (SPARK-61384) Add experimental embedded Rust Spark Connect server with Spark JVM engine
Hyukjin Kwon (Jira) via issues
-
2026/11/19
[jira] [Assigned] (SPARK-61384) Add experimental embedded Rust Spark Connect server with Spark JVM engine
Hyukjin Kwon (Jira) via issues
-
2026/11/19
[jira] [Updated] (SPARK-61608) Fix arrays_zip field naming for map lookups
ASF GitHub Bot (Jira) via issues
-
2026/11/19
[jira] [Updated] (SPARK-62114) Make the attributes and thread-local state of SparkConnectClient, and the lifetime of a session, PySpark's, of plain attributes that the requests read when they are built, in the Python client
ASF GitHub Bot (Jira) via issues
-
2026/11/19
[jira] [Updated] (SPARK-52589) Spark 3.5.5 on Kubernetes with Dynamic Allocation Hangs (minExecutors=0) Due to Stale Ghost Executors
Dongjoon Hyun (Jira) via issues
-
2026/11/19
[jira] [Created] (SPARK-62114) Make the attributes and thread-local state of SparkConnectClient, and the lifetime of a session, PySpark's, of plain attributes that the requests read when they are built, in the Python client
Hyukjin Kwon (Jira) via issues
-
2026/11/19
[jira] [Resolved] (SPARK-52589) Spark 3.5.5 on Kubernetes with Dynamic Allocation Hangs (minExecutors=0) Due to Stale Ghost Executors
Dongjoon Hyun (Jira) via issues
-
2026/11/19
[jira] [Updated] (SPARK-52589) Spark 3.5.5 on Kubernetes with Dynamic Allocation Hangs (minExecutors=0) Due to Stale Ghost Executors
Dongjoon Hyun (Jira) via issues
-
2026/11/19
[jira] [Updated] (SPARK-62104) Make FileSourceCharVarcharTestSuite length checks use assertLengthCheckFailure
Dongjoon Hyun (Jira) via issues
-
2026/11/19
[jira] [Resolved] (SPARK-62104) Make FileSourceCharVarcharTestSuite length checks use assertLengthCheckFailure
Dongjoon Hyun (Jira) via issues
-
2026/11/19
[jira] [Assigned] (SPARK-62104) Make FileSourceCharVarcharTestSuite length checks use assertLengthCheckFailure
Dongjoon Hyun (Jira) via issues
-
2026/11/19
[jira] [Assigned] (SPARK-61372) Reject NaN and bool relativeError in approxQuantile
Dongjoon Hyun (Jira) via issues
-
2026/11/19
[jira] [Resolved] (SPARK-61372) Reject NaN and bool relativeError in approxQuantile
Dongjoon Hyun (Jira) via issues
-
2026/11/19
[jira] [Assigned] (SPARK-61272) Stop reporting a wrong-type timeout as not positive
Dongjoon Hyun (Jira) via issues
-
2026/11/19
[jira] [Updated] (SPARK-62031) Free the last batch of a native data source scan that stops early without waiting for a GC
Gengliang Wang (Jira) via issues
-
2026/11/19
[jira] [Updated] (SPARK-62031) Free the last batch of a native data source scan that stops early without waiting for a GC
Gengliang Wang (Jira) via issues
-
2026/11/19
[jira] [Updated] (SPARK-61306) Expose push_domains in the Rust SDK for native data sources
Gengliang Wang (Jira) via issues
-
2026/11/19
[jira] [Resolved] (SPARK-61272) Stop reporting a wrong-type timeout as not positive
Dongjoon Hyun (Jira) via issues
-
2026/11/19
[jira] [Updated] (SPARK-61306) Expose push_domains in the Rust SDK for native data sources
Gengliang Wang (Jira) via issues
-
2026/11/19
[jira] [Updated] (SPARK-62113) Fix MERGE failing analysis when its only clause is NOT MATCHED with a NULL condition
ASF GitHub Bot (Jira) via issues
-
2026/11/19
[jira] [Assigned] (SPARK-62031) Free the last batch of a native data source scan that stops early without waiting for a GC
Hyukjin Kwon (Jira) via issues
-
2026/11/19
[jira] [Created] (SPARK-62113) Fix MERGE failing analysis when its only clause is NOT MATCHED with a NULL condition
Dongjoon Hyun (Jira) via issues
-
2026/11/19
[jira] [Updated] (SPARK-62111) Make the pickles and copies of DataFrames, Columns and table arguments carry their UDF functions and Python plans, which each request builds and pickles again, as PySpark does
ASF GitHub Bot (Jira) via issues
-
2026/11/19
[jira] [Updated] (SPARK-61306) Expose push_domains in the Rust SDK for native data sources
Hyukjin Kwon (Jira) via issues
-
2026/11/19
[jira] [Updated] (SPARK-62031) Free the last batch of a native data source scan that stops early without waiting for a GC
Hyukjin Kwon (Jira) via issues
-
2026/11/19
[jira] [Assigned] (SPARK-61306) Expose push_domains in the Rust SDK for native data sources
Hyukjin Kwon (Jira) via issues
-
2026/11/19
[jira] [Resolved] (SPARK-61306) Expose push_domains in the Rust SDK for native data sources
Hyukjin Kwon (Jira) via issues
-
2026/11/19
[jira] [Resolved] (SPARK-62031) Free the last batch of a native data source scan that stops early without waiting for a GC
Hyukjin Kwon (Jira) via issues
-
2026/11/19
[jira] [Assigned] (SPARK-61671) Add SparkSession.listFiles and SparkSession.listArchives for Spark Connect
Hyukjin Kwon (Jira) via issues
-
2026/11/19
[jira] [Resolved] (SPARK-61671) Add SparkSession.listFiles and SparkSession.listArchives for Spark Connect
Hyukjin Kwon (Jira) via issues
-
2026/11/19
[jira] [Updated] (SPARK-62112) Add the physical representation and the FileRef value of the FILE type
ASF GitHub Bot (Jira) via issues
-
2026/11/19
[jira] [Created] (SPARK-62112) Add the physical representation and the FileRef value of the FILE type
Dejan Krakovic (Jira) via issues
-
2026/11/19
[jira] [Updated] (SPARK-62107) Keep the zero digit when to_char formats zero with no fractional digits
ASF GitHub Bot (Jira) via issues
-
2026/11/19
[jira] [Assigned] (SPARK-61643) Run the JavaScript linter only when its inputs change
Nicholas Chammas (Jira) via issues
-
2026/11/19
[jira] [Resolved] (SPARK-61643) Run the JavaScript linter only when its inputs change
Nicholas Chammas (Jira) via issues
-
2026/11/19
[jira] [Updated] (SPARK-61878) BIN BY: a join keyword after the BIN BY clause is parsed as a table alias
Wenchen Fan (Jira) via issues
-
2026/11/19
[jira] [Updated] (SPARK-62067) Report Python worker timing metrics in nanoseconds
Haotian Sun (Jira) via issues
-
2026/11/19
[jira] [Created] (SPARK-62111) Make the pickles and copies of DataFrames, Columns and table arguments carry their UDF functions and Python plans, which each request builds and pickles again, as PySpark does
Hyukjin Kwon (Jira) via issues
-
2026/11/19
[jira] [Updated] (SPARK-62110) Fix DSv2 generated columns storing wrong values when they compare a CHAR column with a string literal
Dongjoon Hyun (Jira) via issues
-
2026/11/19
[jira] [Updated] (SPARK-62110) Fix DSv2 generated columns storing wrong values when they compare a CHAR column with a string literal
Dongjoon Hyun (Jira) via issues
-
2026/11/19
[jira] [Updated] (SPARK-62110) Fix DSv2 generated columns storing wrong values when they compare a CHAR column with a string literal
Dongjoon Hyun (Jira) via issues
-
2026/11/19
[jira] [Updated] (SPARK-62110) Fix DSv2 generated columns storing wrong values when they compare a CHAR column with a string literal
ASF GitHub Bot (Jira) via issues
-
2026/11/19
[jira] [Created] (SPARK-62110) Fix DSv2 generated columns storing wrong values when they compare a CHAR column with a string literal
Dongjoon Hyun (Jira) via issues
-
2026/11/19
[jira] [Assigned] (SPARK-62070) Fix CHECK constraints accepting rows that violate them when they compare a CHAR column with a string literal
Dongjoon Hyun (Jira) via issues
-
2026/11/19
[jira] [Resolved] (SPARK-62070) Fix CHECK constraints accepting rows that violate them when they compare a CHAR column with a string literal
Dongjoon Hyun (Jira) via issues
-
2026/11/19
[jira] [Updated] (SPARK-62109) Keep server parse errors whose condition the Spark Connect Scala client does not define
ASF GitHub Bot (Jira) via issues
-
2026/11/19
[jira] [Updated] (SPARK-62067) Report Python worker timing metrics in nanoseconds
Haotian Sun (Jira) via issues
-
2026/11/19
[jira] [Updated] (SPARK-62109) Keep server parse errors whose condition the Spark Connect Scala client does not define
Daniel Tenedorio (Jira) via issues
-
2026/11/19
[jira] [Created] (SPARK-62109) Keep server parse errors whose condition the Spark Connect Scala client does not define
Daniel Tenedorio (Jira) via issues
-
2026/11/19
[jira] [Updated] (SPARK-62108) Grouped and cogrouped Arrow Python UDFs keep a task completion listener per group until the task ends
ASF GitHub Bot (Jira) via issues
-
2026/11/19
[jira] [Created] (SPARK-62108) Grouped and cogrouped Arrow Python UDFs keep a task completion listener per group until the task ends
Rakesh Kumar (Jira) via issues
-
2026/11/19
[jira] [Created] (SPARK-62107) Keep the zero digit when to_char formats zero with no fractional digits
Daniel Tenedorio (Jira) via issues
-
2026/11/19
[jira] [Commented] (SPARK-62098) Apply per-partition runtime bloom filters in the scan of the application side
Peter Toth (Jira) via issues
-
2026/11/19
[jira] [Updated] (SPARK-60663) Collect detailed timing metrics for mapInPandas
Tian Gao (Jira) via issues
-
2026/11/19
[jira] [Resolved] (SPARK-60663) Collect detailed timing metrics for mapInPandas
Tian Gao (Jira) via issues
-
2026/11/19
[jira] [Assigned] (SPARK-60663) Collect detailed timing metrics for mapInPandas
Tian Gao (Jira) via issues
-
2026/11/19
[jira] [Assigned] (SPARK-62101) help() of the Connect Column, WindowSpec, TableArg, DataFrameNaFunctions and DataFrameStatFunctions does not show PySpark's docstrings, and the Connect functions modules have docstrings of their own, in the Python client
Hyukjin Kwon (Jira) via issues
-
2026/11/19
[jira] [Resolved] (SPARK-62101) help() of the Connect Column, WindowSpec, TableArg, DataFrameNaFunctions and DataFrameStatFunctions does not show PySpark's docstrings, and the Connect functions modules have docstrings of their own, in the Python client
Hyukjin Kwon (Jira) via issues
-
2026/11/19
[jira] [Updated] (SPARK-62106) Deduplicate Python UDF calls over equal aggregates and repeated nondeterministic calls - #60733
Dongjoon Hyun (Jira) via issues
-
2026/11/19
[jira] [Updated] (SPARK-62106) Deduplicate Python UDF calls over equal aggregates and repeated nondeterministic calls
Dongjoon Hyun (Jira) via issues
-
2026/11/19
[jira] [Updated] (SPARK-62106) Fix Python UDFs evaluated twice for a call selected twice or equal calls over an aggregate
Dongjoon Hyun (Jira) via issues
-
2026/11/19
[jira] [Updated] (SPARK-62104) Make FileSourceCharVarcharTestSuite length checks use assertLengthCheckFailure
ASF GitHub Bot (Jira) via issues
-
2026/11/19
[jira] [Updated] (SPARK-62106) Fix Python UDFs evaluated twice for a call selected twice or equal calls over an aggregate
ASF GitHub Bot (Jira) via issues
-
2026/11/19
[jira] [Created] (SPARK-62106) Fix Python UDFs evaluated twice for a call selected twice or equal calls over an aggregate
Dongjoon Hyun (Jira) via issues
-
2026/11/19
[jira] [Resolved] (SPARK-62094) Fix wrong results by Dataset.unpivot and groupingSets when an outer join makes a nested field nullable
Dongjoon Hyun (Jira) via issues
-
2026/11/19
[jira] [Assigned] (SPARK-62094) Fix wrong results by Dataset.unpivot and groupingSets when an outer join makes a nested field nullable
Dongjoon Hyun (Jira) via issues
-
2026/11/19
[jira] [Updated] (SPARK-61931) SPIP: Add the OBJECT data type
Serge Rielau (Jira) via issues
-
2026/11/19
[jira] [Updated] (SPARK-61931) SPIP: Add the OBJECT data type
Serge Rielau (Jira) via issues
-
2026/11/19
[jira] [Updated] (SPARK-62097) Overridable Test Assertions
Pedrum Jalali (Jira) via issues
-
2026/11/19
[jira] [Created] (SPARK-62104) Make FileSourceCharVarcharTestSuite length checks use assertLengthCheckFailure
Pedrum Jalali (Jira) via issues
-
2026/11/19
[jira] [Updated] (SPARK-60737) Close the Arrow input of Python UDFs when the task ends before the input is exhausted
Dongjoon Hyun (Jira) via issues
-
2026/11/19
[jira] [Created] (SPARK-62105) Make the NOT NULL assertion in `RuntimeNullChecksV2Writes` overridable
Pedrum Jalali (Jira) via issues
-
2026/11/19
[jira] [Created] (SPARK-62103) Make assertNullMapKeyFailure protected
Pedrum Jalali (Jira) via issues
-
2026/11/19
[jira] [Assigned] (SPARK-62089) Make the messages of the Rust protobuf runtime of pyspark.sql.connect.proto, and of the plugins' generated modules, behave as upb's where protobuf is installed, without requiring it
Hyukjin Kwon (Jira) via issues