Messages by Thread
-
[jira] [Updated] (SPARK-54411) [SS] Introduce Writer for Repartition - support mlutiple column family
Zifei Feng (Jira)
-
[jira] [Updated] (SPARK-54411) [SS] Introduce Writer for Repartition - support multiple column familoes
Zifei Feng (Jira)
-
[jira] [Updated] (SPARK-54420) Introduce State Writer for offline repartitioning - support single column family
Zifei Feng (Jira)
-
[jira] [Updated] (SPARK-54411) [SS] Introduce Writer for Repartition - support multiple column families
Zifei Feng (Jira)
-
[jira] [Updated] (SPARK-54619) Add sanity check for runner conf
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-54619) Add sanity check for runner conf
Tian Gao (Jira)
-
[jira] [Assigned] (SPARK-54618) Promote `LocalScan` to `Stable`
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-54618) Promote `LocalScan` to `Stable`
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-54618) Promote `LocalScan` to `Stable`
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-54618) Promote `LocalScan` to `Stable`
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-54617) Register Arrow Grouped Iter Aggregate UDF for SQL usage
Yicong Huang (Jira)
-
[jira] [Created] (SPARK-54617) Register Arrow Grouped Iter Aggregate UDF for SQL usage
Yicong Huang (Jira)
-
[jira] [Updated] (SPARK-54615) Always pass runner_conf to python worker
ASF GitHub Bot (Jira)
-
[jira] [Updated] (SPARK-54616) Mark `SupportsPushDownVariants` as `Experimental`
ASF GitHub Bot (Jira)
-
[jira] [Updated] (SPARK-54604) Grammar errors in python_data_source.rst
Yicong Huang (Jira)
-
[jira] [Created] (SPARK-54616) Mark `SupportsPushDownVariants` as `Experimental`
Dongjoon Hyun (Jira)
-
[jira] [Created] (SPARK-54615) Always pass runner_conf to python worker
Tian Gao (Jira)
-
[jira] [Updated] (SPARK-54443) Partition key extraction for all streaming stateful operators
B. Micheal Okutubo (Jira)
-
[jira] [Updated] (SPARK-54614) Upgrade `tink` to 1.19.0
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-54614) Upgrade `tink` to 1.19.0
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-54611) Upgrade `lz4-java` to 1.10.1
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-54611) Upgrade `lz4-java` to 1.10.1
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-54613) Upgrade `ammonite` to 3.0.4
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-54613) Upgrade `ammonite` to 3.0.4
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-54612) Upgrade `scala-maven-plugin` to 4.9.7
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-54612) Upgrade `scala-maven-plugin` to 4.9.7
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-53747) spark.app.name should be escaped
PJ Fanning (Jira)
-
[jira] [Updated] (SPARK-54611) Upgrade `lz4-java` to 1.10.1
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-54611) Upgrade `lz4-java` to 1.10.1
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-54608) Avoid double caching of type converter in UDTF
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-54608) Avoid double caching of type converter in UDTF
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-54610) [SDP] Improve SDP Programming Guide
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-54610) [SDP] Improve SDP Programming Guide
Jacek Laskowski (Jira)
-
[jira] [Assigned] (SPARK-54606) Fix spark.eventLog.rolling.enabled deafult value in docs
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-54606) Fix spark.eventLog.rolling.enabled deafult value in docs
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-52334) Update all files, jars, and pyFiles to reference the working directory after they are downloaded
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-52334) In Kubernetes mode, update all files, jars, archiveFiles, and pyFiles to reference the working directory after they are downloaded.
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-52334) In Kubernetes mode, update all files, jars, archiveFiles, and pyFiles to reference the working directory after they are downloaded.
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-52334) In Kubernetes mode, update all files, jars, archiveFiles, and pyFiles to reference the working directory after they are downloaded.
Dongjoon Hyun (Jira)
-
[jira] [Commented] (SPARK-54584) Add `.name()` to the DataStreamReader to enable source naming
Aparna Garg (Jira)
-
[jira] [Commented] (SPARK-54122) Improve the testing experience for TransformWithState
Aparna Garg (Jira)
-
[jira] [Updated] (SPARK-54609) Add a config to disable TIME type by default ahead of Spark 4.1 release
ASF GitHub Bot (Jira)
-
[jira] [Commented] (SPARK-54609) Add a config to disable TIME type by default ahead of Spark 4.1 release
David Milicevic (Jira)
-
[jira] [Created] (SPARK-54609) Add a config to disable TIME type by default ahead of Spark 4.1 release
David Milicevic (Jira)
-
[jira] [Updated] (SPARK-54608) Avoid double caching of type converter in UDTF
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-54608) Avoid double caching of type converter in UDTF
Ruifeng Zheng (Jira)
-
[jira] [Updated] (SPARK-54607) Remove the unused method `toStringHelper` from `AbstractFetchShuffleBlocks.java`
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-54607) Remove the unused method `toStringHelper` from `AbstractFetchShuffleBlocks.java`
Yang Jie (Jira)
-
[jira] [Updated] (SPARK-54606) Fix spark.eventLog.rolling.enabled deafult value in docs
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-54606) Fix spark.eventLog.rolling.enabled deafult value in docs
Cheng Pan (Jira)
-
[jira] [Resolved] (SPARK-54598) Refactor UDF fetching logic out from invocation
Ruifeng Zheng (Jira)
-
[jira] [Assigned] (SPARK-54598) Refactor UDF fetching logic out from invocation
Ruifeng Zheng (Jira)
-
[jira] [Updated] (SPARK-54605) Driver pod environment variables set via spark.kubernetes.driverEnv can be overridden by spark-env.sh
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-54605) Driver pod environment variables set via spark.kubernetes.driverEnv can be overridden by spark-env.sh
wangxinyu (Jira)
-
[jira] [Comment Edited] (SPARK-54372) PySpark: incorrect `avg(<timestamp>)` query result
Vindhya G (Jira)
-
[jira] [Commented] (SPARK-54372) PySpark: incorrect `avg(<timestamp>)` query result
Vindhya G (Jira)
-
[jira] [Updated] (SPARK-54603) Typo in contributing.rst "a example" -> "an example"
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-54604) Grammar errors in python_data_source.rst
Yicong Huang (Jira)
-
[jira] [Commented] (SPARK-54603) Typo in contributing.rst "a example" -> "an example"
Aparna Garg (Jira)
-
[jira] [Created] (SPARK-54603) Typo in contributing.rst "a example" -> "an example"
Yicong Huang (Jira)
-
[jira] [Updated] (SPARK-54602) Update `NOTICE-binary` with `Netty` `4.2.7.Final` license
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-54602) Update `NOTICE-binary` with `Netty 4.2.7` license
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-54602) Update `NOTICE-binary` with `Netty 4.2.7` license
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-54600) Don't use pickle to save/load models in pyspark.ml.connect
Ruifeng Zheng (Jira)
-
[jira] [Resolved] (SPARK-54600) Don't use pickle to save/load models in pyspark.ml.connect
Ruifeng Zheng (Jira)
-
[jira] [Updated] (SPARK-54602) Update `NOTICE-binary` with `Netty 4.2.7` license
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-54602) Update `NOTICE-binary` with `Netty 4.2.7` license
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-54601) Data loss in TimestampType when writing to MS SQL Server: Microsecond precision truncated to milliseconds
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-54601) Data loss in TimestampType when writing to MS SQL Server: Microsecond precision truncated to milliseconds
Vinod KC (Jira)
-
[jira] [Resolved] (SPARK-54587) Consolidate runner_conf logic
Ruifeng Zheng (Jira)
-
[jira] [Assigned] (SPARK-54587) Consolidate runner_conf logic
Ruifeng Zheng (Jira)
-
[jira] [Resolved] (SPARK-54591) Upgrade commons-lang3 to 3.20.0
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-54591) Upgrade commons-lang3 to 3.20.0
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-54597) Upgrade `lz4-java` to 1.10.0
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-54597) Upgrade `lz4-java` to 1.10.0
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-54563) Add test to ensure Jetty sanitizes newlines in X-Frame-Options header
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-54563) Add test to ensure Jetty sanitizes newlines in X-Frame-Options header
Ruifeng Zheng (Jira)
-
[jira] [Reopened] (SPARK-54563) Disallow newline in spark.ui.allowFramingFrom
Ruifeng Zheng (Jira)
-
[jira] [Resolved] (SPARK-54563) Disallow newline in spark.ui.allowFramingFrom
Ruifeng Zheng (Jira)
-
[jira] [Updated] (SPARK-54600) Don't use pickle to save/load models in pyspark.ml.connect
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-54600) Don't use pickle to save/load models in pyspark.ml.connect
Ruifeng Zheng (Jira)
-
[jira] [Updated] (SPARK-54599) Make PythonException a SparkThrowable and handle it in Python
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-54599) Make PythonException a SparkThrowable and handle it in Python
Tian Gao (Jira)
-
[jira] [Updated] (SPARK-54598) Refactor UDF fetching logic out from invocation
Yicong Huang (Jira)
-
[jira] [Created] (SPARK-54598) Refactor UDF fetching logic out from invocation
Yicong Huang (Jira)
-
[jira] [Updated] (SPARK-54597) Upgrade `lz4-java` to 1.10.0
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-54597) Upgrade `lz4-java` to 1.10.0
Dongjoon Hyun (Jira)
-
[jira] [Comment Edited] (SPARK-54586) Spark is creating invalid parquet files - put non utf-8 data in string column
Qiegang Long (Jira)
-
[jira] [Commented] (SPARK-54586) Spark is creating invalid parquet files - put non utf-8 data in string column
Qiegang Long (Jira)
-
[jira] [Updated] (SPARK-54596) Burst-aware memoryOverhead Allocation Algorithm for Spark@K8S
Nan Zhu (Jira)
-
[jira] [Comment Edited] (SPARK-54596) Burst-aware memoryOverhead Allocation Algorithm for Spark@K8S
Nan Zhu (Jira)
-
[jira] [Created] (SPARK-54596) Burst-aware memoryOverhead Allocation Algorithm for Spark@K8S
Nan Zhu (Jira)
-
[jira] [Commented] (SPARK-54596) Burst-aware memoryOverhead Allocation Algorithm for Spark@K8S
Nan Zhu (Jira)
-
[jira] [Created] (SPARK-54595) Bind implicit schema coercion behavior with WITH SCHEMA EVOLUTION clause
Szehon Ho (Jira)
-
[jira] [Updated] (SPARK-54595) Keep existing behavior without SCHEMA EVOLUTION clause
Szehon Ho (Jira)
-
[jira] [Assigned] (SPARK-54330) Optimize Py4J calls in spark.createDataFrame
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-54386) JavaEncoderSuite testSimpleEncoders has potential to deadlock
Asif (Jira)
-
[jira] [Assigned] (SPARK-54573) Add test for CONSTRAINTS in case of source with less nested struct field than target
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-54573) Add test for CONSTRAINTS in case of source with less nested struct field than target
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-54578) Perform Code Cleanup on `AssignmentUtils`
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-54578) Perform Code Cleanup on `AssignmentUtils`
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-54581) Postgres connector option `fetchsize` only works when lowercased
ASF GitHub Bot (Jira)
-
[jira] [Commented] (SPARK-54594) Duplicated edges for subquery in plan dot
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-54594) Duplicated edges for subquery in plan dot
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-54594) Duplicated edges for subquery in plan dot
Dongjoon Hyun (Jira)
-
[jira] [Commented] (SPARK-54592) Make `estimatedSize` private
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-54592) Make `estimatedSize` private
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-54592) Make `estimatedSize` private
Dongjoon Hyun (Jira)
-
[jira] [Commented] (SPARK-54565) SparkBuildInfo should load spark-version-info.properties from its own classloader
Dongjoon Hyun (Jira)
-
[jira] [Commented] (SPARK-54533) Metric executorSource.METRIC_RESULT_SIZE is updated with uninitialized value
Dongjoon Hyun (Jira)
-
[jira] [Commented] (SPARK-54309) Add Metrics to DML Operations
Dongjoon Hyun (Jira)
-
[jira] [Commented] (SPARK-54310) Add numSourceRows metric for Merge Into
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-54310) Add numSourceRows metric for Merge Into
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-54562) Block eager analysis / execution inside flow function from server side rather than client side
Sandy Ryza (Jira)
-
[jira] [Assigned] (SPARK-54562) Block eager analysis / execution inside flow function from server side rather than client side
Sandy Ryza (Jira)
-
[jira] [Updated] (SPARK-54594) Duplicated edges for subquery in plan dot
ASF GitHub Bot (Jira)
-
[jira] [Updated] (SPARK-54593) Expand DPP for LogicalRelation and LogicalRDD
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-54594) Duplicated edges for subquery in plan dot
Kent Yao (Jira)
-
[jira] [Created] (SPARK-54593) Expand DPP for LogicalRelation and LogicalRDD
Dustin Smith (Jira)
-
[jira] [Updated] (SPARK-53696) Make the data type for BINARY in PySpark bytes by default
Dmitry (Jira)
-
[jira] [Updated] (SPARK-54592) Make `estimatedSize` private
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-54592) Make `estimatedSize` private
Ruifeng Zheng (Jira)
-
[jira] [Updated] (SPARK-54591) Upgrade commons-lang3 to 3.20.0
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-54591) Upgrade commons-lang3 to 3.20.0
Yang Jie (Jira)
-
[jira] [Reopened] (SPARK-54310) Add numSourceRows metric for Merge Into
Wenchen Fan (Jira)
-
[jira] [Assigned] (SPARK-54570) Propagate the error class correctly in PySpark Connect Client
Ruifeng Zheng (Jira)
-
[jira] [Resolved] (SPARK-54570) Propagate the error class correctly in PySpark Connect Client
Ruifeng Zheng (Jira)
-
[jira] [Assigned] (SPARK-54572) Support VSCode breakpoint for development
Ruifeng Zheng (Jira)
-
[jira] [Resolved] (SPARK-54572) Support VSCode breakpoint for development
Ruifeng Zheng (Jira)
-
[jira] [Created] (SPARK-54590) State Writer supports checkpoint V2
Zifei Feng (Jira)
-
[jira] [Resolved] (SPARK-54316) Consolidate serde for pandas iterator
Ruifeng Zheng (Jira)
-
[jira] [Assigned] (SPARK-54316) Consolidate serde for pandas iterator
Ruifeng Zheng (Jira)
-
[jira] [Resolved] (SPARK-54577) Optimize Py4J calls in schema inference
Ruifeng Zheng (Jira)
-
[jira] [Assigned] (SPARK-54577) Optimize Py4J calls in schema inference
Ruifeng Zheng (Jira)
-
[jira] [Resolved] (SPARK-54575) Reenable SparkConnectCreationTests.test_with_none_and_nan
Ruifeng Zheng (Jira)
-
[jira] [Assigned] (SPARK-54575) Reenable SparkConnectCreationTests.test_with_none_and_nan
Ruifeng Zheng (Jira)
-
[jira] [Updated] (SPARK-53616) Introduce iterator API for pandas grouped agg UDF
ASF GitHub Bot (Jira)
-
[jira] [Updated] (SPARK-54589) Consolidate serde for SQL_GROUPED_AGG_PANDAS
Yicong Huang (Jira)
-
[jira] [Created] (SPARK-54589) Consolidate serde for SQL_GROUPED_AGG_PANDAS
Yicong Huang (Jira)
-
[jira] [Updated] (SPARK-54588) Add time_format function to convert TIME values to formatted string representations
Vinod KC (Jira)
-
[jira] [Created] (SPARK-54588) Add time_format function to convert TIME values to formatted string representations
Vinod KC (Jira)
-
[jira] [Resolved] (SPARK-54576) Add documentation for new sketch based aggregate functions
Daniel Tenedorio (Jira)
-
[jira] [Updated] (SPARK-54587) Consolidate runner_conf logic
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-54587) Consolidate runner_conf logic
Tian Gao (Jira)
-
[jira] [Updated] (SPARK-5192) Parquet fails to parse schema contains '\r'
ASF GitHub Bot (Jira)