Messages by Thread
-
-
[jira] [Created] (SPARK-47675) Remove `aws.java.sdk.v2.version` property in pom.xml
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-47674) Enable `spark.metrics.appStatusSource.enabled` by default
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-47655) Integrate timer with Initial State handling for state-v2
ASF GitHub Bot (Jira)
-
[jira] [Commented] (SPARK-39897) StackOverflowError in TaskMemoryManager
Vladimir Prus (Jira)
-
[jira] [Assigned] (SPARK-47674) Enable `spark.metrics.appStatusSource.enabled` by default
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-47674) Enable `spark.metrics.appStatusSource.enabled` by default
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-47674) Enable `spark.metrics.appStatusSource.enabled` by default
Dongjoon Hyun (Jira)
-
[jira] [Created] (SPARK-47673) [Arbitrary State Support] State TTL support - ListState
Eric Marnadi (Jira)
-
[jira] [Created] (SPARK-47672) Avoid double evaluation of non-trivial projected elements from filter pushdown
Holden Karau (Jira)
-
[jira] [Resolved] (SPARK-47659) Improve `*LoggingSuite*`
Gengliang Wang (Jira)
-
[jira] [Updated] (SPARK-47659) Improve `*LoggingSuite*`
Gengliang Wang (Jira)
-
[jira] [Created] (SPARK-47671) Enable structured logging in log4j2.properties.template and update `configuration.md`
Gengliang Wang (Jira)
-
[jira] [Created] (SPARK-47670) Multiple calls to GET_JSON_OBJECT with the same JSON str should parse it just one time
Zheng Shao (Jira)
-
[jira] [Resolved] (SPARK-46840) Collation benchmarking
Wenchen Fan (Jira)
-
[jira] [Assigned] (SPARK-46840) Collation benchmarking
Wenchen Fan (Jira)
-
[jira] [Updated] (SPARK-47669) Add `try_cast` function in DataFrame
ASF GitHub Bot (Jira)
-
[jira] [Updated] (SPARK-47663) Add an end to end tests for checking if spark task works well with resources
ASF GitHub Bot (Jira)
-
[jira] [Commented] (SPARK-47666) Fix NPE when reading mysql bit array as LongType
Kent Yao (Jira)
-
[jira] [Resolved] (SPARK-47666) Fix NPE when reading mysql bit array as LongType
Kent Yao (Jira)
-
[jira] [Created] (SPARK-47668) Add API to remove the existing ResourceProfile from ResourceProfileManager
Bobby Wang (Jira)
-
[jira] [Commented] (SPARK-47567) StringLocate
Milan Dankovic (Jira)
-
[jira] [Assigned] (SPARK-47664) Validate the column name with cached schema
Hyukjin Kwon (Jira)
-
[jira] [Resolved] (SPARK-47664) Validate the column name with cached schema
Hyukjin Kwon (Jira)
-
[jira] [Commented] (SPARK-47240) SPIP: Structured Logging Framework for Apache Spark
BingKun Pan (Jira)
-
[jira] [Created] (SPARK-47667) Specify certain stages for speculative execution
KnightChess (Jira)
-
[jira] [Updated] (SPARK-47666) Fix NPE when reading mysql bit array as LongType
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-47666) Fix NPE when reading mysql bit array as LongType
Kent Yao (Jira)
-
[jira] [Resolved] (SPARK-47569) Disallow comparing variant.
Wenchen Fan (Jira)
-
[jira] [Updated] (SPARK-45593) Building a runnable distribution from master code running spark-sql raise error "java.lang.ClassNotFoundException: org.sparkproject.guava.util.concurrent.internal.InternalFutureFailureAccess"
Yang Jie (Jira)
-
[jira] [Updated] (SPARK-47660) Memory leak in StructType column's .dropFields method
Eylon Ronen (Jira)
-
[jira] [Resolved] (SPARK-47654) Structured logging framework: support log concatenation
Gengliang Wang (Jira)
-
[jira] [Updated] (SPARK-47665) Using SMALLINT to Write ShortType to MYSQL
ASF GitHub Bot (Jira)
-
[jira] [Updated] (SPARK-47540) SPIP: Pure Python Package (Spark Connect)
Hyukjin Kwon (Jira)
-
[jira] [Created] (SPARK-47665) Using SMALLINT to Write ShortType to MYSQL
Kent Yao (Jira)
-
[jira] [Updated] (SPARK-47664) Validate the column name with cached schema
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-47664) Validate the column name with cached schema
Ruifeng Zheng (Jira)
-
[jira] [Created] (SPARK-47663) Add an end to end tests for checking if spark task works well with resources
Bobby Wang (Jira)
-
[jira] [Assigned] (SPARK-47645) Make Spark build with -release instead of -target
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-47645) Make Spark build with -release instead of -target
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-47662) Document Mapping Spark SQL Data Types to MySQL
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-47662) Document Mapping Spark SQL Data Types to MySQL
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-47662) Document Mapping Spark SQL Data Types to MySQL
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-47662) Document Mapping Spark SQL Data Types to MySQL
Kent Yao (Jira)
-
[jira] [Resolved] (SPARK-47658) Upgrade `tink` to 1.12.0
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-47656) Upgrade commons-io to 2.16.0
Dongjoon Hyun (Jira)
-
[jira] [Created] (SPARK-47661) Using from_json with columnNameOfCorruptRecord and ArrayType schema not working
Eylon Ronen (Jira)
-
[jira] [Created] (SPARK-47660) Memory leak in StructType column's .dropFields method
Eylon Ronen (Jira)
-
[jira] [Assigned] (SPARK-42846) Assign a name to the error class _LEGACY_ERROR_TEMP_2011
ASF GitHub Bot (Jira)
-
[jira] [Updated] (SPARK-42846) Assign a name to the error class _LEGACY_ERROR_TEMP_2011
ASF GitHub Bot (Jira)
-
[jira] [Updated] (SPARK-47657) Implement filter pushdown support for collation per file source
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-47657) Implement filter pushdown support for collation per file source
Stefan Kandic (Jira)
-
[jira] [Updated] (SPARK-47656) Upgrade commons-io to 2.16.0
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-47655) Integrate timer with Initial State handling for state-v2
Jing Zhan (Jira)
-
[jira] [Updated] (SPARK-47654) Structured logging framework: support log concatenation
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-47654) Structured logging framework: support log concatenation
Gengliang Wang (Jira)
-
[jira] [Assigned] (SPARK-47576) Implement logInfo API in structured logging framework
Gengliang Wang (Jira)
-
[jira] [Resolved] (SPARK-47576) Implement logInfo API in structured logging framework
Gengliang Wang (Jira)
-
[jira] [Resolved] (SPARK-47637) Use errorCapturingIdentifier rule in more places to improve error messages
Gengliang Wang (Jira)
-
[jira] [Assigned] (SPARK-47637) Use errorCapturingIdentifier rule in more places to improve error messages
Gengliang Wang (Jira)
-
[jira] [Updated] (SPARK-47576) Implement logInfo API in structured logging framework
ASF GitHub Bot (Jira)
-
[jira] [Resolved] (SPARK-47575) Implement logWarning API in structured logging framework
Gengliang Wang (Jira)
-
[jira] [Resolved] (SPARK-47648) Use `checkError()` to check Exception in `[CSV|Json|Xml]Suite` and `[Csv|Json]FunctionsSuite`
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-47648) Use `checkError()` to check Exception in `[CSV|Json|Xml]Suite` and `[Csv|Json]FunctionsSuite`
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-47647) Make MySQL data source be able to read bit(n>1) as BinaryType like Postgres
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-47647) Make MySQL data source be able to read bit(n>1) as BinaryType like Postgres
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-47642) Exclude `org.junit.jupiter` and `org.junit.platform` from `jmock-junit5`
Dongjoon Hyun (Jira)
-
[jira] [Created] (SPARK-47652) Spark Remote Connect to multiple Spark Sessions
Nagharajan Raghavendran (Jira)
-
[jira] [Created] (SPARK-47650) In local mode, Spark DataFrame cannot fully parallelize
yinan zhan (Jira)
-
[jira] [Assigned] (SPARK-47649) Make the parameter `inputs` of the function `[csv|parquet|orc|json|text|xml](paths: String*)` non empty
ASF GitHub Bot (Jira)
-
[jira] [Updated] (SPARK-47649) Make the parameter `inputs` of the function `[csv|parquet|orc|json|text|xml](paths: String*)` non empty
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-47649) Make the parameter `inputs` of the function `[csv|parquet|orc|json|text|xml](paths: String*)` non empty
BingKun Pan (Jira)
-
[jira] [Assigned] (SPARK-47646) try_to_number fails with NPE for malformed input
Hyukjin Kwon (Jira)
-
[jira] [Resolved] (SPARK-47646) try_to_number fails with NPE for malformed input
Hyukjin Kwon (Jira)
-
[jira] [Updated] (SPARK-47648) Use `checkError()` to check Exception in `[CSV|Json|Xml]Suite` and `[Csv|Json]FunctionsSuite`
BingKun Pan (Jira)
-
[jira] [Resolved] (SPARK-47572) Enforce Window partitionSpec is orderable.
Wenchen Fan (Jira)
-
[jira] [Assigned] (SPARK-47572) Enforce Window partitionSpec is orderable.
Wenchen Fan (Jira)
-
[jira] [Updated] (SPARK-47648) Use checkError() to check Exception in [CSV|Json|Xml]Suite and [Csv|Json]FunctionsSuite
BingKun Pan (Jira)
-
[jira] [Updated] (SPARK-47648) Use checkError() to check Exception in [Json|Xml|CSV]Suite and [Json|CSV]FunctionsSuite
BingKun Pan (Jira)
-
[jira] [Updated] (SPARK-47648) Use checkError() to check Exception in `Json/Xml/CSV`Suite and `Csv/Json`FunctionsSuite
BingKun Pan (Jira)
-
[jira] [Created] (SPARK-47648) Use checkError() to check Exception in `Json/Xml/Csv`Suite and ``
BingKun Pan (Jira)
-
[jira] [Updated] (SPARK-47647) Make MySQL data source be able to read bit(n>1) as BinaryType like Postgres
ASF GitHub Bot (Jira)
-
[jira] [Assigned] (SPARK-47644) Refine docstrings of try_*
Hyukjin Kwon (Jira)
-
[jira] [Updated] (SPARK-47646) try_to_number fails with NPE for malformed input
ASF GitHub Bot (Jira)
-
[jira] [Resolved] (SPARK-47644) Refine docstrings of try_*
Hyukjin Kwon (Jira)
-
[jira] [Created] (SPARK-47647) Make MySQL data source be able to read bit(n>1) as BinaryType like Postgres
Kent Yao (Jira)
-
[jira] [Created] (SPARK-47646) try_to_number fails with NPE for malformed input
Hyukjin Kwon (Jira)
-
[jira] [Updated] (SPARK-47645) Make Spark build with -release instead of -target
Yang Jie (Jira)
-
[jira] [Created] (SPARK-47645) Make Spark build with -release instead of -target
Yang Jie (Jira)
-
[jira] [Updated] (SPARK-47575) Implement logWarning API in structured logging framework
Gengliang Wang (Jira)
-
[jira] [Resolved] (SPARK-47574) Introduce Structured Logging Framework
Gengliang Wang (Jira)
-
[jira] [Created] (SPARK-47644) Improve docstrings of try_*
Hyukjin Kwon (Jira)
-
[jira] [Updated] (SPARK-47644) Refine docstrings of try_*
Hyukjin Kwon (Jira)
-
[jira] [Resolved] (SPARK-47629) Add `common/variant` and `connector/kinesis-asl` to maven daily test module list
Yang Jie (Jira)
-
[jira] [Assigned] (SPARK-47629) Add `common/variant` and `connector/kinesis-asl` to maven daily test module list
Yang Jie (Jira)
-
[jira] [Updated] (SPARK-47643) Add pyspark test for python streaming data source
ASF GitHub Bot (Jira)
-
[jira] [Updated] (SPARK-47642) Exclude `org.junit.jupiter` and `org.junit.platform` from `jmock-junit5`
Yang Jie (Jira)
-
[jira] [Created] (SPARK-47642) Exclude `junit-jupiter-api` and `org.junit.platform` from `jmock-junit5`
Yang Jie (Jira)
-
[jira] [Resolved] (SPARK-47568) Fix race condition between maintenance thread and task thead for RocksDB snapshot
Jungtaek Lim (Jira)
-
[jira] [Updated] (SPARK-47639) Support codegen for json_tuple
ASF GitHub Bot (Jira)
-
[jira] [Resolved] (SPARK-47640) Support codegen for json_tuple
Xianming Lei (Jira)
-
[jira] [Created] (SPARK-47640) Support codegen for json_tuple
Xianming Lei (Jira)
-
[jira] [Resolved] (SPARK-47511) Canonicalize With expressions by re-assigning IDs
Wenchen Fan (Jira)
-
[jira] [Created] (SPARK-47639) Support codegen for json_tuple
Xianming Lei (Jira)
-
[jira] [Updated] (SPARK-47638) Skip column name validation in PS
ASF GitHub Bot (Jira)
-
[jira] [Resolved] (SPARK-47638) Skip column name validation in PS
Ruifeng Zheng (Jira)
-
[jira] [Assigned] (SPARK-47638) Skip column name validation in PS
Ruifeng Zheng (Jira)
-
[jira] [Resolved] (SPARK-47525) Support subquery correlation joining on map attributes
Wenchen Fan (Jira)
-
[jira] [Assigned] (SPARK-47525) Support subquery correlation joining on map attributes
Wenchen Fan (Jira)
-
[jira] [Created] (SPARK-47638) Skip column name validation in PS
Ruifeng Zheng (Jira)
-
[jira] [Resolved] (SPARK-47623) Use `QuietTest` in parity tests
Hyukjin Kwon (Jira)
-
[jira] [Resolved] (SPARK-47631) Remove unused `SQLConf.parquetOutputCommitterClass` method
Hyukjin Kwon (Jira)
-
[jira] [Assigned] (SPARK-47631) Remove unused `SQLConf.parquetOutputCommitterClass` method
Hyukjin Kwon (Jira)
-
[jira] [Updated] (SPARK-47637) Use errorCapturingIdentifier rule in more places to improve error messages
ASF GitHub Bot (Jira)
-
[jira] [Resolved] (SPARK-47636) Use Java 17 instead of 17-jre image in K8s Dockerfile
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-47635) Use Java 21 instead of 21-jre in K8s Dockerfile
Dongjoon Hyun (Jira)
-
[jira] [Created] (SPARK-47637) Use errorCapturingIdentifier rule in more places to improve error messages
Serge Rielau (Jira)
-
[jira] [Updated] (SPARK-47636) Use Java 17 instead of 17-jre image in K8s Dockerfile
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-47636) Use Java 17 instead of 17-jre image in K8s Dockerfile
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-47635) Use Java 21 instead of 21-jre in K8s Dockerfile
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-47635) Use Java 21 instead of 21-jre in K8s Dockerfile
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-47635) Use Java 21 instead of 21-jre in K8s Dockerfile
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-47492) Relax definition of whitespace in lexer
Gengliang Wang (Jira)
-
[jira] [Resolved] (SPARK-47492) Relax definition of whitespace in lexer
Gengliang Wang (Jira)
-
[jira] [Updated] (SPARK-47634) Legacy support for map normalization
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-47634) Legacy support for map normalization
Stevo Mitric (Jira)
-
[jira] [Assigned] (SPARK-47632) Ban `com.amazonaws:aws-java-sdk-bundle` dependency
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-47632) Ban `com.amazonaws:aws-java-sdk-bundle` dependency
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-47633) Cache miss for queries using JOIN LATERAL with join condition
Bruce Robbins (Jira)
-
[jira] [Created] (SPARK-47633) Cache miss for queries using JOIN LATERAL with join condition
Bruce Robbins (Jira)
-
[jira] [Updated] (SPARK-47632) Ban `com.amazonaws:aws-java-sdk-bundle` dependency
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-47632) Ban `com.amazonaws:aws-java-sdk-bundle` dependency
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-47631) Remove unused `SQLConf.parquetOutputCommitterClass` method
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-47631) Remove unused `SQLConf.parquetOutputCommitterClass` method
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-47630) Upgrade `zstd-jni` to 1.5.6-1
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-47475) Support `spark.kubernetes.jars.avoidDownloadSchemes` for K8s Cluster Mode
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-47628) Fix Postgres bit array issue 'Cannot cast to boolean'
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-47628) Fix Postgres bit array issue 'Cannot cast to boolean'
Dongjoon Hyun (Jira)
-
[jira] [Commented] (SPARK-47622) Spark creates lot of tiny blocks for a single driverLog file of size less than a dfs.blocksize
Srinivasu Majeti (Jira)
-
[jira] [Updated] (SPARK-47629) Add `common/variant` and `connector/kinesis-asl` to maven daily test module list
Yang Jie (Jira)
-
[jira] [Updated] (SPARK-47629) Add `common/variant` to maven daily test module list
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-47629) Add `common/variant` to maven daily test module list
Yang Jie (Jira)
-
[jira] [Resolved] (SPARK-47559) Codegen Support for variant `parse_json`
Wenchen Fan (Jira)
-
[jira] [Resolved] (SPARK-47621) Refine docstring of `try_sum`, `try_avg`, `avg`, `sum`, `mean`
Ruifeng Zheng (Jira)
-
[jira] [Updated] (SPARK-47614) Update some outdated comments about JavaModuleOptions
BingKun Pan (Jira)
-
[jira] [Resolved] (SPARK-47614) Rename `JavaModuleOptions` to `JVMRuntimeOptions`
Kent Yao (Jira)
-
[jira] [Assigned] (SPARK-47614) Rename `JavaModuleOptions` to `JVMRuntimeOptions`
Kent Yao (Jira)
-
[jira] [Created] (SPARK-47628) Fix Postgres bit array issue 'Cannot cast to boolean'
Kent Yao (Jira)
-
[jira] [Updated] (SPARK-47628) Fix Postgres bit array issue 'Cannot cast to boolean'
Kent Yao (Jira)
-
[jira] [Updated] (SPARK-47626) Addition for Map Implicit Casting of Collated Strings
Mihailo Milosevic (Jira)
-
[jira] [Updated] (SPARK-47625) Addition of Indeterminate Collation Support
Mihailo Milosevic (Jira)
-
[jira] [Created] (SPARK-47626) Addition for Map Implicit Casting of Collated Strings
Mihailo Milosevic (Jira)
-
[jira] [Created] (SPARK-47625) Addition of Indeterminate Collation Support
Mihailo Milosevic (Jira)
-
[jira] [Updated] (SPARK-47210) Addition of implicit casting without indeterminate support
Mihailo Milosevic (Jira)
-
[jira] [Updated] (SPARK-47210) Implicit casting on collated expressions
Mihailo Milosevic (Jira)
-
[jira] [Created] (SPARK-47624) Collation Implict Casting Support
Mihailo Milosevic (Jira)
-
[jira] [Assigned] (SPARK-47210) Implicit casting on collated expressions
ASF GitHub Bot (Jira)
-
[jira] [Updated] (SPARK-47621) Refine docstring of `try_sum`, `try_avg`, `avg`, `sum`, `mean`
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-47622) Spark creates lot of tiny blocks for a single driverLog file of size less than a dfs.blocksize
Srinivasu Majeti (Jira)
-
[jira] [Created] (SPARK-47621) Refine docstring of `try_sum`, `try_avg`, `avg`, `sum`, `mean`
Hyukjin Kwon (Jira)
-
[jira] [Resolved] (SPARK-47363) Initial State without state reader implementation for State API v2.
Jungtaek Lim (Jira)
-
[jira] [Commented] (SPARK-47287) Aggregate in not causes
Juefei Yan (Jira)
-
[jira] [Resolved] (SPARK-47619) Refine docstring of `to_json/from_json`
Hyukjin Kwon (Jira)
-
[jira] [Commented] (SPARK-44050) Unable to Mount ConfigMap in Driver Pod - ConfigMap Creation Issue
liangyouze (Jira)
-
[jira] [Updated] (SPARK-47619) Refine docstring of `to_json/from_json`
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-47619) Refine docstring of `to_json/from_json`
Hyukjin Kwon (Jira)
-
[jira] [Resolved] (SPARK-47543) Inferring `dict` as `MapType` from Pandas DataFrame to allow DataFrame creation.
Hyukjin Kwon (Jira)
-
[jira] [Resolved] (SPARK-47107) Implement partition reader for python streaming data source
Jungtaek Lim (Jira)