[jira] [Updated] (SPARK-37179) ANSI mode: Allow casting between Timestamp and Numeric

[ https://issues.apache.org/jira/browse/SPARK-37179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-37179: --- Description: The casting between > ANSI mode: Allow casting between Timestamp and Numeric

[jira] [Created] (SPARK-37179) ANSI mode: Allow casting between Timestamp and Numeric

Gengliang Wang created SPARK-37179: -- Summary: ANSI mode: Allow casting between Timestamp and Numeric Key: SPARK-37179 URL: https://issues.apache.org/jira/browse/SPARK-37179 Project: Spark

[jira] [Resolved] (SPARK-37163) Disallow casting Date as Numeric types

[ https://issues.apache.org/jira/browse/SPARK-37163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-37163. Resolution: Won't Do > Disallow casting Date as Numeric types >

[jira] [Created] (SPARK-37163) Disallow casting Date as Numeric types

Gengliang Wang created SPARK-37163: -- Summary: Disallow casting Date as Numeric types Key: SPARK-37163 URL: https://issues.apache.org/jira/browse/SPARK-37163 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-37057) Fix wrong DocSearch facet filter in release-tag.sh

[ https://issues.apache.org/jira/browse/SPARK-37057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-37057. Fix Version/s: 3.2.1 3.3.0 Resolution: Fixed Issue resolved by

[jira] [Created] (SPARK-37057) Fix wrong DocSearch facet filter in release-tag.sh

Gengliang Wang created SPARK-37057: -- Summary: Fix wrong DocSearch facet filter in release-tag.sh Key: SPARK-37057 URL: https://issues.apache.org/jira/browse/SPARK-37057 Project: Spark Issue

[jira] [Updated] (SPARK-36367) Fix the behavior to follow pandas >= 1.3

[ https://issues.apache.org/jira/browse/SPARK-36367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-36367: --- Affects Version/s: (was: 3.3.0) 3.2.0 > Fix the behavior to

[jira] [Updated] (SPARK-34990) Add ParquetEncryptionSuite

[ https://issues.apache.org/jira/browse/SPARK-34990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-34990: --- Priority: Minor (was: Major) > Add ParquetEncryptionSuite > -- > >

[jira] [Updated] (SPARK-34990) Add ParquetEncryptionSuite

[ https://issues.apache.org/jira/browse/SPARK-34990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-34990: --- Issue Type: Test (was: New Feature) > Add ParquetEncryptionSuite >

[jira] [Resolved] (SPARK-34198) Add RocksDB StateStore implementation

[ https://issues.apache.org/jira/browse/SPARK-34198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-34198. Assignee: Apache Spark Resolution: Fixed > Add RocksDB StateStore implementation >

[jira] [Updated] (SPARK-35531) Can not insert into hive bucket table if create table with upper case schema

[ https://issues.apache.org/jira/browse/SPARK-35531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-35531: --- Affects Version/s: 3.0.0 3.1.1 > Can not insert into hive bucket

[jira] [Commented] (SPARK-35531) Can not insert into hive bucket table if create table with upper case schema

[ https://issues.apache.org/jira/browse/SPARK-35531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17425954#comment-17425954 ] Gengliang Wang commented on SPARK-35531: I can reproduce the issue on 3.0.0 and 3.1.1. It's a

[jira] [Commented] (SPARK-36905) Reading Hive view without explicit column names fails in Spark

[ https://issues.apache.org/jira/browse/SPARK-36905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17425072#comment-17425072 ] Gengliang Wang commented on SPARK-36905: [~shardulm] Thanks for reporting the issue. I don't

[jira] [Commented] (SPARK-36892) Disable batch fetch for a shuffle when push based shuffle is enabled

[ https://issues.apache.org/jira/browse/SPARK-36892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17424825#comment-17424825 ] Gengliang Wang commented on SPARK-36892: [~mridulm80] [~mshen] [~zhouyejoe] [~apatnam] Again,

[jira] [Resolved] (SPARK-36892) Disable batch fetch for a shuffle when push based shuffle is enabled

[ https://issues.apache.org/jira/browse/SPARK-36892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-36892. Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 34156

[jira] [Assigned] (SPARK-36892) Disable batch fetch for a shuffle when push based shuffle is enabled

[ https://issues.apache.org/jira/browse/SPARK-36892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-36892: -- Assignee: Ye Zhou > Disable batch fetch for a shuffle when push based shuffle is

[jira] [Assigned] (SPARK-36926) Discrepancy in Q22 of TPCH for Spark 3.2

[ https://issues.apache.org/jira/browse/SPARK-36926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-36926: -- Assignee: Wenchen Fan (was: Gengliang Wang) > Discrepancy in Q22 of TPCH for Spark

[jira] [Assigned] (SPARK-36926) Discrepancy in Q22 of TPCH for Spark 3.2

[ https://issues.apache.org/jira/browse/SPARK-36926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-36926: -- Assignee: Gengliang Wang > Discrepancy in Q22 of TPCH for Spark 3.2 >

[jira] [Resolved] (SPARK-36926) Discrepancy in Q22 of TPCH for Spark 3.2

[ https://issues.apache.org/jira/browse/SPARK-36926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-36926. Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 34193

[jira] [Commented] (SPARK-36892) Disable batch fetch for a shuffle when push based shuffle is enabled

[ https://issues.apache.org/jira/browse/SPARK-36892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17422964#comment-17422964 ] Gengliang Wang commented on SPARK-36892: [~mshen] Thanks for the tests. I understand it is not

[jira] [Commented] (SPARK-36904) The specified datastore driver ("org.postgresql.Driver") was not found in the CLASSPATH

[ https://issues.apache.org/jira/browse/SPARK-36904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17422768#comment-17422768 ] Gengliang Wang commented on SPARK-36904: I tried building the code with ``` ./build/mvn

[jira] [Commented] (SPARK-36904) The specified datastore driver ("org.postgresql.Driver") was not found in the CLASSPATH

[ https://issues.apache.org/jira/browse/SPARK-36904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17422740#comment-17422740 ] Gengliang Wang commented on SPARK-36904: [~jlaskowski] Have you tried using the binary tarball

[jira] [Commented] (SPARK-36892) Disable batch fetch for a shuffle when push based shuffle is enabled

[ https://issues.apache.org/jira/browse/SPARK-36892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17422593#comment-17422593 ] Gengliang Wang commented on SPARK-36892: [~mridulm80] [~zhouyejoe] [~mshen] The push-based

[jira] [Commented] (SPARK-36892) Disable batch fetch for a shuffle when push based shuffle is enabled

[ https://issues.apache.org/jira/browse/SPARK-36892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17422533#comment-17422533 ] Gengliang Wang commented on SPARK-36892: [~zhouyejoe] Thank you! > Disable batch fetch for a

[jira] [Assigned] (SPARK-36836) "sha2" expression with bit_length of 224 returns incorrect results

[ https://issues.apache.org/jira/browse/SPARK-36836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-36836: -- Assignee: Richard Chen > "sha2" expression with bit_length of 224 returns incorrect

[jira] [Resolved] (SPARK-36836) "sha2" expression with bit_length of 224 returns incorrect results

[ https://issues.apache.org/jira/browse/SPARK-36836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-36836. Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 34086

[jira] [Resolved] (SPARK-36873) Add provided Guava dependency for network-yarn module

[ https://issues.apache.org/jira/browse/SPARK-36873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-36873. Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 34125

[jira] [Assigned] (SPARK-36856) Building by "./build/mvn" may be stuck on MacOS

[ https://issues.apache.org/jira/browse/SPARK-36856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-36856: -- Assignee: copperybean > Building by "./build/mvn" may be stuck on MacOS >

[jira] [Updated] (SPARK-36856) Building by "./build/mvn" may be stuck on MacOS

[ https://issues.apache.org/jira/browse/SPARK-36856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-36856: --- Affects Version/s: (was: 3.0.0) 3.2.0 > Building by

[jira] [Updated] (SPARK-36856) Building by "./build/mvn" may be stuck on MacOS

[ https://issues.apache.org/jira/browse/SPARK-36856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-36856: --- Priority: Minor (was: Major) > Building by "./build/mvn" may be stuck on MacOS >

[jira] [Resolved] (SPARK-36856) Building by "./build/mvn" may be stuck on MacOS

[ https://issues.apache.org/jira/browse/SPARK-36856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-36856. Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 34111

[jira] [Comment Edited] (SPARK-36861) Partition columns are overly eagerly parsed as dates

[ https://issues.apache.org/jira/browse/SPARK-36861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17420549#comment-17420549 ] Gengliang Wang edited comment on SPARK-36861 at 9/27/21, 8:06 AM: -- Hmm,

[jira] [Updated] (SPARK-36861) Partition columns are overly eagerly parsed as dates

[ https://issues.apache.org/jira/browse/SPARK-36861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-36861: --- Affects Version/s: (was: 3.2.0) 3.3.0 > Partition columns are

[jira] [Commented] (SPARK-36861) Partition columns are overly eagerly parsed as dates

[ https://issues.apache.org/jira/browse/SPARK-36861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17420549#comment-17420549 ] Gengliang Wang commented on SPARK-36861: Hmm, the PR https://github.com/apache/spark/pull/33709

[jira] [Commented] (SPARK-36861) Partition columns are overly eagerly parsed as dates

[ https://issues.apache.org/jira/browse/SPARK-36861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17420538#comment-17420538 ] Gengliang Wang commented on SPARK-36861: [~tanelk] This is a new behavior introduced from

[jira] [Assigned] (SPARK-36851) Incorrect parsing of negative ANSI typed interval literals

[ https://issues.apache.org/jira/browse/SPARK-36851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-36851: -- Assignee: Peng Lei > Incorrect parsing of negative ANSI typed interval literals >

[jira] [Resolved] (SPARK-36851) Incorrect parsing of negative ANSI typed interval literals

[ https://issues.apache.org/jira/browse/SPARK-36851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-36851. Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 34107

[jira] [Resolved] (SPARK-36827) Task/Stage/Job data remain in memory leads memory leak

[ https://issues.apache.org/jira/browse/SPARK-36827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-36827. Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 34092

[jira] [Assigned] (SPARK-36827) Task/Stage/Job data remain in memory leads memory leak

[ https://issues.apache.org/jira/browse/SPARK-36827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-36827: -- Assignee: Gengliang Wang > Task/Stage/Job data remain in memory leads memory leak >

[jira] [Assigned] (SPARK-36835) Spark 3.2.0 POMs are no longer "dependency reduced"

[ https://issues.apache.org/jira/browse/SPARK-36835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-36835: -- Assignee: Chao Sun > Spark 3.2.0 POMs are no longer "dependency reduced" >

[jira] [Resolved] (SPARK-36835) Spark 3.2.0 POMs are no longer "dependency reduced"

[ https://issues.apache.org/jira/browse/SPARK-36835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-36835. Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 34085

[jira] [Assigned] (SPARK-36782) Deadlock between map-output-dispatcher and dispatcher-BlockManagerMaster upon migrating shuffle blocks

[ https://issues.apache.org/jira/browse/SPARK-36782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-36782: -- Assignee: Fabian Thiele > Deadlock between map-output-dispatcher and

[jira] [Resolved] (SPARK-36782) Deadlock between map-output-dispatcher and dispatcher-BlockManagerMaster upon migrating shuffle blocks

[ https://issues.apache.org/jira/browse/SPARK-36782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-36782. Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 34043

[jira] [Updated] (SPARK-35103) Improve the performance of type coercion rules

[ https://issues.apache.org/jira/browse/SPARK-35103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-35103: --- Summary: Improve the performance of type coercion rules (was: Improve type coercion rule

[jira] [Assigned] (SPARK-36772) FinalizeShuffleMerge fails with an exception due to attempt id not matching

[ https://issues.apache.org/jira/browse/SPARK-36772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-36772: -- Assignee: Ye Zhou > FinalizeShuffleMerge fails with an exception due to attempt id

[jira] [Resolved] (SPARK-36772) FinalizeShuffleMerge fails with an exception due to attempt id not matching

[ https://issues.apache.org/jira/browse/SPARK-36772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-36772. Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 34018

[jira] [Comment Edited] (SPARK-36433) Logs should show correct URL of where HistoryServer is started

[ https://issues.apache.org/jira/browse/SPARK-36433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17416007#comment-17416007 ] Gengliang Wang edited comment on SPARK-36433 at 9/16/21, 9:34 AM: --

[jira] [Assigned] (SPARK-36433) Logs should show correct URL of where HistoryServer is started

[ https://issues.apache.org/jira/browse/SPARK-36433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-36433: -- Assignee: Thejdeep Gudivada (was: Thejdeep) > Logs should show correct URL of where

[jira] [Assigned] (SPARK-36433) Logs should show correct URL of where HistoryServer is started

[ https://issues.apache.org/jira/browse/SPARK-36433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-36433: -- Assignee: Thejdeep > Logs should show correct URL of where HistoryServer is started

[jira] [Commented] (SPARK-36433) Logs should show correct URL of where HistoryServer is started

[ https://issues.apache.org/jira/browse/SPARK-36433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17416007#comment-17416007 ] Gengliang Wang commented on SPARK-36433: [~thejdeep][~holden] The regression change SPARK-36237

[jira] [Updated] (SPARK-36433) Logs should show correct URL of where HistoryServer is started

[ https://issues.apache.org/jira/browse/SPARK-36433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-36433: --- Priority: Minor (was: Blocker) > Logs should show correct URL of where HistoryServer is

[jira] [Updated] (SPARK-36433) Logs should show correct URL of where HistoryServer is started

[ https://issues.apache.org/jira/browse/SPARK-36433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-36433: --- Affects Version/s: (was: 3.2.0) 3.3.0 > Logs should show correct

[jira] [Resolved] (SPARK-36433) Logs should show correct URL of where HistoryServer is started

[ https://issues.apache.org/jira/browse/SPARK-36433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-36433. Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33659

[jira] [Commented] (SPARK-34183) DataSource V2: Support required distribution and ordering in SS

[ https://issues.apache.org/jira/browse/SPARK-34183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17415987#comment-17415987 ] Gengliang Wang commented on SPARK-34183: [~kabhwan]DSV2 APIs are still in development. Shall we

[jira] [Resolved] (SPARK-36734) Upgrade ORC to 1.5.13

[ https://issues.apache.org/jira/browse/SPARK-36734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-36734. Fix Version/s: 3.1.3 Resolution: Fixed Issue resolved by pull request 33972

[jira] [Created] (SPARK-36775) Add documentation for ANSI store assignment rules

Gengliang Wang created SPARK-36775: -- Summary: Add documentation for ANSI store assignment rules Key: SPARK-36775 URL: https://issues.apache.org/jira/browse/SPARK-36775 Project: Spark Issue

[jira] [Commented] (SPARK-36772) FinalizeShuffleMerge fails with an exception due to attempt id not matching

[ https://issues.apache.org/jira/browse/SPARK-36772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17415810#comment-17415810 ] Gengliang Wang commented on SPARK-36772: [~mridulm80]Thanks for the ping. I will cut RC3 after

[jira] [Commented] (SPARK-36596) Review and fix issues in 3.2.0 Documents

[ https://issues.apache.org/jira/browse/SPARK-36596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17414681#comment-17414681 ] Gengliang Wang commented on SPARK-36596: [~holden] Yes, marking this one as fixed. Thanks! >

[jira] [Resolved] (SPARK-36596) Review and fix issues in 3.2.0 Documents

[ https://issues.apache.org/jira/browse/SPARK-36596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-36596. Resolution: Fixed > Review and fix issues in 3.2.0 Documents >

[jira] [Resolved] (SPARK-36724) Support timestamp_ntz as a type of time column for SessionWindow

[ https://issues.apache.org/jira/browse/SPARK-36724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-36724. Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33965

[jira] [Updated] (SPARK-33275) ANSI mode: runtime errors instead of returning null on invalid inputs

[ https://issues.apache.org/jira/browse/SPARK-33275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-33275: --- Summary: ANSI mode: runtime errors instead of returning null on invalid inputs (was: ANSI

[jira] [Commented] (SPARK-34276) Check the unreleased/unresolved JIRAs/PRs of Parquet 1.11 and 1.12

[ https://issues.apache.org/jira/browse/SPARK-34276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17411391#comment-17411391 ] Gengliang Wang commented on SPARK-34276: [~nemon][~gszadovszky][~csun] the PR

[jira] [Comment Edited] (SPARK-34276) Check the unreleased/unresolved JIRAs/PRs of Parquet 1.11 and 1.12

[ https://issues.apache.org/jira/browse/SPARK-34276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17411391#comment-17411391 ] Gengliang Wang edited comment on SPARK-34276 at 9/7/21, 5:45 PM: -

[jira] [Comment Edited] (SPARK-34276) Check the unreleased/unresolved JIRAs/PRs of Parquet 1.11 and 1.12

[ https://issues.apache.org/jira/browse/SPARK-34276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17411391#comment-17411391 ] Gengliang Wang edited comment on SPARK-34276 at 9/7/21, 5:45 PM: -

[jira] [Resolved] (SPARK-36619) HDFSBackedStateStore and RocksDBStateStore have bugs on prefix scan

[ https://issues.apache.org/jira/browse/SPARK-36619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-36619. Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33870

[jira] [Assigned] (SPARK-36619) HDFSBackedStateStore and RocksDBStateStore have bugs on prefix scan

[ https://issues.apache.org/jira/browse/SPARK-36619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-36619: -- Assignee: Jungtaek Lim > HDFSBackedStateStore and RocksDBStateStore have bugs on

[jira] [Commented] (SPARK-36608) Support TimestampNTZ in PySpark

[ https://issues.apache.org/jira/browse/SPARK-36608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17406492#comment-17406492 ] Gengliang Wang commented on SPARK-36608: Thanks a lot, [~hyukjin.kwon]! > Support TimestampNTZ

[jira] [Created] (SPARK-36606) Enhance the docs and tests of try_add/try_divide

Gengliang Wang created SPARK-36606: -- Summary: Enhance the docs and tests of try_add/try_divide Key: SPARK-36606 URL: https://issues.apache.org/jira/browse/SPARK-36606 Project: Spark Issue

[jira] [Resolved] (SPARK-36597) Fix issues in SQL function docs

[ https://issues.apache.org/jira/browse/SPARK-36597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-36597. Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33847

[jira] [Updated] (SPARK-36595) Document window & session_window function in SQL API doc

[ https://issues.apache.org/jira/browse/SPARK-36595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-36595: --- Parent: SPARK-36596 Issue Type: Sub-task (was: Documentation) > Document window &

[jira] [Updated] (SPARK-36597) Fix issues in SQL function docs

[ https://issues.apache.org/jira/browse/SPARK-36597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-36597: --- Summary: Fix issues in SQL function docs (was: Revise issues in SQL function docs) > Fix

[jira] [Created] (SPARK-36597) Revise issues in SQL function docs

Gengliang Wang created SPARK-36597: -- Summary: Revise issues in SQL function docs Key: SPARK-36597 URL: https://issues.apache.org/jira/browse/SPARK-36597 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-36549) Add taskStatus support multiple value to doc

[ https://issues.apache.org/jira/browse/SPARK-36549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-36549: --- Parent: SPARK-36596 Issue Type: Sub-task (was: Improvement) > Add taskStatus

[jira] [Resolved] (SPARK-36457) Review and fix issues in API docs

[ https://issues.apache.org/jira/browse/SPARK-36457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-36457. Resolution: Fixed > Review and fix issues in API docs > -

[jira] [Updated] (SPARK-36457) Review and fix issues in Scala/Java API docs

[ https://issues.apache.org/jira/browse/SPARK-36457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-36457: --- Summary: Review and fix issues in Scala/Java API docs (was: Review and fix issues in API

[jira] [Updated] (SPARK-36457) Review and fix issues in API docs

[ https://issues.apache.org/jira/browse/SPARK-36457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-36457: --- Parent: SPARK-36596 Issue Type: Sub-task (was: Improvement) > Review and fix

[jira] [Created] (SPARK-36596) Review and fix issues in 3.2.0 Documents

Gengliang Wang created SPARK-36596: -- Summary: Review and fix issues in 3.2.0 Documents Key: SPARK-36596 URL: https://issues.apache.org/jira/browse/SPARK-36596 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-36585) Support setting "since" version in FunctionRegistry

[ https://issues.apache.org/jira/browse/SPARK-36585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-36585. Fix Version/s: 3.2.0 Resolution: Fixed The issue is resolved in

[jira] [Updated] (SPARK-36581) Add back transformAllExpressions to AnalysisHelper

[ https://issues.apache.org/jira/browse/SPARK-36581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-36581: --- Priority: Minor (was: Major) > Add back transformAllExpressions to AnalysisHelper >

[jira] [Created] (SPARK-36585) Support setting "since" version in FunctionRegistry

Gengliang Wang created SPARK-36585: -- Summary: Support setting "since" version in FunctionRegistry Key: SPARK-36585 URL: https://issues.apache.org/jira/browse/SPARK-36585 Project: Spark

[jira] [Commented] (SPARK-31936) Implement ScriptTransform in sql/core

[ https://issues.apache.org/jira/browse/SPARK-31936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17403034#comment-17403034 ] Gengliang Wang commented on SPARK-31936: Thank you [~angerszhuuu] > Implement ScriptTransform

[jira] [Commented] (SPARK-31936) Implement ScriptTransform in sql/core

[ https://issues.apache.org/jira/browse/SPARK-31936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17403025#comment-17403025 ] Gengliang Wang commented on SPARK-31936: [~angerszhuuu] Is this finished? > Implement

[jira] [Commented] (SPARK-36558) Stage has all tasks finished but with ongoing finalization can cause job hang

[ https://issues.apache.org/jira/browse/SPARK-36558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17402960#comment-17402960 ] Gengliang Wang commented on SPARK-36558: [~Ngone51] Nice catch. I will cut RC2 after this one is

[jira] [Updated] (SPARK-36557) Update the MAVEN_OPTS in Spark build docs

[ https://issues.apache.org/jira/browse/SPARK-36557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-36557: --- Summary: Update the MAVEN_OPTS in Spark build docs (was: Update the docs for MAVEN_OPTS of

[jira] [Created] (SPARK-36557) Update the docs for MAVEN_OPTS of Spark build

Gengliang Wang created SPARK-36557: -- Summary: Update the docs for MAVEN_OPTS of Spark build Key: SPARK-36557 URL: https://issues.apache.org/jira/browse/SPARK-36557 Project: Spark Issue

[jira] [Updated] (SPARK-36557) Update the docs for MAVEN_OPTS of Spark build

[ https://issues.apache.org/jira/browse/SPARK-36557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-36557: --- Issue Type: Task (was: Bug) > Update the docs for MAVEN_OPTS of Spark build >

[jira] [Reopened] (SPARK-36457) Review and fix issues in API docs

[ https://issues.apache.org/jira/browse/SPARK-36457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reopened SPARK-36457: Assignee: Gengliang Wang I will compare the docs between 3.2 and 3.1 manually > Review

[jira] [Resolved] (SPARK-36551) Add sphinx-plotly-directive in Spark release Dockerfile

[ https://issues.apache.org/jira/browse/SPARK-36551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-36551. Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33797

[jira] [Updated] (SPARK-36551) Add sphinx-plotly-directive in Spark release Dockerfile

[ https://issues.apache.org/jira/browse/SPARK-36551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-36551: --- Summary: Add sphinx-plotly-directive in Spark release Dockerfile (was: Add

[jira] [Created] (SPARK-36551) Add sphinx-plotly-directive in Spark release docker script

Gengliang Wang created SPARK-36551: -- Summary: Add sphinx-plotly-directive in Spark release docker script Key: SPARK-36551 URL: https://issues.apache.org/jira/browse/SPARK-36551 Project: Spark

[jira] [Resolved] (SPARK-36547) Downgrade scala-maven-plugin to 4.3.0

[ https://issues.apache.org/jira/browse/SPARK-36547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-36547. Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33791

[jira] [Created] (SPARK-36547) Downgrade scala-maven-plugin to 4.3.0

Gengliang Wang created SPARK-36547: -- Summary: Downgrade scala-maven-plugin to 4.3.0 Key: SPARK-36547 URL: https://issues.apache.org/jira/browse/SPARK-36547 Project: Spark Issue Type:

[jira] [Updated] (SPARK-34305) Unify v1 and v2 ALTER TABLE .. SET SERDE tests

[ https://issues.apache.org/jira/browse/SPARK-34305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-34305: --- Fix Version/s: (was: 3.2.0) 3.3.0 > Unify v1 and v2 ALTER TABLE ..

[jira] [Updated] (SPARK-34332) Unify v1 and v2 ALTER TABLE .. SET LOCATION tests

[ https://issues.apache.org/jira/browse/SPARK-34332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-34332: --- Fix Version/s: (was: 3.2.0) 3.3.0 > Unify v1 and v2 ALTER TABLE ..

[jira] [Updated] (SPARK-36082) when the right side is small enough to use SingleColumn Null Aware Anti Join

[ https://issues.apache.org/jira/browse/SPARK-36082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-36082: --- Fix Version/s: (was: 3.2.0) 3.3.0 > when the right side is small

[jira] [Resolved] (SPARK-34884) Improve dynamic partition pruning evaluation

[ https://issues.apache.org/jira/browse/SPARK-34884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-34884. Resolution: Fixed > Improve dynamic partition pruning evaluation >

[jira] [Resolved] (SPARK-36512) Fix UISeleniumSuite in sql/hive-thriftserver

[ https://issues.apache.org/jira/browse/SPARK-36512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-36512. Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33741

[jira] [Comment Edited] (SPARK-36465) Dynamic gap duration in session window

[ https://issues.apache.org/jira/browse/SPARK-36465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17400803#comment-17400803 ] Gengliang Wang edited comment on SPARK-36465 at 8/18/21, 5:51 AM: --

[jira] [Commented] (SPARK-36465) Dynamic gap duration in session window

[ https://issues.apache.org/jira/browse/SPARK-36465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17400803#comment-17400803 ] Gengliang Wang commented on SPARK-36465: [~viirya][~kabhwan]FYI I converted this one as a

[jira] [Updated] (SPARK-36465) Dynamic gap duration in session window

[ https://issues.apache.org/jira/browse/SPARK-36465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-36465: --- Parent: SPARK-10816 Issue Type: Sub-task (was: Improvement) > Dynamic gap duration

<    5   6   7   8   9   10   11   12   13   14   >