[jira] [Updated] (SPARK-35978) Support new keyword TIMESTAMP_LTZ

[ https://issues.apache.org/jira/browse/SPARK-35978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-35978: --- Affects Version/s: (was: 3.3.0) > Support new keyword TIMESTAMP_LTZ >

[jira] [Updated] (SPARK-35978) Support new keyword TIMESTAMP_LTZ

[ https://issues.apache.org/jira/browse/SPARK-35978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-35978: --- Affects Version/s: 3.3.0 > Support new keyword TIMESTAMP_LTZ >

[jira] [Resolved] (SPARK-35955) Fix decimal overflow issues for Average

[ https://issues.apache.org/jira/browse/SPARK-35955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-35955. Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33177

[jira] [Assigned] (SPARK-35955) Fix decimal overflow issues for Average

[ https://issues.apache.org/jira/browse/SPARK-35955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-35955: -- Assignee: Karen Feng > Fix decimal overflow issues for Average >

[jira] [Assigned] (SPARK-35897) Support user defined initial state with flatMapGroupsWithState in Structured Streaming

[ https://issues.apache.org/jira/browse/SPARK-35897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-35897: -- Assignee: Rahul Shivu Mahadev > Support user defined initial state with

[jira] [Resolved] (SPARK-35897) Support user defined initial state with flatMapGroupsWithState in Structured Streaming

[ https://issues.apache.org/jira/browse/SPARK-35897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-35897. Resolution: Fixed Issue resolved by pull request 33093

[jira] [Assigned] (SPARK-35984) Add a config to force using ShuffledHashJoin for test purpose

[ https://issues.apache.org/jira/browse/SPARK-35984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35984: Assignee: (was: Apache Spark) > Add a config to force using ShuffledHashJoin for

[jira] [Commented] (SPARK-35984) Add a config to force using ShuffledHashJoin for test purpose

[ https://issues.apache.org/jira/browse/SPARK-35984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17373193#comment-17373193 ] Apache Spark commented on SPARK-35984: -- User 'linhongliu-db' has created a pull request for this

[jira] [Assigned] (SPARK-35984) Add a config to force using ShuffledHashJoin for test purpose

[ https://issues.apache.org/jira/browse/SPARK-35984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35984: Assignee: Apache Spark > Add a config to force using ShuffledHashJoin for test purpose >

[jira] [Assigned] (SPARK-35982) Allow from_json/to_json for map types where value types are year-month intervals

[ https://issues.apache.org/jira/browse/SPARK-35982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35982: Assignee: Kousuke Saruta (was: Apache Spark) > Allow from_json/to_json for map types

[jira] [Assigned] (SPARK-35982) Allow from_json/to_json for map types where value types are year-month intervals

[ https://issues.apache.org/jira/browse/SPARK-35982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35982: Assignee: Apache Spark (was: Kousuke Saruta) > Allow from_json/to_json for map types

[jira] [Commented] (SPARK-35982) Allow from_json/to_json for map types where value types are year-month intervals

[ https://issues.apache.org/jira/browse/SPARK-35982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17373164#comment-17373164 ] Apache Spark commented on SPARK-35982: -- User 'sarutak' has created a pull request for this issue:

[jira] [Created] (SPARK-35984) Add a config to force using ShuffledHashJoin for test purpose

Linhong Liu created SPARK-35984: --- Summary: Add a config to force using ShuffledHashJoin for test purpose Key: SPARK-35984 URL: https://issues.apache.org/jira/browse/SPARK-35984 Project: Spark

[jira] [Updated] (SPARK-35983) Allow from_json/to_json for map types where value types are day-time intervals

[ https://issues.apache.org/jira/browse/SPARK-35983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-35983: --- Description: In the current master, from_json and to_json are doesn't support map types

[jira] [Updated] (SPARK-35982) Allow from_json/to_json for map types where value types are year-month intervals

[ https://issues.apache.org/jira/browse/SPARK-35982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-35982: --- Description: In the current master, from_json and to_json are doesn't support map types

[jira] [Updated] (SPARK-35982) Allow from_json/to_json for map types where value types are year-month intervals

[ https://issues.apache.org/jira/browse/SPARK-35982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-35982: --- Summary: Allow from_json/to_json for map types where value types are year-month intervals

[jira] [Updated] (SPARK-35983) Allow from_json/to_json for map types where value types are day-time intervals

[ https://issues.apache.org/jira/browse/SPARK-35983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-35983: --- Summary: Allow from_json/to_json for map types where value types are day-time intervals

[jira] [Created] (SPARK-35983) Allow day-time intervals as map value types

Kousuke Saruta created SPARK-35983: -- Summary: Allow day-time intervals as map value types Key: SPARK-35983 URL: https://issues.apache.org/jira/browse/SPARK-35983 Project: Spark Issue Type:

[jira] [Updated] (SPARK-35982) Allow year-month intervals as map value types

[ https://issues.apache.org/jira/browse/SPARK-35982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-35982: --- Summary: Allow year-month intervals as map value types (was: Allow year-month intervals as

[jira] [Updated] (SPARK-35982) Allow year-month intervals as map value types

[ https://issues.apache.org/jira/browse/SPARK-35982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-35982: --- Description: In the current master, an exception is thrown if we specify year-month

[jira] [Created] (SPARK-35982) Allow year-month intervals as map key types

Kousuke Saruta created SPARK-35982: -- Summary: Allow year-month intervals as map key types Key: SPARK-35982 URL: https://issues.apache.org/jira/browse/SPARK-35982 Project: Spark Issue Type:

[jira] [Updated] (SPARK-32899) Support submit application with user-defined cluster manager

[ https://issues.apache.org/jira/browse/SPARK-32899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xianyang Liu updated SPARK-32899: - Description: We have supported users to define the customed cluster manager with

[jira] [Resolved] (SPARK-35339) Improve unit tests for data-type-based basic operations

[ https://issues.apache.org/jira/browse/SPARK-35339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-35339. --- Fix Version/s: 3.2.0 Assignee: Xinrong Meng Resolution: Fixed Issue

[jira] [Commented] (SPARK-35825) Increase the heap and stack size for Maven build

[ https://issues.apache.org/jira/browse/SPARK-35825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17373114#comment-17373114 ] Apache Spark commented on SPARK-35825: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-35779) Support dynamic filtering for v2 tables

[ https://issues.apache.org/jira/browse/SPARK-35779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-35779: --- Assignee: Anton Okolnychyi > Support dynamic filtering for v2 tables >

[jira] [Resolved] (SPARK-35779) Support dynamic filtering for v2 tables

[ https://issues.apache.org/jira/browse/SPARK-35779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-35779. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32921

[jira] [Commented] (SPARK-35981) Use check_exact=False in StatsTest.test_cov_corr_meta to loosen the check precision

[ https://issues.apache.org/jira/browse/SPARK-35981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17373079#comment-17373079 ] Apache Spark commented on SPARK-35981: -- User 'ueshin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-35981) Use check_exact=False in StatsTest.test_cov_corr_meta to loosen the check precision

[ https://issues.apache.org/jira/browse/SPARK-35981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35981: Assignee: (was: Apache Spark) > Use check_exact=False in

[jira] [Assigned] (SPARK-35981) Use check_exact=False in StatsTest.test_cov_corr_meta to loosen the check precision

[ https://issues.apache.org/jira/browse/SPARK-35981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35981: Assignee: Apache Spark > Use check_exact=False in StatsTest.test_cov_corr_meta to loosen

[jira] [Commented] (SPARK-35981) Use check_exact=False in StatsTest.test_cov_corr_meta to loosen the check precision

[ https://issues.apache.org/jira/browse/SPARK-35981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17373078#comment-17373078 ] Apache Spark commented on SPARK-35981: -- User 'ueshin' has created a pull request for this issue:

[jira] [Updated] (SPARK-35976) Adjust `astype` method for ExtensionDtype in pandas API on Spark

[ https://issues.apache.org/jira/browse/SPARK-35976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-35976: - Description: Currently, `astype` method for ExtensionDtype in pandas API on Spark is not

[jira] [Created] (SPARK-35981) Use check_exact=False in StatsTest.test_cov_corr_meta to loosen the check precision

Takuya Ueshin created SPARK-35981: - Summary: Use check_exact=False in StatsTest.test_cov_corr_meta to loosen the check precision Key: SPARK-35981 URL: https://issues.apache.org/jira/browse/SPARK-35981

[jira] [Assigned] (SPARK-35980) ThreadAudit test helper should log whether a thread is a Daemon thread

[ https://issues.apache.org/jira/browse/SPARK-35980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35980: Assignee: (was: Apache Spark) > ThreadAudit test helper should log whether a thread

[jira] [Commented] (SPARK-35980) ThreadAudit test helper should log whether a thread is a Daemon thread

[ https://issues.apache.org/jira/browse/SPARK-35980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17373069#comment-17373069 ] Apache Spark commented on SPARK-35980: -- User 'timarmstrong' has created a pull request for this

[jira] [Assigned] (SPARK-35980) ThreadAudit test helper should log whether a thread is a Daemon thread

[ https://issues.apache.org/jira/browse/SPARK-35980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35980: Assignee: Apache Spark > ThreadAudit test helper should log whether a thread is a Daemon

[jira] [Commented] (SPARK-35980) ThreadAudit test helper should log whether a thread is a Daemon thread

[ https://issues.apache.org/jira/browse/SPARK-35980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17373068#comment-17373068 ] Apache Spark commented on SPARK-35980: -- User 'timarmstrong' has created a pull request for this

[jira] [Commented] (SPARK-35980) ThreadAudit test helper should log whether a thread is a Daemon thread

[ https://issues.apache.org/jira/browse/SPARK-35980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17373065#comment-17373065 ] Tim Armstrong commented on SPARK-35980: --- I plan to contribute a fix for this. > ThreadAudit test

[jira] [Created] (SPARK-35980) ThreadAudit test helper should log whether a thread is a Daemon thread

Tim Armstrong created SPARK-35980: - Summary: ThreadAudit test helper should log whether a thread is a Daemon thread Key: SPARK-35980 URL: https://issues.apache.org/jira/browse/SPARK-35980 Project:

[jira] [Assigned] (SPARK-35955) Fix decimal overflow issues for Average

[ https://issues.apache.org/jira/browse/SPARK-35955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35955: Assignee: Apache Spark > Fix decimal overflow issues for Average >

[jira] [Commented] (SPARK-35955) Fix decimal overflow issues for Average

[ https://issues.apache.org/jira/browse/SPARK-35955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17373039#comment-17373039 ] Apache Spark commented on SPARK-35955: -- User 'karenfeng' has created a pull request for this issue:

[jira] [Assigned] (SPARK-35955) Fix decimal overflow issues for Average

[ https://issues.apache.org/jira/browse/SPARK-35955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35955: Assignee: (was: Apache Spark) > Fix decimal overflow issues for Average >

[jira] [Resolved] (SPARK-35975) New configuration spark.sql.timestampType for the default timestamp type

[ https://issues.apache.org/jira/browse/SPARK-35975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-35975. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33176

[jira] [Commented] (SPARK-35855) Unify reuse map data structures in non-AQE and AQE rules

[ https://issues.apache.org/jira/browse/SPARK-35855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17373025#comment-17373025 ] Apache Spark commented on SPARK-35855: -- User 'karenfeng' has created a pull request for this issue:

[jira] [Commented] (SPARK-35855) Unify reuse map data structures in non-AQE and AQE rules

[ https://issues.apache.org/jira/browse/SPARK-35855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17373023#comment-17373023 ] Apache Spark commented on SPARK-35855: -- User 'karenfeng' has created a pull request for this issue:

[jira] [Resolved] (SPARK-35974) Spark submit REST cluster/standalone mode - launching an s3a jar with STS

[ https://issues.apache.org/jira/browse/SPARK-35974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-35974. --- Resolution: Cannot Reproduce Could you try to use Apache Spark 3.1.2, please, [~toopt4],

[jira] [Commented] (SPARK-35974) Spark submit REST cluster/standalone mode - launching an s3a jar with STS

[ https://issues.apache.org/jira/browse/SPARK-35974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17372995#comment-17372995 ] Dongjoon Hyun commented on SPARK-35974: --- Free free to reopen this with the updated information

[jira] [Comment Edited] (SPARK-35972) NestColumnPruning cause execute loss output

[ https://issues.apache.org/jira/browse/SPARK-35972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17372980#comment-17372980 ] Dongjoon Hyun edited comment on SPARK-35972 at 7/1/21, 6:06 PM: Hi,

[jira] [Commented] (SPARK-35972) NestColumnPruning cause execute loss output

[ https://issues.apache.org/jira/browse/SPARK-35972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17372980#comment-17372980 ] Dongjoon Hyun commented on SPARK-35972: --- Hi, [~angerszhu]. Could you make this as a BUG? >

[jira] [Created] (SPARK-35979) Return different timestamp literals based on the default timestamp type

Gengliang Wang created SPARK-35979: -- Summary: Return different timestamp literals based on the default timestamp type Key: SPARK-35979 URL: https://issues.apache.org/jira/browse/SPARK-35979 Project:

[jira] [Created] (SPARK-35978) Support new keyword TIMESTAMP_LTZ

Gengliang Wang created SPARK-35978: -- Summary: Support new keyword TIMESTAMP_LTZ Key: SPARK-35978 URL: https://issues.apache.org/jira/browse/SPARK-35978 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-35977) Support new keyword TIMESTAMP_NTZ

Gengliang Wang created SPARK-35977: -- Summary: Support new keyword TIMESTAMP_NTZ Key: SPARK-35977 URL: https://issues.apache.org/jira/browse/SPARK-35977 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-35756) unionByName should support nested struct also

[ https://issues.apache.org/jira/browse/SPARK-35756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-35756. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32972

[jira] [Assigned] (SPARK-35756) unionByName should support nested struct also

[ https://issues.apache.org/jira/browse/SPARK-35756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-35756: --- Assignee: Saurabh Chawla > unionByName should support nested struct also >

[jira] [Created] (SPARK-35976) Adjust `astype` method for ExtensionDtype in pandas API on Spark

Xinrong Meng created SPARK-35976: Summary: Adjust `astype` method for ExtensionDtype in pandas API on Spark Key: SPARK-35976 URL: https://issues.apache.org/jira/browse/SPARK-35976 Project: Spark

[jira] [Assigned] (SPARK-35975) New configuration spark.sql.timestampType for the default timestamp type

[ https://issues.apache.org/jira/browse/SPARK-35975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35975: Assignee: Apache Spark (was: Gengliang Wang) > New configuration

[jira] [Assigned] (SPARK-35975) New configuration spark.sql.timestampType for the default timestamp type

[ https://issues.apache.org/jira/browse/SPARK-35975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35975: Assignee: Gengliang Wang (was: Apache Spark) > New configuration

[jira] [Commented] (SPARK-35975) New configuration spark.sql.timestampType for the default timestamp type

[ https://issues.apache.org/jira/browse/SPARK-35975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17372914#comment-17372914 ] Apache Spark commented on SPARK-35975: -- User 'gengliangwang' has created a pull request for this

[jira] [Created] (SPARK-35975) New configuration spark.sql.timestampType for the default timestamp type

Gengliang Wang created SPARK-35975: -- Summary: New configuration spark.sql.timestampType for the default timestamp type Key: SPARK-35975 URL: https://issues.apache.org/jira/browse/SPARK-35975

[jira] [Commented] (SPARK-35955) Fix decimal overflow issues for Average

[ https://issues.apache.org/jira/browse/SPARK-35955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17372910#comment-17372910 ] Karen Feng commented on SPARK-35955: I have changes almost ready locally, will open PR

[jira] [Updated] (SPARK-35968) Make sure partitions are not too small in AQE partition coalescing

[ https://issues.apache.org/jira/browse/SPARK-35968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-35968: -- Parent: SPARK-33828 Issue Type: Sub-task (was: Improvement) > Make sure partitions

[jira] [Resolved] (SPARK-35969) Make the pod prefix more readable and tallied with K8S DNS Label Names

[ https://issues.apache.org/jira/browse/SPARK-35969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-35969. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33171

[jira] [Assigned] (SPARK-35969) Make the pod prefix more readable and tallied with K8S DNS Label Names

[ https://issues.apache.org/jira/browse/SPARK-35969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-35969: - Assignee: Kent Yao > Make the pod prefix more readable and tallied with K8S DNS Label

[jira] [Created] (SPARK-35974) Spark submit REST cluster/standalone mode - launching an s3a jar with STS

t oo created SPARK-35974: Summary: Spark submit REST cluster/standalone mode - launching an s3a jar with STS Key: SPARK-35974 URL: https://issues.apache.org/jira/browse/SPARK-35974 Project: Spark

[jira] [Assigned] (SPARK-35973) DataSourceV2: Support SHOW CATALOGS

[ https://issues.apache.org/jira/browse/SPARK-35973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35973: Assignee: Apache Spark > DataSourceV2: Support SHOW CATALOGS >

[jira] [Assigned] (SPARK-35973) DataSourceV2: Support SHOW CATALOGS

[ https://issues.apache.org/jira/browse/SPARK-35973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35973: Assignee: (was: Apache Spark) > DataSourceV2: Support SHOW CATALOGS >

[jira] [Commented] (SPARK-35973) DataSourceV2: Support SHOW CATALOGS

[ https://issues.apache.org/jira/browse/SPARK-35973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17372800#comment-17372800 ] Apache Spark commented on SPARK-35973: -- User 'Peng-Lei' has created a pull request for this issue:

[jira] [Updated] (SPARK-35973) DataSourceV2: Support SHOW CATALOGS

[ https://issues.apache.org/jira/browse/SPARK-35973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] PengLei updated SPARK-35973: Description: Datasource V2 can support multiple catalogs. Having "SHOW CATALOGS" to list the catalogs and

[jira] [Commented] (SPARK-35973) DataSourceV2: Support SHOW CATALOGS

[ https://issues.apache.org/jira/browse/SPARK-35973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17372797#comment-17372797 ] PengLei commented on SPARK-35973: - I am woking on this. After 3.2 released > DataSourceV2: Support SHOW

[jira] [Created] (SPARK-35973) DataSourceV2: Support SHOW CATALOGS

PengLei created SPARK-35973: --- Summary: DataSourceV2: Support SHOW CATALOGS Key: SPARK-35973 URL: https://issues.apache.org/jira/browse/SPARK-35973 Project: Spark Issue Type: Task

[jira] [Resolved] (SPARK-35971) Rename the type name of TimestampNTZType as "timestamp_ntz"

[ https://issues.apache.org/jira/browse/SPARK-35971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-35971. Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33173

[jira] [Resolved] (SPARK-35686) Avoid using auto generated alias when creating view

[ https://issues.apache.org/jira/browse/SPARK-35686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-35686. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32832

[jira] [Commented] (SPARK-35972) NestColumnPruning cause execute loss output

[ https://issues.apache.org/jira/browse/SPARK-35972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17372647#comment-17372647 ] angerszhu commented on SPARK-35972: --- We meet a case that it can analyze/optimize and generate

[jira] [Updated] (SPARK-35972) NestColumnPruning cause execute loss output

[ https://issues.apache.org/jira/browse/SPARK-35972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-35972: -- Description: {code:java} Job aborted due to stage failure: Task 47 in stage 1.0 failed 4 times, most

[jira] [Created] (SPARK-35972) NestColumnPruning cause execute loss output

angerszhu created SPARK-35972: - Summary: NestColumnPruning cause execute loss output Key: SPARK-35972 URL: https://issues.apache.org/jira/browse/SPARK-35972 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-35966) Port HIVE-17952: Fix license headers to avoid dangling javadoc warnings

[ https://issues.apache.org/jira/browse/SPARK-35966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-35966. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33169

[jira] [Assigned] (SPARK-35966) Port HIVE-17952: Fix license headers to avoid dangling javadoc warnings

[ https://issues.apache.org/jira/browse/SPARK-35966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-35966: Assignee: Kent Yao > Port HIVE-17952: Fix license headers to avoid dangling javadoc warnings >

[jira] [Assigned] (SPARK-35965) Add documentation for ORC nested column vectorized reader

[ https://issues.apache.org/jira/browse/SPARK-35965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-35965: Assignee: Cheng Su > Add documentation for ORC nested column vectorized reader >

[jira] [Resolved] (SPARK-35965) Add documentation for ORC nested column vectorized reader

[ https://issues.apache.org/jira/browse/SPARK-35965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-35965. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33168

[jira] [Resolved] (SPARK-35685) Prompt recreating the View when there is a schema incompatible change

[ https://issues.apache.org/jira/browse/SPARK-35685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-35685. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32831

[jira] [Assigned] (SPARK-35685) Prompt recreating the View when there is a schema incompatible change

[ https://issues.apache.org/jira/browse/SPARK-35685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-35685: --- Assignee: Linhong Liu > Prompt recreating the View when there is a schema incompatible

[jira] [Assigned] (SPARK-35618) Resolve star expressions in subquery

[ https://issues.apache.org/jira/browse/SPARK-35618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-35618: --- Assignee: Allison Wang > Resolve star expressions in subquery >

[jira] [Resolved] (SPARK-35618) Resolve star expressions in subquery

[ https://issues.apache.org/jira/browse/SPARK-35618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-35618. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32787

[jira] [Commented] (SPARK-35955) Fix decimal overflow issues for Average

[ https://issues.apache.org/jira/browse/SPARK-35955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17372566#comment-17372566 ] dgd_contributor commented on SPARK-35955: - I will raise a pull request soon   > Fix decimal

[jira] [Commented] (SPARK-35721) Path level discover for python unittests

[ https://issues.apache.org/jira/browse/SPARK-35721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17372560#comment-17372560 ] Apache Spark commented on SPARK-35721: -- User 'Yikun' has created a pull request for this issue:

[jira] [Commented] (SPARK-35721) Path level discover for python unittests

[ https://issues.apache.org/jira/browse/SPARK-35721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17372559#comment-17372559 ] Apache Spark commented on SPARK-35721: -- User 'Yikun' has created a pull request for this issue:

[jira] [Commented] (SPARK-35971) Rename the type name of TimestampNTZType as "timestamp_ntz"

[ https://issues.apache.org/jira/browse/SPARK-35971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17372555#comment-17372555 ] Apache Spark commented on SPARK-35971: -- User 'gengliangwang' has created a pull request for this

[jira] [Assigned] (SPARK-35971) Rename the type name of TimestampNTZType as "timestamp_ntz"

[ https://issues.apache.org/jira/browse/SPARK-35971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35971: Assignee: Apache Spark (was: Gengliang Wang) > Rename the type name of TimestampNTZType

[jira] [Assigned] (SPARK-35971) Rename the type name of TimestampNTZType as "timestamp_ntz"

[ https://issues.apache.org/jira/browse/SPARK-35971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35971: Assignee: Gengliang Wang (was: Apache Spark) > Rename the type name of TimestampNTZType

[jira] [Commented] (SPARK-35971) Rename the type name of TimestampNTZType as "timestamp_ntz"

[ https://issues.apache.org/jira/browse/SPARK-35971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17372553#comment-17372553 ] Apache Spark commented on SPARK-35971: -- User 'gengliangwang' has created a pull request for this

[jira] [Assigned] (SPARK-35968) Make sure partitions are not too small in AQE partition coalescing

[ https://issues.apache.org/jira/browse/SPARK-35968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35968: Assignee: Apache Spark > Make sure partitions are not too small in AQE partition

[jira] [Assigned] (SPARK-35968) Make sure partitions are not too small in AQE partition coalescing

[ https://issues.apache.org/jira/browse/SPARK-35968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35968: Assignee: (was: Apache Spark) > Make sure partitions are not too small in AQE

[jira] [Commented] (SPARK-35968) Make sure partitions are not too small in AQE partition coalescing

[ https://issues.apache.org/jira/browse/SPARK-35968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17372552#comment-17372552 ] Apache Spark commented on SPARK-35968: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Created] (SPARK-35971) Rename the type name of TimestampNTZType as "timestamp_ntz"

Gengliang Wang created SPARK-35971: -- Summary: Rename the type name of TimestampNTZType as "timestamp_ntz" Key: SPARK-35971 URL: https://issues.apache.org/jira/browse/SPARK-35971 Project: Spark

[jira] [Resolved] (SPARK-35963) Rename TimestampWithoutTZType to TimestampNTZType

[ https://issues.apache.org/jira/browse/SPARK-35963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-35963. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33167

[jira] [Assigned] (SPARK-35969) Make the pod prefix more readable and tallied with K8S DNS Label Names

[ https://issues.apache.org/jira/browse/SPARK-35969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35969: Assignee: Apache Spark > Make the pod prefix more readable and tallied with K8S DNS

[jira] [Created] (SPARK-35970) Allow predicate for pyspark.sql.functions.array_sort

Ramanan Subramanian created SPARK-35970: --- Summary: Allow predicate for pyspark.sql.functions.array_sort Key: SPARK-35970 URL: https://issues.apache.org/jira/browse/SPARK-35970 Project: Spark

[jira] [Commented] (SPARK-35969) Make the pod prefix more readable and tallied with K8S DNS Label Names

[ https://issues.apache.org/jira/browse/SPARK-35969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17372532#comment-17372532 ] Apache Spark commented on SPARK-35969: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Assigned] (SPARK-35969) Make the pod prefix more readable and tallied with K8S DNS Label Names

[ https://issues.apache.org/jira/browse/SPARK-35969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35969: Assignee: (was: Apache Spark) > Make the pod prefix more readable and tallied with

[jira] [Commented] (SPARK-35969) Make the pod prefix more readable and tallied with K8S DNS Label Names

[ https://issues.apache.org/jira/browse/SPARK-35969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17372531#comment-17372531 ] Apache Spark commented on SPARK-35969: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Created] (SPARK-35969) Make the pod prefix more readable and tallied with K8S DNS Label Names

Kent Yao created SPARK-35969: Summary: Make the pod prefix more readable and tallied with K8S DNS Label Names Key: SPARK-35969 URL: https://issues.apache.org/jira/browse/SPARK-35969 Project: Spark

  1   2   >