[jira] [Updated] (SPARK-49054) Column default value should support current_* functions

[ https://issues.apache.org/jira/browse/SPARK-49054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-49054: - Fix Version/s: 4.0.0 > Column default value should support current_* functions > ---

[jira] [Commented] (SPARK-48483) Allow UnsafeExternalSorter to spill when other consumer requests memory

[ https://issues.apache.org/jira/browse/SPARK-48483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17870074#comment-17870074 ] Jin Chengcheng commented on SPARK-48483: Currently, Spark operator only spill it

[jira] [Created] (SPARK-49077) Remove bouncycastle-related test dependencies from hive-thriftserver module

Yang Jie created SPARK-49077: Summary: Remove bouncycastle-related test dependencies from hive-thriftserver module Key: SPARK-49077 URL: https://issues.apache.org/jira/browse/SPARK-49077 Project: Spark

[jira] [Updated] (SPARK-49076) Fix the outdated logical plan name in `AstBuilder's` comments

[ https://issues.apache.org/jira/browse/SPARK-49076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-49076: Summary: Fix the outdated logical plan name in `AstBuilder's` comments (was: Fix the outdated log

[jira] [Updated] (SPARK-49076) Fix the outdated logical plan name in `AstBuilder`'s comments

[ https://issues.apache.org/jira/browse/SPARK-49076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-49076: --- Labels: pull-request-available (was: ) > Fix the outdated logical plan name in `AstBuilder`

[jira] [Created] (SPARK-49076) Fix the outdated logical plan name in `AstBuilder`'s comments

BingKun Pan created SPARK-49076: --- Summary: Fix the outdated logical plan name in `AstBuilder`'s comments Key: SPARK-49076 URL: https://issues.apache.org/jira/browse/SPARK-49076 Project: Spark

[jira] [Updated] (SPARK-49075) Upgrade JUNit5 related to the latest version

[ https://issues.apache.org/jira/browse/SPARK-49075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-49075: --- Labels: pull-request-available (was: ) > Upgrade JUNit5 related to the latest version > ---

[jira] [Assigned] (SPARK-49074) Fix cached Variant with column size greater than 128KB or individual variant larger than 2kb

[ https://issues.apache.org/jira/browse/SPARK-49074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-49074: --- Assignee: Richard Chen > Fix cached Variant with column size greater than 128KB or individu

[jira] [Resolved] (SPARK-49074) Fix cached Variant with column size greater than 128KB or individual variant larger than 2kb

[ https://issues.apache.org/jira/browse/SPARK-49074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-49074. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47559 [https://gith

[jira] [Commented] (SPARK-48937) Fix collation support for the StringToMap expression (binary & lowercase collation only)

[ https://issues.apache.org/jira/browse/SPARK-48937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17870045#comment-17870045 ] Uroš Bojanić commented on SPARK-48937: -- Sure, go for it! Please keep me posted, and

[jira] [Commented] (SPARK-48937) Fix collation support for the StringToMap expression (binary & lowercase collation only)

[ https://issues.apache.org/jira/browse/SPARK-48937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17870042#comment-17870042 ] psyren99 commented on SPARK-48937: -- Would 2 more days work? Hoping to have something in

[jira] [Updated] (SPARK-49074) Fix cached Variant with column size greater than 128KB or individual variant larger than 2kb

[ https://issues.apache.org/jira/browse/SPARK-49074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-49074: --- Labels: pull-request-available (was: ) > Fix cached Variant with column size greater than 1

[jira] [Created] (SPARK-49074) Fix cached Variant with column size greater than 128KB or individual variant larger than 2kb

Richard Chen created SPARK-49074: Summary: Fix cached Variant with column size greater than 128KB or individual variant larger than 2kb Key: SPARK-49074 URL: https://issues.apache.org/jira/browse/SPARK-49074

[jira] [Resolved] (SPARK-49066) Reduce the effective scope of the configuration `spark.hadoop.hadoop.security.key.provider.path` in test scenarios

[ https://issues.apache.org/jira/browse/SPARK-49066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49066. --- Fix Version/s: 4.0.0 3.5.2 Resolution: Fixed > Reduce the effectiv

[jira] [Updated] (SPARK-49066) Reduce the effective scope of the configuration `spark.hadoop.hadoop.security.key.provider.path` in test scenarios

[ https://issues.apache.org/jira/browse/SPARK-49066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49066: -- Issue Type: Test (was: Improvement) > Reduce the effective scope of the configuration > `spa

[jira] [Commented] (SPARK-48937) Fix collation support for the StringToMap expression (binary & lowercase collation only)

[ https://issues.apache.org/jira/browse/SPARK-48937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17869977#comment-17869977 ] Uroš Bojanić commented on SPARK-48937: -- We're already 7 days past the original dead

[jira] [Commented] (SPARK-48937) Fix collation support for the StringToMap expression (binary & lowercase collation only)

[ https://issues.apache.org/jira/browse/SPARK-48937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17869975#comment-17869975 ] psyren99 commented on SPARK-48937: -- Sorry, if I'm able to finish it would I be reassign

[jira] [Updated] (SPARK-44638) Unable to read from JDBC data sources when using custom schema containing varchar

[ https://issues.apache.org/jira/browse/SPARK-44638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-44638: -- Fix Version/s: 3.5.2 > Unable to read from JDBC data sources when using custom schema containi

[jira] [Resolved] (SPARK-44638) Unable to read from JDBC data sources when using custom schema containing varchar

[ https://issues.apache.org/jira/browse/SPARK-44638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-44638. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47551 [https://

[jira] [Assigned] (SPARK-44638) Unable to read from JDBC data sources when using custom schema containing varchar

[ https://issues.apache.org/jira/browse/SPARK-44638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-44638: - Assignee: Kent Yao > Unable to read from JDBC data sources when using custom schema con

[jira] [Commented] (SPARK-18134) SQL: MapType in Group BY and Joins not working

[ https://issues.apache.org/jira/browse/SPARK-18134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17869944#comment-17869944 ] Dongjoon Hyun commented on SPARK-18134: --- You can file a working PR to the Apache S

[jira] [Commented] (SPARK-48950) Corrupt data from parquet scans

[ https://issues.apache.org/jira/browse/SPARK-48950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17869931#comment-17869931 ] Dongjoon Hyun commented on SPARK-48950: --- Thank you, [~Tom_Newton]. According to th

[jira] [Updated] (SPARK-42388) Avoid unnecessary parquet footer reads when no filters in vectorized reader

[ https://issues.apache.org/jira/browse/SPARK-42388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-42388: --- Labels: pull-request-available (was: ) > Avoid unnecessary parquet footer reads when no fil

[jira] [Commented] (SPARK-49000) Aggregation with DISTINCT gives wrong results when dealing with literals

[ https://issues.apache.org/jira/browse/SPARK-49000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17869930#comment-17869930 ] Dongjoon Hyun commented on SPARK-49000: --- Thank you, [~uros-db]. > Aggregation wit

[jira] [Commented] (SPARK-18134) SQL: MapType in Group BY and Joins not working

[ https://issues.apache.org/jira/browse/SPARK-18134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17869929#comment-17869929 ] Rakesh Kumar commented on SPARK-18134: -- Folks, what is the current state of this JI

[jira] [Commented] (SPARK-49000) Aggregation with DISTINCT gives wrong results when dealing with literals

[ https://issues.apache.org/jira/browse/SPARK-49000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17869928#comment-17869928 ] Uroš Bojanić commented on SPARK-49000: -- [~dongjoon] please try: {code:java} create

[jira] [Commented] (SPARK-49000) Aggregation with DISTINCT gives wrong results when dealing with literals

[ https://issues.apache.org/jira/browse/SPARK-49000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17869925#comment-17869925 ] Dongjoon Hyun commented on SPARK-49000: --- When I use `spark-sq`, Apache Spark 3.5.1

[jira] [Updated] (SPARK-34819) MapType supports orderable semantics

[ https://issues.apache.org/jira/browse/SPARK-34819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-34819: --- Labels: pull-request-available (was: ) > MapType supports orderable semantics > ---

[jira] [Updated] (SPARK-49000) Aggregation with DISTINCT gives wrong results when dealing with literals

[ https://issues.apache.org/jira/browse/SPARK-49000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49000: -- Affects Version/s: 3.4.3 3.3.4 3.5.1

[jira] [Updated] (SPARK-49000) Aggregation with DISTINCT gives wrong results when dealing with literals

[ https://issues.apache.org/jira/browse/SPARK-49000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49000: -- Labels: correctness pull-request-available (was: pull-request-available) > Aggregation with D

[jira] [Resolved] (SPARK-49000) Aggregation with DISTINCT gives wrong results when dealing with literals

[ https://issues.apache.org/jira/browse/SPARK-49000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-49000. - Fix Version/s: 3.5.2 4.0.0 Resolution: Fixed Issue resolved by pull re

[jira] [Assigned] (SPARK-49000) Aggregation with DISTINCT gives wrong results when dealing with literals

[ https://issues.apache.org/jira/browse/SPARK-49000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-49000: --- Assignee: Uroš Bojanić > Aggregation with DISTINCT gives wrong results when dealing with li

[jira] [Updated] (SPARK-49047) Truncate the message for logging

[ https://issues.apache.org/jira/browse/SPARK-49047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-49047: -- Summary: Truncate the message for logging (was: Hide data in LocalRelation message) > Trunca

[jira] [Updated] (SPARK-49047) Hide data in LocalRelation message

[ https://issues.apache.org/jira/browse/SPARK-49047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-49047: --- Labels: pull-request-available (was: ) > Hide data in LocalRelation message > -

[jira] [Updated] (SPARK-49073) Improve docs `sql-ref-syntax-qry-select.md`

[ https://issues.apache.org/jira/browse/SPARK-49073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-49073: --- Labels: pull-request-available (was: ) > Improve docs `sql-ref-syntax-qry-select.md` >

[jira] [Created] (SPARK-49073) Improve docs `sql-ref-syntax-qry-select.md`

BingKun Pan created SPARK-49073: --- Summary: Improve docs `sql-ref-syntax-qry-select.md` Key: SPARK-49073 URL: https://issues.apache.org/jira/browse/SPARK-49073 Project: Spark Issue Type: Improve

[jira] [Assigned] (SPARK-48977) Optimize collation support for string search (UTF8_LCASE collation)

[ https://issues.apache.org/jira/browse/SPARK-48977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-48977: -- Assignee: Apache Spark > Optimize collation support for string search (UTF8_LCASE col

[jira] [Assigned] (SPARK-48977) Optimize collation support for string search (UTF8_LCASE collation)

[ https://issues.apache.org/jira/browse/SPARK-48977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48977: --- Assignee: Uroš Bojanić > Optimize collation support for string search (UTF8_LCASE collation

[jira] [Resolved] (SPARK-48977) Optimize collation support for string search (UTF8_LCASE collation)

[ https://issues.apache.org/jira/browse/SPARK-48977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48977. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47444 [https://gith

[jira] [Assigned] (SPARK-48977) Optimize collation support for string search (UTF8_LCASE collation)

[ https://issues.apache.org/jira/browse/SPARK-48977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-48977: -- Assignee: (was: Apache Spark) > Optimize collation support for string search (UTF

[jira] [Updated] (SPARK-48977) Optimize collation support for string search (UTF8_LCASE collation)

[ https://issues.apache.org/jira/browse/SPARK-48977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48977: --- Labels: pull-request-available (was: ) > Optimize collation support for string search (UTF8

[jira] [Assigned] (SPARK-44638) Unable to read from JDBC data sources when using custom schema containing varchar

[ https://issues.apache.org/jira/browse/SPARK-44638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-44638: -- Assignee: (was: Apache Spark) > Unable to read from JDBC data sources when using

[jira] [Assigned] (SPARK-44638) Unable to read from JDBC data sources when using custom schema containing varchar

[ https://issues.apache.org/jira/browse/SPARK-44638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-44638: -- Assignee: Apache Spark > Unable to read from JDBC data sources when using custom sche

[jira] [Assigned] (SPARK-44638) Unable to read from JDBC data sources when using custom schema containing varchar

[ https://issues.apache.org/jira/browse/SPARK-44638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-44638: -- Assignee: Apache Spark > Unable to read from JDBC data sources when using custom sche

[jira] [Assigned] (SPARK-49000) Aggregation with DISTINCT gives wrong results when dealing with literals

[ https://issues.apache.org/jira/browse/SPARK-49000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-49000: -- Assignee: (was: Apache Spark) > Aggregation with DISTINCT gives wrong results whe

[jira] [Assigned] (SPARK-44638) Unable to read from JDBC data sources when using custom schema containing varchar

[ https://issues.apache.org/jira/browse/SPARK-44638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-44638: -- Assignee: (was: Apache Spark) > Unable to read from JDBC data sources when using

[jira] [Assigned] (SPARK-49000) Aggregation with DISTINCT gives wrong results when dealing with literals

[ https://issues.apache.org/jira/browse/SPARK-49000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-49000: -- Assignee: Apache Spark > Aggregation with DISTINCT gives wrong results when dealing w

[jira] [Updated] (SPARK-44638) Unable to read from JDBC data sources when using custom schema containing varchar

[ https://issues.apache.org/jira/browse/SPARK-44638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-44638: --- Labels: pull-request-available (was: ) > Unable to read from JDBC data sources when using c

[jira] [Assigned] (SPARK-49072) Fix abnormal display of text content which contains two $ in one line but non-formula in docs

[ https://issues.apache.org/jira/browse/SPARK-49072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-49072: -- Assignee: Apache Spark > Fix abnormal display of text content which contains two $ in

[jira] [Assigned] (SPARK-48964) Fix the discrepancy between implementation, comment and documentation of option recursive.fields.max.depth in ProtoBuf connector

[ https://issues.apache.org/jira/browse/SPARK-48964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-48964: Assignee: Wei Guo > Fix the discrepancy between implementation, comment and documentation of > o

[jira] [Assigned] (SPARK-49072) Fix abnormal display of text content which contains two $ in one line but non-formula in docs

[ https://issues.apache.org/jira/browse/SPARK-49072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-49072: -- Assignee: (was: Apache Spark) > Fix abnormal display of text content which contai

[jira] [Assigned] (SPARK-49000) Aggregation with DISTINCT gives wrong results when dealing with literals

[ https://issues.apache.org/jira/browse/SPARK-49000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-49000: -- Assignee: Apache Spark > Aggregation with DISTINCT gives wrong results when dealing w

[jira] [Assigned] (SPARK-49000) Aggregation with DISTINCT gives wrong results when dealing with literals

[ https://issues.apache.org/jira/browse/SPARK-49000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-49000: -- Assignee: (was: Apache Spark) > Aggregation with DISTINCT gives wrong results whe

[jira] [Resolved] (SPARK-48964) Fix the discrepancy between implementation, comment and documentation of option recursive.fields.max.depth in ProtoBuf connector

[ https://issues.apache.org/jira/browse/SPARK-48964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-48964. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47458 [https://github.com

[jira] [Resolved] (SPARK-49064) Upgrade Kafka to 3.8.0

[ https://issues.apache.org/jira/browse/SPARK-49064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49064. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47540 [https://

[jira] [Updated] (SPARK-49071) Remove ArraySortLike trait

[ https://issues.apache.org/jira/browse/SPARK-49071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiDuo You updated SPARK-49071: -- Summary: Remove ArraySortLike trait (was: Cleanup SortArray) > Remove ArraySortLike trait > -

[jira] [Updated] (SPARK-49072) Fix abnormal display of text content which contains two $ in one line but non-formula in docs

[ https://issues.apache.org/jira/browse/SPARK-49072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Guo updated SPARK-49072: Summary: Fix abnormal display of text content which contains two $ in one line but non-formula in docs (w

[jira] [Updated] (SPARK-49072) Fix abnormal display of text content which contains two $ in one line but not non-formula in docs

[ https://issues.apache.org/jira/browse/SPARK-49072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-49072: --- Labels: pull-request-available (was: ) > Fix abnormal display of text content which contain

[jira] [Created] (SPARK-49072) Fix abnormal display of text content which contains two $ in one line but not non-formula in docs

Wei Guo created SPARK-49072: --- Summary: Fix abnormal display of text content which contains two $ in one line but not non-formula in docs Key: SPARK-49072 URL: https://issues.apache.org/jira/browse/SPARK-49072