[jira] [Updated] (SPARK-47114) In the spark driver pod. Failed to access the krb5 file

[ https://issues.apache.org/jira/browse/SPARK-47114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated SPARK-47114: -- Description: spark runs in kubernetes and accesses an external hdfs cluster (kerberos)，pod error logs

[jira] [Updated] (SPARK-47114) In the spark driver pod. Failed to access the krb5 file

[ https://issues.apache.org/jira/browse/SPARK-47114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated SPARK-47114: -- Description: spark runs in kubernetes and accesses an external hdfs cluster (kerberos)，pod error logs

[jira] [Assigned] (SPARK-47112) Write logs into a file in SparkR Windows build

[ https://issues.apache.org/jira/browse/SPARK-47112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47112: Assignee: Hyukjin Kwon > Write logs into a file in SparkR Windows build >

[jira] [Resolved] (SPARK-47112) Write logs into a file in SparkR Windows build

[ https://issues.apache.org/jira/browse/SPARK-47112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47112. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45192

[jira] [Updated] (SPARK-47116) Install proper Python version in SparkR Windows build to avoid warnings

[ https://issues.apache.org/jira/browse/SPARK-47116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47116: --- Labels: pull-request-available (was: ) > Install proper Python version in SparkR Windows

[jira] [Created] (SPARK-47116) Install proper Python version in SparkR Windows build to avoid warnings

Hyukjin Kwon created SPARK-47116: Summary: Install proper Python version in SparkR Windows build to avoid warnings Key: SPARK-47116 URL: https://issues.apache.org/jira/browse/SPARK-47116 Project:

[jira] [Updated] (SPARK-47113) Revert S3A endpoint fixup logic of SPARK-35878

[ https://issues.apache.org/jira/browse/SPARK-47113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47113: -- Parent: SPARK-47046 Issue Type: Sub-task (was: Task) > Revert S3A endpoint fixup

[jira] [Assigned] (SPARK-47113) Revert S3A endpoint fixup logic of SPARK-35878

[ https://issues.apache.org/jira/browse/SPARK-47113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47113: - Assignee: Steve Loughran > Revert S3A endpoint fixup logic of SPARK-35878 >

[jira] [Resolved] (SPARK-47113) Revert S3A endpoint fixup logic of SPARK-35878

[ https://issues.apache.org/jira/browse/SPARK-47113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47113. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45193

[jira] [Assigned] (SPARK-47115) Use larger memory for Maven builds

[ https://issues.apache.org/jira/browse/SPARK-47115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47115: Assignee: Hyukjin Kwon > Use larger memory for Maven builds >

[jira] [Resolved] (SPARK-47115) Use larger memory for Maven builds

[ https://issues.apache.org/jira/browse/SPARK-47115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47115. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45195

[jira] [Updated] (SPARK-47115) Use larger memory for Maven builds

[ https://issues.apache.org/jira/browse/SPARK-47115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47115: --- Labels: pull-request-available (was: ) > Use larger memory for Maven builds >

[jira] [Created] (SPARK-47115) Use larger memory for Maven builds

Hyukjin Kwon created SPARK-47115: Summary: Use larger memory for Maven builds Key: SPARK-47115 URL: https://issues.apache.org/jira/browse/SPARK-47115 Project: Spark Issue Type: Test

[jira] [Updated] (SPARK-47114) In the spark driver pod. Failed to access the krb5 file

[ https://issues.apache.org/jira/browse/SPARK-47114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated SPARK-47114: -- Description: spark runs in kubernetes and accesses an external hdfs cluster (kerberos)，pod error logs

[jira] [Created] (SPARK-47114) In the spark driver pod. Failed to access the krb5 file

melin created SPARK-47114: - Summary: In the spark driver pod. Failed to access the krb5 file Key: SPARK-47114 URL: https://issues.apache.org/jira/browse/SPARK-47114 Project: Spark Issue Type: New

[jira] [Updated] (SPARK-47113) Revert S3A endpoint fixup logic of SPARK-35878

[ https://issues.apache.org/jira/browse/SPARK-47113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47113: --- Labels: pull-request-available (was: ) > Revert S3A endpoint fixup logic of SPARK-35878 >

[jira] [Created] (SPARK-47113) Revert S3A endpoint fixup logic of SPARK-35878

Dongjoon Hyun created SPARK-47113: - Summary: Revert S3A endpoint fixup logic of SPARK-35878 Key: SPARK-47113 URL: https://issues.apache.org/jira/browse/SPARK-47113 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-46928) Support ListState in Arbitrary State API v2

[ https://issues.apache.org/jira/browse/SPARK-46928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-46928. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44961

[jira] [Assigned] (SPARK-46928) Support ListState in Arbitrary State API v2

[ https://issues.apache.org/jira/browse/SPARK-46928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-46928: Assignee: Bhuwan Sahni > Support ListState in Arbitrary State API v2 >

[jira] [Commented] (SPARK-46934) Unable to create Hive View from certain Spark Dataframe StructType

[ https://issues.apache.org/jira/browse/SPARK-46934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17819062#comment-17819062 ] Yu-Ting LIN commented on SPARK-46934: - [~dongjoon] As I have mentioned before, we are currently

[jira] [Assigned] (SPARK-47052) Separate state tracking variables from MicroBatchExecution/StreamExecution

[ https://issues.apache.org/jira/browse/SPARK-47052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-47052: Assignee: Boyang Jerry Peng > Separate state tracking variables from

[jira] [Resolved] (SPARK-47052) Separate state tracking variables from MicroBatchExecution/StreamExecution

[ https://issues.apache.org/jira/browse/SPARK-47052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-47052. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45109

[jira] [Resolved] (SPARK-47111) Upgrade `PostgreSQL` JDBC driver to 42.7.2 and docker image to 16.2

[ https://issues.apache.org/jira/browse/SPARK-47111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47111. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45191

[jira] [Updated] (SPARK-47112) Write logs into a file in SparkR Windows build

[ https://issues.apache.org/jira/browse/SPARK-47112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47112: --- Labels: pull-request-available (was: ) > Write logs into a file in SparkR Windows build >

[jira] [Created] (SPARK-47112) Write logs into a file in SparkR Windows build

Hyukjin Kwon created SPARK-47112: Summary: Write logs into a file in SparkR Windows build Key: SPARK-47112 URL: https://issues.apache.org/jira/browse/SPARK-47112 Project: Spark Issue Type:

[jira] [Updated] (SPARK-47110) Reenble AmmoniteTest tests in Maven builds

[ https://issues.apache.org/jira/browse/SPARK-47110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-47110: - Description: Disabled in https://github.com/apache/spark/pull/45186 because of TTY issues. See

[jira] [Updated] (SPARK-47110) Reenble AmmoniteTest tests in Maven builds

[ https://issues.apache.org/jira/browse/SPARK-47110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-47110: - Summary: Reenble AmmoniteTest tests in Maven builds (was: Eanble AmmoniteTest tests in Maven

[jira] [Created] (SPARK-47110) Eanble AmmoniteTest tests in Maven builds

Hyukjin Kwon created SPARK-47110: Summary: Eanble AmmoniteTest tests in Maven builds Key: SPARK-47110 URL: https://issues.apache.org/jira/browse/SPARK-47110 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-47109) Upgrade `commons-compress` to 1.26.0

[ https://issues.apache.org/jira/browse/SPARK-47109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47109. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45189

[jira] [Assigned] (SPARK-47109) Upgrade `commons-compress` to 1.26.0

[ https://issues.apache.org/jira/browse/SPARK-47109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47109: - Assignee: Dongjoon Hyun > Upgrade `commons-compress` to 1.26.0 >

[jira] [Updated] (SPARK-47101) HiveExternalCatalog.verifyDataSchema does not fully comply with hive column name rules

[ https://issues.apache.org/jira/browse/SPARK-47101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47101: -- Affects Version/s: (was: 3.5.0) (was: 3.4.2) >

[jira] [Updated] (SPARK-47101) HiveExternalCatalog.verifyDataSchema does not fully comply with hive column name rules

[ https://issues.apache.org/jira/browse/SPARK-47101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-47101: - Issue Type: Improvement (was: Test) > HiveExternalCatalog.verifyDataSchema does not fully comply with

[jira] [Updated] (SPARK-47109) Upgrade `commons-compress` to 1.26.0

[ https://issues.apache.org/jira/browse/SPARK-47109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47109: --- Labels: pull-request-available (was: ) > Upgrade `commons-compress` to 1.26.0 >

[jira] [Created] (SPARK-47109) Upgrade `commons-compress` to 1.26.0

Dongjoon Hyun created SPARK-47109: - Summary: Upgrade `commons-compress` to 1.26.0 Key: SPARK-47109 URL: https://issues.apache.org/jira/browse/SPARK-47109 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-44814) Test to trigger protobuf 4.23.3 crash

[ https://issues.apache.org/jira/browse/SPARK-44814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-44814: --- Labels: pull-request-available (was: ) > Test to trigger protobuf 4.23.3 crash >

[jira] [Resolved] (SPARK-46906) Add a check for stateful operator change for streaming

[ https://issues.apache.org/jira/browse/SPARK-46906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-46906. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44927

[jira] [Resolved] (SPARK-47108) Set `derby.connection.requireAuthentication` to false explicitly in CLIs

[ https://issues.apache.org/jira/browse/SPARK-47108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47108. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45185

[jira] [Assigned] (SPARK-47108) Set `derby.connection.requireAuthentication` to false explicitly in CLIs

[ https://issues.apache.org/jira/browse/SPARK-47108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47108: - Assignee: Dongjoon Hyun > Set `derby.connection.requireAuthentication` to false

[jira] [Updated] (SPARK-47108) Set `derby.connection.requireAuthentication` to false explicitly in CLIs

[ https://issues.apache.org/jira/browse/SPARK-47108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47108: --- Labels: pull-request-available (was: ) > Set `derby.connection.requireAuthentication` to

[jira] [Created] (SPARK-47108) Set `derby.connection.requireAuthentication` to false explicitly in CLIs

Dongjoon Hyun created SPARK-47108: - Summary: Set `derby.connection.requireAuthentication` to false explicitly in CLIs Key: SPARK-47108 URL: https://issues.apache.org/jira/browse/SPARK-47108 Project:

[jira] [Updated] (SPARK-42328) Assign name to _LEGACY_ERROR_TEMP_1175

[ https://issues.apache.org/jira/browse/SPARK-42328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-42328: --- Labels: pull-request-available (was: ) > Assign name to _LEGACY_ERROR_TEMP_1175 >

[jira] [Updated] (SPARK-46257) Upgrade Derby to 10.16.1.1

[ https://issues.apache.org/jira/browse/SPARK-46257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46257: -- Description: [https://db.apache.org/derby/releases/release-10_16_1_1.cgi] 1. Drop Java

[jira] [Updated] (SPARK-46257) Upgrade Derby to 10.16.1.1

[ https://issues.apache.org/jira/browse/SPARK-46257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46257: -- Description: [https://db.apache.org/derby/releases/release-10_16_1_1.cgi] {quote}Derby no

[jira] [Updated] (SPARK-47085) Preformance issue on thrift API

[ https://issues.apache.org/jira/browse/SPARK-47085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47085: -- Fix Version/s: 3.5.2 > Preformance issue on thrift API > --- > >

[jira] [Commented] (SPARK-47085) Preformance issue on thrift API

[ https://issues.apache.org/jira/browse/SPARK-47085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17818989#comment-17818989 ] Dongjoon Hyun commented on SPARK-47085: --- Thank you. I added SPARK-39041 as a link `is caused by`.

[jira] [Commented] (SPARK-47105) Spark Container doesn't have spark group or spark user created

[ https://issues.apache.org/jira/browse/SPARK-47105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17818974#comment-17818974 ] Albert Wong commented on SPARK-47105: - Related: https://issues.apache.org/jira/browse/SPARK-45557 >

[jira] [Updated] (SPARK-47105) Spark Container doesn't have spark group or spark user created

[ https://issues.apache.org/jira/browse/SPARK-47105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Albert Wong updated SPARK-47105: Shepherd: Hyukjin Kwon > Spark Container doesn't have spark group or spark user created >

[jira] [Created] (SPARK-47107) Implement partition reader for python streaming data source

Chaoqin Li created SPARK-47107: -- Summary: Implement partition reader for python streaming data source Key: SPARK-47107 URL: https://issues.apache.org/jira/browse/SPARK-47107 Project: Spark

[jira] [Updated] (SPARK-47106) Plan canonicalization test serializes/deserializes class that is not serializable

[ https://issues.apache.org/jira/browse/SPARK-47106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47106: -- Affects Version/s: 4.0.0 (was: 3.4.0)

[jira] [Updated] (SPARK-47106) Plan canonicalization test serializes/deserializes class that is not serializable

[ https://issues.apache.org/jira/browse/SPARK-47106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47106: -- Issue Type: Improvement (was: Test) > Plan canonicalization test serializes/deserializes

[jira] [Commented] (SPARK-45557) Spark Connect can not be started because of missing user home dir in Docker container

[ https://issues.apache.org/jira/browse/SPARK-45557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17818942#comment-17818942 ] Albert Wong commented on SPARK-45557: - Related https://issues.apache.org/jira/browse/SPARK-47105 >

[jira] [Updated] (SPARK-47105) Spark Container doesn't have spark group or spark user created

[ https://issues.apache.org/jira/browse/SPARK-47105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Albert Wong updated SPARK-47105: Component/s: Spark Docker > Spark Container doesn't have spark group or spark user created >

[jira] [Commented] (SPARK-40513) SPIP: Support Docker Official Image for Spark

[ https://issues.apache.org/jira/browse/SPARK-40513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17818935#comment-17818935 ] Albert Wong commented on SPARK-40513: - Related issue.  

[jira] [Commented] (SPARK-47104) Spark SQL query fails with NullPointerException

[ https://issues.apache.org/jira/browse/SPARK-47104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17818934#comment-17818934 ] Bruce Robbins commented on SPARK-47104: --- It's not a CSV specific issue. You can reproduce with a

[jira] [Updated] (SPARK-47085) Preformance issue on thrift API

[ https://issues.apache.org/jira/browse/SPARK-47085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Izek Greenfield updated SPARK-47085: Description: This new complexity was introduced in SPARK-39041. before this PR the code

[jira] [Commented] (SPARK-47085) Preformance issue on thrift API

[ https://issues.apache.org/jira/browse/SPARK-47085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17818932#comment-17818932 ] Izek Greenfield commented on SPARK-47085: - [~dongjoon] I updated the details > Preformance

[jira] [Updated] (SPARK-47085) Preformance issue on thrift API

[ https://issues.apache.org/jira/browse/SPARK-47085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Izek Greenfield updated SPARK-47085: Description: This new complexity was introduced in SPARK-39041. before this PR the code

[jira] [Created] (SPARK-47106) Plan canonicalization test serializes/deserializes class that is not serializable

Parth Chandra created SPARK-47106: - Summary: Plan canonicalization test serializes/deserializes class that is not serializable Key: SPARK-47106 URL: https://issues.apache.org/jira/browse/SPARK-47106

[jira] [Created] (SPARK-47105) Spark Container doesn't have spark group or spark user created

Albert Wong created SPARK-47105: --- Summary: Spark Container doesn't have spark group or spark user created Key: SPARK-47105 URL: https://issues.apache.org/jira/browse/SPARK-47105 Project: Spark

[jira] [Resolved] (SPARK-45615) Remove redundant"Auto-application to `()` is deprecated" compile suppression rules.

[ https://issues.apache.org/jira/browse/SPARK-45615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45615. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45179

[jira] [Assigned] (SPARK-45615) Remove redundant"Auto-application to `()` is deprecated" compile suppression rules.

[ https://issues.apache.org/jira/browse/SPARK-45615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-45615: - Assignee: Yang Jie > Remove redundant"Auto-application to `()` is deprecated" compile

[jira] [Resolved] (SPARK-47098) Migrate from AppVeyor to GitHub Actions for SparkR tests on Windows

[ https://issues.apache.org/jira/browse/SPARK-47098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47098. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45175

[jira] [Commented] (SPARK-47085) Preformance issue on thrift API

[ https://issues.apache.org/jira/browse/SPARK-47085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17818878#comment-17818878 ] Dongjoon Hyun commented on SPARK-47085: --- Hi, [~igreenfi]and [~yao]. Could you provide some

[jira] [Resolved] (SPARK-46858) Upgrade Pandas to 2.2.0

[ https://issues.apache.org/jira/browse/SPARK-46858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46858. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44881

[jira] [Commented] (SPARK-42328) Assign name to _LEGACY_ERROR_TEMP_1175

[ https://issues.apache.org/jira/browse/SPARK-42328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17818849#comment-17818849 ] Nikola Mandic commented on SPARK-42328: --- [~maxgekk] Yes, thank you. > Assign name to

[jira] [Commented] (SPARK-42328) Assign name to _LEGACY_ERROR_TEMP_1175

[ https://issues.apache.org/jira/browse/SPARK-42328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17818844#comment-17818844 ] Max Gekk commented on SPARK-42328: -- @nikolamand-db Would you like to work on this? > Assign name to

[jira] [Comment Edited] (SPARK-42328) Assign name to _LEGACY_ERROR_TEMP_1175

[ https://issues.apache.org/jira/browse/SPARK-42328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17818844#comment-17818844 ] Max Gekk edited comment on SPARK-42328 at 2/20/24 2:53 PM: --- [~nikolamand-db]

[jira] [Created] (SPARK-47104) Spark SQL query fails with NullPointerException

Chhavi Bansal created SPARK-47104: - Summary: Spark SQL query fails with NullPointerException Key: SPARK-47104 URL: https://issues.apache.org/jira/browse/SPARK-47104 Project: Spark Issue

[jira] [Assigned] (SPARK-47044) Add JDBC query to explain formatted command

[ https://issues.apache.org/jira/browse/SPARK-47044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47044: --- Assignee: Uros Stankovic > Add JDBC query to explain formatted command >

[jira] [Resolved] (SPARK-47044) Add JDBC query to explain formatted command

[ https://issues.apache.org/jira/browse/SPARK-47044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47044. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45102

[jira] [Updated] (SPARK-47103) Make the default storage level of intermediate datasets for MLlib configurable

[ https://issues.apache.org/jira/browse/SPARK-47103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47103: --- Labels: pull-request-available (was: ) > Make the default storage level of intermediate

[jira] [Created] (SPARK-47103) Make the default storage level of intermediate datasets for MLlib configurable

Cheng Pan created SPARK-47103: - Summary: Make the default storage level of intermediate datasets for MLlib configurable Key: SPARK-47103 URL: https://issues.apache.org/jira/browse/SPARK-47103 Project:

[jira] [Updated] (SPARK-46992) Inconsistent results with 'sort', 'cache', and AQE.

[ https://issues.apache.org/jira/browse/SPARK-46992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46992: --- Labels: correctness pull-request-available (was: correctness) > Inconsistent results with

[jira] [Commented] (SPARK-46992) Inconsistent results with 'sort', 'cache', and AQE.

[ https://issues.apache.org/jira/browse/SPARK-46992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17818784#comment-17818784 ] Jie Han commented on SPARK-46992: - It's because the second collect() reuses qe.executedPlan which is a

[jira] [Updated] (SPARK-47009) Create table with collation

[ https://issues.apache.org/jira/browse/SPARK-47009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Kandic updated SPARK-47009: -- Epic Link: SPARK-46830 > Create table with collation > --- > >

[jira] [Updated] (SPARK-47102) Add COLLATION_ENABLED config flag

[ https://issues.apache.org/jira/browse/SPARK-47102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Kandic updated SPARK-47102: -- Epic Link: SPARK-46830 > Add COLLATION_ENABLED config flag >

[jira] [Updated] (SPARK-47015) Disable partitioning on collated columns

[ https://issues.apache.org/jira/browse/SPARK-47015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Kandic updated SPARK-47015: -- Epic Link: SPARK-46830 > Disable partitioning on collated columns >

[jira] [Created] (SPARK-47102) Add COLLATION_ENABLED config flag

Mihailo Milosevic created SPARK-47102: - Summary: Add COLLATION_ENABLED config flag Key: SPARK-47102 URL: https://issues.apache.org/jira/browse/SPARK-47102 Project: Spark Issue Type:

[jira] [Updated] (SPARK-47079) Unable to create PySpark dataframe containing Variant columns

[ https://issues.apache.org/jira/browse/SPARK-47079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47079: --- Labels: pull-request-available (was: ) > Unable to create PySpark dataframe containing

[jira] [Commented] (SPARK-44149) Support DataFrame Merge API

[ https://issues.apache.org/jira/browse/SPARK-44149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17818746#comment-17818746 ] Hussein Awala commented on SPARK-44149: --- Is it duplicated by SPARK-46207 which was fixed by

[jira] [Commented] (SPARK-43259) Assign a name to the error class _LEGACY_ERROR_TEMP_2024

[ https://issues.apache.org/jira/browse/SPARK-43259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17818730#comment-17818730 ] Mihailo Milosevic commented on SPARK-43259: --- I want to work on this issue. Raised a PR for

[jira] [Updated] (SPARK-47101) HiveExternalCatalog.verifyDataSchema does not fully comply with hive column name rules

[ https://issues.apache.org/jira/browse/SPARK-47101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47101: --- Labels: pull-request-available (was: ) > HiveExternalCatalog.verifyDataSchema does not

[jira] [Updated] (SPARK-47101) HiveExternalCatalog.verifyDataSchema does not fully comply with hive column name rules

[ https://issues.apache.org/jira/browse/SPARK-47101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-47101: - Summary: HiveExternalCatalog.verifyDataSchema does not fully comply with hive column name rules (was:

[jira] [Created] (SPARK-47101) HiveExternalCatalog.verifyDataSchema does not fully comply hive column name rules

Kent Yao created SPARK-47101: Summary: HiveExternalCatalog.verifyDataSchema does not fully comply hive column name rules Key: SPARK-47101 URL: https://issues.apache.org/jira/browse/SPARK-47101 Project:

[jira] [Assigned] (SPARK-43259) Assign a name to the error class _LEGACY_ERROR_TEMP_2024

[ https://issues.apache.org/jira/browse/SPARK-43259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-43259: -- Assignee: (was: Apache Spark) > Assign a name to the error class

[jira] [Assigned] (SPARK-46743) Count bug introduced for scalar subquery when using TEMPORARY VIEW, as compared to using table

[ https://issues.apache.org/jira/browse/SPARK-46743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-46743: -- Assignee: (was: Apache Spark) > Count bug introduced for scalar subquery when

[jira] [Assigned] (SPARK-46743) Count bug introduced for scalar subquery when using TEMPORARY VIEW, as compared to using table

[ https://issues.apache.org/jira/browse/SPARK-46743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-46743: -- Assignee: Apache Spark > Count bug introduced for scalar subquery when using

[jira] [Assigned] (SPARK-43259) Assign a name to the error class _LEGACY_ERROR_TEMP_2024

[ https://issues.apache.org/jira/browse/SPARK-43259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-43259: -- Assignee: Apache Spark > Assign a name to the error class _LEGACY_ERROR_TEMP_2024 >

[jira] [Assigned] (SPARK-43259) Assign a name to the error class _LEGACY_ERROR_TEMP_2024

[ https://issues.apache.org/jira/browse/SPARK-43259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-43259: -- Assignee: (was: Apache Spark) > Assign a name to the error class

[jira] [Assigned] (SPARK-43259) Assign a name to the error class _LEGACY_ERROR_TEMP_2024

[ https://issues.apache.org/jira/browse/SPARK-43259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-43259: -- Assignee: Apache Spark > Assign a name to the error class _LEGACY_ERROR_TEMP_2024 >

[jira] [Resolved] (SPARK-47100) Upgrade netty to 4.1.107.Final and netty-tcnative to 2.0.62.Final

[ https://issues.apache.org/jira/browse/SPARK-47100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-47100. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45178

[jira] [Assigned] (SPARK-43259) Assign a name to the error class _LEGACY_ERROR_TEMP_2024

[ https://issues.apache.org/jira/browse/SPARK-43259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-43259: -- Assignee: Apache Spark > Assign a name to the error class _LEGACY_ERROR_TEMP_2024 >

[jira] [Assigned] (SPARK-43259) Assign a name to the error class _LEGACY_ERROR_TEMP_2024

[ https://issues.apache.org/jira/browse/SPARK-43259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-43259: -- Assignee: (was: Apache Spark) > Assign a name to the error class