[jira] [Assigned] (SPARK-43259) Assign a name to the error class _LEGACY_ERROR_TEMP_2024

2024-02-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-43259: -- Assignee: (was: Apache Spark) > Assign a name to the error class _LEGACY_ERROR_TE

[jira] [Assigned] (SPARK-43259) Assign a name to the error class _LEGACY_ERROR_TEMP_2024

2024-02-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-43259: -- Assignee: Apache Spark > Assign a name to the error class _LEGACY_ERROR_TEMP_2024 > -

[jira] [Resolved] (SPARK-47100) Upgrade netty to 4.1.107.Final and netty-tcnative to 2.0.62.Final

2024-02-20 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-47100. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45178 [https://github.com

[jira] [Assigned] (SPARK-43259) Assign a name to the error class _LEGACY_ERROR_TEMP_2024

2024-02-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-43259: -- Assignee: Apache Spark > Assign a name to the error class _LEGACY_ERROR_TEMP_2024 > -

[jira] [Assigned] (SPARK-43259) Assign a name to the error class _LEGACY_ERROR_TEMP_2024

2024-02-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-43259: -- Assignee: (was: Apache Spark) > Assign a name to the error class _LEGACY_ERROR_TE

[jira] [Assigned] (SPARK-43259) Assign a name to the error class _LEGACY_ERROR_TEMP_2024

2024-02-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-43259: -- Assignee: Apache Spark > Assign a name to the error class _LEGACY_ERROR_TEMP_2024 > -

[jira] [Assigned] (SPARK-46743) Count bug introduced for scalar subquery when using TEMPORARY VIEW, as compared to using table

2024-02-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-46743: -- Assignee: Apache Spark > Count bug introduced for scalar subquery when using TEMPORAR

[jira] [Assigned] (SPARK-46743) Count bug introduced for scalar subquery when using TEMPORARY VIEW, as compared to using table

2024-02-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-46743: -- Assignee: (was: Apache Spark) > Count bug introduced for scalar subquery when usi

[jira] [Assigned] (SPARK-43259) Assign a name to the error class _LEGACY_ERROR_TEMP_2024

2024-02-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-43259: -- Assignee: (was: Apache Spark) > Assign a name to the error class _LEGACY_ERROR_TE

[jira] [Created] (SPARK-47101) HiveExternalCatalog.verifyDataSchema does not fully comply hive column name rules

2024-02-20 Thread Kent Yao (Jira)
Kent Yao created SPARK-47101: Summary: HiveExternalCatalog.verifyDataSchema does not fully comply hive column name rules Key: SPARK-47101 URL: https://issues.apache.org/jira/browse/SPARK-47101 Project: Sp

[jira] [Updated] (SPARK-47101) HiveExternalCatalog.verifyDataSchema does not fully comply with hive column name rules

2024-02-20 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-47101: - Summary: HiveExternalCatalog.verifyDataSchema does not fully comply with hive column name rules (was: H

[jira] [Updated] (SPARK-47101) HiveExternalCatalog.verifyDataSchema does not fully comply with hive column name rules

2024-02-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47101: --- Labels: pull-request-available (was: ) > HiveExternalCatalog.verifyDataSchema does not full

[jira] [Commented] (SPARK-43259) Assign a name to the error class _LEGACY_ERROR_TEMP_2024

2024-02-20 Thread Mihailo Milosevic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17818730#comment-17818730 ] Mihailo Milosevic commented on SPARK-43259: --- I want to work on this issue. Ra

[jira] [Commented] (SPARK-44149) Support DataFrame Merge API

2024-02-20 Thread Hussein Awala (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17818746#comment-17818746 ] Hussein Awala commented on SPARK-44149: --- Is it duplicated by SPARK-46207 which was

[jira] [Updated] (SPARK-47079) Unable to create PySpark dataframe containing Variant columns

2024-02-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47079: --- Labels: pull-request-available (was: ) > Unable to create PySpark dataframe containing Vari

[jira] [Created] (SPARK-47102) Add COLLATION_ENABLED config flag

2024-02-20 Thread Mihailo Milosevic (Jira)
Mihailo Milosevic created SPARK-47102: - Summary: Add COLLATION_ENABLED config flag Key: SPARK-47102 URL: https://issues.apache.org/jira/browse/SPARK-47102 Project: Spark Issue Type: Impro

[jira] [Updated] (SPARK-47015) Disable partitioning on collated columns

2024-02-20 Thread Stefan Kandic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Kandic updated SPARK-47015: -- Epic Link: SPARK-46830 > Disable partitioning on collated columns > --

[jira] [Updated] (SPARK-47102) Add COLLATION_ENABLED config flag

2024-02-20 Thread Stefan Kandic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Kandic updated SPARK-47102: -- Epic Link: SPARK-46830 > Add COLLATION_ENABLED config flag > -

[jira] [Updated] (SPARK-47009) Create table with collation

2024-02-20 Thread Stefan Kandic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Kandic updated SPARK-47009: -- Epic Link: SPARK-46830 > Create table with collation > --- > >

[jira] [Commented] (SPARK-46992) Inconsistent results with 'sort', 'cache', and AQE.

2024-02-20 Thread Jie Han (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17818784#comment-17818784 ] Jie Han commented on SPARK-46992: - It's because the second collect() reuses qe.executedP

[jira] [Updated] (SPARK-46992) Inconsistent results with 'sort', 'cache', and AQE.

2024-02-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46992: --- Labels: correctness pull-request-available (was: correctness) > Inconsistent results with '

[jira] [Created] (SPARK-47103) Make the default storage level of intermediate datasets for MLlib configurable

2024-02-20 Thread Cheng Pan (Jira)
Cheng Pan created SPARK-47103: - Summary: Make the default storage level of intermediate datasets for MLlib configurable Key: SPARK-47103 URL: https://issues.apache.org/jira/browse/SPARK-47103 Project: Spa

[jira] [Updated] (SPARK-47103) Make the default storage level of intermediate datasets for MLlib configurable

2024-02-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47103: --- Labels: pull-request-available (was: ) > Make the default storage level of intermediate dat

[jira] [Assigned] (SPARK-47044) Add JDBC query to explain formatted command

2024-02-20 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47044: --- Assignee: Uros Stankovic > Add JDBC query to explain formatted command > --

[jira] [Resolved] (SPARK-47044) Add JDBC query to explain formatted command

2024-02-20 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47044. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45102 [https://gith

[jira] [Created] (SPARK-47104) Spark SQL query fails with NullPointerException

2024-02-20 Thread Chhavi Bansal (Jira)
Chhavi Bansal created SPARK-47104: - Summary: Spark SQL query fails with NullPointerException Key: SPARK-47104 URL: https://issues.apache.org/jira/browse/SPARK-47104 Project: Spark Issue Type:

[jira] [Comment Edited] (SPARK-42328) Assign name to _LEGACY_ERROR_TEMP_1175

2024-02-20 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17818844#comment-17818844 ] Max Gekk edited comment on SPARK-42328 at 2/20/24 2:53 PM: --- [~

[jira] [Commented] (SPARK-42328) Assign name to _LEGACY_ERROR_TEMP_1175

2024-02-20 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17818844#comment-17818844 ] Max Gekk commented on SPARK-42328: -- @nikolamand-db Would you like to work on this? > A

[jira] [Commented] (SPARK-42328) Assign name to _LEGACY_ERROR_TEMP_1175

2024-02-20 Thread Nikola Mandic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17818849#comment-17818849 ] Nikola Mandic commented on SPARK-42328: --- [~maxgekk] Yes, thank you. > Assign name

[jira] [Resolved] (SPARK-46858) Upgrade Pandas to 2.2.0

2024-02-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46858. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44881 [https://

[jira] [Commented] (SPARK-47085) Preformance issue on thrift API

2024-02-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17818878#comment-17818878 ] Dongjoon Hyun commented on SPARK-47085: --- Hi, [~igreenfi]and [~yao]. Could you pro

[jira] [Resolved] (SPARK-47098) Migrate from AppVeyor to GitHub Actions for SparkR tests on Windows

2024-02-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47098. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45175 [https://

[jira] [Resolved] (SPARK-45615) Remove redundant"Auto-application to `()` is deprecated" compile suppression rules.

2024-02-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45615. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45179 [https://

[jira] [Assigned] (SPARK-45615) Remove redundant"Auto-application to `()` is deprecated" compile suppression rules.

2024-02-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-45615: - Assignee: Yang Jie > Remove redundant"Auto-application to `()` is deprecated" compile s

[jira] [Created] (SPARK-47105) Spark Container doesn't have spark group or spark user created

2024-02-20 Thread Albert Wong (Jira)
Albert Wong created SPARK-47105: --- Summary: Spark Container doesn't have spark group or spark user created Key: SPARK-47105 URL: https://issues.apache.org/jira/browse/SPARK-47105 Project: Spark

[jira] [Created] (SPARK-47106) Plan canonicalization test serializes/deserializes class that is not serializable

2024-02-20 Thread Parth Chandra (Jira)
Parth Chandra created SPARK-47106: - Summary: Plan canonicalization test serializes/deserializes class that is not serializable Key: SPARK-47106 URL: https://issues.apache.org/jira/browse/SPARK-47106 P

[jira] [Updated] (SPARK-47085) Preformance issue on thrift API

2024-02-20 Thread Izek Greenfield (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Izek Greenfield updated SPARK-47085: Description: This new complexity was introduced in SPARK-39041. before this PR the code w

[jira] [Commented] (SPARK-47085) Preformance issue on thrift API

2024-02-20 Thread Izek Greenfield (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17818932#comment-17818932 ] Izek Greenfield commented on SPARK-47085: - [~dongjoon] I updated the details

[jira] [Updated] (SPARK-47085) Preformance issue on thrift API

2024-02-20 Thread Izek Greenfield (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Izek Greenfield updated SPARK-47085: Description: This new complexity was introduced in SPARK-39041. before this PR the code w

[jira] [Commented] (SPARK-47104) Spark SQL query fails with NullPointerException

2024-02-20 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17818934#comment-17818934 ] Bruce Robbins commented on SPARK-47104: --- It's not a CSV specific issue. You can re

[jira] [Commented] (SPARK-40513) SPIP: Support Docker Official Image for Spark

2024-02-20 Thread Albert Wong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17818935#comment-17818935 ] Albert Wong commented on SPARK-40513: - Related issue.  https://issues.apache.org/jir

[jira] [Updated] (SPARK-47105) Spark Container doesn't have spark group or spark user created

2024-02-20 Thread Albert Wong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Albert Wong updated SPARK-47105: Component/s: Spark Docker > Spark Container doesn't have spark group or spark user created > -

[jira] [Commented] (SPARK-45557) Spark Connect can not be started because of missing user home dir in Docker container

2024-02-20 Thread Albert Wong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17818942#comment-17818942 ] Albert Wong commented on SPARK-45557: - Related https://issues.apache.org/jira/browse

[jira] [Updated] (SPARK-47106) Plan canonicalization test serializes/deserializes class that is not serializable

2024-02-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47106: -- Issue Type: Improvement (was: Test) > Plan canonicalization test serializes/deserializes clas

[jira] [Updated] (SPARK-47106) Plan canonicalization test serializes/deserializes class that is not serializable

2024-02-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47106: -- Affects Version/s: 4.0.0 (was: 3.4.0) (wa

[jira] [Created] (SPARK-47107) Implement partition reader for python streaming data source

2024-02-20 Thread Chaoqin Li (Jira)
Chaoqin Li created SPARK-47107: -- Summary: Implement partition reader for python streaming data source Key: SPARK-47107 URL: https://issues.apache.org/jira/browse/SPARK-47107 Project: Spark Issu

[jira] [Updated] (SPARK-47105) Spark Container doesn't have spark group or spark user created

2024-02-20 Thread Albert Wong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Albert Wong updated SPARK-47105: Shepherd: Hyukjin Kwon > Spark Container doesn't have spark group or spark user created >

[jira] [Commented] (SPARK-47105) Spark Container doesn't have spark group or spark user created

2024-02-20 Thread Albert Wong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17818974#comment-17818974 ] Albert Wong commented on SPARK-47105: - Related: https://issues.apache.org/jira/brows

[jira] [Commented] (SPARK-47085) Preformance issue on thrift API

2024-02-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17818989#comment-17818989 ] Dongjoon Hyun commented on SPARK-47085: --- Thank you. I added SPARK-39041 as a link

[jira] [Updated] (SPARK-47085) Preformance issue on thrift API

2024-02-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47085: -- Fix Version/s: 3.5.2 > Preformance issue on thrift API > --- > >

[jira] [Updated] (SPARK-46257) Upgrade Derby to 10.16.1.1

2024-02-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46257: -- Description: [https://db.apache.org/derby/releases/release-10_16_1_1.cgi] {quote}Derby no long

[jira] [Updated] (SPARK-46257) Upgrade Derby to 10.16.1.1

2024-02-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46257: -- Description: [https://db.apache.org/derby/releases/release-10_16_1_1.cgi] 1. Drop Java Securi

[jira] [Updated] (SPARK-42328) Assign name to _LEGACY_ERROR_TEMP_1175

2024-02-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-42328: --- Labels: pull-request-available (was: ) > Assign name to _LEGACY_ERROR_TEMP_1175 > -

[jira] [Created] (SPARK-47108) Set `derby.connection.requireAuthentication` to false explicitly in CLIs

2024-02-20 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47108: - Summary: Set `derby.connection.requireAuthentication` to false explicitly in CLIs Key: SPARK-47108 URL: https://issues.apache.org/jira/browse/SPARK-47108 Project: S

[jira] [Updated] (SPARK-47108) Set `derby.connection.requireAuthentication` to false explicitly in CLIs

2024-02-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47108: --- Labels: pull-request-available (was: ) > Set `derby.connection.requireAuthentication` to fa

[jira] [Assigned] (SPARK-47108) Set `derby.connection.requireAuthentication` to false explicitly in CLIs

2024-02-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47108: - Assignee: Dongjoon Hyun > Set `derby.connection.requireAuthentication` to false explici

[jira] [Resolved] (SPARK-47108) Set `derby.connection.requireAuthentication` to false explicitly in CLIs

2024-02-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47108. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45185 [https://

[jira] [Resolved] (SPARK-46906) Add a check for stateful operator change for streaming

2024-02-20 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-46906. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44927 [https://gi

[jira] [Updated] (SPARK-44814) Test to trigger protobuf 4.23.3 crash

2024-02-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-44814: --- Labels: pull-request-available (was: ) > Test to trigger protobuf 4.23.3 crash > --

[jira] [Created] (SPARK-47109) Upgrade `commons-compress` to 1.26.0

2024-02-20 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47109: - Summary: Upgrade `commons-compress` to 1.26.0 Key: SPARK-47109 URL: https://issues.apache.org/jira/browse/SPARK-47109 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-47109) Upgrade `commons-compress` to 1.26.0

2024-02-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47109: --- Labels: pull-request-available (was: ) > Upgrade `commons-compress` to 1.26.0 > ---

[jira] [Updated] (SPARK-47101) HiveExternalCatalog.verifyDataSchema does not fully comply with hive column name rules

2024-02-20 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-47101: - Issue Type: Improvement (was: Test) > HiveExternalCatalog.verifyDataSchema does not fully comply with h

[jira] [Updated] (SPARK-47101) HiveExternalCatalog.verifyDataSchema does not fully comply with hive column name rules

2024-02-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47101: -- Affects Version/s: (was: 3.5.0) (was: 3.4.2) > HiveExternalCata

[jira] [Assigned] (SPARK-47109) Upgrade `commons-compress` to 1.26.0

2024-02-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47109: - Assignee: Dongjoon Hyun > Upgrade `commons-compress` to 1.26.0 > --

[jira] [Resolved] (SPARK-47109) Upgrade `commons-compress` to 1.26.0

2024-02-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47109. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45189 [https://

[jira] [Created] (SPARK-47110) Eanble AmmoniteTest tests in Maven builds

2024-02-20 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-47110: Summary: Eanble AmmoniteTest tests in Maven builds Key: SPARK-47110 URL: https://issues.apache.org/jira/browse/SPARK-47110 Project: Spark Issue Type: Improve

[jira] [Updated] (SPARK-47110) Reenble AmmoniteTest tests in Maven builds

2024-02-20 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-47110: - Summary: Reenble AmmoniteTest tests in Maven builds (was: Eanble AmmoniteTest tests in Maven bu

[jira] [Updated] (SPARK-47110) Reenble AmmoniteTest tests in Maven builds

2024-02-20 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-47110: - Description: Disabled in https://github.com/apache/spark/pull/45186 because of TTY issues. See

[jira] [Created] (SPARK-47112) Write logs into a file in SparkR Windows build

2024-02-20 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-47112: Summary: Write logs into a file in SparkR Windows build Key: SPARK-47112 URL: https://issues.apache.org/jira/browse/SPARK-47112 Project: Spark Issue Type: Te

[jira] [Updated] (SPARK-47112) Write logs into a file in SparkR Windows build

2024-02-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47112: --- Labels: pull-request-available (was: ) > Write logs into a file in SparkR Windows build > -

[jira] [Resolved] (SPARK-47111) Upgrade `PostgreSQL` JDBC driver to 42.7.2 and docker image to 16.2

2024-02-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47111. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45191 [https://

[jira] [Resolved] (SPARK-47052) Separate state tracking variables from MicroBatchExecution/StreamExecution

2024-02-20 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-47052. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45109 [https://gi

[jira] [Assigned] (SPARK-47052) Separate state tracking variables from MicroBatchExecution/StreamExecution

2024-02-20 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-47052: Assignee: Boyang Jerry Peng > Separate state tracking variables from MicroBatchExecution/

[jira] [Commented] (SPARK-46934) Unable to create Hive View from certain Spark Dataframe StructType

2024-02-20 Thread Yu-Ting LIN (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17819062#comment-17819062 ] Yu-Ting LIN commented on SPARK-46934: - [~dongjoon] As I have mentioned before, we ar

[jira] [Assigned] (SPARK-46928) Support ListState in Arbitrary State API v2

2024-02-20 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-46928: Assignee: Bhuwan Sahni > Support ListState in Arbitrary State API v2 > --

[jira] [Resolved] (SPARK-46928) Support ListState in Arbitrary State API v2

2024-02-20 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-46928. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44961 [https://gi

[jira] [Created] (SPARK-47113) Revert S3A endpoint fixup logic of SPARK-35878

2024-02-20 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47113: - Summary: Revert S3A endpoint fixup logic of SPARK-35878 Key: SPARK-47113 URL: https://issues.apache.org/jira/browse/SPARK-47113 Project: Spark Issue Type:

[jira] [Updated] (SPARK-47113) Revert S3A endpoint fixup logic of SPARK-35878

2024-02-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47113: --- Labels: pull-request-available (was: ) > Revert S3A endpoint fixup logic of SPARK-35878 > -

[jira] [Created] (SPARK-47114) In the spark driver pod. Failed to access the krb5 file

2024-02-20 Thread melin (Jira)
melin created SPARK-47114: - Summary: In the spark driver pod. Failed to access the krb5 file Key: SPARK-47114 URL: https://issues.apache.org/jira/browse/SPARK-47114 Project: Spark Issue Type: New Fea

[jira] [Updated] (SPARK-47114) In the spark driver pod. Failed to access the krb5 file

2024-02-20 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated SPARK-47114: -- Description: spark runs in kubernetes and accesses an external hdfs cluster (kerberos),pod error logs {code:j

[jira] [Created] (SPARK-47115) Use larger memory for Maven builds

2024-02-20 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-47115: Summary: Use larger memory for Maven builds Key: SPARK-47115 URL: https://issues.apache.org/jira/browse/SPARK-47115 Project: Spark Issue Type: Test

[jira] [Updated] (SPARK-47115) Use larger memory for Maven builds

2024-02-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47115: --- Labels: pull-request-available (was: ) > Use larger memory for Maven builds > -

[jira] [Resolved] (SPARK-47115) Use larger memory for Maven builds

2024-02-20 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47115. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45195 [https://gi

[jira] [Assigned] (SPARK-47115) Use larger memory for Maven builds

2024-02-20 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47115: Assignee: Hyukjin Kwon > Use larger memory for Maven builds > ---

[jira] [Resolved] (SPARK-47113) Revert S3A endpoint fixup logic of SPARK-35878

2024-02-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47113. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45193 [https://

[jira] [Assigned] (SPARK-47113) Revert S3A endpoint fixup logic of SPARK-35878

2024-02-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47113: - Assignee: Steve Loughran > Revert S3A endpoint fixup logic of SPARK-35878 > ---

[jira] [Updated] (SPARK-47113) Revert S3A endpoint fixup logic of SPARK-35878

2024-02-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47113: -- Parent: SPARK-47046 Issue Type: Sub-task (was: Task) > Revert S3A endpoint fixup logi

[jira] [Created] (SPARK-47116) Install proper Python version in SparkR Windows build to avoid warnings

2024-02-20 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-47116: Summary: Install proper Python version in SparkR Windows build to avoid warnings Key: SPARK-47116 URL: https://issues.apache.org/jira/browse/SPARK-47116 Project: Spar

[jira] [Updated] (SPARK-47116) Install proper Python version in SparkR Windows build to avoid warnings

2024-02-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47116: --- Labels: pull-request-available (was: ) > Install proper Python version in SparkR Windows bu

[jira] [Assigned] (SPARK-47112) Write logs into a file in SparkR Windows build

2024-02-20 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47112: Assignee: Hyukjin Kwon > Write logs into a file in SparkR Windows build > ---

[jira] [Resolved] (SPARK-47112) Write logs into a file in SparkR Windows build

2024-02-20 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47112. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45192 [https://gi

[jira] [Updated] (SPARK-47114) In the spark driver pod. Failed to access the krb5 file

2024-02-20 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated SPARK-47114: -- Description: spark runs in kubernetes and accesses an external hdfs cluster (kerberos),pod error logs {code:j

[jira] [Updated] (SPARK-47114) In the spark driver pod. Failed to access the krb5 file

2024-02-20 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated SPARK-47114: -- Description: spark runs in kubernetes and accesses an external hdfs cluster (kerberos),pod error logs {code:j