[jira] [Resolved] (SPARK-46809) Check error message parameter properly

2024-02-21 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee resolved SPARK-46809. - Resolution: Not A Bug Seems to be working fine > Check error message parameter properly >

[jira] [Resolved] (SPARK-47127) Update `SKIP_SPARK_RELEASE_VERSIONS` in Maven CIs

2024-02-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47127. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45212

[jira] [Updated] (SPARK-44914) Upgrade Ivy to 2.5.2

2024-02-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-44914: -- Summary: Upgrade Ivy to 2.5.2 (was: Upgrade Apache Ivy to 2.5.2) > Upgrade Ivy to 2.5.2 >

[jira] [Updated] (SPARK-44914) Upgrade Apache Ivy to 2.5.2

2024-02-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-44914: -- Summary: Upgrade Apache Ivy to 2.5.2 (was: Upgrade Apache ivy to 2.5.2) > Upgrade Apache

[jira] [Created] (SPARK-47126) Re-enable Spark 3.4 test in HiveExternalCatalogVersionsSuite

2024-02-21 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47126: - Summary: Re-enable Spark 3.4 test in HiveExternalCatalogVersionsSuite Key: SPARK-47126 URL: https://issues.apache.org/jira/browse/SPARK-47126 Project: Spark

[jira] [Updated] (SPARK-47125) Return null if Univocity never triggers parsing

2024-02-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-47125: - Fix Version/s: 3.5.2 (was: 3.5.3) > Return null if Univocity never

[jira] [Updated] (SPARK-47125) Return null if Univocity never triggers parsing

2024-02-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-47125: - Fix Version/s: 3.5.3 3.4.3 > Return null if Univocity never triggers parsing

[jira] [Updated] (SPARK-47117) Format the whole code base

2024-02-21 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-47117: - Priority: Trivial (was: Major) > Format the whole code base > -- > >

[jira] [Assigned] (SPARK-47125) Return null if Univocity never triggers parsing

2024-02-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47125: Assignee: Hyukjin Kwon > Return null if Univocity never triggers parsing >

[jira] [Resolved] (SPARK-47125) Return null if Univocity never triggers parsing

2024-02-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47125. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45210

[jira] [Updated] (SPARK-34631) Caught Hive MetaException when query by partition (partition col start with ‘$’)

2024-02-21 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-34631: - Description: emphasized textcreate a table, set location as parquet, do msck repair table to get the

[jira] [Resolved] (SPARK-47101) HiveExternalCatalog.verifyDataSchema does not fully comply with hive column name rules

2024-02-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47101. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45180

[jira] [Assigned] (SPARK-47101) HiveExternalCatalog.verifyDataSchema does not fully comply with hive column name rules

2024-02-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47101: - Assignee: Kent Yao > HiveExternalCatalog.verifyDataSchema does not fully comply with

[jira] [Updated] (SPARK-47036) RocksDB versionID Mismatch in SST files with Compaction

2024-02-21 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-47036: - Fix Version/s: 3.5.2 > RocksDB versionID Mismatch in SST files with Compaction >

[jira] [Assigned] (SPARK-47124) Skip scheduled SparkR on Windows in fork repositories by default

2024-02-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47124: - Assignee: Hyukjin Kwon > Skip scheduled SparkR on Windows in fork repositories by

[jira] [Resolved] (SPARK-47124) Skip scheduled SparkR on Windows in fork repositories by default

2024-02-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47124. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45208

[jira] [Updated] (SPARK-47125) Return null if Univocity never triggers parsing

2024-02-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47125: --- Labels: pull-request-available (was: ) > Return null if Univocity never triggers parsing >

[jira] [Created] (SPARK-47125) Return null if Univocity never triggers parsing

2024-02-21 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-47125: Summary: Return null if Univocity never triggers parsing Key: SPARK-47125 URL: https://issues.apache.org/jira/browse/SPARK-47125 Project: Spark Issue Type:

[jira] [Updated] (SPARK-47123) JDBCRDD does not correctly handle errors in getQueryOutputSchema

2024-02-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47123: --- Labels: pull-request-available (was: ) > JDBCRDD does not correctly handle errors in

[jira] [Updated] (SPARK-47124) Skip scheduled SparkR on Windows in fork repositories by default

2024-02-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47124: --- Labels: pull-request-available (was: ) > Skip scheduled SparkR on Windows in fork

[jira] [Updated] (SPARK-47124) Skip scheduled SparkR on Windows in fork repositories by default

2024-02-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-47124: - Priority: Minor (was: Major) > Skip scheduled SparkR on Windows in fork repositories by

[jira] [Updated] (SPARK-47124) Skip scheduled SparkR on Windows in fork repositories by default

2024-02-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-47124: - Summary: Skip scheduled SparkR on Windows in fork repositories by default (was: Skip SparkR on

[jira] [Created] (SPARK-47124) Skip SparkR on Windows in fork repositories

2024-02-21 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-47124: Summary: Skip SparkR on Windows in fork repositories Key: SPARK-47124 URL: https://issues.apache.org/jira/browse/SPARK-47124 Project: Spark Issue Type: Test

[jira] [Updated] (SPARK-31745) Enable Hive related test cases of SparkR on Windows

2024-02-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-31745: --- Labels: pull-request-available (was: ) > Enable Hive related test cases of SparkR on

[jira] [Updated] (SPARK-31745) Enable Hive related test cases of SparkR on Windows

2024-02-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-31745: - Summary: Enable Hive related test cases of SparkR on Windows (was: Enable Hive related test

[jira] [Created] (SPARK-47123) JDBCRDD does not correctly handle errors in getQueryOutputSchema

2024-02-21 Thread Pablo Langa Blanco (Jira)
Pablo Langa Blanco created SPARK-47123: -- Summary: JDBCRDD does not correctly handle errors in getQueryOutputSchema Key: SPARK-47123 URL: https://issues.apache.org/jira/browse/SPARK-47123

[jira] [Commented] (SPARK-47123) JDBCRDD does not correctly handle errors in getQueryOutputSchema

2024-02-21 Thread Pablo Langa Blanco (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17819413#comment-17819413 ] Pablo Langa Blanco commented on SPARK-47123: I'm working on it > JDBCRDD does not correctly

[jira] [Resolved] (SPARK-47121) Avoid noisy RejectedExecutionExceptions during StandaloneSchedulerBackend shutdown

2024-02-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47121. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45203

[jira] [Assigned] (SPARK-47122) Pin `buf-setup-action` to `v1.29.0`

2024-02-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47122: - Assignee: Dongjoon Hyun > Pin `buf-setup-action` to `v1.29.0` >

[jira] [Resolved] (SPARK-47122) Pin `buf-setup-action` to `v1.29.0`

2024-02-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47122. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45205

[jira] [Updated] (SPARK-47122) Pin `buf-setup-action` to `v1.29.0`

2024-02-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47122: --- Labels: pull-request-available (was: ) > Pin `buf-setup-action` to `v1.29.0` >

[jira] [Created] (SPARK-47122) Pin `buf-setup-action` to `v1.29.0`

2024-02-21 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47122: - Summary: Pin `buf-setup-action` to `v1.29.0` Key: SPARK-47122 URL: https://issues.apache.org/jira/browse/SPARK-47122 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-47104) Spark SQL query fails with NullPointerException

2024-02-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47104. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45199

[jira] [Assigned] (SPARK-47104) Spark SQL query fails with NullPointerException

2024-02-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47104: - Assignee: Bruce Robbins > Spark SQL query fails with NullPointerException >

[jira] [Updated] (SPARK-47104) Spark SQL query fails with NullPointerException

2024-02-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47104: -- Affects Version/s: 3.0.3 > Spark SQL query fails with NullPointerException >

[jira] [Updated] (SPARK-47104) Spark SQL query fails with NullPointerException

2024-02-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47104: -- Affects Version/s: 3.1.3 > Spark SQL query fails with NullPointerException >

[jira] [Resolved] (SPARK-47119) Add `hive-jackson-provided` profile

2024-02-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47119. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45201

[jira] [Assigned] (SPARK-47036) RocksDB versionID Mismatch in SST files with Compaction

2024-02-21 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-47036: Assignee: Bhuwan Sahni > RocksDB versionID Mismatch in SST files with Compaction >

[jira] [Resolved] (SPARK-47036) RocksDB versionID Mismatch in SST files with Compaction

2024-02-21 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-47036. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45092

[jira] [Updated] (SPARK-47121) Avoid noisy RejectedExecutionExceptions during StandaloneSchedulerBackend shutdown

2024-02-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47121: --- Labels: pull-request-available (was: ) > Avoid noisy RejectedExecutionExceptions during

[jira] [Created] (SPARK-47121) Avoid noisy RejectedExecutionExceptions during StandaloneSchedulerBackend shutdown

2024-02-21 Thread Josh Rosen (Jira)
Josh Rosen created SPARK-47121: -- Summary: Avoid noisy RejectedExecutionExceptions during StandaloneSchedulerBackend shutdown Key: SPARK-47121 URL: https://issues.apache.org/jira/browse/SPARK-47121

[jira] [Updated] (SPARK-47120) Null comparison push down data filter from subquery produces in NPE in Parquet filter

2024-02-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47120: --- Labels: pull-request-available (was: ) > Null comparison push down data filter from

[jira] [Updated] (SPARK-47120) Null comparison push down data filter from subquery produces in NPE in Parquet filter

2024-02-21 Thread Cosmin Dumitru (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cosmin Dumitru updated SPARK-47120: --- Description: This issue has been introduced in [https://github.com/apache/spark/pull/41088] 

[jira] [Updated] (SPARK-47120) Null comparison push down data filter from subquery produces in NPE in Parquet filter

2024-02-21 Thread Cosmin Dumitru (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cosmin Dumitru updated SPARK-47120: --- Description: This issue has been introduced in [https://github.com/apache/spark/pull/41088] 

[jira] [Updated] (SPARK-47120) Null comparison push down data filter from subquery produces in NPE in Parquet filter

2024-02-21 Thread Cosmin Dumitru (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cosmin Dumitru updated SPARK-47120: --- Description: This issue has been introduced in [https://github.com/apache/spark/pull/41088] 

[jira] [Updated] (SPARK-47119) Add `hive-jackson-provided` profile

2024-02-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47119: --- Labels: pull-request-available (was: ) > Add `hive-jackson-provided` profile >

[jira] [Created] (SPARK-47119) Add `hive-jackson-provided` profile

2024-02-21 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47119: - Summary: Add `hive-jackson-provided` profile Key: SPARK-47119 URL: https://issues.apache.org/jira/browse/SPARK-47119 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-47119) Add `hive-jackson-provided` profile

2024-02-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47119: - Assignee: Dongjoon Hyun > Add `hive-jackson-provided` profile >

[jira] [Resolved] (SPARK-47099) The `start` value of `paramIndex` for the error class `UNEXPECTED_INPUT_TYPE` should be `1`1

2024-02-21 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-47099. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45177

[jira] [Updated] (SPARK-47104) Spark SQL query fails with NullPointerException

2024-02-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47104: --- Labels: pull-request-available (was: ) > Spark SQL query fails with NullPointerException >

[jira] [Updated] (SPARK-44719) NoClassDefFoundError when using Hive UDF

2024-02-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-44719: --- Labels: pull-request-available (was: ) > NoClassDefFoundError when using Hive UDF >

[jira] [Commented] (SPARK-43225) Remove jackson-core-asl and jackson-mapper-asl from pre-built distribution

2024-02-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17819341#comment-17819341 ] Dongjoon Hyun commented on SPARK-43225: --- For the record, this is logically reverted via

[jira] [Updated] (SPARK-47085) Preformance issue on thrift API

2024-02-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47085: -- Fix Version/s: 3.4.3 > Preformance issue on thrift API > --- > >

[jira] [Commented] (SPARK-46934) Read/write roundtrip for struct type with special characters with HMS

2024-02-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17819309#comment-17819309 ] Dongjoon Hyun commented on SPARK-46934: --- You can track Apache Spark 4.0.0 activity in SPARK-44111,

[jira] [Commented] (SPARK-46934) Read/write roundtrip for struct type with special characters with HMS

2024-02-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17819308#comment-17819308 ] Dongjoon Hyun commented on SPARK-46934: --- Thank you for confirming, [~yutinglin] and [~yao] . I

[jira] [Updated] (SPARK-47104) Spark SQL query fails with NullPointerException

2024-02-21 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-47104: -- Affects Version/s: 3.5.0 3.4.2 > Spark SQL query fails with

[jira] [Updated] (SPARK-46934) Unable to create Hive View from certain Spark Dataframe StructType

2024-02-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46934: -- Issue Type: Improvement (was: Bug) > Unable to create Hive View from certain Spark Dataframe

[jira] [Updated] (SPARK-46934) Read/write roundtrip for struct type with special characters with HMS

2024-02-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46934: -- Summary: Read/write roundtrip for struct type with special characters with HMS (was: Unable

[jira] [Updated] (SPARK-46934) Unable to create Hive View from certain Spark Dataframe StructType

2024-02-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46934: -- Priority: Major (was: Blocker) > Unable to create Hive View from certain Spark Dataframe

[jira] [Updated] (SPARK-46934) Unable to create Hive View from certain Spark Dataframe StructType

2024-02-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46934: -- Affects Version/s: 4.0.0 (was: 3.3.0)

[jira] [Updated] (SPARK-46938) Remove javax-servlet-api exclusion rule for SBT

2024-02-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46938: -- Summary: Remove javax-servlet-api exclusion rule for SBT (was: Migrate jetty 10 to jetty 11)

[jira] [Resolved] (SPARK-46938) Migrate jetty 10 to jetty 11

2024-02-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46938. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45194

[jira] [Comment Edited] (SPARK-21595) introduction of spark.sql.windowExec.buffer.spill.threshold in spark 2.2 breaks existing workflow

2024-02-21 Thread Ramakrishna (Jira)
[ https://issues.apache.org/jira/browse/SPARK-21595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17819249#comment-17819249 ] Ramakrishna edited comment on SPARK-21595 at 2/21/24 1:34 PM: --

[jira] [Commented] (SPARK-21595) introduction of spark.sql.windowExec.buffer.spill.threshold in spark 2.2 breaks existing workflow

2024-02-21 Thread Ramakrishna (Jira)
[ https://issues.apache.org/jira/browse/SPARK-21595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17819249#comment-17819249 ] Ramakrishna commented on SPARK-21595: - [~Rakesh_Shah]  How did you manage to solve this ? I am

[jira] [Commented] (SPARK-43256) Assign a name to the error class _LEGACY_ERROR_TEMP_2021

2024-02-21 Thread A G (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17819237#comment-17819237 ] A G commented on SPARK-43256: - I want to work on this. PR: [https://github.com/apache/spark/pull/45198] >

[jira] [Updated] (SPARK-43256) Assign a name to the error class _LEGACY_ERROR_TEMP_2021

2024-02-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-43256: --- Labels: pull-request-available starter (was: starter) > Assign a name to the error class

[jira] [Commented] (SPARK-46934) Unable to create Hive View from certain Spark Dataframe StructType

2024-02-21 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17819232#comment-17819232 ] Kent Yao commented on SPARK-46934: -- Hi [~dongjoon], this is not a regression. As I commented above, I

[jira] [Created] (SPARK-47117) Format the whole code base

2024-02-21 Thread Jie Han (Jira)
Jie Han created SPARK-47117: --- Summary: Format the whole code base Key: SPARK-47117 URL: https://issues.apache.org/jira/browse/SPARK-47117 Project: Spark Issue Type: Wish Components:

[jira] [Assigned] (SPARK-46938) Migrate jetty 10 to jetty 11

2024-02-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-46938: -- Assignee: Apache Spark (was: HiuFung Kwok) > Migrate jetty 10 to jetty 11 >

[jira] [Assigned] (SPARK-46938) Migrate jetty 10 to jetty 11

2024-02-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-46938: -- Assignee: Apache Spark (was: HiuFung Kwok) > Migrate jetty 10 to jetty 11 >

[jira] [Assigned] (SPARK-47101) HiveExternalCatalog.verifyDataSchema does not fully comply with hive column name rules

2024-02-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47101: -- Assignee: (was: Apache Spark) > HiveExternalCatalog.verifyDataSchema does not

[jira] [Assigned] (SPARK-47101) HiveExternalCatalog.verifyDataSchema does not fully comply with hive column name rules

2024-02-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47101: -- Assignee: Apache Spark > HiveExternalCatalog.verifyDataSchema does not fully comply

[jira] [Assigned] (SPARK-47101) HiveExternalCatalog.verifyDataSchema does not fully comply with hive column name rules

2024-02-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47101: -- Assignee: (was: Apache Spark) > HiveExternalCatalog.verifyDataSchema does not

[jira] [Assigned] (SPARK-47101) HiveExternalCatalog.verifyDataSchema does not fully comply with hive column name rules

2024-02-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47101: -- Assignee: Apache Spark > HiveExternalCatalog.verifyDataSchema does not fully comply

[jira] [Resolved] (SPARK-47116) Install proper Python version in SparkR Windows build to avoid warnings

2024-02-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47116. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45196

[jira] [Assigned] (SPARK-47116) Install proper Python version in SparkR Windows build to avoid warnings

2024-02-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47116: - Assignee: Hyukjin Kwon > Install proper Python version in SparkR Windows build to

[jira] [Updated] (SPARK-47114) In the spark driver pod. Failed to access the krb5 file

2024-02-21 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated SPARK-47114: -- Description: spark runs in kubernetes and accesses an external hdfs cluster (kerberos),pod error logs