[jira] [Updated] (SPARK-41247) Unify the protobuf versions in Spark connect and protobuf connector

2022-11-23 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-41247: --- Component/s: Build > Unify the protobuf versions in Spark connect and protobuf connector >

[jira] [Updated] (SPARK-41244) Introducing a Protobuf serializer for UI data on KV store

2022-11-23 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-41244: --- Summary: Introducing a Protobuf serializer for UI data on KV store (was: Introducing

[jira] [Created] (SPARK-41244) Introducing Protobuf serializer for KV store

2022-11-23 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-41244: -- Summary: Introducing Protobuf serializer for KV store Key: SPARK-41244 URL: https://issues.apache.org/jira/browse/SPARK-41244 Project: Spark Issue Type:

[jira] [Created] (SPARK-41226) Refactor Spark types by introducing physical types

2022-11-22 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-41226: -- Summary: Refactor Spark types by introducing physical types Key: SPARK-41226 URL: https://issues.apache.org/jira/browse/SPARK-41226 Project: Spark Issue

[jira] [Updated] (SPARK-41053) Better Spark UI scalability and Driver stability for large applications

2022-11-22 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-41053: --- Description: After SPARK-18085, the Spark history server(SHS) becomes more scalable for

[jira] [Updated] (SPARK-41053) Better Spark UI scalability and Driver stability for large applications

2022-11-22 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-41053: --- Attachment: Better Spark UI scalability and Driver stability for large applications.pdf >

[jira] [Resolved] (SPARK-41054) Support disk-based KVStore in live UI

2022-11-22 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-41054. Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38567

[jira] [Resolved] (SPARK-41195) Support PIVOT/UNPIVOT with join children

2022-11-21 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-41195. Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38713

[jira] [Assigned] (SPARK-41195) Support PIVOT/UNPIVOT with join children

2022-11-21 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-41195: -- Assignee: Wenchen Fan > Support PIVOT/UNPIVOT with join children >

[jira] [Updated] (SPARK-41053) Better Spark UI scalability and Driver stability for large applications

2022-11-16 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-41053: --- Attachment: (was: Better_UI_Scalability.png) > Better Spark UI scalability and Driver

[jira] [Commented] (SPARK-39865) Show proper error messages on the overflow errors of table insert

2022-11-14 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17634062#comment-17634062 ] Gengliang Wang commented on SPARK-39865: [~catalinii] Could you provide full reproduce steps?

[jira] [Comment Edited] (SPARK-39865) Show proper error messages on the overflow errors of table insert

2022-11-14 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17634062#comment-17634062 ] Gengliang Wang edited comment on SPARK-39865 at 11/14/22 10:05 PM: ---

[jira] [Updated] (SPARK-41053) Better Spark UI scalability and Driver stability for large applications

2022-11-11 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-41053: --- Description: After SPARK-18085, the Spark history server(SHS) becomes more scalable for

[jira] [Updated] (SPARK-41053) Better Spark UI scalability and Driver stability for large applications

2022-11-11 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-41053: --- Attachment: Better_UI_Scalability.png > Better Spark UI scalability and Driver stability

[jira] [Updated] (SPARK-41053) Better Spark UI scalability and Driver stability for large applications

2022-11-11 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-41053: --- Description: After SPARK-18085, the Spark history server(SHS) becomes more scalable for

[jira] [Updated] (SPARK-41053) Better Spark UI scalability and Driver stability for large applications

2022-11-11 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-41053: --- Summary: Better Spark UI scalability and Driver stability for large applications (was:

[jira] [Updated] (SPARK-41054) Support disk-based KVStore in live UI

2022-11-08 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-41054: --- Summary: Support disk-based KVStore in live UI (was: Support RocksDB as KVStore in live

[jira] [Created] (SPARK-41054) Support RocksDB as KVStore in live UI

2022-11-08 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-41054: -- Summary: Support RocksDB as KVStore in live UI Key: SPARK-41054 URL: https://issues.apache.org/jira/browse/SPARK-41054 Project: Spark Issue Type:

[jira] [Created] (SPARK-41053) Support disk-based KV store in Spark live UI

2022-11-08 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-41053: -- Summary: Support disk-based KV store in Spark live UI Key: SPARK-41053 URL: https://issues.apache.org/jira/browse/SPARK-41053 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-40944) Relax ordering constraint for CREATE TABLE column options

2022-10-31 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-40944. Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38418

[jira] [Assigned] (SPARK-40944) Relax ordering constraint for CREATE TABLE column options

2022-10-31 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-40944: -- Assignee: Daniel > Relax ordering constraint for CREATE TABLE column options >

[jira] [Updated] (SPARK-39319) Make query context as part of SparkThrowable

2022-10-28 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-39319: --- Parent: SPARK-38615 Issue Type: Sub-task (was: Improvement) > Make query context

[jira] [Updated] (SPARK-39365) Truncate fragment of query context if it is too long

2022-10-28 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-39365: --- Parent: (was: SPARK-39319) Issue Type: Task (was: Sub-task) > Truncate

[jira] [Updated] (SPARK-38615) SQL Error Attribution Framework

2022-10-28 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-38615: --- Summary: SQL Error Attribution Framework (was: Provide error context for runtime ANSI

[jira] [Resolved] (SPARK-40903) Avoid reordering decimal Add for canonicalization

2022-10-25 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-40903. Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38379

[jira] [Created] (SPARK-40903) Avoid reordering decimal Add for canonicalization

2022-10-24 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-40903: -- Summary: Avoid reordering decimal Add for canonicalization Key: SPARK-40903 URL: https://issues.apache.org/jira/browse/SPARK-40903 Project: Spark Issue

[jira] [Assigned] (SPARK-40654) Protobuf support MVP with descriptor files

2022-10-11 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-40654: -- Assignee: Sandish Kumar HN > Protobuf support MVP with descriptor files >

[jira] [Updated] (SPARK-40654) Protobuf support MVP with descriptor files

2022-10-11 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-40654: --- Affects Version/s: 3.4.0 (was: 3.3.0) > Protobuf support MVP

[jira] [Resolved] (SPARK-40654) Protobuf support MVP with descriptor files

2022-10-11 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-40654. Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37972

[jira] [Resolved] (SPARK-40585) Support double-quoted identifiers

2022-10-04 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-40585. Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38022

[jira] [Assigned] (SPARK-40585) Support double-quoted identifiers

2022-10-04 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-40585: -- Assignee: Serge Rielau > Support double-quoted identifiers >

[jira] [Assigned] (SPARK-40618) Bug in MergeScalarSubqueries rule attempting to merge nested subquery with parent

2022-10-03 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-40618: -- Assignee: Daniel > Bug in MergeScalarSubqueries rule attempting to merge nested

[jira] [Resolved] (SPARK-40618) Bug in MergeScalarSubqueries rule attempting to merge nested subquery with parent

2022-10-03 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-40618. Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38052

[jira] [Resolved] (SPARK-40416) Add error classes for subquery expression CheckAnalysis failures

2022-09-20 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-40416. Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37840

[jira] [Assigned] (SPARK-40416) Add error classes for subquery expression CheckAnalysis failures

2022-09-20 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-40416: -- Assignee: Daniel > Add error classes for subquery expression CheckAnalysis failures

[jira] [Created] (SPARK-40410) Migrate trait QueryErrorsSuiteBase into SparkFunSuite

2022-09-12 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-40410: -- Summary: Migrate trait QueryErrorsSuiteBase into SparkFunSuite Key: SPARK-40410 URL: https://issues.apache.org/jira/browse/SPARK-40410 Project: Spark

[jira] [Created] (SPARK-40395) Provide query context in AnalysisException

2022-09-08 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-40395: -- Summary: Provide query context in AnalysisException Key: SPARK-40395 URL: https://issues.apache.org/jira/browse/SPARK-40395 Project: Spark Issue Type:

[jira] [Updated] (SPARK-40389) Decimals can't upcast as integral types if the cast can overflow

2022-09-08 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-40389: --- Affects Version/s: 3.3.1 > Decimals can't upcast as integral types if the cast can overflow

[jira] [Resolved] (SPARK-40389) Decimals can't upcast as integral types if the cast can overflow

2022-09-08 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-40389. Fix Version/s: 3.3.1 3.4.0 Resolution: Fixed Issue resolved by

[jira] [Updated] (SPARK-40389) Decimals can't upcast as integral types if the cast can overflow

2022-09-08 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-40389: --- Description: In Spark SQL, the method "canUpCast" returns true iff we can safely up-cast

[jira] [Created] (SPARK-40389) Decimals can't upcast as integral types if the cast can overflow

2022-09-08 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-40389: -- Summary: Decimals can't upcast as integral types if the cast can overflow Key: SPARK-40389 URL: https://issues.apache.org/jira/browse/SPARK-40389 Project: Spark

[jira] [Resolved] (SPARK-40318) try_avg() should throw the exceptions from its child

2022-09-06 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-40318. Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37775

[jira] [Created] (SPARK-40319) Remove duplicated query execution error method for PARSE_DATETIME_BY_NEW_PARSER

2022-09-02 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-40319: -- Summary: Remove duplicated query execution error method for PARSE_DATETIME_BY_NEW_PARSER Key: SPARK-40319 URL: https://issues.apache.org/jira/browse/SPARK-40319

[jira] [Created] (SPARK-40318) try_avg() should throw the exceptions from its child

2022-09-02 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-40318: -- Summary: try_avg() should throw the exceptions from its child Key: SPARK-40318 URL: https://issues.apache.org/jira/browse/SPARK-40318 Project: Spark

[jira] [Resolved] (SPARK-40310) try_sum() should throw the exceptions from its child

2022-09-02 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-40310. Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37764

[jira] [Updated] (SPARK-40310) try_sum() should throw the exceptions from its child

2022-09-01 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-40310: --- Summary: try_sum() should throw the exceptions from its child (was: try_sum() should throw

[jira] [Created] (SPARK-40310) try_sum() should throw exceptions from its child

2022-09-01 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-40310: -- Summary: try_sum() should throw exceptions from its child Key: SPARK-40310 URL: https://issues.apache.org/jira/browse/SPARK-40310 Project: Spark Issue

[jira] [Updated] (SPARK-35161) Error-handling SQL functions

2022-09-01 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-35161: --- Epic Link: SPARK-35030 (was: SPARK-38783) > Error-handling SQL functions >

[jira] [Resolved] (SPARK-40256) Switch base image from openjdk to eclipse-temurin

2022-08-30 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-40256. Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37705

[jira] [Assigned] (SPARK-40256) Switch base image from openjdk to eclipse-temurin

2022-08-30 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-40256: -- Assignee: Yikun Jiang > Switch base image from openjdk to eclipse-temurin >

[jira] [Resolved] (SPARK-40222) Numeric try_add/try_divide/try_subtract/try_multiply should throw error from their children

2022-08-26 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-40222. Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37663

[jira] [Created] (SPARK-40222) Numeric try_add/try_divide/try_subtract/try_multiply should throw error from their children

2022-08-25 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-40222: -- Summary: Numeric try_add/try_divide/try_subtract/try_multiply should throw error from their children Key: SPARK-40222 URL: https://issues.apache.org/jira/browse/SPARK-40222

[jira] [Resolved] (SPARK-40183) Use error class NUMERIC_VALUE_OUT_OF_RANGE for overflow in decimal conversion

2022-08-23 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-40183. Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37620

[jira] [Created] (SPARK-40183) Use error class NUMERIC_VALUE_OUT_OF_RANGE for overflow in decimal conversion

2022-08-22 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-40183: -- Summary: Use error class NUMERIC_VALUE_OUT_OF_RANGE for overflow in decimal conversion Key: SPARK-40183 URL: https://issues.apache.org/jira/browse/SPARK-40183

[jira] [Updated] (SPARK-39917) Use different error classes for numeric/interval arithmetic overflow

2022-08-22 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-39917: --- Parent: SPARK-40182 Issue Type: Sub-task (was: Task) > Use different error classes

[jira] [Updated] (SPARK-39865) Show proper error messages on the overflow errors of table insert

2022-08-22 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-39865: --- Description: In Spark 3.3, the error message of ANSI CAST is improved. However, the table

[jira] [Updated] (SPARK-39865) Show proper error messages on the overflow errors of table insert

2022-08-22 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-39865: --- Parent: SPARK-40182 Issue Type: Sub-task (was: Bug) > Show proper error messages

[jira] [Updated] (SPARK-39889) Use different error classes for numeric/interval divided by 0

2022-08-22 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-39889: --- Parent: SPARK-40182 Issue Type: Sub-task (was: Task) > Use different error classes

[jira] [Created] (SPARK-40182) Improve ANSI runtime error messages

2022-08-22 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-40182: -- Summary: Improve ANSI runtime error messages Key: SPARK-40182 URL: https://issues.apache.org/jira/browse/SPARK-40182 Project: Spark Issue Type: Umbrella

[jira] [Commented] (SPARK-40171) Fix flaky tests in ImageFileFormatSuite

2022-08-21 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17582721#comment-17582721 ] Gengliang Wang commented on SPARK-40171: cc [~weichenxu123]  > Fix flaky tests in

[jira] [Created] (SPARK-40172) Temporarily disable flaky test cases in ImageFileFormatSuite

2022-08-21 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-40172: -- Summary: Temporarily disable flaky test cases in ImageFileFormatSuite Key: SPARK-40172 URL: https://issues.apache.org/jira/browse/SPARK-40172 Project: Spark

[jira] [Created] (SPARK-40171) Fix flaky tests in ImageFileFormatSuite

2022-08-21 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-40171: -- Summary: Fix flaky tests in ImageFileFormatSuite Key: SPARK-40171 URL: https://issues.apache.org/jira/browse/SPARK-40171 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-40146) Simply the codegen of getting map value

2022-08-19 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-40146: --- Issue Type: Improvement (was: Bug) > Simply the codegen of getting map value >

[jira] [Created] (SPARK-40146) Simply the codegen of getting map value

2022-08-19 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-40146: -- Summary: Simply the codegen of getting map value Key: SPARK-40146 URL: https://issues.apache.org/jira/browse/SPARK-40146 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-40143) ANSI mode: allow explicitly casting fraction strings as Integral types

2022-08-18 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-40143: --- Summary: ANSI mode: allow explicitly casting fraction strings as Integral types (was:

[jira] [Created] (SPARK-40143) ANSI mode: explicitly casting String as Integral types should allow fraction strings

2022-08-18 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-40143: -- Summary: ANSI mode: explicitly casting String as Integral types should allow fraction strings Key: SPARK-40143 URL: https://issues.apache.org/jira/browse/SPARK-40143

[jira] [Resolved] (SPARK-40109) New SQL function: get()

2022-08-17 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-40109. Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37541

[jira] [Created] (SPARK-40109) New SQL function: get()

2022-08-16 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-40109: -- Summary: New SQL function: get() Key: SPARK-40109 URL: https://issues.apache.org/jira/browse/SPARK-40109 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-40000) Add config to toggle whether to automatically add default values for INSERTs without user-specified fields

2022-08-15 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-4?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-4. Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37430

[jira] [Assigned] (SPARK-40000) Add config to toggle whether to automatically add default values for INSERTs without user-specified fields

2022-08-15 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-4?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-4: -- Assignee: Daniel > Add config to toggle whether to automatically add default values

[jira] [Resolved] (SPARK-40066) ANSI mode: always return null on invalid access to map column

2022-08-15 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-40066. Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37503

[jira] [Assigned] (SPARK-40001) Add config to make DEFAULT values in JSON tables mutually exclusive with SQLConf.JSON_GENERATOR_IGNORE_NULL_FIELDS

2022-08-13 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-40001: -- Assignee: Daniel > Add config to make DEFAULT values in JSON tables mutually

[jira] [Resolved] (SPARK-40001) Add config to make DEFAULT values in JSON tables mutually exclusive with SQLConf.JSON_GENERATOR_IGNORE_NULL_FIELDS

2022-08-13 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-40001. Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37431

[jira] [Assigned] (SPARK-39926) Fix bug in existence DEFAULT value lookups for non-vectorized Parquet scans

2022-08-13 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-39926: -- Assignee: Daniel > Fix bug in existence DEFAULT value lookups for non-vectorized

[jira] [Resolved] (SPARK-39926) Fix bug in existence DEFAULT value lookups for non-vectorized Parquet scans

2022-08-13 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-39926. Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37501

[jira] [Updated] (SPARK-40066) ANSI mode: always return null on invalid access to map column

2022-08-12 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-40066: --- Description: Since https://github.com/apache/spark/pull/30386, Spark always throws an error

[jira] [Created] (SPARK-40066) ANSI mode: always return null on invalid access to map column

2022-08-12 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-40066: -- Summary: ANSI mode: always return null on invalid access to map column Key: SPARK-40066 URL: https://issues.apache.org/jira/browse/SPARK-40066 Project: Spark

[jira] [Resolved] (SPARK-40054) Restore the error handling syntax of try_cast()

2022-08-12 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-40054. Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37486

[jira] [Created] (SPARK-40054) Restore the error handling syntax of try_cast()

2022-08-11 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-40054: -- Summary: Restore the error handling syntax of try_cast() Key: SPARK-40054 URL: https://issues.apache.org/jira/browse/SPARK-40054 Project: Spark Issue

[jira] [Assigned] (SPARK-39985) Test DEFAULT column values with DataFrames

2022-08-11 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-39985: -- Assignee: Daniel > Test DEFAULT column values with DataFrames >

[jira] [Resolved] (SPARK-39985) Test DEFAULT column values with DataFrames

2022-08-11 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-39985. Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37423

[jira] [Created] (SPARK-40031) Remove unnecessary TryEval in TryCast

2022-08-10 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-40031: -- Summary: Remove unnecessary TryEval in TryCast Key: SPARK-40031 URL: https://issues.apache.org/jira/browse/SPARK-40031 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-40016) Remove unnecessary TryEval in TrySum

2022-08-09 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-40016. Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37446

[jira] [Updated] (SPARK-40016) Remove unnecessary TryEval in TrySum

2022-08-09 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-40016: --- Parent: SPARK-35161 Issue Type: Sub-task (was: Task) > Remove unnecessary TryEval

[jira] [Created] (SPARK-40016) Remove unnecessary TryEval in TrySum

2022-08-09 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-40016: -- Summary: Remove unnecessary TryEval in TrySum Key: SPARK-40016 URL: https://issues.apache.org/jira/browse/SPARK-40016 Project: Spark Issue Type: Task

[jira] [Resolved] (SPARK-39917) Use different error classes for numeric/interval arithmetic overflow

2022-08-02 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-39917. Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37374

[jira] [Assigned] (SPARK-39917) Use different error classes for numeric/interval arithmetic overflow

2022-08-02 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-39917: -- Assignee: Gengliang Wang > Use different error classes for numeric/interval

[jira] [Resolved] (SPARK-39917) Use different error classes for numeric/interval arithmetic overflow

2022-08-01 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-39917. Fix Version/s: 3.4.0 Resolution: Fixed > Use different error classes for

[jira] [Created] (SPARK-39918) Replace the wording "un-comparable" with "incomparable"

2022-07-28 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-39918: -- Summary: Replace the wording "un-comparable" with "incomparable" Key: SPARK-39918 URL: https://issues.apache.org/jira/browse/SPARK-39918 Project: Spark

[jira] [Created] (SPARK-39917) Use different error classes for numeric/interval arithmetic overflow

2022-07-28 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-39917: -- Summary: Use different error classes for numeric/interval arithmetic overflow Key: SPARK-39917 URL: https://issues.apache.org/jira/browse/SPARK-39917 Project:

[jira] [Assigned] (SPARK-39862) Fix bug in existence DEFAULT value lookups for V2 data sources

2022-07-28 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-39862: -- Assignee: Daniel > Fix bug in existence DEFAULT value lookups for V2 data sources >

[jira] [Resolved] (SPARK-39862) Fix bug in existence DEFAULT value lookups for V2 data sources

2022-07-28 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-39862. Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37280

[jira] [Resolved] (SPARK-39865) Show proper error messages on the overflow errors of table insert

2022-07-28 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-39865. Fix Version/s: 3.3.1 Resolution: Fixed Issue resolved by pull request 37311

[jira] [Assigned] (SPARK-39844) Restrict adding DEFAULT columns for existing tables to allowlist of supported data source types

2022-07-27 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-39844: -- Assignee: Daniel > Restrict adding DEFAULT columns for existing tables to allowlist

[jira] [Resolved] (SPARK-39844) Restrict adding DEFAULT columns for existing tables to allowlist of supported data source types

2022-07-27 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-39844. Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37256

[jira] [Updated] (SPARK-39889) Use different error classes for numeric/interval divided by 0

2022-07-26 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-39889: --- Summary: Use different error classes for numeric/interval divided by 0 (was: Use a new

[jira] [Created] (SPARK-39889) Use a new error class for "Interval divided by 0" instead of using "DIVIDE_BY_ZERO"

2022-07-26 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-39889: -- Summary: Use a new error class for "Interval divided by 0" instead of using "DIVIDE_BY_ZERO" Key: SPARK-39889 URL: https://issues.apache.org/jira/browse/SPARK-39889

[jira] [Created] (SPARK-39865) Show proper error messages on the overflow errors of table insert

2022-07-25 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-39865: -- Summary: Show proper error messages on the overflow errors of table insert Key: SPARK-39865 URL: https://issues.apache.org/jira/browse/SPARK-39865 Project: Spark

[jira] [Assigned] (SPARK-39818) Fix bug in ARRAY, STRUCT, MAP types with DEFAULT values with NULL field(s)

2022-07-19 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-39818: -- Assignee: Daniel > Fix bug in ARRAY, STRUCT, MAP types with DEFAULT values with NULL

[jira] [Resolved] (SPARK-39818) Fix bug in ARRAY, STRUCT, MAP types with DEFAULT values with NULL field(s)

2022-07-19 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-39818. Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37229

<    1   2   3   4   5   6   7   8   9   10   >