[jira] [Created] (SPARK-48399) Teradata: ByteType wrongly mapping to teradata byte(binary) type
Kent Yao created SPARK-48399: Summary: Teradata: ByteType wrongly mapping to teradata byte(binary) type Key: SPARK-48399 URL: https://issues.apache.org/jira/browse/SPARK-48399 Project: Spark Issue Type: Sub-task Components: SQL Affects Versions: 4.0.0 Reporter: Kent Yao -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Resolved] (SPARK-48387) Postgres: Map TimestampType to TIMESTAMP WITH TIME ZONE
[ https://issues.apache.org/jira/browse/SPARK-48387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-48387. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46701 [https://github.com/apache/spark/pull/46701] > Postgres: Map TimestampType to TIMESTAMP WITH TIME ZONE > --- > > Key: SPARK-48387 > URL: https://issues.apache.org/jira/browse/SPARK-48387 > Project: Spark > Issue Type: Sub-task > Components: SQL >Affects Versions: 4.0.0 >Reporter: Kent Yao >Assignee: Kent Yao >Priority: Major > Labels: pull-request-available > Fix For: 4.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-48387) Postgres: Map TimestampType to TIMESTAMP WITH TIME ZONE
[ https://issues.apache.org/jira/browse/SPARK-48387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-48387: Assignee: Kent Yao > Postgres: Map TimestampType to TIMESTAMP WITH TIME ZONE > --- > > Key: SPARK-48387 > URL: https://issues.apache.org/jira/browse/SPARK-48387 > Project: Spark > Issue Type: Sub-task > Components: SQL >Affects Versions: 4.0.0 >Reporter: Kent Yao >Assignee: Kent Yao >Priority: Major > Labels: pull-request-available > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-48387) Postgres: Map TimestampType to TIMESTAMP WITH TIME ZONE
Kent Yao created SPARK-48387: Summary: Postgres: Map TimestampType to TIMESTAMP WITH TIME ZONE Key: SPARK-48387 URL: https://issues.apache.org/jira/browse/SPARK-48387 Project: Spark Issue Type: Sub-task Components: SQL Affects Versions: 4.0.0 Reporter: Kent Yao -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Resolved] (SPARK-48365) DB2: Document Mapping Spark SQL Data Types to DB2
[ https://issues.apache.org/jira/browse/SPARK-48365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-48365. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46677 [https://github.com/apache/spark/pull/46677] > DB2: Document Mapping Spark SQL Data Types to DB2 > - > > Key: SPARK-48365 > URL: https://issues.apache.org/jira/browse/SPARK-48365 > Project: Spark > Issue Type: Sub-task > Components: Documentation >Affects Versions: 4.0.0 >Reporter: Kent Yao >Assignee: Kent Yao >Priority: Major > Labels: pull-request-available > Fix For: 4.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-48365) DB2: Document Mapping Spark SQL Data Types to DB2
[ https://issues.apache.org/jira/browse/SPARK-48365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-48365: Assignee: Kent Yao > DB2: Document Mapping Spark SQL Data Types to DB2 > - > > Key: SPARK-48365 > URL: https://issues.apache.org/jira/browse/SPARK-48365 > Project: Spark > Issue Type: Sub-task > Components: Documentation >Affects Versions: 4.0.0 >Reporter: Kent Yao >Assignee: Kent Yao >Priority: Major > Labels: pull-request-available > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-48365) DB2: Document Mapping Spark SQL Data Types to DB2
Kent Yao created SPARK-48365: Summary: DB2: Document Mapping Spark SQL Data Types to DB2 Key: SPARK-48365 URL: https://issues.apache.org/jira/browse/SPARK-48365 Project: Spark Issue Type: Sub-task Components: Documentation Affects Versions: 4.0.0 Reporter: Kent Yao -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-48300) Codegen Support for `from_xml`
[ https://issues.apache.org/jira/browse/SPARK-48300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-48300: Assignee: BingKun Pan > Codegen Support for `from_xml` > -- > > Key: SPARK-48300 > URL: https://issues.apache.org/jira/browse/SPARK-48300 > Project: Spark > Issue Type: Improvement > Components: SQL >Affects Versions: 4.0.0 >Reporter: BingKun Pan >Assignee: BingKun Pan >Priority: Minor > Labels: pull-request-available > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Resolved] (SPARK-48300) Codegen Support for `from_xml`
[ https://issues.apache.org/jira/browse/SPARK-48300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-48300. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46609 [https://github.com/apache/spark/pull/46609] > Codegen Support for `from_xml` > -- > > Key: SPARK-48300 > URL: https://issues.apache.org/jira/browse/SPARK-48300 > Project: Spark > Issue Type: Improvement > Components: SQL >Affects Versions: 4.0.0 >Reporter: BingKun Pan >Assignee: BingKun Pan >Priority: Minor > Labels: pull-request-available > Fix For: 4.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Resolved] (SPARK-48337) Precision loss of reading jdbc time values
[ https://issues.apache.org/jira/browse/SPARK-48337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-48337. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46662 [https://github.com/apache/spark/pull/46662] > Precision loss of reading jdbc time values > -- > > Key: SPARK-48337 > URL: https://issues.apache.org/jira/browse/SPARK-48337 > Project: Spark > Issue Type: Sub-task > Components: SQL >Affects Versions: 3.2.4, 4.0.0, 3.5.1, 3.3.4, 3.4.3 >Reporter: Kent Yao >Assignee: Kent Yao >Priority: Major > Labels: pull-request-available > Fix For: 4.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Resolved] (SPARK-48332) Upgrade `jdbc` related test dependencies
[ https://issues.apache.org/jira/browse/SPARK-48332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-48332. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46653 [https://github.com/apache/spark/pull/46653] > Upgrade `jdbc` related test dependencies > > > Key: SPARK-48332 > URL: https://issues.apache.org/jira/browse/SPARK-48332 > Project: Spark > Issue Type: Improvement > Components: Build >Affects Versions: 4.0.0 >Reporter: BingKun Pan >Assignee: BingKun Pan >Priority: Minor > Labels: pull-request-available > Fix For: 4.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-48332) Upgrade `jdbc` related test dependencies
[ https://issues.apache.org/jira/browse/SPARK-48332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-48332: Assignee: BingKun Pan > Upgrade `jdbc` related test dependencies > > > Key: SPARK-48332 > URL: https://issues.apache.org/jira/browse/SPARK-48332 > Project: Spark > Issue Type: Improvement > Components: Build >Affects Versions: 4.0.0 >Reporter: BingKun Pan >Assignee: BingKun Pan >Priority: Minor > Labels: pull-request-available > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Resolved] (SPARK-48323) DB2: Map BooleanType to Boolean instead of Char(1)
[ https://issues.apache.org/jira/browse/SPARK-48323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-48323. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46637 [https://github.com/apache/spark/pull/46637] > DB2: Map BooleanType to Boolean instead of Char(1) > -- > > Key: SPARK-48323 > URL: https://issues.apache.org/jira/browse/SPARK-48323 > Project: Spark > Issue Type: Sub-task > Components: SQL >Affects Versions: 4.0.0 >Reporter: Kent Yao >Assignee: Kent Yao >Priority: Major > Labels: pull-request-available > Fix For: 4.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-48323) DB2: Map BooleanType to Boolean instead of Char(1)
Kent Yao created SPARK-48323: Summary: DB2: Map BooleanType to Boolean instead of Char(1) Key: SPARK-48323 URL: https://issues.apache.org/jira/browse/SPARK-48323 Project: Spark Issue Type: Sub-task Components: SQL Affects Versions: 4.0.0 Reporter: Kent Yao -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Resolved] (SPARK-48306) Improve UDT in error message
[ https://issues.apache.org/jira/browse/SPARK-48306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-48306. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46616 [https://github.com/apache/spark/pull/46616] > Improve UDT in error message > > > Key: SPARK-48306 > URL: https://issues.apache.org/jira/browse/SPARK-48306 > Project: Spark > Issue Type: Improvement > Components: SQL >Affects Versions: 4.0.0 >Reporter: Kent Yao >Assignee: Kent Yao >Priority: Major > Labels: pull-request-available > Fix For: 4.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Resolved] (SPARK-48296) Codegen Support for `to_xml`
[ https://issues.apache.org/jira/browse/SPARK-48296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-48296. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46591 [https://github.com/apache/spark/pull/46591] > Codegen Support for `to_xml` > > > Key: SPARK-48296 > URL: https://issues.apache.org/jira/browse/SPARK-48296 > Project: Spark > Issue Type: Improvement > Components: SQL >Affects Versions: 4.0.0 >Reporter: BingKun Pan >Assignee: BingKun Pan >Priority: Minor > Labels: pull-request-available > Fix For: 4.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-48296) Codegen Support for `to_xml`
[ https://issues.apache.org/jira/browse/SPARK-48296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-48296: Assignee: BingKun Pan > Codegen Support for `to_xml` > > > Key: SPARK-48296 > URL: https://issues.apache.org/jira/browse/SPARK-48296 > Project: Spark > Issue Type: Improvement > Components: SQL >Affects Versions: 4.0.0 >Reporter: BingKun Pan >Assignee: BingKun Pan >Priority: Minor > Labels: pull-request-available > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Resolved] (SPARK-48297) Char/Varchar breaks in TRANSFORM clause
[ https://issues.apache.org/jira/browse/SPARK-48297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-48297. -- Fix Version/s: 3.4.4 3.5.2 4.0.0 Resolution: Fixed Issue resolved by pull request 46603 [https://github.com/apache/spark/pull/46603] > Char/Varchar breaks in TRANSFORM clause > --- > > Key: SPARK-48297 > URL: https://issues.apache.org/jira/browse/SPARK-48297 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 3.1.3, 3.2.4, 4.0.0, 3.5.1, 3.3.4, 3.4.3 >Reporter: Kent Yao >Assignee: Kent Yao >Priority: Major > Labels: pull-request-available > Fix For: 3.4.4, 3.5.2, 4.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Resolved] (SPARK-48264) Upgrade `datasketches-java` to 6.0.0
[ https://issues.apache.org/jira/browse/SPARK-48264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-48264. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46563 [https://github.com/apache/spark/pull/46563] > Upgrade `datasketches-java` to 6.0.0 > > > Key: SPARK-48264 > URL: https://issues.apache.org/jira/browse/SPARK-48264 > Project: Spark > Issue Type: Improvement > Components: Build >Affects Versions: 4.0.0 >Reporter: BingKun Pan >Assignee: BingKun Pan >Priority: Minor > Labels: pull-request-available > Fix For: 4.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Resolved] (SPARK-47607) Add documentation for Structured logging framework
[ https://issues.apache.org/jira/browse/SPARK-47607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47607. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46605 [https://github.com/apache/spark/pull/46605] > Add documentation for Structured logging framework > -- > > Key: SPARK-47607 > URL: https://issues.apache.org/jira/browse/SPARK-47607 > Project: Spark > Issue Type: Sub-task > Components: Spark Core >Affects Versions: 4.0.0 >Reporter: Gengliang Wang >Assignee: Gengliang Wang >Priority: Major > Labels: pull-request-available > Fix For: 4.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-47607) Add documentation for Structured logging framework
[ https://issues.apache.org/jira/browse/SPARK-47607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-47607: Assignee: Gengliang Wang > Add documentation for Structured logging framework > -- > > Key: SPARK-47607 > URL: https://issues.apache.org/jira/browse/SPARK-47607 > Project: Spark > Issue Type: Sub-task > Components: Spark Core >Affects Versions: 4.0.0 >Reporter: Gengliang Wang >Assignee: Gengliang Wang >Priority: Major > Labels: pull-request-available > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Resolved] (SPARK-46001) Spark UI Test Improvements
[ https://issues.apache.org/jira/browse/SPARK-46001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-46001. -- Fix Version/s: 4.0.0 Assignee: Kent Yao Resolution: Fixed > Spark UI Test Improvements > -- > > Key: SPARK-46001 > URL: https://issues.apache.org/jira/browse/SPARK-46001 > Project: Spark > Issue Type: Improvement > Components: Spark Core, SQL, Tests, UI >Affects Versions: 4.0.0 >Reporter: Kent Yao >Assignee: Kent Yao >Priority: Major > Fix For: 4.0.0 > > > Spark UI tests are not supported, it's hard to test for developers and > maintain for the owners -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-48299) Upgrade scala-maven-plugin to 4.9.1
[ https://issues.apache.org/jira/browse/SPARK-48299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-48299: Assignee: Yang Jie > Upgrade scala-maven-plugin to 4.9.1 > --- > > Key: SPARK-48299 > URL: https://issues.apache.org/jira/browse/SPARK-48299 > Project: Spark > Issue Type: Improvement > Components: Build >Affects Versions: 4.0.0 >Reporter: Yang Jie >Assignee: Yang Jie >Priority: Major > Labels: pull-request-available > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Resolved] (SPARK-48299) Upgrade scala-maven-plugin to 4.9.1
[ https://issues.apache.org/jira/browse/SPARK-48299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-48299. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46593 [https://github.com/apache/spark/pull/46593] > Upgrade scala-maven-plugin to 4.9.1 > --- > > Key: SPARK-48299 > URL: https://issues.apache.org/jira/browse/SPARK-48299 > Project: Spark > Issue Type: Improvement > Components: Build >Affects Versions: 4.0.0 >Reporter: Yang Jie >Assignee: Yang Jie >Priority: Major > Labels: pull-request-available > Fix For: 4.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-48219) StreamReader Charset fix with UTF8
[ https://issues.apache.org/jira/browse/SPARK-48219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-48219: Assignee: xy > StreamReader Charset fix with UTF8 > -- > > Key: SPARK-48219 > URL: https://issues.apache.org/jira/browse/SPARK-48219 > Project: Spark > Issue Type: Improvement > Components: Spark Core >Affects Versions: 3.4.3 >Reporter: xy >Assignee: xy >Priority: Major > Labels: pull-request-available > Fix For: 4.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Resolved] (SPARK-48219) StreamReader Charset fix with UTF8
[ https://issues.apache.org/jira/browse/SPARK-48219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-48219. -- Resolution: Fixed Issue resolved by pull request 46509 [https://github.com/apache/spark/pull/46509] > StreamReader Charset fix with UTF8 > -- > > Key: SPARK-48219 > URL: https://issues.apache.org/jira/browse/SPARK-48219 > Project: Spark > Issue Type: Improvement > Components: Spark Core >Affects Versions: 3.4.3 >Reporter: xy >Assignee: xy >Priority: Major > Labels: pull-request-available > Fix For: 4.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-48297) Char/Varchar breaks in TRANSFORM clause
Kent Yao created SPARK-48297: Summary: Char/Varchar breaks in TRANSFORM clause Key: SPARK-48297 URL: https://issues.apache.org/jira/browse/SPARK-48297 Project: Spark Issue Type: Bug Components: SQL Affects Versions: 4.0.0 Reporter: Kent Yao -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Resolved] (SPARK-48289) Clean up Oracle JDBC tests by skipping redundant SYSTEM password reset
[ https://issues.apache.org/jira/browse/SPARK-48289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-48289. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46598 [https://github.com/apache/spark/pull/46598] > Clean up Oracle JDBC tests by skipping redundant SYSTEM password reset > -- > > Key: SPARK-48289 > URL: https://issues.apache.org/jira/browse/SPARK-48289 > Project: Spark > Issue Type: Improvement > Components: Tests >Affects Versions: 4.0.0 >Reporter: Luca Canali >Assignee: Luca Canali >Priority: Minor > Labels: pull-request-available > Fix For: 4.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-48289) Clean up Oracle JDBC tests by skipping redundant SYSTEM password reset
[ https://issues.apache.org/jira/browse/SPARK-48289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-48289: Assignee: Luca Canali > Clean up Oracle JDBC tests by skipping redundant SYSTEM password reset > -- > > Key: SPARK-48289 > URL: https://issues.apache.org/jira/browse/SPARK-48289 > Project: Spark > Issue Type: Improvement > Components: Tests >Affects Versions: 4.0.0 >Reporter: Luca Canali >Assignee: Luca Canali >Priority: Minor > Labels: pull-request-available > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Resolved] (SPARK-48271) Turn match error in RowEncoder into UNSUPPORTED_DATA_TYPE_FOR_ENCODER
[ https://issues.apache.org/jira/browse/SPARK-48271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-48271. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46586 [https://github.com/apache/spark/pull/46586] > Turn match error in RowEncoder into UNSUPPORTED_DATA_TYPE_FOR_ENCODER > - > > Key: SPARK-48271 > URL: https://issues.apache.org/jira/browse/SPARK-48271 > Project: Spark > Issue Type: Improvement > Components: SQL >Affects Versions: 4.0.0 >Reporter: Wenchen Fan >Assignee: Wenchen Fan >Priority: Major > Labels: pull-request-available > Fix For: 4.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-48271) Turn match error in RowEncoder into UNSUPPORTED_DATA_TYPE_FOR_ENCODER
[ https://issues.apache.org/jira/browse/SPARK-48271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-48271: Assignee: Wenchen Fan > Turn match error in RowEncoder into UNSUPPORTED_DATA_TYPE_FOR_ENCODER > - > > Key: SPARK-48271 > URL: https://issues.apache.org/jira/browse/SPARK-48271 > Project: Spark > Issue Type: Improvement > Components: SQL >Affects Versions: 4.0.0 >Reporter: Wenchen Fan >Assignee: Wenchen Fan >Priority: Major > Labels: pull-request-available > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-48285) Update docs for size function and sizeOfNull configuration
Kent Yao created SPARK-48285: Summary: Update docs for size function and sizeOfNull configuration Key: SPARK-48285 URL: https://issues.apache.org/jira/browse/SPARK-48285 Project: Spark Issue Type: Sub-task Components: SQL Affects Versions: 4.0.0 Reporter: Kent Yao -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-48269) DB2: Document Mapping Spark SQL Data Types from DB2 and add tests
[ https://issues.apache.org/jira/browse/SPARK-48269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-48269: Assignee: Kent Yao > DB2: Document Mapping Spark SQL Data Types from DB2 and add tests > - > > Key: SPARK-48269 > URL: https://issues.apache.org/jira/browse/SPARK-48269 > Project: Spark > Issue Type: Sub-task > Components: Documentation, Tests >Affects Versions: 4.0.0 >Reporter: Kent Yao >Assignee: Kent Yao >Priority: Major > Labels: pull-request-available > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Resolved] (SPARK-48269) DB2: Document Mapping Spark SQL Data Types from DB2 and add tests
[ https://issues.apache.org/jira/browse/SPARK-48269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-48269. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46572 [https://github.com/apache/spark/pull/46572] > DB2: Document Mapping Spark SQL Data Types from DB2 and add tests > - > > Key: SPARK-48269 > URL: https://issues.apache.org/jira/browse/SPARK-48269 > Project: Spark > Issue Type: Sub-task > Components: Documentation, Tests >Affects Versions: 4.0.0 >Reporter: Kent Yao >Assignee: Kent Yao >Priority: Major > Labels: pull-request-available > Fix For: 4.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-48172) Fix escaping issues in JDBCDialects
[ https://issues.apache.org/jira/browse/SPARK-48172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-48172: - Fix Version/s: (was: 4.0.0) (was: 3.5.2) (was: 3.4.4) > Fix escaping issues in JDBCDialects > --- > > Key: SPARK-48172 > URL: https://issues.apache.org/jira/browse/SPARK-48172 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 4.0.0 >Reporter: Mihailo Milosevic >Priority: Major > Labels: pull-request-available > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-48026) Promote trunc from a datetime only function to a datetime function
[ https://issues.apache.org/jira/browse/SPARK-48026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-48026: - Issue Type: Improvement (was: Bug) > Promote trunc from a datetime only function to a datetime > function > --- > > Key: SPARK-48026 > URL: https://issues.apache.org/jira/browse/SPARK-48026 > Project: Spark > Issue Type: Improvement > Components: SQL >Affects Versions: 4.0.0 >Reporter: Kent Yao >Assignee: Kent Yao >Priority: Major > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-48269) DB2: Document Mapping Spark SQL Data Types from DB2 and add tests
Kent Yao created SPARK-48269: Summary: DB2: Document Mapping Spark SQL Data Types from DB2 and add tests Key: SPARK-48269 URL: https://issues.apache.org/jira/browse/SPARK-48269 Project: Spark Issue Type: Sub-task Components: Documentation, Tests Affects Versions: 4.0.0 Reporter: Kent Yao -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-48216) Remove overrides DockerJDBCIntegrationSuite.connectionTimeout to make related tests configurable
Kent Yao created SPARK-48216: Summary: Remove overrides DockerJDBCIntegrationSuite.connectionTimeout to make related tests configurable Key: SPARK-48216 URL: https://issues.apache.org/jira/browse/SPARK-48216 Project: Spark Issue Type: Sub-task Components: Spark Docker, Tests Affects Versions: 4.0.0 Reporter: Kent Yao -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Resolved] (SPARK-48211) DB2: Read SMALLINT as ShortType
[ https://issues.apache.org/jira/browse/SPARK-48211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-48211. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46497 [https://github.com/apache/spark/pull/46497] > DB2: Read SMALLINT as ShortType > --- > > Key: SPARK-48211 > URL: https://issues.apache.org/jira/browse/SPARK-48211 > Project: Spark > Issue Type: Sub-task > Components: SQL >Affects Versions: 4.0.0 >Reporter: Kent Yao >Assignee: Kent Yao >Priority: Major > Labels: pull-request-available > Fix For: 4.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-48211) DB2: Read SMALLINT as ShortType
[ https://issues.apache.org/jira/browse/SPARK-48211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-48211: Assignee: Kent Yao > DB2: Read SMALLINT as ShortType > --- > > Key: SPARK-48211 > URL: https://issues.apache.org/jira/browse/SPARK-48211 > Project: Spark > Issue Type: Sub-task > Components: SQL >Affects Versions: 4.0.0 >Reporter: Kent Yao >Assignee: Kent Yao >Priority: Major > Labels: pull-request-available > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-48211) DB2: Read SMALLINT as ShortType
Kent Yao created SPARK-48211: Summary: DB2: Read SMALLINT as ShortType Key: SPARK-48211 URL: https://issues.apache.org/jira/browse/SPARK-48211 Project: Spark Issue Type: Sub-task Components: SQL Affects Versions: 4.0.0 Reporter: Kent Yao -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-48188) Consistently use normalized plan for cache
[ https://issues.apache.org/jira/browse/SPARK-48188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-48188: Assignee: Wenchen Fan > Consistently use normalized plan for cache > -- > > Key: SPARK-48188 > URL: https://issues.apache.org/jira/browse/SPARK-48188 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 4.0.0 >Reporter: Wenchen Fan >Assignee: Wenchen Fan >Priority: Major > Labels: pull-request-available > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Resolved] (SPARK-48188) Consistently use normalized plan for cache
[ https://issues.apache.org/jira/browse/SPARK-48188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-48188. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46465 [https://github.com/apache/spark/pull/46465] > Consistently use normalized plan for cache > -- > > Key: SPARK-48188 > URL: https://issues.apache.org/jira/browse/SPARK-48188 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 4.0.0 >Reporter: Wenchen Fan >Assignee: Wenchen Fan >Priority: Major > Labels: pull-request-available > Fix For: 4.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Resolved] (SPARK-48191) Support UTF-32 for string encode and decode
[ https://issues.apache.org/jira/browse/SPARK-48191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-48191. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46469 [https://github.com/apache/spark/pull/46469] > Support UTF-32 for string encode and decode > --- > > Key: SPARK-48191 > URL: https://issues.apache.org/jira/browse/SPARK-48191 > Project: Spark > Issue Type: Improvement > Components: SQL >Affects Versions: 4.0.0 >Reporter: Vladimir Golubev >Assignee: Vladimir Golubev >Priority: Major > Labels: pull-request-available > Fix For: 4.0.0 > > > It already works, gotta enable it -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-48185) Fix 'symbolic reference class is not accessible: class sun.util.calendar.ZoneInfo'
[ https://issues.apache.org/jira/browse/SPARK-48185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-48185: Assignee: Kent Yao > Fix 'symbolic reference class is not accessible: class > sun.util.calendar.ZoneInfo' > -- > > Key: SPARK-48185 > URL: https://issues.apache.org/jira/browse/SPARK-48185 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 4.0.0 >Reporter: Kent Yao >Assignee: Kent Yao >Priority: Major > Labels: pull-request-available > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Resolved] (SPARK-48185) Fix 'symbolic reference class is not accessible: class sun.util.calendar.ZoneInfo'
[ https://issues.apache.org/jira/browse/SPARK-48185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-48185. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46457 [https://github.com/apache/spark/pull/46457] > Fix 'symbolic reference class is not accessible: class > sun.util.calendar.ZoneInfo' > -- > > Key: SPARK-48185 > URL: https://issues.apache.org/jira/browse/SPARK-48185 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 4.0.0 >Reporter: Kent Yao >Assignee: Kent Yao >Priority: Major > Labels: pull-request-available > Fix For: 4.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Resolved] (SPARK-47914) Do not display the splits parameter in Rang
[ https://issues.apache.org/jira/browse/SPARK-47914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47914. -- Resolution: Fixed Issue resolved by pull request 46136 [https://github.com/apache/spark/pull/46136] > Do not display the splits parameter in Rang > --- > > Key: SPARK-47914 > URL: https://issues.apache.org/jira/browse/SPARK-47914 > Project: Spark > Issue Type: Improvement > Components: SQL >Affects Versions: 3.5.1 >Reporter: guihuawen >Assignee: guihuawen >Priority: Major > Labels: pull-request-available > Fix For: 4.0.0 > > > [SQL] > explain extended select * from range(0, 4); > plan > == Parsed Logical Plan == > 'Project [*] > +- 'UnresolvedTableValuedFunction [range], [0, 4] > > == Analyzed Logical Plan == > id: bigint > Project [id#11L|#11L] > +- Range (0, 4, step=1, splits=None) > > == Optimized Logical Plan == > Range (0, 4, step=1, splits=None) > > == Physical Plan == > *(1) Range (0, 4, step=1, splits=1) > > The splits parameter will only be set during the physical execution phase. > But it is also displayed in the logical execution phase as None, which is not > very user-friendly. Showing the physical execution plan can help users. > > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-47914) Do not display the splits parameter in Rang
[ https://issues.apache.org/jira/browse/SPARK-47914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-47914: Assignee: guihuawen > Do not display the splits parameter in Rang > --- > > Key: SPARK-47914 > URL: https://issues.apache.org/jira/browse/SPARK-47914 > Project: Spark > Issue Type: Improvement > Components: SQL >Affects Versions: 3.5.1 >Reporter: guihuawen >Assignee: guihuawen >Priority: Major > Labels: pull-request-available > Fix For: 4.0.0 > > > [SQL] > explain extended select * from range(0, 4); > plan > == Parsed Logical Plan == > 'Project [*] > +- 'UnresolvedTableValuedFunction [range], [0, 4] > > == Analyzed Logical Plan == > id: bigint > Project [id#11L|#11L] > +- Range (0, 4, step=1, splits=None) > > == Optimized Logical Plan == > Range (0, 4, step=1, splits=None) > > == Physical Plan == > *(1) Range (0, 4, step=1, splits=1) > > The splits parameter will only be set during the physical execution phase. > But it is also displayed in the logical execution phase as None, which is not > very user-friendly. Showing the physical execution plan can help users. > > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-48185) Fix 'symbolic reference class is not accessible: class sun.util.calendar.ZoneInfo'
Kent Yao created SPARK-48185: Summary: Fix 'symbolic reference class is not accessible: class sun.util.calendar.ZoneInfo' Key: SPARK-48185 URL: https://issues.apache.org/jira/browse/SPARK-48185 Project: Spark Issue Type: Bug Components: SQL Affects Versions: 4.0.0 Reporter: Kent Yao -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-48168) Add bitwise shifting operators support
Kent Yao created SPARK-48168: Summary: Add bitwise shifting operators support Key: SPARK-48168 URL: https://issues.apache.org/jira/browse/SPARK-48168 Project: Spark Issue Type: Improvement Components: SQL Affects Versions: 4.0.0 Reporter: Kent Yao -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-48066) TPCDSBenchmark fails with divide by zero in q90 for ANSI
Kent Yao created SPARK-48066: Summary: TPCDSBenchmark fails with divide by zero in q90 for ANSI Key: SPARK-48066 URL: https://issues.apache.org/jira/browse/SPARK-48066 Project: Spark Issue Type: Sub-task Components: SQL, Tests Affects Versions: 4.0.0 Reporter: Kent Yao -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Resolved] (SPARK-47994) SQLServer does not support 1 and 0 as boolean values
[ https://issues.apache.org/jira/browse/SPARK-47994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47994. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46231 [https://github.com/apache/spark/pull/46231] > SQLServer does not support 1 and 0 as boolean values > > > Key: SPARK-47994 > URL: https://issues.apache.org/jira/browse/SPARK-47994 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 3.4.3 >Reporter: Stefan Bukorovic >Assignee: Stefan Bukorovic >Priority: Major > Labels: pull-request-available > Fix For: 4.0.0 > > > Sometimes in Spark, when a column that is generated as CASE WHEN structure is > used in comparison filter, output of optimized plan will be: CASE WHEN > expression THEN (1 or 0)... which is not supported in SQLServer. Exception is > thrown by SQLServer that a "non-boolean expression is given when boolean was > expected". For now, we should not support CASE WHEN pushdown in SQLServer. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-48042) Don't use a copy of timestamp formatter with a new override zone for each value
[ https://issues.apache.org/jira/browse/SPARK-48042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-48042: - Issue Type: Improvement (was: Test) > Don't use a copy of timestamp formatter with a new override zone for each > value > --- > > Key: SPARK-48042 > URL: https://issues.apache.org/jira/browse/SPARK-48042 > Project: Spark > Issue Type: Improvement > Components: SQL >Affects Versions: 4.0.0 >Reporter: Kent Yao >Priority: Major > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-48042) Don't use a copy of timestamp formatter with a new override zone for each value
Kent Yao created SPARK-48042: Summary: Don't use a copy of timestamp formatter with a new override zone for each value Key: SPARK-48042 URL: https://issues.apache.org/jira/browse/SPARK-48042 Project: Spark Issue Type: Test Components: SQL Affects Versions: 4.0.0 Reporter: Kent Yao -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Resolved] (SPARK-48034) NullPointerException in MapStatusesSerDeserBenchmark
[
https://issues.apache.org/jira/browse/SPARK-48034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kent Yao resolved SPARK-48034.
--
Fix Version/s: 3.4.4
3.5.2
4.0.0
Resolution: Fixed
Issue resolved by pull request 46270
[https://github.com/apache/spark/pull/46270]
> NullPointerException in MapStatusesSerDeserBenchmark
>
>
> Key: SPARK-48034
> URL: https://issues.apache.org/jira/browse/SPARK-48034
> Project: Spark
> Issue Type: Test
> Components: Tests
>Affects Versions: 4.0.0
>Reporter: Kent Yao
>Assignee: Kent Yao
>Priority: Major
> Labels: pull-request-available
> Fix For: 3.4.4, 3.5.2, 4.0.0
>
>
> {code:java}
> 4/04/28 09:30:31 ERROR MapOutputTrackerMaster: Error communicating with
> MapOutputTracker
> 3197java.lang.NullPointerException: Cannot invoke
> "org.apache.spark.rpc.RpcEndpointRef.askSync(Object, scala.reflect.ClassTag)"
> because the return value of
> "org.apache.spark.MapOutputTracker.trackerEndpoint()" is null
> 3198 at
> org.apache.spark.MapOutputTracker.askTracker(MapOutputTracker.scala:541)
> 3199 at
> org.apache.spark.MapOutputTracker.sendTracker(MapOutputTracker.scala:551)
> 3200 at
> org.apache.spark.MapOutputTrackerMaster.stop(MapOutputTracker.scala:1242)
> 3201 at org.apache.spark.SparkEnv.stop(SparkEnv.scala:112)
> 3202 at
> org.apache.spark.SparkContext.$anonfun$stop$25(SparkContext.scala:2354)
> 3203 at org.apache.spark.util.Utils$.tryLogNonFatalError(Utils.scala:1294)
> 3204 at org.apache.spark.SparkContext.stop(SparkContext.scala:2354)
> 3205 at org.apache.spark.SparkContext.stop(SparkContext.scala:2259)
> 3206 at
> org.apache.spark.MapStatusesSerDeserBenchmark$.afterAll(MapStatusesSerDeserBenchmark.scala:128)
> 3207 at org.apache.spark.benchmark.BenchmarkBase.main(BenchmarkBase.scala:80)
> 3208 at
> org.apache.spark.MapStatusesSerDeserBenchmark.main(MapStatusesSerDeserBenchmark.scala)
> 3209 at
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 3210 at
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
> 3211 at
> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 3212 at java.base/java.lang.reflect.Method.invoke(Method.java:568)
> 3213 at
> org.apache.spark.benchmark.Benchmarks$.$anonfun$main$7(Benchmarks.scala:128)
> 3214 at scala.collection.ArrayOps$.foreach$extension(ArrayOps.scala:1323)
> 3215 at org.apache.spark.benchmark.Benchmarks$.main(Benchmarks.scala:91)
> 3216 at org.apache.spark.benchmark.Benchmarks.main(Benchmarks.scala)
> 3217 at
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 3218 at
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
> 3219 at
> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 3220 at java.base/java.lang.reflect.Method.invoke(Method.java:568)
> 3221 at
> org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
> 3222 at
> org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:1009)
> 3223 at
> org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:183)
> 3224 at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:206)
> 3225 at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:80)
> 3226 at
> org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:1099)
> 3227 at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:1108)
> 3228 at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
> 322924/04/28 09:30:31 ERROR MapOutputTrackerMaster: Could not tell tracker we
> are stopping.
> 3230org.apache.spark.SparkException: Error communicating with MapOutputTracker
> 3231 at
> org.apache.spark.MapOutputTracker.askTracker(MapOutputTracker.scala:545)
> 3232 at
> org.apache.spark.MapOutputTracker.sendTracker(MapOutputTracker.scala:551)
> 3233 at
> org.apache.spark.MapOutputTrackerMaster.stop(MapOutputTracker.scala:1242)
> 3234 at org.apache.spark.SparkEnv.stop(SparkEnv.scala:112)
> 3235 at
> org.apache.spark.SparkContext.$anonfun$stop$25(SparkContext.scala:2354)
> 3236 at org.apache.spark.util.Utils$.tryLogNonFatalError(Utils.scala:1294)
> 3237 at org.apache.spark.SparkContext.stop(SparkContext.scala:2354)
> 3238 at org.apache.spark.SparkContext.stop(SparkContext.scala:2259)
> 3239 at
> org.apache.spark.MapStatusesSerDeserBenchmark$.afterAll(MapStatusesSerDeserBenchmark.scala:128)
> 3240 at org.apache.spark.benchmark.BenchmarkBase.main(BenchmarkBase.scala:80)
> 3241 at
>
[jira] [Assigned] (SPARK-48034) NullPointerException in MapStatusesSerDeserBenchmark
[
https://issues.apache.org/jira/browse/SPARK-48034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kent Yao reassigned SPARK-48034:
Assignee: Kent Yao
> NullPointerException in MapStatusesSerDeserBenchmark
>
>
> Key: SPARK-48034
> URL: https://issues.apache.org/jira/browse/SPARK-48034
> Project: Spark
> Issue Type: Test
> Components: Tests
>Affects Versions: 4.0.0
>Reporter: Kent Yao
>Assignee: Kent Yao
>Priority: Major
> Labels: pull-request-available
>
> {code:java}
> 4/04/28 09:30:31 ERROR MapOutputTrackerMaster: Error communicating with
> MapOutputTracker
> 3197java.lang.NullPointerException: Cannot invoke
> "org.apache.spark.rpc.RpcEndpointRef.askSync(Object, scala.reflect.ClassTag)"
> because the return value of
> "org.apache.spark.MapOutputTracker.trackerEndpoint()" is null
> 3198 at
> org.apache.spark.MapOutputTracker.askTracker(MapOutputTracker.scala:541)
> 3199 at
> org.apache.spark.MapOutputTracker.sendTracker(MapOutputTracker.scala:551)
> 3200 at
> org.apache.spark.MapOutputTrackerMaster.stop(MapOutputTracker.scala:1242)
> 3201 at org.apache.spark.SparkEnv.stop(SparkEnv.scala:112)
> 3202 at
> org.apache.spark.SparkContext.$anonfun$stop$25(SparkContext.scala:2354)
> 3203 at org.apache.spark.util.Utils$.tryLogNonFatalError(Utils.scala:1294)
> 3204 at org.apache.spark.SparkContext.stop(SparkContext.scala:2354)
> 3205 at org.apache.spark.SparkContext.stop(SparkContext.scala:2259)
> 3206 at
> org.apache.spark.MapStatusesSerDeserBenchmark$.afterAll(MapStatusesSerDeserBenchmark.scala:128)
> 3207 at org.apache.spark.benchmark.BenchmarkBase.main(BenchmarkBase.scala:80)
> 3208 at
> org.apache.spark.MapStatusesSerDeserBenchmark.main(MapStatusesSerDeserBenchmark.scala)
> 3209 at
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 3210 at
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
> 3211 at
> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 3212 at java.base/java.lang.reflect.Method.invoke(Method.java:568)
> 3213 at
> org.apache.spark.benchmark.Benchmarks$.$anonfun$main$7(Benchmarks.scala:128)
> 3214 at scala.collection.ArrayOps$.foreach$extension(ArrayOps.scala:1323)
> 3215 at org.apache.spark.benchmark.Benchmarks$.main(Benchmarks.scala:91)
> 3216 at org.apache.spark.benchmark.Benchmarks.main(Benchmarks.scala)
> 3217 at
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 3218 at
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
> 3219 at
> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 3220 at java.base/java.lang.reflect.Method.invoke(Method.java:568)
> 3221 at
> org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
> 3222 at
> org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:1009)
> 3223 at
> org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:183)
> 3224 at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:206)
> 3225 at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:80)
> 3226 at
> org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:1099)
> 3227 at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:1108)
> 3228 at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
> 322924/04/28 09:30:31 ERROR MapOutputTrackerMaster: Could not tell tracker we
> are stopping.
> 3230org.apache.spark.SparkException: Error communicating with MapOutputTracker
> 3231 at
> org.apache.spark.MapOutputTracker.askTracker(MapOutputTracker.scala:545)
> 3232 at
> org.apache.spark.MapOutputTracker.sendTracker(MapOutputTracker.scala:551)
> 3233 at
> org.apache.spark.MapOutputTrackerMaster.stop(MapOutputTracker.scala:1242)
> 3234 at org.apache.spark.SparkEnv.stop(SparkEnv.scala:112)
> 3235 at
> org.apache.spark.SparkContext.$anonfun$stop$25(SparkContext.scala:2354)
> 3236 at org.apache.spark.util.Utils$.tryLogNonFatalError(Utils.scala:1294)
> 3237 at org.apache.spark.SparkContext.stop(SparkContext.scala:2354)
> 3238 at org.apache.spark.SparkContext.stop(SparkContext.scala:2259)
> 3239 at
> org.apache.spark.MapStatusesSerDeserBenchmark$.afterAll(MapStatusesSerDeserBenchmark.scala:128)
> 3240 at org.apache.spark.benchmark.BenchmarkBase.main(BenchmarkBase.scala:80)
> 3241 at
> org.apache.spark.MapStatusesSerDeserBenchmark.main(MapStatusesSerDeserBenchmark.scala)
> 3242 at
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 3243 at
>
[jira] [Created] (SPARK-48034) NullPointerException in MapStatusesSerDeserBenchmark
Kent Yao created SPARK-48034:
Summary: NullPointerException in MapStatusesSerDeserBenchmark
Key: SPARK-48034
URL: https://issues.apache.org/jira/browse/SPARK-48034
Project: Spark
Issue Type: Test
Components: Tests
Affects Versions: 4.0.0
Reporter: Kent Yao
{code:java}
4/04/28 09:30:31 ERROR MapOutputTrackerMaster: Error communicating with
MapOutputTracker
3197java.lang.NullPointerException: Cannot invoke
"org.apache.spark.rpc.RpcEndpointRef.askSync(Object, scala.reflect.ClassTag)"
because the return value of
"org.apache.spark.MapOutputTracker.trackerEndpoint()" is null
3198at
org.apache.spark.MapOutputTracker.askTracker(MapOutputTracker.scala:541)
3199at
org.apache.spark.MapOutputTracker.sendTracker(MapOutputTracker.scala:551)
3200at
org.apache.spark.MapOutputTrackerMaster.stop(MapOutputTracker.scala:1242)
3201at org.apache.spark.SparkEnv.stop(SparkEnv.scala:112)
3202at
org.apache.spark.SparkContext.$anonfun$stop$25(SparkContext.scala:2354)
3203at org.apache.spark.util.Utils$.tryLogNonFatalError(Utils.scala:1294)
3204at org.apache.spark.SparkContext.stop(SparkContext.scala:2354)
3205at org.apache.spark.SparkContext.stop(SparkContext.scala:2259)
3206at
org.apache.spark.MapStatusesSerDeserBenchmark$.afterAll(MapStatusesSerDeserBenchmark.scala:128)
3207at org.apache.spark.benchmark.BenchmarkBase.main(BenchmarkBase.scala:80)
3208at
org.apache.spark.MapStatusesSerDeserBenchmark.main(MapStatusesSerDeserBenchmark.scala)
3209at
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
3210at
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
3211at
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
3212at java.base/java.lang.reflect.Method.invoke(Method.java:568)
3213at
org.apache.spark.benchmark.Benchmarks$.$anonfun$main$7(Benchmarks.scala:128)
3214at scala.collection.ArrayOps$.foreach$extension(ArrayOps.scala:1323)
3215at org.apache.spark.benchmark.Benchmarks$.main(Benchmarks.scala:91)
3216at org.apache.spark.benchmark.Benchmarks.main(Benchmarks.scala)
3217at
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
3218at
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
3219at
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
3220at java.base/java.lang.reflect.Method.invoke(Method.java:568)
3221at
org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
3222at
org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:1009)
3223at
org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:183)
3224at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:206)
3225at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:80)
3226at
org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:1099)
3227at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:1108)
3228at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
322924/04/28 09:30:31 ERROR MapOutputTrackerMaster: Could not tell tracker we
are stopping.
3230org.apache.spark.SparkException: Error communicating with MapOutputTracker
3231at
org.apache.spark.MapOutputTracker.askTracker(MapOutputTracker.scala:545)
3232at
org.apache.spark.MapOutputTracker.sendTracker(MapOutputTracker.scala:551)
3233at
org.apache.spark.MapOutputTrackerMaster.stop(MapOutputTracker.scala:1242)
3234at org.apache.spark.SparkEnv.stop(SparkEnv.scala:112)
3235at
org.apache.spark.SparkContext.$anonfun$stop$25(SparkContext.scala:2354)
3236at org.apache.spark.util.Utils$.tryLogNonFatalError(Utils.scala:1294)
3237at org.apache.spark.SparkContext.stop(SparkContext.scala:2354)
3238at org.apache.spark.SparkContext.stop(SparkContext.scala:2259)
3239at
org.apache.spark.MapStatusesSerDeserBenchmark$.afterAll(MapStatusesSerDeserBenchmark.scala:128)
3240at org.apache.spark.benchmark.BenchmarkBase.main(BenchmarkBase.scala:80)
3241at
org.apache.spark.MapStatusesSerDeserBenchmark.main(MapStatusesSerDeserBenchmark.scala)
3242at
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
3243at
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
3244at
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
3245at java.base/java.lang.reflect.Method.invoke(Method.java:568)
3246at
org.apache.spark.benchmark.Benchmarks$.$anonfun$main$7(Benchmarks.scala:128)
3247at
[jira] [Updated] (SPARK-44442) Drop mesos support
[
https://issues.apache.org/jira/browse/SPARK-2?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kent Yao updated SPARK-2:
-
Labels: pull-request-available releasenotes (was: pull-request-available)
> Drop mesos support
> --
>
> Key: SPARK-2
> URL: https://issues.apache.org/jira/browse/SPARK-2
> Project: Spark
> Issue Type: Sub-task
> Components: Mesos
>Affects Versions: 4.0.0
>Reporter: Yang Jie
>Assignee: Sean R. Owen
>Priority: Major
> Labels: pull-request-available, releasenotes
> Fix For: 4.0.0
>
>
> [https://spark.apache.org/docs/latest/running-on-mesos.html]
>
> {_}Note{_}: Apache Mesos support is deprecated as of Apache Spark 3.2.0. It
> will be removed in a future version.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-48028) Regenerate benchmark results after turning ANSI on
[ https://issues.apache.org/jira/browse/SPARK-48028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-48028: - External issue ID: SPARK-4 > Regenerate benchmark results after turning ANSI on > -- > > Key: SPARK-48028 > URL: https://issues.apache.org/jira/browse/SPARK-48028 > Project: Spark > Issue Type: Sub-task > Components: SQL >Affects Versions: 4.0.0 >Reporter: Kent Yao >Assignee: Kent Yao >Priority: Major > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-48028) Regenerate benchmark results after turning ANSI on
[ https://issues.apache.org/jira/browse/SPARK-48028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-48028: Assignee: Kent Yao > Regenerate benchmark results after turning ANSI on > -- > > Key: SPARK-48028 > URL: https://issues.apache.org/jira/browse/SPARK-48028 > Project: Spark > Issue Type: Sub-task > Components: SQL >Affects Versions: 4.0.0 >Reporter: Kent Yao >Assignee: Kent Yao >Priority: Major > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-48028) Regenerate benchmark results after turning ANSI on
Kent Yao created SPARK-48028: Summary: Regenerate benchmark results after turning ANSI on Key: SPARK-48028 URL: https://issues.apache.org/jira/browse/SPARK-48028 Project: Spark Issue Type: Sub-task Components: SQL Affects Versions: 4.0.0 Reporter: Kent Yao -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Resolved] (SPARK-48025) Fix org.apache.spark.sql.execution.benchmark.DateTimeBenchmark
[ https://issues.apache.org/jira/browse/SPARK-48025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-48025. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46261 [https://github.com/apache/spark/pull/46261] > Fix org.apache.spark.sql.execution.benchmark.DateTimeBenchmark > -- > > Key: SPARK-48025 > URL: https://issues.apache.org/jira/browse/SPARK-48025 > Project: Spark > Issue Type: Bug > Components: SQL, Tests >Affects Versions: 4.0.0 >Reporter: Kent Yao >Assignee: Kent Yao >Priority: Major > Labels: pull-request-available > Fix For: 4.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-48025) Fix org.apache.spark.sql.execution.benchmark.DateTimeBenchmark
[ https://issues.apache.org/jira/browse/SPARK-48025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-48025: Assignee: Kent Yao > Fix org.apache.spark.sql.execution.benchmark.DateTimeBenchmark > -- > > Key: SPARK-48025 > URL: https://issues.apache.org/jira/browse/SPARK-48025 > Project: Spark > Issue Type: Bug > Components: SQL, Tests >Affects Versions: 4.0.0 >Reporter: Kent Yao >Assignee: Kent Yao >Priority: Major > Labels: pull-request-available > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-48026) Promote trunc from a datetime only function to a datetime function
Kent Yao created SPARK-48026: Summary: Promote trunc from a datetime only function to a datetime function Key: SPARK-48026 URL: https://issues.apache.org/jira/browse/SPARK-48026 Project: Spark Issue Type: Bug Components: SQL Affects Versions: 4.0.0 Reporter: Kent Yao -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-48025) Fix org.apache.spark.sql.execution.benchmark.DateTimeBenchmark
Kent Yao created SPARK-48025: Summary: Fix org.apache.spark.sql.execution.benchmark.DateTimeBenchmark Key: SPARK-48025 URL: https://issues.apache.org/jira/browse/SPARK-48025 Project: Spark Issue Type: Bug Components: SQL, Tests Affects Versions: 4.0.0 Reporter: Kent Yao -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-48020) Pin 'pandas==2.2.2'
[ https://issues.apache.org/jira/browse/SPARK-48020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-48020: Assignee: Ruifeng Zheng > Pin 'pandas==2.2.2' > --- > > Key: SPARK-48020 > URL: https://issues.apache.org/jira/browse/SPARK-48020 > Project: Spark > Issue Type: Test > Components: Project Infra, PySpark >Affects Versions: 4.0.0 >Reporter: Ruifeng Zheng >Assignee: Ruifeng Zheng >Priority: Major > Labels: pull-request-available > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Resolved] (SPARK-48020) Pin 'pandas==2.2.2'
[ https://issues.apache.org/jira/browse/SPARK-48020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-48020. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46256 [https://github.com/apache/spark/pull/46256] > Pin 'pandas==2.2.2' > --- > > Key: SPARK-48020 > URL: https://issues.apache.org/jira/browse/SPARK-48020 > Project: Spark > Issue Type: Test > Components: Project Infra, PySpark >Affects Versions: 4.0.0 >Reporter: Ruifeng Zheng >Assignee: Ruifeng Zheng >Priority: Major > Labels: pull-request-available > Fix For: 4.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Resolved] (SPARK-47968) MsSQLServer: Map datatimeoffset to TimestampType
[ https://issues.apache.org/jira/browse/SPARK-47968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47968. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46239 [https://github.com/apache/spark/pull/46239] > MsSQLServer: Map datatimeoffset to TimestampType > > > Key: SPARK-47968 > URL: https://issues.apache.org/jira/browse/SPARK-47968 > Project: Spark > Issue Type: Sub-task > Components: SQL >Affects Versions: 4.0.0 >Reporter: Kent Yao >Assignee: Kent Yao >Priority: Major > Labels: pull-request-available > Fix For: 4.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-48004) Add WriteFilesExecBase trait for v1 write
[ https://issues.apache.org/jira/browse/SPARK-48004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-48004: Assignee: XiDuo You > Add WriteFilesExecBase trait for v1 write > - > > Key: SPARK-48004 > URL: https://issues.apache.org/jira/browse/SPARK-48004 > Project: Spark > Issue Type: Task > Components: SQL >Affects Versions: 4.0.0 >Reporter: XiDuo You >Assignee: XiDuo You >Priority: Minor > Labels: pull-request-available > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Resolved] (SPARK-48004) Add WriteFilesExecBase trait for v1 write
[ https://issues.apache.org/jira/browse/SPARK-48004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-48004. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46240 [https://github.com/apache/spark/pull/46240] > Add WriteFilesExecBase trait for v1 write > - > > Key: SPARK-48004 > URL: https://issues.apache.org/jira/browse/SPARK-48004 > Project: Spark > Issue Type: Task > Components: SQL >Affects Versions: 4.0.0 >Reporter: XiDuo You >Assignee: XiDuo You >Priority: Minor > Labels: pull-request-available > Fix For: 4.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-48007) MsSQLServer: upgrade mssql.jdbc.version to 12.6.1.jre11
Kent Yao created SPARK-48007: Summary: MsSQLServer: upgrade mssql.jdbc.version to 12.6.1.jre11 Key: SPARK-48007 URL: https://issues.apache.org/jira/browse/SPARK-48007 Project: Spark Issue Type: Sub-task Components: Build, Tests Affects Versions: 4.0.0 Reporter: Kent Yao -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Resolved] (SPARK-48001) Remove unused `private implicit def arrayToArrayWritable` from `SparkContext`
[ https://issues.apache.org/jira/browse/SPARK-48001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-48001. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46238 [https://github.com/apache/spark/pull/46238] > Remove unused `private implicit def arrayToArrayWritable` from `SparkContext` > - > > Key: SPARK-48001 > URL: https://issues.apache.org/jira/browse/SPARK-48001 > Project: Spark > Issue Type: Improvement > Components: Spark Core >Affects Versions: 4.0.0 >Reporter: Yang Jie >Assignee: Yang Jie >Priority: Major > Labels: pull-request-available > Fix For: 4.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-48001) Remove unused `private implicit def arrayToArrayWritable` from `SparkContext`
[ https://issues.apache.org/jira/browse/SPARK-48001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-48001: Assignee: Yang Jie > Remove unused `private implicit def arrayToArrayWritable` from `SparkContext` > - > > Key: SPARK-48001 > URL: https://issues.apache.org/jira/browse/SPARK-48001 > Project: Spark > Issue Type: Improvement > Components: Spark Core >Affects Versions: 4.0.0 >Reporter: Yang Jie >Assignee: Yang Jie >Priority: Major > Labels: pull-request-available > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-47440) SQLServer does not support LIKE operator in binary comparison
[
https://issues.apache.org/jira/browse/SPARK-47440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kent Yao updated SPARK-47440:
-
Parent: SPARK-47361
Issue Type: Sub-task (was: Bug)
> SQLServer does not support LIKE operator in binary comparison
> -
>
> Key: SPARK-47440
> URL: https://issues.apache.org/jira/browse/SPARK-47440
> Project: Spark
> Issue Type: Sub-task
> Components: SQL
>Affects Versions: 4.0.0
>Reporter: Stefan Bukorovic
>Assignee: Stefan Bukorovic
>Priority: Major
> Labels: pull-request-available
> Fix For: 4.0.0, 3.5.2
>
>
> When pushing Spark query to MsSqlServer engine we sometimes construct SQL
> query that has a LIKE operator as a part of the binary comparison operation,
> which is not permitted in SQL Server syntax.
> For example a query
> {code:java}
> SELECT * FROM people WHERE (name LIKE "s%") = 1{code}
> will not execute on MsSQLServer.
> These queries should be detected and not pushed to execution in MsSqlServer.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Resolved] (SPARK-47982) Update code style' plugins to latest version
[ https://issues.apache.org/jira/browse/SPARK-47982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47982. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46216 [https://github.com/apache/spark/pull/46216] > Update code style' plugins to latest version > > > Key: SPARK-47982 > URL: https://issues.apache.org/jira/browse/SPARK-47982 > Project: Spark > Issue Type: Improvement > Components: Build >Affects Versions: 4.0.0 >Reporter: BingKun Pan >Assignee: BingKun Pan >Priority: Minor > Labels: pull-request-available > Fix For: 4.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Resolved] (SPARK-47984) Change `MetricsAggregate/V2Aggregator`'s `serialize/deserialize` to call `SparkSerDeUtils`'s `serialize/deserialize` methods.
[ https://issues.apache.org/jira/browse/SPARK-47984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47984. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46218 [https://github.com/apache/spark/pull/46218] > Change `MetricsAggregate/V2Aggregator`'s `serialize/deserialize` to call > `SparkSerDeUtils`'s `serialize/deserialize` methods. > - > > Key: SPARK-47984 > URL: https://issues.apache.org/jira/browse/SPARK-47984 > Project: Spark > Issue Type: Improvement > Components: MLlib, SQL >Affects Versions: 4.0.0 >Reporter: Yang Jie >Assignee: Yang Jie >Priority: Major > Labels: pull-request-available > Fix For: 4.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-47984) Change `MetricsAggregate/V2Aggregator`'s `serialize/deserialize` to call `SparkSerDeUtils`'s `serialize/deserialize` methods.
[ https://issues.apache.org/jira/browse/SPARK-47984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-47984: Assignee: Yang Jie > Change `MetricsAggregate/V2Aggregator`'s `serialize/deserialize` to call > `SparkSerDeUtils`'s `serialize/deserialize` methods. > - > > Key: SPARK-47984 > URL: https://issues.apache.org/jira/browse/SPARK-47984 > Project: Spark > Issue Type: Improvement > Components: MLlib, SQL >Affects Versions: 4.0.0 >Reporter: Yang Jie >Assignee: Yang Jie >Priority: Major > Labels: pull-request-available > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Resolved] (SPARK-47983) Demote spark.sql.pyspark.legacy.inferArrayTypeFromFirstElement.enabled to internal
[ https://issues.apache.org/jira/browse/SPARK-47983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47983. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46217 [https://github.com/apache/spark/pull/46217] > Demote spark.sql.pyspark.legacy.inferArrayTypeFromFirstElement.enabled to > internal > -- > > Key: SPARK-47983 > URL: https://issues.apache.org/jira/browse/SPARK-47983 > Project: Spark > Issue Type: Improvement > Components: SQL >Affects Versions: 4.0.0 >Reporter: Kent Yao >Assignee: Kent Yao >Priority: Major > Labels: pull-request-available > Fix For: 4.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-47983) Demote spark.sql.pyspark.legacy.inferArrayTypeFromFirstElement.enabled to internal
Kent Yao created SPARK-47983: Summary: Demote spark.sql.pyspark.legacy.inferArrayTypeFromFirstElement.enabled to internal Key: SPARK-47983 URL: https://issues.apache.org/jira/browse/SPARK-47983 Project: Spark Issue Type: Improvement Components: SQL Affects Versions: 4.0.0 Reporter: Kent Yao -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-47953) MsSQLServer: Document Mapping Spark SQL Data Types to Microsoft SQL Server
Kent Yao created SPARK-47953: Summary: MsSQLServer: Document Mapping Spark SQL Data Types to Microsoft SQL Server Key: SPARK-47953 URL: https://issues.apache.org/jira/browse/SPARK-47953 Project: Spark Issue Type: Sub-task Components: Documentation Affects Versions: 4.0.0 Reporter: Kent Yao -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Resolved] (SPARK-47945) MsSQLServer: Document Mapping Spark SQL Data Types from Microsoft SQL Server and add tests
[ https://issues.apache.org/jira/browse/SPARK-47945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47945. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46173 [https://github.com/apache/spark/pull/46173] > MsSQLServer: Document Mapping Spark SQL Data Types from Microsoft SQL Server > and add tests > -- > > Key: SPARK-47945 > URL: https://issues.apache.org/jira/browse/SPARK-47945 > Project: Spark > Issue Type: Sub-task > Components: SQL >Affects Versions: 4.0.0 >Reporter: Kent Yao >Assignee: Kent Yao >Priority: Major > Labels: pull-request-available > Fix For: 4.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-47945) MsSQLServer: Document Mapping Spark SQL Data Types from Microsoft SQL Server and add tests
[ https://issues.apache.org/jira/browse/SPARK-47945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-47945: Assignee: Kent Yao > MsSQLServer: Document Mapping Spark SQL Data Types from Microsoft SQL Server > and add tests > -- > > Key: SPARK-47945 > URL: https://issues.apache.org/jira/browse/SPARK-47945 > Project: Spark > Issue Type: Sub-task > Components: SQL >Affects Versions: 4.0.0 >Reporter: Kent Yao >Assignee: Kent Yao >Priority: Major > Labels: pull-request-available > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-47949) MsSQLServer: Bump up docker image version to2022-CU12-GDR1-ubuntu-22.04
Kent Yao created SPARK-47949: Summary: MsSQLServer: Bump up docker image version to2022-CU12-GDR1-ubuntu-22.04 Key: SPARK-47949 URL: https://issues.apache.org/jira/browse/SPARK-47949 Project: Spark Issue Type: Sub-task Components: Spark Docker Affects Versions: 4.0.0 Reporter: Kent Yao https://mcr.microsoft.com/en-us/product/mssql/server/tags -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-47945) MsSQLServer: Document Mapping Spark SQL Data Types from Microsoft SQL Server and add tests
Kent Yao created SPARK-47945: Summary: MsSQLServer: Document Mapping Spark SQL Data Types from Microsoft SQL Server and add tests Key: SPARK-47945 URL: https://issues.apache.org/jira/browse/SPARK-47945 Project: Spark Issue Type: Sub-task Components: SQL Affects Versions: 4.0.0 Reporter: Kent Yao -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-47938) MsSQLServer: Cannot find data type BYTE error
Kent Yao created SPARK-47938: Summary: MsSQLServer: Cannot find data type BYTE error Key: SPARK-47938 URL: https://issues.apache.org/jira/browse/SPARK-47938 Project: Spark Issue Type: Sub-task Components: SQL Affects Versions: 4.0.0 Reporter: Kent Yao -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-47916) Unused and leaked session hive instance in HiveSessionImplwithUGI
Kent Yao created SPARK-47916: Summary: Unused and leaked session hive instance in HiveSessionImplwithUGI Key: SPARK-47916 URL: https://issues.apache.org/jira/browse/SPARK-47916 Project: Spark Issue Type: Bug Components: SQL Affects Versions: 4.0.0 Reporter: Kent Yao -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-47833) Supply caller stackstrace for checkAndGlobPathIfNecessary AnalysisException
[ https://issues.apache.org/jira/browse/SPARK-47833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-47833: Assignee: Cheng Pan > Supply caller stackstrace for checkAndGlobPathIfNecessary AnalysisException > --- > > Key: SPARK-47833 > URL: https://issues.apache.org/jira/browse/SPARK-47833 > Project: Spark > Issue Type: Improvement > Components: Spark Core, SQL >Affects Versions: 3.1.3 >Reporter: Cheng Pan >Assignee: Cheng Pan >Priority: Major > Labels: pull-request-available > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Resolved] (SPARK-47833) Supply caller stackstrace for checkAndGlobPathIfNecessary AnalysisException
[ https://issues.apache.org/jira/browse/SPARK-47833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47833. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46028 [https://github.com/apache/spark/pull/46028] > Supply caller stackstrace for checkAndGlobPathIfNecessary AnalysisException > --- > > Key: SPARK-47833 > URL: https://issues.apache.org/jira/browse/SPARK-47833 > Project: Spark > Issue Type: Improvement > Components: Spark Core, SQL >Affects Versions: 3.1.3 >Reporter: Cheng Pan >Assignee: Cheng Pan >Priority: Major > Labels: pull-request-available > Fix For: 4.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-47911) Introduces a universal BinaryFormatter to make binary output consistent
Kent Yao created SPARK-47911: Summary: Introduces a universal BinaryFormatter to make binary output consistent Key: SPARK-47911 URL: https://issues.apache.org/jira/browse/SPARK-47911 Project: Spark Issue Type: New Feature Components: SQL Affects Versions: 4.0.0 Reporter: Kent Yao -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-47905) ANSI Mode: Trim binary values shall result binary type instead of string type
Kent Yao created SPARK-47905: Summary: ANSI Mode: Trim binary values shall result binary type instead of string type Key: SPARK-47905 URL: https://issues.apache.org/jira/browse/SPARK-47905 Project: Spark Issue Type: Bug Components: SQL Affects Versions: 4.0.0 Reporter: Kent Yao ``` when applied to binary strings is identical in syntax (apart from the default ) and semantics to the corresponding operation on character strings except that the returned value is a binary string. ``` -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Resolved] (SPARK-47897) ExpressionSet performance regression in scala 2.12
[ https://issues.apache.org/jira/browse/SPARK-47897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47897. -- Fix Version/s: 3.4.4 3.5.2 Resolution: Fixed Issue resolved by pull request 46114 [https://github.com/apache/spark/pull/46114] > ExpressionSet performance regression in scala 2.12 > -- > > Key: SPARK-47897 > URL: https://issues.apache.org/jira/browse/SPARK-47897 > Project: Spark > Issue Type: Improvement > Components: SQL >Affects Versions: 3.5.1 >Reporter: Zhen Wang >Assignee: Zhen Wang >Priority: Major > Labels: pull-request-available > Fix For: 3.4.4, 3.5.2 > > > After SPARK-38836, the `++` and `--` methods in ExpressionSet of scala 2.12 > were removed, causing performance regression. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-47898) Port HIVE-12270: Add DBTokenStore support to HS2 delegation token
Kent Yao created SPARK-47898: Summary: Port HIVE-12270: Add DBTokenStore support to HS2 delegation token Key: SPARK-47898 URL: https://issues.apache.org/jira/browse/SPARK-47898 Project: Spark Issue Type: Improvement Components: SQL Affects Versions: 4.0.0 Reporter: Kent Yao -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-47361) Improve JDBC data sources
[ https://issues.apache.org/jira/browse/SPARK-47361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-47361: - Affects Version/s: 3.5.1 3.4.2 > Improve JDBC data sources > - > > Key: SPARK-47361 > URL: https://issues.apache.org/jira/browse/SPARK-47361 > Project: Spark > Issue Type: Improvement > Components: SQL >Affects Versions: 3.4.2, 4.0.0, 3.5.1 >Reporter: Dongjoon Hyun >Assignee: Kent Yao >Priority: Major > Labels: releasenotes > Fix For: 4.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-47882) createTableColumnTypes need to be mapped to database types instead of using directly
[ https://issues.apache.org/jira/browse/SPARK-47882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-47882: - Affects Version/s: 3.5.1 3.4.2 > createTableColumnTypes need to be mapped to database types instead of using > directly > > > Key: SPARK-47882 > URL: https://issues.apache.org/jira/browse/SPARK-47882 > Project: Spark > Issue Type: Sub-task > Components: SQL >Affects Versions: 3.4.2, 4.0.0, 3.5.1 >Reporter: Kent Yao >Priority: Major > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-47361) Improve JDBC data sources
[ https://issues.apache.org/jira/browse/SPARK-47361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-47361: - Affects Version/s: (was: 3.4.2) (was: 3.5.1) > Improve JDBC data sources > - > > Key: SPARK-47361 > URL: https://issues.apache.org/jira/browse/SPARK-47361 > Project: Spark > Issue Type: Improvement > Components: SQL >Affects Versions: 4.0.0 >Reporter: Dongjoon Hyun >Assignee: Kent Yao >Priority: Major > Labels: releasenotes > Fix For: 4.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-47882) createTableColumnTypes need to be mapped to database types instead of using directly
Kent Yao created SPARK-47882: Summary: createTableColumnTypes need to be mapped to database types instead of using directly Key: SPARK-47882 URL: https://issues.apache.org/jira/browse/SPARK-47882 Project: Spark Issue Type: Sub-task Components: SQL Affects Versions: 4.0.0 Reporter: Kent Yao -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Resolved] (SPARK-47880) Oracle: Document Mapping Spark SQL Data Types to Oracle
[ https://issues.apache.org/jira/browse/SPARK-47880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47880. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46092 [https://github.com/apache/spark/pull/46092] > Oracle: Document Mapping Spark SQL Data Types to Oracle > --- > > Key: SPARK-47880 > URL: https://issues.apache.org/jira/browse/SPARK-47880 > Project: Spark > Issue Type: Sub-task > Components: SQL >Affects Versions: 4.0.0 >Reporter: Kent Yao >Assignee: Kent Yao >Priority: Major > Labels: pull-request-available > Fix For: 4.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-47880) Oracle: Document Mapping Spark SQL Data Types to Oracle
[ https://issues.apache.org/jira/browse/SPARK-47880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-47880: Assignee: Kent Yao > Oracle: Document Mapping Spark SQL Data Types to Oracle > --- > > Key: SPARK-47880 > URL: https://issues.apache.org/jira/browse/SPARK-47880 > Project: Spark > Issue Type: Sub-task > Components: SQL >Affects Versions: 4.0.0 >Reporter: Kent Yao >Assignee: Kent Yao >Priority: Major > Labels: pull-request-available > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Resolved] (SPARK-47879) Oracle: Use VARCHAR2 instead of VARCHAR for VarcharType mapping
[ https://issues.apache.org/jira/browse/SPARK-47879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47879. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46091 [https://github.com/apache/spark/pull/46091] > Oracle: Use VARCHAR2 instead of VARCHAR for VarcharType mapping > > > Key: SPARK-47879 > URL: https://issues.apache.org/jira/browse/SPARK-47879 > Project: Spark > Issue Type: Sub-task > Components: SQL >Affects Versions: 4.0.0 >Reporter: Kent Yao >Assignee: Kent Yao >Priority: Major > Labels: pull-request-available > Fix For: 4.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-47880) Oracle: Document Mapping Spark SQL Data Types to Oracle
Kent Yao created SPARK-47880: Summary: Oracle: Document Mapping Spark SQL Data Types to Oracle Key: SPARK-47880 URL: https://issues.apache.org/jira/browse/SPARK-47880 Project: Spark Issue Type: Sub-task Components: SQL Affects Versions: 4.0.0 Reporter: Kent Yao -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
