[jira] [Created] (SPARK-42457) Scala Client Session Read API

2023-02-15 Thread Zhen Li (Jira)
Zhen Li created SPARK-42457: --- Summary: Scala Client Session Read API Key: SPARK-42457 URL: https://issues.apache.org/jira/browse/SPARK-42457 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-42457) Scala Client Session Read API

2023-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42457: Assignee: (was: Apache Spark) > Scala Client Session Read API >

[jira] [Commented] (SPARK-42457) Scala Client Session Read API

2023-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17689370#comment-17689370 ] Apache Spark commented on SPARK-42457: -- User 'zhenlineo' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42457) Scala Client Session Read API

2023-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42457: Assignee: Apache Spark > Scala Client Session Read API > - >

[jira] [Commented] (SPARK-41591) Implement functionality for training a PyTorch file locally

2023-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17689405#comment-17689405 ] Apache Spark commented on SPARK-41591: -- User 'rithwik-db' has created a pull request for this

[jira] [Commented] (SPARK-41591) Implement functionality for training a PyTorch file locally

2023-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17689407#comment-17689407 ] Apache Spark commented on SPARK-41591: -- User 'rithwik-db' has created a pull request for this

[jira] [Assigned] (SPARK-42384) Mask function's generated code does not handle null input

2023-02-15 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-42384: -- Assignee: Bruce Robbins > Mask function's generated code does not handle null input

[jira] [Resolved] (SPARK-42384) Mask function's generated code does not handle null input

2023-02-15 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-42384. Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39945

[jira] [Assigned] (SPARK-42426) insertInto fails when the column names are different from the table columns

2023-02-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-42426: Assignee: Takuya Ueshin > insertInto fails when the column names are different from the

[jira] [Resolved] (SPARK-42426) insertInto fails when the column names are different from the table columns

2023-02-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42426. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40024

[jira] [Created] (SPARK-42459) Create pyspark.sql.connect.utils to keep common codes

2023-02-15 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-42459: Summary: Create pyspark.sql.connect.utils to keep common codes Key: SPARK-42459 URL: https://issues.apache.org/jira/browse/SPARK-42459 Project: Spark Issue

[jira] [Assigned] (SPARK-41817) SparkSession.read support reading with schema

2023-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41817: Assignee: (was: Apache Spark) > SparkSession.read support reading with schema >

[jira] [Assigned] (SPARK-42459) Create pyspark.sql.connect.utils to keep common codes

2023-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42459: Assignee: (was: Apache Spark) > Create pyspark.sql.connect.utils to keep common

[jira] [Assigned] (SPARK-42459) Create pyspark.sql.connect.utils to keep common codes

2023-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42459: Assignee: Apache Spark > Create pyspark.sql.connect.utils to keep common codes >

[jira] [Commented] (SPARK-42459) Create pyspark.sql.connect.utils to keep common codes

2023-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17689421#comment-17689421 ] Apache Spark commented on SPARK-42459: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-42456) Consolidating the PySpark version upgrade note pages into a single page to make it easier to read

2023-02-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-42456: Assignee: Allan Folting > Consolidating the PySpark version upgrade note pages into a

[jira] [Resolved] (SPARK-42456) Consolidating the PySpark version upgrade note pages into a single page to make it easier to read

2023-02-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42456. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40044

[jira] [Resolved] (SPARK-42455) Rename JDBC option inferTimestampNTZType as preferTimestampNTZ

2023-02-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42455. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40042

[jira] [Created] (SPARK-42458) createDataFrame should support DDL string as schema

2023-02-15 Thread Takuya Ueshin (Jira)
Takuya Ueshin created SPARK-42458: - Summary: createDataFrame should support DDL string as schema Key: SPARK-42458 URL: https://issues.apache.org/jira/browse/SPARK-42458 Project: Spark Issue

[jira] [Commented] (SPARK-41817) SparkSession.read support reading with schema

2023-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17689420#comment-17689420 ] Apache Spark commented on SPARK-41817: -- User 'ueshin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-41817) SparkSession.read support reading with schema

2023-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41817: Assignee: Apache Spark > SparkSession.read support reading with schema >

[jira] [Assigned] (SPARK-42453) Implement function max in Scala client

2023-02-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42453: --- Assignee: Rui Wang > Implement function max in Scala client >

[jira] [Resolved] (SPARK-42453) Implement function max in Scala client

2023-02-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42453. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40041

[jira] [Resolved] (SPARK-41817) SparkSession.read support reading with schema

2023-02-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-41817. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40046

[jira] [Assigned] (SPARK-41817) SparkSession.read support reading with schema

2023-02-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-41817: Assignee: Sandeep Singh > SparkSession.read support reading with schema >

[jira] [Assigned] (SPARK-42451) Remove 3.1 and Java 17 check from filter condition of `testingVersions` in `HiveExternalCatalogVersionsSuite`

2023-02-15 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-42451: --- Assignee: Yang Jie > Remove 3.1 and Java 17 check from filter condition of

[jira] [Resolved] (SPARK-42451) Remove 3.1 and Java 17 check from filter condition of `testingVersions` in `HiveExternalCatalogVersionsSuite`

2023-02-15 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-42451. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40039

[jira] [Created] (SPARK-42460) E2E test should clean-up results

2023-02-15 Thread Jira
Herman van Hövell created SPARK-42460: - Summary: E2E test should clean-up results Key: SPARK-42460 URL: https://issues.apache.org/jira/browse/SPARK-42460 Project: Spark Issue Type: Task

[jira] [Assigned] (SPARK-42460) E2E test should clean-up results

2023-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42460: Assignee: Apache Spark > E2E test should clean-up results >

[jira] [Assigned] (SPARK-42460) E2E test should clean-up results

2023-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42460: Assignee: (was: Apache Spark) > E2E test should clean-up results >

[jira] [Commented] (SPARK-42460) E2E test should clean-up results

2023-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17689459#comment-17689459 ] Apache Spark commented on SPARK-42460: -- User 'hvanhovell' has created a pull request for this

[jira] [Assigned] (SPARK-42459) Create pyspark.sql.connect.utils to keep common codes

2023-02-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-42459: Assignee: Hyukjin Kwon > Create pyspark.sql.connect.utils to keep common codes >

[jira] [Resolved] (SPARK-42459) Create pyspark.sql.connect.utils to keep common codes

2023-02-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42459. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40047

[jira] [Created] (SPARK-42461) Scala Client - Initial Set of Functions

2023-02-15 Thread Jira
Herman van Hövell created SPARK-42461: - Summary: Scala Client - Initial Set of Functions Key: SPARK-42461 URL: https://issues.apache.org/jira/browse/SPARK-42461 Project: Spark Issue

[jira] [Commented] (SPARK-42398) refine default column value framework

2023-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17689473#comment-17689473 ] Apache Spark commented on SPARK-42398: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Commented] (SPARK-42398) refine default column value framework

2023-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17689474#comment-17689474 ] Apache Spark commented on SPARK-42398: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42461) Scala Client - Initial Set of Functions

2023-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42461: Assignee: Apache Spark > Scala Client - Initial Set of Functions >

[jira] [Assigned] (SPARK-42461) Scala Client - Initial Set of Functions

2023-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42461: Assignee: (was: Apache Spark) > Scala Client - Initial Set of Functions >

[jira] [Commented] (SPARK-42461) Scala Client - Initial Set of Functions

2023-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17689476#comment-17689476 ] Apache Spark commented on SPARK-42461: -- User 'hvanhovell' has created a pull request for this

[jira] [Commented] (SPARK-42452) Remove hadoop-2 profile from Apache Spark

2023-02-15 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17689484#comment-17689484 ] Yang Jie commented on SPARK-42452: -- Thanks for your explanation [~dongjoon] . Let's wait until the

<    1   2