[jira] [Updated] (SPARK-42445) Fix SparkR install.spark function

[ https://issues.apache.org/jira/browse/SPARK-42445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-42445: -- Affects Version/s: 3.4.0 > Fix SparkR install.spark function >

[jira] [Created] (SPARK-42446) Updating PySpark documentation to enhance usability

Allan Folting created SPARK-42446: - Summary: Updating PySpark documentation to enhance usability Key: SPARK-42446 URL: https://issues.apache.org/jira/browse/SPARK-42446 Project: Spark Issue

[jira] [Updated] (SPARK-42445) Fix SparkR install.spark function

[ https://issues.apache.org/jira/browse/SPARK-42445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-42445: -- Description: {code} $ R R version 4.2.1 (2022-06-23) -- "Funny-Looking Kid" Copyright (C)

[jira] [Resolved] (SPARK-42427) Conv should return an error if the internal conversion overflows

[ https://issues.apache.org/jira/browse/SPARK-42427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-42427. Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40001

[jira] [Commented] (SPARK-42445) Fix SparkR install.spark function

[ https://issues.apache.org/jira/browse/SPARK-42445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17688837#comment-17688837 ] Apache Spark commented on SPARK-42445: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-42445) Fix SparkR install.spark function

[ https://issues.apache.org/jira/browse/SPARK-42445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42445: Assignee: (was: Apache Spark) > Fix SparkR install.spark function >

[jira] [Assigned] (SPARK-42445) Fix SparkR install.spark function

[ https://issues.apache.org/jira/browse/SPARK-42445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42445: Assignee: Apache Spark > Fix SparkR install.spark function >

[jira] [Created] (SPARK-42445) Fix SparkR install.spark function

Dongjoon Hyun created SPARK-42445: - Summary: Fix SparkR install.spark function Key: SPARK-42445 URL: https://issues.apache.org/jira/browse/SPARK-42445 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-42002) Implement DataFrameWriterV2 (ReadwriterV2Tests)

[ https://issues.apache.org/jira/browse/SPARK-42002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17688832#comment-17688832 ] Apache Spark commented on SPARK-42002: -- User 'zhengruifeng' has created a pull request for this

[jira] [Commented] (SPARK-42002) Implement DataFrameWriterV2 (ReadwriterV2Tests)

[ https://issues.apache.org/jira/browse/SPARK-42002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17688833#comment-17688833 ] Apache Spark commented on SPARK-42002: -- User 'zhengruifeng' has created a pull request for this

[jira] [Commented] (SPARK-42431) Union avoid calling `output` before analysis

[ https://issues.apache.org/jira/browse/SPARK-42431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17688813#comment-17688813 ] Apache Spark commented on SPARK-42431: -- User 'zhengruifeng' has created a pull request for this

[jira] [Assigned] (SPARK-38324) The second range is not [0, 59] in the day time ANSI interval

[ https://issues.apache.org/jira/browse/SPARK-38324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38324: Assignee: (was: Apache Spark) > The second range is not [0, 59] in the day time ANSI

[jira] [Assigned] (SPARK-38324) The second range is not [0, 59] in the day time ANSI interval

[ https://issues.apache.org/jira/browse/SPARK-38324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38324: Assignee: Apache Spark > The second range is not [0, 59] in the day time ANSI interval >

[jira] [Commented] (SPARK-38324) The second range is not [0, 59] in the day time ANSI interval

[ https://issues.apache.org/jira/browse/SPARK-38324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17688807#comment-17688807 ] Apache Spark commented on SPARK-38324: -- User 'haoyanzhang' has created a pull request for this

[jira] [Commented] (SPARK-38324) The second range is not [0, 59] in the day time ANSI interval

[ https://issues.apache.org/jira/browse/SPARK-38324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17688806#comment-17688806 ] Apache Spark commented on SPARK-38324: -- User 'haoyanzhang' has created a pull request for this

[jira] [Commented] (SPARK-42441) Scala Client - Implement Column API

[ https://issues.apache.org/jira/browse/SPARK-42441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17688805#comment-17688805 ] Apache Spark commented on SPARK-42441: -- User 'hvanhovell' has created a pull request for this

[jira] [Commented] (SPARK-42441) Scala Client - Implement Column API

[ https://issues.apache.org/jira/browse/SPARK-42441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17688804#comment-17688804 ] Apache Spark commented on SPARK-42441: -- User 'hvanhovell' has created a pull request for this

[jira] [Assigned] (SPARK-42441) Scala Client - Implement Column API

[ https://issues.apache.org/jira/browse/SPARK-42441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42441: Assignee: Apache Spark > Scala Client - Implement Column API >

[jira] [Assigned] (SPARK-42441) Scala Client - Implement Column API

[ https://issues.apache.org/jira/browse/SPARK-42441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42441: Assignee: (was: Apache Spark) > Scala Client - Implement Column API >

[jira] [Updated] (SPARK-42444) DataFrame.drop should handle multi columns properly

[ https://issues.apache.org/jira/browse/SPARK-42444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-42444: -- Description: {code:java} from pyspark.sql import Row df1 = spark.createDataFrame([(14,

[jira] [Created] (SPARK-42444) DataFrame.drop should handle multi columns properly

Ruifeng Zheng created SPARK-42444: - Summary: DataFrame.drop should handle multi columns properly Key: SPARK-42444 URL: https://issues.apache.org/jira/browse/SPARK-42444 Project: Spark Issue

[jira] [Commented] (SPARK-42401) Incorrect results or NPE when inserting null value into array using array_insert/array_append

[ https://issues.apache.org/jira/browse/SPARK-42401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17688786#comment-17688786 ] Apache Spark commented on SPARK-42401: -- User 'bersprockets' has created a pull request for this

[jira] [Commented] (SPARK-42401) Incorrect results or NPE when inserting null value into array using array_insert/array_append

[ https://issues.apache.org/jira/browse/SPARK-42401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17688788#comment-17688788 ] Apache Spark commented on SPARK-42401: -- User 'bersprockets' has created a pull request for this

[jira] [Commented] (SPARK-42426) insertInto fails when the column names are different from the table columns

[ https://issues.apache.org/jira/browse/SPARK-42426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17688765#comment-17688765 ] Apache Spark commented on SPARK-42426: -- User 'ueshin' has created a pull request for this issue:

[jira] [Commented] (SPARK-42426) insertInto fails when the column names are different from the table columns

[ https://issues.apache.org/jira/browse/SPARK-42426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17688763#comment-17688763 ] Apache Spark commented on SPARK-42426: -- User 'ueshin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42426) insertInto fails when the column names are different from the table columns

[ https://issues.apache.org/jira/browse/SPARK-42426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42426: Assignee: (was: Apache Spark) > insertInto fails when the column names are different

[jira] [Assigned] (SPARK-42426) insertInto fails when the column names are different from the table columns

[ https://issues.apache.org/jira/browse/SPARK-42426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42426: Assignee: Apache Spark > insertInto fails when the column names are different from the

[jira] [Commented] (SPARK-42401) Incorrect results or NPE when inserting null value into array using array_insert/array_append

[ https://issues.apache.org/jira/browse/SPARK-42401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17688759#comment-17688759 ] Bruce Robbins commented on SPARK-42401: --- There is another case: {noformat} spark-sql> select

[jira] [Resolved] (SPARK-42443) Remove unused object in DataFrameAggregateSuite

[ https://issues.apache.org/jira/browse/SPARK-42443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42443. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40023

[jira] [Commented] (SPARK-42443) Remove unused object in DataFrameAggregateSuite

[ https://issues.apache.org/jira/browse/SPARK-42443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17688757#comment-17688757 ] Apache Spark commented on SPARK-42443: -- User 'amaliujia' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42443) Remove unused object in DataFrameAggregateSuite

[ https://issues.apache.org/jira/browse/SPARK-42443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42443: Assignee: Rui Wang (was: Apache Spark) > Remove unused object in

[jira] [Assigned] (SPARK-42443) Remove unused object in DataFrameAggregateSuite

[ https://issues.apache.org/jira/browse/SPARK-42443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42443: Assignee: Apache Spark (was: Rui Wang) > Remove unused object in

[jira] [Created] (SPARK-42443) Remove unused object in DataFrameAggregateSuite

Rui Wang created SPARK-42443: Summary: Remove unused object in DataFrameAggregateSuite Key: SPARK-42443 URL: https://issues.apache.org/jira/browse/SPARK-42443 Project: Spark Issue Type: Task

[jira] [Commented] (SPARK-42399) CONV() silently overflows returning wrong results

[ https://issues.apache.org/jira/browse/SPARK-42399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17688755#comment-17688755 ] Serge Rielau commented on SPARK-42399: -- Adding support is of course best. If it can be done

[jira] [Commented] (SPARK-42406) [PROTOBUF] Recursive field handling is incompatible with delta

[ https://issues.apache.org/jira/browse/SPARK-42406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17688752#comment-17688752 ] Raghu Angadi commented on SPARK-42406: -- Thanks for merging

[jira] [Reopened] (SPARK-42406) [PROTOBUF] Recursive field handling is incompatible with delta

[ https://issues.apache.org/jira/browse/SPARK-42406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reopened SPARK-42406: > [PROTOBUF] Recursive field handling is incompatible with delta >

[jira] [Assigned] (SPARK-42442) Use spark.sql.timestampType for data source inference

[ https://issues.apache.org/jira/browse/SPARK-42442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42442: Assignee: Gengliang Wang (was: Apache Spark) > Use spark.sql.timestampType for data

[jira] [Assigned] (SPARK-42442) Use spark.sql.timestampType for data source inference

[ https://issues.apache.org/jira/browse/SPARK-42442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42442: Assignee: Apache Spark (was: Gengliang Wang) > Use spark.sql.timestampType for data

[jira] [Commented] (SPARK-42442) Use spark.sql.timestampType for data source inference

[ https://issues.apache.org/jira/browse/SPARK-42442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17688748#comment-17688748 ] Apache Spark commented on SPARK-42442: -- User 'gengliangwang' has created a pull request for this

[jira] [Created] (SPARK-42442) Use spark.sql.timestampType for data source inference

Gengliang Wang created SPARK-42442: -- Summary: Use spark.sql.timestampType for data source inference Key: SPARK-42442 URL: https://issues.apache.org/jira/browse/SPARK-42442 Project: Spark

[jira] [Assigned] (SPARK-42406) [PROTOBUF] Recursive field handling is incompatible with delta

[ https://issues.apache.org/jira/browse/SPARK-42406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-42406: -- Assignee: Raghu Angadi > [PROTOBUF] Recursive field handling is incompatible with

[jira] [Resolved] (SPARK-42406) [PROTOBUF] Recursive field handling is incompatible with delta

[ https://issues.apache.org/jira/browse/SPARK-42406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-42406. Fix Version/s: 3.4.0 (was: 3.4.1) Resolution: Fixed Issue

[jira] [Commented] (SPARK-42342) Introduce base hierarchy to exceptions.

[ https://issues.apache.org/jira/browse/SPARK-42342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17688691#comment-17688691 ] Apache Spark commented on SPARK-42342: -- User 'ueshin' has created a pull request for this issue:

[jira] [Commented] (SPARK-41775) Implement training functions as input

[ https://issues.apache.org/jira/browse/SPARK-41775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17688683#comment-17688683 ] Apache Spark commented on SPARK-41775: -- User 'rithwik-db' has created a pull request for this

[jira] [Resolved] (SPARK-42430) Add documentation for TimestampNTZ type

[ https://issues.apache.org/jira/browse/SPARK-42430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-42430. Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40005

[jira] [Created] (SPARK-42441) Scala Client - Implement Column API

Herman van Hövell created SPARK-42441: - Summary: Scala Client - Implement Column API Key: SPARK-42441 URL: https://issues.apache.org/jira/browse/SPARK-42441 Project: Spark Issue Type:

[jira] [Commented] (SPARK-42440) Implement First batch of Dataset APIs

[ https://issues.apache.org/jira/browse/SPARK-42440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17688640#comment-17688640 ] Apache Spark commented on SPARK-42440: -- User 'hvanhovell' has created a pull request for this

[jira] [Assigned] (SPARK-42440) Implement First batch of Dataset APIs

[ https://issues.apache.org/jira/browse/SPARK-42440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42440: Assignee: (was: Apache Spark) > Implement First batch of Dataset APIs >

[jira] [Assigned] (SPARK-42440) Implement First batch of Dataset APIs

[ https://issues.apache.org/jira/browse/SPARK-42440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42440: Assignee: Apache Spark > Implement First batch of Dataset APIs >

[jira] [Commented] (SPARK-42440) Implement First batch of Dataset APIs

[ https://issues.apache.org/jira/browse/SPARK-42440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17688639#comment-17688639 ] Apache Spark commented on SPARK-42440: -- User 'hvanhovell' has created a pull request for this

[jira] [Created] (SPARK-42440) Implement First batch of Dataset APIs

Herman van Hövell created SPARK-42440: - Summary: Implement First batch of Dataset APIs Key: SPARK-42440 URL: https://issues.apache.org/jira/browse/SPARK-42440 Project: Spark Issue Type:

[jira] [Commented] (SPARK-42439) Job description in v2 FileWrites can have the wrong committer

[ https://issues.apache.org/jira/browse/SPARK-42439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17688621#comment-17688621 ] Apache Spark commented on SPARK-42439: -- User 'LorenzoMartini' has created a pull request for this

[jira] [Updated] (SPARK-42439) Job description in v2 FileWrites can have the wrong committer

[ https://issues.apache.org/jira/browse/SPARK-42439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lorenzo Martini updated SPARK-42439: Labels: bug (was: ) > Job description in v2 FileWrites can have the wrong committer >

[jira] [Commented] (SPARK-42439) Job description in v2 FileWrites can have the wrong committer

[ https://issues.apache.org/jira/browse/SPARK-42439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17688615#comment-17688615 ] Apache Spark commented on SPARK-42439: -- User 'LorenzoMartini' has created a pull request for this

[jira] [Assigned] (SPARK-42439) Job description in v2 FileWrites can have the wrong committer

[ https://issues.apache.org/jira/browse/SPARK-42439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42439: Assignee: (was: Apache Spark) > Job description in v2 FileWrites can have the wrong

[jira] [Commented] (SPARK-42439) Job description in v2 FileWrites can have the wrong committer

[ https://issues.apache.org/jira/browse/SPARK-42439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17688613#comment-17688613 ] Apache Spark commented on SPARK-42439: -- User 'LorenzoMartini' has created a pull request for this

[jira] [Assigned] (SPARK-42439) Job description in v2 FileWrites can have the wrong committer

[ https://issues.apache.org/jira/browse/SPARK-42439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42439: Assignee: Apache Spark > Job description in v2 FileWrites can have the wrong committer >

[jira] [Created] (SPARK-42439) Job description in v2 FileWrites can have the wrong committer

Lorenzo Martini created SPARK-42439: --- Summary: Job description in v2 FileWrites can have the wrong committer Key: SPARK-42439 URL: https://issues.apache.org/jira/browse/SPARK-42439 Project: Spark

[jira] [Comment Edited] (SPARK-42399) CONV() silently overflows returning wrong results

[ https://issues.apache.org/jira/browse/SPARK-42399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17688598#comment-17688598 ] Narek Karapetian edited comment on SPARK-42399 at 2/14/23 4:39 PM: ---

[jira] [Commented] (SPARK-42399) CONV() silently overflows returning wrong results

[ https://issues.apache.org/jira/browse/SPARK-42399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17688598#comment-17688598 ] Narek Karapetian commented on SPARK-42399: -- Why do we need to throw an exception in ANSI mode,

[jira] [Commented] (SPARK-42438) Improve constraint propagation using multiTransform

[ https://issues.apache.org/jira/browse/SPARK-42438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17688542#comment-17688542 ] Apache Spark commented on SPARK-42438: -- User 'peter-toth' has created a pull request for this

[jira] [Assigned] (SPARK-42438) Improve constraint propagation using multiTransform

[ https://issues.apache.org/jira/browse/SPARK-42438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42438: Assignee: Apache Spark > Improve constraint propagation using multiTransform >

[jira] [Assigned] (SPARK-42438) Improve constraint propagation using multiTransform

[ https://issues.apache.org/jira/browse/SPARK-42438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42438: Assignee: (was: Apache Spark) > Improve constraint propagation using multiTransform

[jira] [Commented] (SPARK-42436) Improve multiTransform to generate alternatives dynamically

[ https://issues.apache.org/jira/browse/SPARK-42436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17688541#comment-17688541 ] Apache Spark commented on SPARK-42436: -- User 'peter-toth' has created a pull request for this

[jira] [Commented] (SPARK-42436) Improve multiTransform to generate alternatives dynamically

[ https://issues.apache.org/jira/browse/SPARK-42436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17688539#comment-17688539 ] Apache Spark commented on SPARK-42436: -- User 'peter-toth' has created a pull request for this

[jira] [Created] (SPARK-42438) Improve constraint propagation using multiTransform

Peter Toth created SPARK-42438: -- Summary: Improve constraint propagation using multiTransform Key: SPARK-42438 URL: https://issues.apache.org/jira/browse/SPARK-42438 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-42436) Improve multiTransform to generate alternatives dynamically

[ https://issues.apache.org/jira/browse/SPARK-42436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42436: Assignee: (was: Apache Spark) > Improve multiTransform to generate alternatives

[jira] [Assigned] (SPARK-42436) Improve multiTransform to generate alternatives dynamically

[ https://issues.apache.org/jira/browse/SPARK-42436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42436: Assignee: Apache Spark > Improve multiTransform to generate alternatives dynamically >

[jira] [Commented] (SPARK-42373) Remove unused blank line removal from CSVExprUtils

[ https://issues.apache.org/jira/browse/SPARK-42373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17688531#comment-17688531 ] Ted Chester Jenks commented on SPARK-42373: --- For the main use-case for this, 

[jira] [Assigned] (SPARK-42437) Pyspark catalog.cacheTable allow to specify storage level

[ https://issues.apache.org/jira/browse/SPARK-42437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42437: Assignee: (was: Apache Spark) > Pyspark catalog.cacheTable allow to specify storage

[jira] [Commented] (SPARK-42437) Pyspark catalog.cacheTable allow to specify storage level

[ https://issues.apache.org/jira/browse/SPARK-42437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17688517#comment-17688517 ] Apache Spark commented on SPARK-42437: -- User 'khalidmammadov' has created a pull request for this

[jira] [Assigned] (SPARK-42437) Pyspark catalog.cacheTable allow to specify storage level

[ https://issues.apache.org/jira/browse/SPARK-42437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42437: Assignee: Apache Spark > Pyspark catalog.cacheTable allow to specify storage level >

[jira] [Created] (SPARK-42437) Pyspark catalog.cacheTable allow to specify storage level

Khalid Mammadov created SPARK-42437: --- Summary: Pyspark catalog.cacheTable allow to specify storage level Key: SPARK-42437 URL: https://issues.apache.org/jira/browse/SPARK-42437 Project: Spark

[jira] [Created] (SPARK-42436) Improve multiTransform to generate alternatives dynamically

Peter Toth created SPARK-42436: -- Summary: Improve multiTransform to generate alternatives dynamically Key: SPARK-42436 URL: https://issues.apache.org/jira/browse/SPARK-42436 Project: Spark

[jira] [Resolved] (SPARK-42418) Updating PySpark documentation to support new users better

[ https://issues.apache.org/jira/browse/SPARK-42418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42418. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39992

[jira] [Assigned] (SPARK-42418) Updating PySpark documentation to support new users better

[ https://issues.apache.org/jira/browse/SPARK-42418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-42418: Assignee: Allan Folting > Updating PySpark documentation to support new users better >

[jira] [Resolved] (SPARK-42433) Add `array_insert` to Connect

[ https://issues.apache.org/jira/browse/SPARK-42433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42433. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40010

[jira] [Assigned] (SPARK-42433) Add `array_insert` to Connect

[ https://issues.apache.org/jira/browse/SPARK-42433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-42433: Assignee: Ruifeng Zheng > Add `array_insert` to Connect > -

[jira] [Commented] (SPARK-42435) Update DataTables to 1.13.2

[ https://issues.apache.org/jira/browse/SPARK-42435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17688502#comment-17688502 ] Apache Spark commented on SPARK-42435: -- User 'peter-toth' has created a pull request for this

[jira] [Assigned] (SPARK-42435) Update DataTables to 1.13.2

[ https://issues.apache.org/jira/browse/SPARK-42435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42435: Assignee: (was: Apache Spark) > Update DataTables to 1.13.2 >

[jira] [Assigned] (SPARK-42435) Update DataTables to 1.13.2

[ https://issues.apache.org/jira/browse/SPARK-42435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42435: Assignee: Apache Spark > Update DataTables to 1.13.2 > --- > >

[jira] [Resolved] (SPARK-42431) Union avoid calling `output` before analysis

[ https://issues.apache.org/jira/browse/SPARK-42431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42431. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40008

[jira] [Assigned] (SPARK-42431) Union avoid calling `output` before analysis

[ https://issues.apache.org/jira/browse/SPARK-42431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-42431: Assignee: Ruifeng Zheng > Union avoid calling `output` before analysis >

[jira] [Resolved] (SPARK-42434) `array_append` should accept `Any` value

[ https://issues.apache.org/jira/browse/SPARK-42434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42434. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40012

[jira] [Assigned] (SPARK-42434) `array_append` should accept `Any` value

[ https://issues.apache.org/jira/browse/SPARK-42434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-42434: Assignee: Ruifeng Zheng > `array_append` should accept `Any` value >

[jira] [Created] (SPARK-42435) Update DataTables to 1.13.2

Peter Toth created SPARK-42435: -- Summary: Update DataTables to 1.13.2 Key: SPARK-42435 URL: https://issues.apache.org/jira/browse/SPARK-42435 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-42367) DataFrame.drop should handle duplicated columns properly

[ https://issues.apache.org/jira/browse/SPARK-42367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42367: Assignee: (was: Apache Spark) > DataFrame.drop should handle duplicated columns

[jira] [Assigned] (SPARK-42367) DataFrame.drop should handle duplicated columns properly

[ https://issues.apache.org/jira/browse/SPARK-42367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42367: Assignee: Apache Spark > DataFrame.drop should handle duplicated columns properly >

[jira] [Commented] (SPARK-42367) DataFrame.drop should handle duplicated columns properly

[ https://issues.apache.org/jira/browse/SPARK-42367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17688434#comment-17688434 ] Apache Spark commented on SPARK-42367: -- User 'zhengruifeng' has created a pull request for this

[jira] [Commented] (SPARK-42374) User-facing documentaiton

[ https://issues.apache.org/jira/browse/SPARK-42374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17688394#comment-17688394 ] Martin Grund commented on SPARK-42374: -- Yes, that is correct. There is not built-in authentication.

[jira] [Commented] (SPARK-39375) SPIP: Spark Connect - A client and server interface for Apache Spark

[ https://issues.apache.org/jira/browse/SPARK-39375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17688393#comment-17688393 ] Martin Grund commented on SPARK-39375: -- [~tgraves] Currently the Python UDFs are implemented

[jira] [Resolved] (SPARK-42428) Standardize __repr__ of CommonInlineUserDefinedFunction

[ https://issues.apache.org/jira/browse/SPARK-42428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-42428. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40003

[jira] [Assigned] (SPARK-42428) Standardize __repr__ of CommonInlineUserDefinedFunction

[ https://issues.apache.org/jira/browse/SPARK-42428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-42428: - Assignee: Xinrong Meng > Standardize __repr__ of CommonInlineUserDefinedFunction >

[jira] [Updated] (SPARK-42434) `array_append` should accept `Any` value

[ https://issues.apache.org/jira/browse/SPARK-42434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-42434: -- Parent: SPARK-41283 Issue Type: Sub-task (was: Improvement) > `array_append` should

[jira] [Updated] (SPARK-42433) Add `array_insert` to Connect

[ https://issues.apache.org/jira/browse/SPARK-42433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-42433: -- Parent: SPARK-41283 Issue Type: Sub-task (was: Improvement) > Add `array_insert` to

[jira] [Updated] (SPARK-42433) Add `array_insert` to Connect

[ https://issues.apache.org/jira/browse/SPARK-42433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-42433: -- Summary: Add `array_insert` to Connect (was: `array_insert` should accept literal

[jira] [Commented] (SPARK-41727) ClassCastException when config spark.sql.hive.metastore* properties under jdk17

[ https://issues.apache.org/jira/browse/SPARK-41727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17688377#comment-17688377 ] kevinshin commented on SPARK-41727: ---

[jira] [Assigned] (SPARK-42434) `array_append` should accept `Any` value

[ https://issues.apache.org/jira/browse/SPARK-42434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42434: Assignee: Apache Spark > `array_append` should accept `Any` value >

[jira] [Commented] (SPARK-42434) `array_append` should accept `Any` value

[ https://issues.apache.org/jira/browse/SPARK-42434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17688374#comment-17688374 ] Apache Spark commented on SPARK-42434: -- User 'zhengruifeng' has created a pull request for this

[jira] [Assigned] (SPARK-42434) `array_append` should accept `Any` value

[ https://issues.apache.org/jira/browse/SPARK-42434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42434: Assignee: (was: Apache Spark) > `array_append` should accept `Any` value >

  1   2   >