[
https://issues.apache.org/jira/browse/SPARK-61617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-61617:
-----------------------------------
Labels: pull-request-available (was: )
> Match PySpark's registerTempTable, the bool and properties arguments of the
> catalog and writers, and createExternalTable's signature, in the Python client
> ----------------------------------------------------------------------------------------------------------------------------------------------------------
>
> Key: SPARK-61617
> URL: https://issues.apache.org/jira/browse/SPARK-61617
> Project: Spark
> Issue Type: Bug
> Components: Connect
> Affects Versions: connect-rust-4.3.0
> Reporter: Hyukjin Kwon
> Priority: Major
> Labels: pull-request-available
> Fix For: connect-rust-4.3.0
>
>
> The Python client of spark-connect-rust differed from PySpark 4.3.0's Connect
> client in these catalog and writer methods:
> - DataFrame.registerTempTable created the view, raising
> TEMP_TABLE_OR_VIEW_ALREADY_EXISTS for an existing one, without PySpark's
> FutureWarning "Deprecated in 2.0, use createOrReplaceTempView instead.".
> PySpark's warns and calls createOrReplaceTempView.
> - The bool arguments of dropTable, dropView, createDatabase, dropDatabase,
> getCreateTableString, analyzeTable, DataFrameWriter.insertInto and
> DataFrame.unpersist took only a bool, where PySpark takes what its proto bool
> fields take (an int, a NumPy bool) or tests the truth of the value.
> - createDatabase(properties=[]) raised a TypeError, where PySpark takes a
> false value as no properties.
> - createExternalTable took a fifth positional description, which PySpark's
> (tableName, path=None, source=None, schema=None, **options) does not.
--
This message was sent by Atlassian Jira
(v10.3.26#10030026)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]