Hyukjin Kwon created SPARK-61617:
------------------------------------
Summary: Match PySpark's registerTempTable, the bool and
properties arguments of the catalog and writers, and createExternalTable's
signature, in the Python client
Key: SPARK-61617
URL: https://issues.apache.org/jira/browse/SPARK-61617
Project: Spark
Issue Type: Bug
Components: Connect
Affects Versions: connect-rust-4.3.0
Reporter: Hyukjin Kwon
The Python client of spark-connect-rust differed from PySpark 4.3.0's Connect
client in these catalog and writer methods:
- DataFrame.registerTempTable created the view, raising
TEMP_TABLE_OR_VIEW_ALREADY_EXISTS for an existing one, without PySpark's
FutureWarning "Deprecated in 2.0, use createOrReplaceTempView instead.".
PySpark's warns and calls createOrReplaceTempView.
- The bool arguments of dropTable, dropView, createDatabase, dropDatabase,
getCreateTableString, analyzeTable, DataFrameWriter.insertInto and
DataFrame.unpersist took only a bool, where PySpark takes what its proto bool
fields take (an int, a NumPy bool) or tests the truth of the value.
- createDatabase(properties=[]) raised a TypeError, where PySpark takes a false
value as no properties.
- createExternalTable took a fifth positional description, which PySpark's
(tableName, path=None, source=None, schema=None, **options) does not.
--
This message was sent by Atlassian Jira
(v10.3.26#10030026)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]