Hi Community,
I get the following error when using Spark Connect in PySpark 3.5.1
and writing with DataFrameWriterV2.overwrite.
```
> df.writeTo('db.table').overwrite(F.col('id')==F.lit(1))
...
SparkConnectGrpcException:
(org.apache.spark.sql.connect.common.InvalidPlanInput) Expression with
ID: 0 is not supported
```
I believe this is caused by the following code:
https://github.com/apache/spark/blob/6e371e1df50e35d807065015525772c3c02a5995/python/pyspark/sql/connect/plan.py#L1760-L1763
Is there a JIRA issue or PR regarding this error?
If not, create one.
Thanks,
Toki Takahashi
---------------------------------------------------------------------
To unsubscribe e-mail: [email protected]
