ThibauldC commented on issue #6615:
URL: https://github.com/apache/iceberg/issues/6615#issuecomment-1717634559
Does anyone have a (temporary) solution for this? We are also facing issues
with the `MERGE INTO` statement in combination with a temporary view. We had no
issues in PySpark 3.2.1, but we are encountering this issue when trying to
upgrade to PySpark 3.3. We tried with 3.3.0 and 3.3.2, but same issues. We are
unfortunately not capable of upgrading to PySpark 3.4 (yet).
Here is the piece of our code that is throwing the error:
```python
dataframe.createOrReplaceTempView("example_subquery")
spark.sql("""
merge into test.test.example s
using example_subquery d
on s.id = d.id and s.lw = d.lw
when matched then update set s.end_ts} = d.end_ts,
s.current_flag = d.current_flag
s.update_ts = current_timestamp()
when not matched then insert *
""")
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
