rudolfix commented on issue #2467: URL: https://github.com/apache/iceberg-python/issues/2467#issuecomment-3389686266
We have the same problem when running automated tests with `upsert` and `pyiceberg 0.10`. I was able to track it down to https://github.com/apache/iceberg-python/blob/main/pyiceberg/table/__init__.py#L824 a `DataScan` used to generate batched does not see newly added columns. Note that we didn't append any data to the table in between schema evolution and upsert transaction. previously (0.9) used `table.scan` didn't have this problem. I hope it helps a little... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
