rdblue commented on issue #25955: [SPARK-29277][SQL] Add early DSv2 filter and projection pushdown URL: https://github.com/apache/spark/pull/25955#issuecomment-544757883 @cloud-fan, the test failure on the last version appears to be a buggy test case. Could you take a look to confirm? The test first creates a table with the default format, `parquet`. Then it appends to the table using the DataFrameWriter API and `$v2Format`, which writes to an in-memory table (and succeeds). Last, the test tries to validate the written data, but there are no Parquet files because the write went to the in-memory table. Looks like a test bug to me.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
