felipepessoto commented on PR #13502: URL: https://github.com/apache/gluten/pull/13502#issuecomment-6667564671
@malinjawi Pushed e57998b8c with the review follow-ups. The inline replies cover the timestamp guard and direct UPDATE/DELETE file reads. I also added partitioned and unpartitioned CDF UPDATE/DELETE cases that inspect both data and change Parquet files and compare the rows with vanilla Delta, plus an OPTIMIZE case that requires real file replacement and checks the new files, partition values, and statistics. The docs now explain the virtual __is_cdc partition and the wider CHECK/NOT NULL exception impact. DeltaNativeWriteSuite is now explicitly included in group 1 of the existing Spark 4.0/4.1/4.2 CI jobs. I checked the actual parallel-UT discovery output: only that suite is added, with no existing suites lost. All 59 focused tests passed locally on Spark 4.1, including its 12 tests; fresh CI is pending. The generic JNI fix remains in #13133, where combined strict Delta constraint validation is being added separately. I also followed up on #13386 about checking connector build availability as well as URI schemes. Neither exception preservation nor filesystem fallback is claimed fixed by this PR. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
