naveenp2708 commented on PR #57644: URL: https://github.com/apache/spark/pull/57644#issuecomment-6087653115
Good catch @szehon-ho, thanks for tracing it. Fixed both: - `appendEngineOwnedReservedFields` now reconciles the metadata struct recursively, so a declared nested name and order survive with the engine's types/nullability (the retained case). - `reservedFieldCasingDrifts` recurses too and reports nested drift with a qualified name (`__spark_autocdc_metadata.DELETESEQUENCE`), reusing the same error, so an omitted declaration that resolves the nested names to canonical against an upper-cased target is rejected up front (the omitted case). Two regression tests on your scenario: the retained declaration with a case-sensitive downstream `SELECT *` (now resolves), and the omitted declaration (now rejected with the drift error). Both fail without the change and pass with it. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
