leaves12138 opened a new pull request, #7868: URL: https://github.com/apache/paimon/pull/7868
## What changed Cherry-picked 88e4dd407cbd557c21e6246535edef4b3e34a97d onto master. This updates Spark merge-into data evolution update column detection so target self-assignments are not treated as modified columns when Spark adds or changes qualifiers. The logic now treats matching AttributeReference exprIds as the same target column, while still including source-side assignments such as target_col = source_col. ## Why Spark AttributeReference.equals also compares qualifiers, so the same target field can compare unequal as file_name#2 versus t.file_name#2. That made updateColumns include unchanged fields and caused partial updates to rewrite more columns than expected. ## Validation - mvn -pl paimon-spark/paimon-spark-common -DskipTests -Dcheckstyle.skip -Drat.skip -Dspotless.check.skip=true compile - mvn -pl paimon-spark/paimon-spark-common -DskipTests -Dcheckstyle.skip -Drat.skip spotless:check -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
