ArnavBalyan opened a new pull request, #8843:
URL: https://github.com/apache/paimon/pull/8843

   ### Purpose
    - Data data evolution drops the rows when a column type/nullability changes
    - This is because evolutionStats leaves the -1 offset for a column whose 
stored type differs from the current type, which DataEvolutionArray encodes as 
all null.
    - LeafPredicate then prunes the pre alter version of the file and loses 
rows.
    - Correct such columns to the -2 so the file is kept
   
   ### Tests
    - UT


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to