plusplusjiajia commented on PR #642: URL: https://github.com/apache/paimon-rust/pull/642#issuecomment-5214806872
> `_ROW_ID = ...` predicates targeting non-Data Evolution tables are extracted and removed from the residual; they subsequently become silently ineffective, resulting in the return of all data. This behavior has been reproduced in local tests. A check for Data Evolution should be performed prior to extraction, or the predicates should be retained in the residual and rejected across the board. @JingsongLi Thanks for catching this — confirmed and fixed in the second commit. _ROW_ID >= 102 returned all four rows of a file at first_row_id = 100. Took your second option. One thing worth your check: I gated on row-tracking.enabled || data-evolution.enabled rather than data evolution alone, since what matters is whether data files record a first_row_id, which row tracking assigns. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
