XiaoHongbo-Hope opened a new pull request, #8863: URL: https://github.com/apache/paimon/pull/8863
### Purpose [#8739](https://github.com/apache/paimon/pull/8739) added row-count based data file rolling (`target-file-row-num`) on the core side. PyPaimon file-store writers previously did not support it and failed fast whenever the option was enabled. This PR implements `target-file-row-num` rolling for **data-evolution append tables** in PyPaimon. ### Changes - `DataWriter._check_and_roll_if_needed`: roll a file when it reaches `target-file-row-num` rows or `target-file-size`, whichever comes first (exact slicing, mirroring the format-table path). Defaults to the max long (disabled), so size-based rolling is unchanged when the option is unset. - `FileStoreWrite._create_data_writer`: narrow the fail-fast so the option is permitted only for data-evolution append tables (i.e. `AppendOnlyDataWriter` — not primary-key, blob or vector writers, which override rolling and remain unsupported for now). ### Tests `data_evolution_row_rolling_test.py`: - rolls when the row count exceeds the limit (10 rows / limit 3 → files of 3,3,3,1); - exact multiple rolls evenly; - below the limit stays a single file; - unset option does not roll by rows; - a non-DE table still fails fast. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
