SteNicholas commented on PR #564: URL: https://github.com/apache/paimon-cpp/pull/564#issuecomment-6944442978
Thanks @lxy-9602. [Your observation](https://github.com/apache/paimon-cpp/pull/564#issuecomment-6944276366) is correct: the four-reader bound is per raw split. `CreateReader(splits)` still constructs every split reader eagerly, so S raw splits with at least four files each can retain up to 4 × S file readers before the first batch. The shared executor limits concurrent builds, not the total number of retained readers, and early termination still pays the initial preparation cost for later splits. Agreed that lazy split initialization belongs in a follow-up. It needs to preserve split order and ownership of the creation state, define validation and deferred-error behavior, and test that early close leaves later splits unopened. A TODO near the multi-split creation loop would be a useful pointer to that remaining work. This PR addresses the per-split bound; the cross-split limitation remains. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
