SteNicholas commented on PR #564:
URL: https://github.com/apache/paimon-cpp/pull/564#issuecomment-6944442978

   Thanks @lxy-9602. [Your 
observation](https://github.com/apache/paimon-cpp/pull/564#issuecomment-6944276366)
 is correct: the four-reader bound is per raw split. `CreateReader(splits)` 
still constructs every split reader eagerly, so S raw splits with at least four 
files each can retain up to 4 × S file readers before the first batch. The 
shared executor limits concurrent builds, not the total number of retained 
readers, and early termination still pays the initial preparation cost for 
later splits.
   
   Agreed that lazy split initialization belongs in a follow-up. It needs to 
preserve split order and ownership of the creation state, define validation and 
deferred-error behavior, and test that early close leaves later splits 
unopened. A TODO near the multi-split creation loop would be a useful pointer 
to that remaining work. This PR addresses the per-split bound; the cross-split 
limitation remains.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to