XiaoHongbo-Hope opened a new pull request, #11103:
URL: https://github.com/apache/paimon/pull/11103

   ### Purpose
   
   Direct `VideoFrameCollator(rows)` calls currently decode different videos 
serially, while the LeRobot dataset path already uses the shared parallel 
decoder scheduler. Add `decode_parallelism` to the direct entry point and reuse 
that scheduler and process-local executor.
   
   Callers can set `decode_parallelism=4`; the default stays 1 for existing 
callbacks that share mutable state. Decoding is bounded by `max_open_videos`, 
preserves input order, and drains pending work on failure. Decoder creation 
remains sequential.
   
   ### Tests
   
   - `multimodal_video_test.py` and `video_decode_parallelism_test.py`: 32 
passed, 11 skipped, 48 subtests passed.
   - Added direct-call coverage for concurrency, ordered outputs, sorted 
frames, cache eviction, failure recovery, parameter validation and the serial 
default.
   - `git diff --check` passed.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to