XiaoHongbo-Hope opened a new pull request, #11103: URL: https://github.com/apache/paimon/pull/11103
### Purpose Direct `VideoFrameCollator(rows)` calls currently decode different videos serially, while the LeRobot dataset path already uses the shared parallel decoder scheduler. Add `decode_parallelism` to the direct entry point and reuse that scheduler and process-local executor. Callers can set `decode_parallelism=4`; the default stays 1 for existing callbacks that share mutable state. Decoding is bounded by `max_open_videos`, preserves input order, and drains pending work on failure. Decoder creation remains sequential. ### Tests - `multimodal_video_test.py` and `video_decode_parallelism_test.py`: 32 passed, 11 skipped, 48 subtests passed. - Added direct-call coverage for concurrency, ordered outputs, sorted frames, cache eviction, failure recovery, parameter validation and the serial default. - `git diff --check` passed. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
