fanruan-tuco opened a new pull request, #18522: URL: https://github.com/apache/iceberg/pull/18522
Fast local or cached manifest reads can complete during ParallelIterable's fixed 10 ms sleep, delaying result consumption and further task scheduling. Replace polling with semaphore notifications on data arrival, task completion or failure, and closure. Drain stale notifications before checking task and queue state so concurrent updates remain observable. Test plan: Verify wake-up on data before task completion, empty task completion, task failure, and closure while waiting. Validated with `TestParallelIterable`. Fixes #18521 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
