dabla commented on PR #48868: URL: https://github.com/apache/airflow/pull/48868#issuecomment-2939239076
> We need a length value somehow because the scheduler needs to know how many tis to run. Since it is not possible to actually know the real length, I think one possibility would be to just use the original length and create potentially too many tis, and just mark the ones not needed as skipped afterwards. The length issue for filter would not be an issue anymore if following [PR ](https://github.com/apache/airflow/pull/51391) would be accepted, so best to wait what comes out of it. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
