FrankPortman commented on issue #59294: URL: https://github.com/apache/airflow/issues/59294#issuecomment-3688184192
Maybe not a v1 thing, but I can see it being a nice-to-have to essentially have a decay of how many partitions you are okay being missing, as a function of how far past some job date timestamp the universe time is. In other words, ideally wait for all 31 partitions of the month, but if we're 3 days past due, be okay with, say, 28/31 for practical purposes. Is this something that you think will be easy to bolt on either in userland or in official Airflowland, or would that be a more involved re-design based on how you guys are thinking about solving this? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
