potiuk commented on issue #17429:
URL: https://github.com/apache/airflow/issues/17429#issuecomment-1711370529
> @eladkal Any updates on this? Is the REST API for detect changes coming
anytime soon?
It will come when someone implements it. This is open-source and there is no
way to answer that question authoritatively. But there is one way to make sure
it's coming - if you or your company contributes it and creates a PR, or maybe
fund work of somone who will do it. This is a certain way to make it happen.
And you are absolutely welcome to do it. You seem to run buisness on top of
Airflow so contributing back to get the feature you need seems like a good idea
I think. Otherwise you need to wait until someone who has similar need will add
it. But it might mean you will wait for a long time.\
> Any idea on how to tell airflow to scan the DAG file for new changes
before triggering it?
No way currently. But you can add some markers to your DAG files (date,
version etc.) and make an API call to check if the marker is present in the
serialized form of the DAG. This is an easy (albeit somewhat active loop) to
check if your latest change has been already processed by DAG File processor.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
