davidkl97 opened a new issue, #24828:
URL: https://github.com/apache/airflow/issues/24828

   ### Description
   
   While full db cleanup is useful to run in rare occasions, deleting data 
regarding to specific dag ids provides modular maintenance method to clean 
specific "intensive" dags and provide clear context and responsivness in the 
web ui and interfaces in cluster.
   
   an initial idea was gathered to add optional `dag_id` key in `_TableConfig` 
at 
[db_cleanup.py](https://github.com/apache/airflow/blob/e2fd41f7b14adef2c3a88dde14d088b5ef93b460/airflow/utils/db_cleanup.py#L45)
 and append condition in `_build_query`(after adding the argument of course). 
Those changes could be provided also in the helm chart as list of cleanup jobs.
   
   would love to hear you inputs about the use case and the implementation 
relating to the current effort(e.g #24590).
   Thanks.
   
   ### Use case/motivation
   
   - cleanup of specific "intensive" dags.
   - modular and configurable context and metadata in the web server and the 
different interfaces.
   
   ### Related issues
   
   _No response_
   
   ### Are you willing to submit a PR?
   
   - [X] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of 
Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to