jpays opened a new issue #10603: URL: https://github.com/apache/airflow/issues/10603
<!-- Welcome to Apache Airflow! For a smooth issue process, try to answer the following questions. Don't worry if they're not all applicable; just try to include what you can :-) If you need to include code snippets or logs, please put them in fenced code blocks. If they're super-long, please use the details tag like <details><summary>super-long log</summary> lots of stuff </details> Please delete these comment blocks before submitting the issue. --> **Description** Currently there is no way to add custom metadata to a dag run, this would be an interesting enhancement. **Use case / motivation** This could have multiple use cases, here are some examples : * Let's say you have a dag that ends up loading data in a table, the number of lines loaded could be added as a custom metadata on the dag run * You have a dag that run multiple times every day, and that can process serveral perimeters of data depending on external factors, the perimeters processed could be added as a custom metadata on the dag run * The main goal is to provide some easy-to-use feedback about what a dagrun has done. This could afterwards be displayed on the dagrun UI, but I think it is mainly relevant to use in charts, SQL queries or various dataviz products such has Tableau that could be plugged on the airflow DB. Ultimately, this data could be made available in the new API. I don't know if there is a way to achieve this differently. I can help adding this feature if necessary. **Related Issues** Could not find. Thanks & Regards. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
