mobuchowski opened a new pull request, #47564: URL: https://github.com/apache/airflow/pull/47564
This PR is a followup to https://github.com/apache/airflow/pull/47508 When explicitly enabled by the user for supported operators, we will automatically inject parent job information into the Spark job properties. For example, when submitting a Spark job using the LivyOperator, we will include details about the Airflow task that triggered it so that the OpenLineage Spark integration can include them in parentRunFacet. More detailed description is in https://github.com/apache/airflow/pull/44477 - this adds the same feature, but for different operator. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
