mobuchowski opened a new pull request, #31717: URL: https://github.com/apache/airflow/pull/31717
The idea for system tests is as follows: - there is `VariableTransport` that will push OpenLineage events to `Variable` with key `<DAG_ID>.<TASK_ID>.event.<EVENT_TYPE>`. - System tests DAGs will be configured to use this transport - then, newly added `OpenLineageTestOperator` will compare the `expected` events with the ones that are stored in Variables. This PR adds those components, as well as OL support for `BigQueryGetDataOperator` and OL support for system test utilizing it. PR is based on previous PR: https://github.com/apache/airflow/pull/31293 - only second commit is relevant to this PR. Closes: #29676 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
