This is an automated email from the ASF dual-hosted git repository.
potiuk pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/airflow.git
The following commit(s) were added to refs/heads/main by this push:
new 592eafa82a openlineage, docs: add missing execution_timeout conf value
(#41042)
592eafa82a is described below
commit 592eafa82af5c39c2268b590c2216c82c39b8a3b
Author: Maciej Obuchowski <[email protected]>
AuthorDate: Fri Jul 26 15:26:20 2024 +0200
openlineage, docs: add missing execution_timeout conf value (#41042)
Signed-off-by: Maciej Obuchowski <[email protected]>
---
.../guides/user.rst | 20 ++++++++++++++++++++
1 file changed, 20 insertions(+)
diff --git a/docs/apache-airflow-providers-openlineage/guides/user.rst
b/docs/apache-airflow-providers-openlineage/guides/user.rst
index 19b8ef9d78..a5ced101f0 100644
--- a/docs/apache-airflow-providers-openlineage/guides/user.rst
+++ b/docs/apache-airflow-providers-openlineage/guides/user.rst
@@ -191,6 +191,26 @@ If not set, it's using ``default`` namespace. Provide the
name of the namespace
.. _options:disable:
+Timeout
+^^^^^^^
+
+To add a layer of isolation between task execution and OpenLineage, adding a
level of assurance that OpenLineage execution does not
+interfere with task execution in a way other than taking time, OpenLineage
methods run in separate process.
+The code runs with default timeout of 10 seconds. You can increase this by
setting the ``execution_timeout`` value.
+
+.. code-block:: ini
+
+ [openlineage]
+ transport = {"type": "http", "url": "http://example.com:5000", "endpoint":
"api/v1/lineage"}
+ execution_timeout = 60
+
+``AIRFLOW__OPENLINEAGE__EXECUTION_TIMEOUT`` environment variable is an
equivalent.
+
+.. code-block:: ini
+
+ AIRFLOW__OPENLINEAGE__EXECUTION_TIMEOUT=60
+
+
Disable
^^^^^^^
You can disable sending OpenLineage events without uninstalling OpenLineage
provider by setting