Lee-W commented on issue #58676:
URL: https://github.com/apache/airflow/issues/58676#issuecomment-3631572442
@MarcusCramer91, is there any airflow config you feel is suspicious? Or
maybe let's check whether the error happens in core or google-provider. Could
you please test with a Dag like the following one and see whether the log is
still disappearing?
```python
from __future__ import annotations
from datetime import datetime, timedelta
from airflow.providers.standard.triggers.temporal import TimeDeltaTrigger
from airflow.sdk import DAG, BaseOperator, Context
class SimpleDeferrableOperator(BaseOperator):
def __init__(self, wait_seconds: int = 5, **kwargs):
super().__init__(**kwargs)
self.wait_seconds = wait_seconds
def pre_execute(self, context: Context):
self.log.info(">>> pre_execute called by self.log")
super().pre_execute(context)
def execute(self, context: Context):
print(">>> Deferring task...")
self.defer(
method_name="execute_complete",
trigger=TimeDeltaTrigger(timedelta(seconds=self.wait_seconds)),
)
def execute_complete(self, context: Context, event=None):
print(">>> execute_complete called, event:", event)
return "completed"
with DAG(
dag_id="minimal_deferrable_dag",
start_date=datetime(2024, 1, 1),
schedule=None,
catchup=False,
):
SimpleDeferrableOperator(
task_id="wait_then_complete",
wait_seconds=10,
)
```
If so, then we can almost confirm this is an issue from the core. And the
next step could be turn on and turn off your airflow config one by one and see
what makes this happened
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
