marcus-moura commented on issue #16163:
URL: https://github.com/apache/airflow/issues/16163#issuecomment-1461063608
I've been facing this problem too, in my case my task doesn't even run. It
is a task to run a job in Databricks with DatabricksDeferrableOperator and its
upstreams last for approximately 2 hours, but in the log of the tasks that
fail, the execution date is less than the end date of the upstreams. So it
looks like it ran without the upstreams having successfully completed.
When analyzing the scheduler log I found this:
`[2023-03-08 06:06:06,617] {scheduler_job.py:687} ERROR - Executor reports
task instance <TaskInstance:
job_orchestration.sourcing.cubo_custos_job_new.cubo_custos_job_new
scheduled__2023-03-07T05:00:00+00:00 [queued ]> finished (success) although the
task says its queued. (Info: None) Was the task killed externally?`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
