crazyproger commented on issue #17507:
URL: https://github.com/apache/airflow/issues/17507#issuecomment-910187889
We met this on different dags. Clearing dagrun helps in all cases.
Task log:
```
*** Reading local file: /opt/airflow/logs/<Dag
id>/wait_cache_ready/2021-08-31T17:00:00+00:00/1.log
[2021-08-31 18:14:43,582] {taskinstance.py:903} INFO - Dependencies all met
for <TaskInstance:<Dag id>.wait_cache_ready 2021-08-31T17:00:00+00:00 [queued]>
[2021-08-31 18:14:43,608] {taskinstance.py:903} INFO - Dependencies all met
for <TaskInstance: <Dag id>.wait_cache_ready 2021-08-31T17:00:00+00:00 [queued]>
[2021-08-31 18:14:43,609] {taskinstance.py:1094} INFO -
--------------------------------------------------------------------------------
[2021-08-31 18:14:43,609] {taskinstance.py:1095} INFO - Starting attempt 1
of 1
[2021-08-31 18:14:43,609] {taskinstance.py:1096} INFO -
--------------------------------------------------------------------------------
[2021-08-31 18:14:43,631] {taskinstance.py:1114} INFO - Executing
<Task(PythonSensor): wait_cache_ready> on 2021-08-31T17:00:00+00:00
[2021-08-31 18:14:43,638] {standard_task_runner.py:52} INFO - Started
process 25320 to run task
[2021-08-31 18:14:43,643] {standard_task_runner.py:76} INFO - Running:
['airflow', 'tasks', 'run', '<Dag id>', 'wait_cache_ready',
'2021-08-31T17:00:00+00:00', '--job-id', '45735641', '--pool', 'default_pool',
'--raw', '--subdir',
'DAGS_FOLDER/<integration>/upload_dags/installs_hourly_2.py', '--cfg-path',
'/tmp/tmp90yuh86s', '--error-file', '/tmp/tmp3s15tqza']
[2021-08-31 18:14:43,644] {standard_task_runner.py:77} INFO - Job 45735641:
Subtask wait_cache_ready
[2021-08-31 18:14:48,697] {local_task_job.py:204} WARNING - Recorded pid
23138 does not match the current pid 25320
[2021-08-31 18:14:48,699] {process_utils.py:100} INFO - Sending
Signals.SIGTERM to GPID 25320
[2021-08-31 18:14:48,707] {process_utils.py:66} INFO - Process
psutil.Process(pid=25320, status='terminated', exitcode=<Negsignal.SIGTERM:
-15>, started='18:14:42') (25320) terminated with exit code Negsignal.SIGTERM
```
function that creates dag is here:
https://gist.github.com/crazyproger/a2a516f8e6b757b88d29f6fccca16990
It has failed on first task - sensor, implementation is at the bottom - `def
check_file_exists`.
I omit other tasks implementations.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
