[ 
https://issues.apache.org/jira/browse/AIRFLOW-5071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17309540#comment-17309540
 ] 

ASF GitHub Bot commented on AIRFLOW-5071:
-----------------------------------------

easthy-alterpost edited a comment on issue #10790:
URL: https://github.com/apache/airflow/issues/10790#issuecomment-808355662


   Trying Airflow 2.0.1. No tasks could be executed :(
   ```
   scheduler_1  | [2021-03-26 16:25:55,097] {{scheduler_job.py:941}} INFO - 1 
tasks up for execution:
   
   scheduler_1  |  <TaskInstance: test_dag.mirrors_to_vaniks 2021-03-26 
16:25:55.009735+00:00 [scheduled]>
   
   scheduler_1  | [2021-03-26 16:25:55,100] {{scheduler_job.py:975}} INFO - 
Figuring out tasks to run in Pool(name=default_pool) with 128 open slots and 1 
task instances ready to be queued
   
   scheduler_1  | [2021-03-26 16:25:55,100] {{scheduler_job.py:1002}} INFO - 
DAG test_dag has 0/16 running and queued tasks
   
   scheduler_1  | [2021-03-26 16:25:55,100] {{scheduler_job.py:1063}} INFO - 
Setting the following tasks to queued state:
   
   scheduler_1  |  <TaskInstance: test_dag.mirrors_to_vaniks 2021-03-26 
16:25:55.009735+00:00 [scheduled]>
   
   scheduler_1  | [2021-03-26 16:25:55,103] {{scheduler_job.py:1105}} INFO - 
Sending TaskInstanceKey(dag_id='test_dag', task_id='mirrors_to_vaniks', 
execution_date=datetime.datetime(2021, 3, 26, 16, 25, 55, 9735, 
tzinfo=Timezone('UTC')), try_number=1) to executor with priority 1 and queue 
default
   
   scheduler_1  | [2021-03-26 16:25:55,104] {{base_executor.py:82}} INFO - 
Adding to queue: ['airflow', 'tasks', 'run', 'test_dag', 'mirrors_to_vaniks', 
'2021-03-26T16:25:55.009735+00:00', '--local', '--pool', 'default_pool', 
'--subdir', '/usr/local/airflow/dags/mwl/test_dag.py']
   
   scheduler_1  | [2021-03-26 16:25:55,149] {{scheduler_job.py:1206}} INFO - 
Executor reports execution of test_dag.mirrors_to_vaniks 
execution_date=2021-03-26 16:25:55.009735+00:00 exited with status queued for 
try_number 1
   
   scheduler_1  | [2021-03-26 16:25:55,154] {{scheduler_job.py:1226}} INFO - 
Setting external_id for <TaskInstance: test_dag.mirrors_to_vaniks 2021-03-26 
16:25:55.009735+00:00 [queued]> to 53fa2dc3-9f17-4813-a1bc-7e28f18e0ddd
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


> Thousand os Executor reports task instance X finished (success) although the 
> task says its queued. Was the task killed externally?
> ----------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: AIRFLOW-5071
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-5071
>             Project: Apache Airflow
>          Issue Type: Bug
>          Components: DAG, scheduler
>    Affects Versions: 1.10.3
>            Reporter: msempere
>            Priority: Critical
>             Fix For: 1.10.12
>
>         Attachments: image-2020-01-27-18-10-29-124.png, 
> image-2020-07-08-07-58-42-972.png
>
>
> I'm opening this issue because since I update to 1.10.3 I'm seeing thousands 
> of daily messages like the following in the logs:
>  
> ```
>  {{__init__.py:1580}} ERROR - Executor reports task instance <TaskInstance: X 
> 2019-07-29 00:00:00+00:00 [queued]> finished (success) although the task says 
> its queued. Was the task killed externally?
> {{jobs.py:1484}} ERROR - Executor reports task instance <TaskInstance: X 
> 2019-07-29 00:00:00+00:00 [queued]> finished (success) although the task says 
> its queued. Was the task killed externally?
> ```
> -And looks like this is triggering also thousand of daily emails because the 
> flag to send email in case of failure is set to True.-
> I have Airflow setup to use Celery and Redis as a backend queue service.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to