abhijit-kottur commented on issue #7935: scheduler gets stuck without a trace
URL: https://github.com/apache/airflow/issues/7935#issuecomment-606489074
 
 
   I'm running Airflow 1.10.4 as Celery in k8s. The scheduler pod is getting 
stuck while starting up at the step 'Resetting orphaned tasks'. 
   
   ```
   [2020-03-31 19:34:36,955] {{__init__.py:51}} INFO - Using executor 
CeleryExecutor
     ____________       _____________
    ____    |__( )_________  __/__  /________      __
   ____  /| |_  /__  ___/_  /_ __  /_  __ \_ | /| / /
   ___  ___ |  / _  /   _  __/ _  / / /_/ /_ |/ |/ /
    _/_/  |_/_/  /_/    /_/    /_/  \____/____/|__/
   [2020-03-31 19:34:37,533] {{scheduler_job.py:1288}} INFO - Starting the 
scheduler
   [2020-03-31 19:34:37,534] {{scheduler_job.py:1296}} INFO - Running execute 
loop for -1 seconds
   [2020-03-31 19:34:37,534] {{scheduler_job.py:1297}} INFO - Processing each 
file at most -1 times
   [2020-03-31 19:34:37,535] {{scheduler_job.py:1300}} INFO - Searching for 
files in /usr/local/airflow/dags
   [2020-03-31 19:34:38,124] {{scheduler_job.py:1302}} INFO - There are 39 
files in /usr/local/airflow/dags
   [2020-03-31 19:34:38,124] {{scheduler_job.py:1349}} INFO - Resetting 
orphaned tasks for active dag runs
   ```
   
   This causes the UI to say 
   
   > The scheduler does not appear to be running. Last heartbeat was received 5 
minutes ago
   
   The same thing happens even after restarting the scheduler pod. (regardless 
of the CPU usage)
   
   Any leads to solve this?

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[email protected]


With regards,
Apache Git Services

Reply via email to