smhood commented on issue #36998:
URL: https://github.com/apache/airflow/issues/36998#issuecomment-1910408593

   Looking over the logs I get two different outcomes.... when I restart the 
pods I get the following:
   ```
   [2024-01-25T13:20:23.100+0000] {scheduler_job_runner.py:696} INFO - Received 
executor event with state queued for task instance 
TaskInstanceKey(dag_id='acq__azure_blob__superhero__blob_battles_parquet_feed', 
task_id='get_execution_parameters', 
run_id='scheduled__2024-01-25T09:00:00+00:00', try_number=1, map_index=-1)
   [2024-01-25T13:20:23.101+0000] {scheduler_job_runner.py:696} INFO - Received 
executor event with state queued for task instance 
TaskInstanceKey(dag_id='acq__sftp__superhero__sftp_battles_csv_feed', 
task_id='get_execution_parameters', 
run_id='scheduled__2024-01-25T09:00:00+00:00', try_number=1, map_index=-1)
   [2024-01-25T13:20:23.101+0000] {scheduler_job_runner.py:696} INFO - Received 
executor event with state queued for task instance 
TaskInstanceKey(dag_id='acq__azure_blob__superhero__blob_battles_csv_feed', 
task_id='get_execution_parameters', 
run_id='scheduled__2024-01-25T09:00:00+00:00', try_number=1, map_index=-1)
   [2024-01-25T13:20:23.101+0000] {scheduler_job_runner.py:696} INFO - Received 
executor event with state success for task instance 
TaskInstanceKey(dag_id='acq__azure_blob__superhero__blob_battles_parquet_feed', 
task_id='check_new_files', run_id='scheduled__2024-01-25T00:00:00+00:00', 
try_number=1, map_index=-1)
   [2024-01-25T13:20:23.101+0000] {scheduler_job_runner.py:696} INFO - Received 
executor event with state success for task instance 
TaskInstanceKey(dag_id='acq__azure_blob__data_platform_meta__test_trading_partner',
 task_id='check_new_files', run_id='scheduled__2024-01-25T00:00:00+00:00', 
try_number=1, map_index=-1)
   [2024-01-25T13:20:23.101+0000] {scheduler_job_runner.py:696} INFO - Received 
executor event with state success for task instance 
TaskInstanceKey(dag_id='acq__sftp__superhero__sftp_battles_csv_feed', 
task_id='get_execution_parameters', 
run_id='scheduled__2024-01-25T03:00:00+00:00', try_number=1, map_index=-1)
   [2024-01-25T13:20:23.101+0000] {scheduler_job_runner.py:696} INFO - Received 
executor event with state success for task instance 
TaskInstanceKey(dag_id='acq__sftp__superhero__sftp_battles_csv_feed', 
task_id='get_execution_parameters', 
run_id='scheduled__2024-01-25T00:00:00+00:00', try_number=1, map_index=-1)
   [2024-01-25T13:20:23.102+0000] {scheduler_job_runner.py:696} INFO - Received 
executor event with state success for task instance 
TaskInstanceKey(dag_id='acq__azure_blob__data_platform_meta__test_trading_partner',
 task_id='get_execution_parameters', 
run_id='scheduled__2024-01-25T03:00:00+00:00', try_number=1, map_index=-1)
   [2024-01-25T13:20:23.102+0000] {scheduler_job_runner.py:696} INFO - Received 
executor event with state success for task instance 
TaskInstanceKey(dag_id='acq__sftp__superhero__sftp_battles_csv_feed', 
task_id='get_execution_parameters', 
run_id='scheduled__2024-01-25T04:00:00+00:00', try_number=1, map_index=-1)
   [2024-01-25T13:20:23.102+0000] {scheduler_job_runner.py:696} INFO - Received 
executor event with state success for task instance 
TaskInstanceKey(dag_id='acq__azure_blob__superhero__blob_battles_parquet_feed', 
task_id='check_new_files', run_id='scheduled__2024-01-24T21:00:00+00:00', 
try_number=1, map_index=-1)
   [2024-01-25T13:20:23.102+0000] {scheduler_job_runner.py:696} INFO - Received 
executor event with state success for task instance 
TaskInstanceKey(dag_id='acq__sftp__superhero__sftp_battles_csv_feed', 
task_id='get_execution_parameters', 
run_id='scheduled__2024-01-25T08:00:00+00:00', try_number=1, map_index=-1)
   ```
   
   However after that I never get the success event:
   ```
   [2024-01-25T14:00:24.228+0000] {scheduler_job_runner.py:696} INFO - Received 
executor event with state queued for task instance 
TaskInstanceKey(dag_id='acq__azure_blob__superhero__blob_battles_zip_feed', 
task_id='check_new_files', run_id='scheduled__2024-01-25T13:00:00+00:00', 
try_number=1, map_index=-1)
   [2024-01-25T14:00:24.228+0000] {scheduler_job_runner.py:696} INFO - Received 
executor event with state queued for task instance 
TaskInstanceKey(dag_id='acq__azure_blob__superhero__blob_battles_csv_feed', 
task_id='check_new_files', run_id='scheduled__2024-01-25T13:00:00+00:00', 
try_number=1, map_index=-1)
   [2024-01-25T14:00:24.228+0000] {scheduler_job_runner.py:696} INFO - Received 
executor event with state queued for task instance 
TaskInstanceKey(dag_id='acq__azure_blob__superhero__blob_battles_parquet_feed', 
task_id='check_new_files', run_id='scheduled__2024-01-25T13:00:00+00:00', 
try_number=1, map_index=-1)
   [2024-01-25T14:00:24.229+0000] {scheduler_job_runner.py:696} INFO - Received 
executor event with state queued for task instance 
TaskInstanceKey(dag_id='acq__sftp__superhero__sftp_battles_csv_feed', 
task_id='check_new_files', run_id='scheduled__2024-01-25T13:00:00+00:00', 
try_number=1, map_index=-1)
   [2024-01-25T14:00:24.229+0000] {scheduler_job_runner.py:696} INFO - Received 
executor event with state queued for task instance 
TaskInstanceKey(dag_id='acq__azure_blob__data_platform_meta__test_trading_partner',
 task_id='check_new_files', run_id='scheduled__2024-01-25T13:00:00+00:00', 
try_number=1, map_index=-1)
   [2024-01-25T14:00:24.236+0000] {scheduler_job_runner.py:723} INFO - Setting 
external_id for <TaskInstance: 
acq__azure_blob__superhero__blob_battles_zip_feed.check_new_files 
scheduled__2024-01-25T13:00:00+00:00 [queued]> to 4915
   [2024-01-25T14:00:24.236+0000] {scheduler_job_runner.py:723} INFO - Setting 
external_id for <TaskInstance: 
acq__azure_blob__superhero__blob_battles_csv_feed.check_new_files 
scheduled__2024-01-25T13:00:00+00:00 [queued]> to 4915
   [2024-01-25T14:00:24.236+0000] {scheduler_job_runner.py:723} INFO - Setting 
external_id for <TaskInstance: 
acq__azure_blob__superhero__blob_battles_parquet_feed.check_new_files 
scheduled__2024-01-25T13:00:00+00:00 [queued]> to 4915
   [2024-01-25T14:00:24.237+0000] {scheduler_job_runner.py:723} INFO - Setting 
external_id for <TaskInstance: 
acq__sftp__superhero__sftp_battles_csv_feed.check_new_files 
scheduled__2024-01-25T13:00:00+00:00 [queued]> to 4915
   [2024-01-25T14:00:24.237+0000] {scheduler_job_runner.py:723} INFO - Setting 
external_id for <TaskInstance: 
acq__azure_blob__data_platform_meta__test_trading_partner.check_new_files 
scheduled__2024-01-25T13:00:00+00:00 [queued]> to 4915
   [2024-01-25T14:00:24.243+0000] {manager.py:258} DEBUG - Received message of 
type DagParsingStat
   [2024-01-25T14:00:24.243+0000] {manager.py:258} DEBUG - Received message of 
type DagParsingStat
   [2024-01-25T14:00:24.243+0000] {manager.py:258} DEBUG - Received message of 
type DagParsingStat
   [2024-01-25T14:00:24.243+0000] {manager.py:258} DEBUG - Received message of 
type DagParsingStat
   [2024-01-25T14:00:24.244+0000] {manager.py:258} DEBUG - Received message of 
type DagParsingStat
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to