The GitHub Actions job "Tests (AMD)" on airflow.git/observability/celery-executor-sync-gap-logging has failed. Run started by GitHub user prince8273 (triggered by eladkal).
Head commit for run: 13ca82778d6d6247c18d956317c3b537ccb21c3e / Prince Kumar <[email protected]> observability: add structured diagnostics to CeleryExecutor sync gap events CeleryExecutor.update_all_workload_states() and update_task_state() had two silent failure modes with no structured logging or metrics: - When a tracked Celery task returns a falsy/None state from the broker (reachable on AMQP and non-KV backends where BulkStateFetcher does not guarantee PENDING conversion), the task was silently skipped with no log line and no metric. - When update_task_state() hit the unexpected-state branch, the existing log.info emitted only the TaskInstanceKey and the raw state string, with no worker hostname, no Celery info payload, and no metric. Changes (additive only, no behavior change): - Add else-branch in update_all_workload_states() loop: warning log with celery_task_id + key, Stats.incr(celery.task_not_found_in_broker) - Replace single-line log.info in update_task_state() unexpected-state branch: warning log with key + celery_state + worker hostname (extracted from info dict when available) + raw info payload, Stats.incr(celery.task_unexpected_state) - Level bump log.info -> log.warning for unexpected-state: this branch represents a state the executor has no handler for No new imports required -- Stats already present via airflow.providers.common.compat.sdk. Signed-off-by: Prince Kumar <[email protected]> Report URL: https://github.com/apache/airflow/actions/runs/26013874198 With regards, GitHub Actions via GitBox --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
