dstandish opened a new pull request #13247: URL: https://github.com/apache/airflow/pull/13247
Before SchedulerJob starts executor it sets `self.executor.job_id = self.id`, where self.id is the primary key in the jobs table. See here: https://github.com/apache/airflow/blob/master/airflow/jobs/scheduler_job.py#L1265. So with KubernetesExecutor, when `start` is called, the executor has a value under `job_id`. But with CeleryKubernetesExecutor enabled, the actual executors are under attributes on the CKE object, so they don't have the job ID, so when K8s executor tries to start, it fails because it doesn't find a job id. This PR fixes this issue by propagating the job_id to the "child" executors. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
