dstandish commented on issue #23727: URL: https://github.com/apache/airflow/issues/23727#issuecomment-1156670025
This issue is resolved by #24117 because it is about the scheduler crash, not the webserver. I was under the impression that the webserver issue may have been handled / documented elsewhere. If that's not the case can you please create an issue and tag me? > I don't think pod reconcile function is the cause of this, since it only merges pod_template with pod_override, I think what you miss is that the executor_config, if provided, is merged in pod reconciliation also. and executor_config is the root cause here --- it gets pickled with old k8s library and when read with new library bad things happen. > symptom not cause It's important to not crash the scheduler. That's fixed by #24117 and that's why it's merged. I have another PR https://github.com/apache/airflow/pull/24356 that works to make executor config pickling more tolerant of k8s library upgrades, but it's less trivial. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
