hterik opened a new issue, #26101:
URL: https://github.com/apache/airflow/issues/26101
### Apache Airflow version
2.3.4
### What happened
Trying to start Kubernetes tasks using a `pod_override` results in pods not
starting after upgrading from 2.3.2 to 2.3.4
The pod_override look very odd, filled with many Encoding.VAR objects, see
following scheduler log:
```
{kubernetes_executor.py:550} INFO - Add task
TaskInstanceKey(dag_id='commit_check', task_id='sync_and_build',
run_id='5776-2-1662037155', try_number=1, map_index=-1) with command
['airflow', 'tasks', 'run', 'commit_check', 'sync_and_build',
'5776-2-1662037155', '--local', '--subdir', 'DAGS_FOLDER/dag_on_commit.py']
with executor_config {'pod_override': {'Encoding.VAR': {'Encoding.VAR':
{'Encoding.VAR': {'metadata': {'Encoding.VAR': {'annotations': {'Encoding.VAR':
{}, 'Encoding.TYPE': 'dict'}}, 'Encoding.TYPE': 'dict'}, 'spec':
{'Encoding.VAR': {'containers': REDACTED 'Encoding.TYPE': 'k8s.V1Pod'},
'Encoding.TYPE': 'dict'}}
{kubernetes_executor.py:554} ERROR - Invalid executor_config for
TaskInstanceKey(dag_id='commit_check', task_id='sync_and_build',
run_id='5776-2-1662037155', try_number=1, map_index=-1)
```
Looking in the UI, the task get stuck in scheduled state forever. By
clicking instance details, it shows similar state of the pod_override with many
Encoding.VAR.
This appears like a recent addition, in 2.3.4 via
https://github.com/apache/airflow/pull/24356.
@dstandish do you understand if this is connected?
### What you think should happen instead
_No response_
### How to reproduce
_No response_
### Operating System
Debian GNU/Linux 11 (bullseye)
### Versions of Apache Airflow Providers
apache-airflow-providers-celery==3.0.0
apache-airflow-providers-cncf-kubernetes==4.3.0
apache-airflow-providers-common-sql==1.1.0
apache-airflow-providers-docker==3.1.0
apache-airflow-providers-ftp==3.1.0
apache-airflow-providers-http==4.0.0
apache-airflow-providers-imap==3.0.0
apache-airflow-providers-postgres==5.2.0
apache-airflow-providers-sqlite==3.2.0
kubernetes==23.6.0
### Deployment
Other Docker-based deployment
### Deployment details
_No response_
### Anything else
_No response_
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of
Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
