Taragolis commented on issue #34975:
URL: https://github.com/apache/airflow/issues/34975#issuecomment-1765146479
Then try to set `CeleryKubernetesExecutor`, executor related commands moved
into the providers and injected into the CLI depend on configured executor.
Locally it also work
```console
❯ airflow config get-value core executor
SequentialExecutor
❯ airflow kubernetes --help
Usage: airflow [-h] GROUP_OR_COMMAND ...
...
airflow command error: argument GROUP_OR_COMMAND: invalid choice:
'kubernetes' (choose from 'cheat-sheet', 'config', 'connections',
'dag-processor', 'dags', 'db', 'info', 'jobs', 'kerberos', 'plugins', 'pools',
'providers', 'roles', 'rotate-fernet-key', 'scheduler', 'standalone',
'sync-perm', 'tasks', 'triggerer', 'users', 'variables', 'version',
'webserver'), see help above.
❯ airflow celery --help
Usage: airflow [-h] GROUP_OR_COMMAND ...
...
airflow command error: argument GROUP_OR_COMMAND: invalid choice: 'celery'
(choose from 'cheat-sheet', 'config', 'connections', 'dag-processor', 'dags',
'db', 'info', 'jobs', 'kerberos', 'plugins', 'pools', 'providers', 'roles',
'rotate-fernet-key', 'scheduler', 'standalone', 'sync-perm', 'tasks',
'triggerer', 'users', 'variables', 'version', 'webserver'), see help above.
❯ export AIRFLOW__CORE__EXECUTOR="CeleryKubernetesExecutor"
❯ airflow config get-value core executor
CeleryKubernetesExecutor
❯ airflow kubernetes --help
Usage: airflow kubernetes [-h] COMMAND ...
Tools to help run the KubernetesExecutor
Positional Arguments:
COMMAND
cleanup-pods Clean up Kubernetes pods (created by
KubernetesExecutor/KubernetesPodOperator) in evicted/failed/succeeded/pending
states
generate-dag-yaml
Generate YAML files for all tasks in DAG. Useful for
debugging tasks without launching into a cluster
Optional Arguments:
-h, --help show this help message and exit
❯ airflow celery --help
Usage: airflow celery [-h] COMMAND ...
Start celery components. Works only when using CeleryExecutor. For more
information, see
https://airflow.apache.org/docs/apache-airflow/stable/executor/celery.html
Positional Arguments:
COMMAND
flower Start a Celery Flower
stop Stop the Celery worker gracefully
worker Start a Celery worker node
Optional Arguments:
-h, --help show this help message and exit
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
