luederm opened a new issue, #37149:
URL: https://github.com/apache/airflow/issues/37149
### Apache Airflow version
2.8.1
### If "Other Airflow 2 version" selected, which one?
_No response_
### What happened?
After upgrading from airflow version 2.6 to 2.8, all DAGs I trigger through
the UI fail immediately with the error:
`ERROR - Executor reports task instance <TaskInstance: ... [queued]>
finished (failed) although the task says it's queued. (Info: None) Was the task
killed externally?`
I tested this with python version 3.9 and 3.11, and the issue persisted
with both versions.
DAGs can be successfully ran by running them directly with `.test()`
### What you think should happen instead?
_No response_
### How to reproduce
On MacOS, create a conda environment with python 3.11:
`conda create -n airflow-2-8-1 python=3.11`
Activate the environment and install google-re through conda:
`conda activate airflow-2-8-1`
`conda install google-re2`
Install airflow:
`pip install
"apache-airflow[async,celery,crypto,jdbc,ldap,password,mysql,postgres,redis,s3,sftp,ssh,slack]==2.8.1"
--constraint
"https://raw.githubusercontent.com/apache/airflow/constraints-2.8.1/constraints-3.11.txt"`
Set up airflow config and database.
Run airflow:
`airflow standalone`
Trigger an example DAG.
### Operating System
MacOS Ventura 13.6
### Versions of Apache Airflow Providers
_No response_
### Deployment
Other
### Deployment details
airflow was installed in a stand-alone conda environment.
The command used to install airflow (when testing with python 3.11) is:
`pip install
"apache-airflow[async,celery,crypto,jdbc,ldap,password,mysql,postgres,redis,s3,sftp,ssh,slack]==2.8.1"
--constraint
"https://raw.githubusercontent.com/apache/airflow/constraints-2.8.1/constraints-3.11.txt"`
The package google-re2 was installed through conda prior to running this
command because it fails to install through pip.
I created a new airflow database for testing the deployment. I tried running
the airflow server with `airflow standalone` and by running each component
separately.
### Anything else?
Output from conda list:
```
# packages in environment at /Users/luederm/miniconda3/envs/airflow-2-8-1:
#
# Name Version Build Channel
aiohttp 3.9.1 pypi_0 pypi
aiosignal 1.3.1 pypi_0 pypi
alembic 1.13.1 pypi_0 pypi
amqp 5.2.0 pypi_0 pypi
annotated-types 0.6.0 pypi_0 pypi
anyio 4.2.0 pypi_0 pypi
apache-airflow 2.8.1 pypi_0 pypi
apache-airflow-providers-amazon 8.16.0 pypi_0 pypi
apache-airflow-providers-celery 3.5.1 pypi_0 pypi
apache-airflow-providers-common-io 1.2.0 pypi_0 pypi
apache-airflow-providers-common-sql 1.10.0 pypi_0 pypi
apache-airflow-providers-ftp 3.7.0 pypi_0 pypi
apache-airflow-providers-http 4.8.0 pypi_0 pypi
apache-airflow-providers-imap 3.5.0 pypi_0 pypi
apache-airflow-providers-jdbc 4.2.1 pypi_0 pypi
apache-airflow-providers-mysql 5.5.1 pypi_0 pypi
apache-airflow-providers-postgres 5.10.0 pypi_0 pypi
apache-airflow-providers-redis 3.6.0 pypi_0 pypi
apache-airflow-providers-sftp 4.8.1 pypi_0 pypi
apache-airflow-providers-slack 8.5.1 pypi_0 pypi
apache-airflow-providers-sqlite 3.7.0 pypi_0 pypi
apache-airflow-providers-ssh 3.10.0 pypi_0 pypi
apispec 6.4.0 pypi_0 pypi
argcomplete 3.2.1 pypi_0 pypi
asgiref 3.7.2 pypi_0 pypi
asn1crypto 1.5.1 pypi_0 pypi
attrs 23.2.0 pypi_0 pypi
babel 2.14.0 pypi_0 pypi
backoff 2.2.1 pypi_0 pypi
bcrypt 4.1.2 pypi_0 pypi
beautifulsoup4 4.12.2 pypi_0 pypi
billiard 4.2.0 pypi_0 pypi
blinker 1.7.0 pypi_0 pypi
boto3 1.33.13 pypi_0 pypi
botocore 1.33.13 pypi_0 pypi
bzip2 1.0.8 h1de35cc_0
ca-certificates 2023.12.12 hecd8cb5_0
cachelib 0.9.0 pypi_0 pypi
celery 5.3.6 pypi_0 pypi
certifi 2023.11.17 pypi_0 pypi
cffi 1.16.0 pypi_0 pypi
charset-normalizer 3.3.2 pypi_0 pypi
click 8.1.7 pypi_0 pypi
click-didyoumean 0.3.0 pypi_0 pypi
click-plugins 1.1.1 pypi_0 pypi
click-repl 0.3.0 pypi_0 pypi
clickclick 20.10.2 pypi_0 pypi
colorama 0.4.6 pypi_0 pypi
colorlog 4.8.0 pypi_0 pypi
configupdater 3.2 pypi_0 pypi
connexion 2.14.2 pypi_0 pypi
cron-descriptor 1.4.0 pypi_0 pypi
croniter 2.0.1 pypi_0 pypi
cryptography 41.0.7 pypi_0 pypi
deprecated 1.2.14 pypi_0 pypi
dill 0.3.1.1 pypi_0 pypi
dnspython 2.4.2 pypi_0 pypi
docutils 0.20.1 pypi_0 pypi
email-validator 1.3.1 pypi_0 pypi
eventlet 0.34.3 pypi_0 pypi
flask 2.2.5 pypi_0 pypi
flask-appbuilder 4.3.10 pypi_0 pypi
flask-babel 2.0.0 pypi_0 pypi
flask-bcrypt 1.0.1 pypi_0 pypi
flask-caching 2.1.0 pypi_0 pypi
flask-jwt-extended 4.6.0 pypi_0 pypi
flask-limiter 3.5.0 pypi_0 pypi
flask-login 0.6.3 pypi_0 pypi
flask-session 0.5.0 pypi_0 pypi
flask-sqlalchemy 2.5.1 pypi_0 pypi
flask-wtf 1.2.1 pypi_0 pypi
flower 2.0.1 pypi_0 pypi
frozenlist 1.4.1 pypi_0 pypi
fsspec 2023.12.2 pypi_0 pypi
gevent 23.9.1 pypi_0 pypi
google-re2 1.1 py311h1f0d0e3_0 conda-forge
googleapis-common-protos 1.62.0 pypi_0 pypi
greenlet 3.0.3 pypi_0 pypi
grpcio 1.60.0 pypi_0 pypi
gunicorn 21.2.0 pypi_0 pypi
h11 0.14.0 pypi_0 pypi
httpcore 0.16.3 pypi_0 pypi
httpx 0.23.3 pypi_0 pypi
humanize 4.9.0 pypi_0 pypi
idna 3.6 pypi_0 pypi
importlib-metadata 6.11.0 pypi_0 pypi
importlib-resources 6.1.1 pypi_0 pypi
inflection 0.5.1 pypi_0 pypi
itsdangerous 2.1.2 pypi_0 pypi
jaydebeapi 1.2.3 pypi_0 pypi
jinja2 3.1.3 pypi_0 pypi
jmespath 0.10.0 pypi_0 pypi
jpype1 1.5.0 pypi_0 pypi
jsonpath-ng 1.6.1 pypi_0 pypi
jsonschema 4.20.0 pypi_0 pypi
jsonschema-specifications 2023.12.1 pypi_0 pypi
kombu 5.3.5 pypi_0 pypi
lazy-object-proxy 1.10.0 pypi_0 pypi
ldap3 2.9.1 pypi_0 pypi
libabseil 20230802.1 cxx17_h048a20a_0 conda-forge
libcxx 16.0.6 hd57cbcb_0 conda-forge
libffi 3.4.4 hecd8cb5_0
libre2-11 2023.06.02 h4694dbf_0 conda-forge
limits 3.7.0 pypi_0 pypi
linkify-it-py 2.0.2 pypi_0 pypi
lockfile 0.12.2 pypi_0 pypi
lxml 5.1.0 pypi_0 pypi
mako 1.3.0 pypi_0 pypi
markdown 3.5.2 pypi_0 pypi
markdown-it-py 3.0.0 pypi_0 pypi
markupsafe 2.1.3 pypi_0 pypi
marshmallow 3.20.2 pypi_0 pypi
marshmallow-oneofschema 3.0.1 pypi_0 pypi
marshmallow-sqlalchemy 0.26.1 pypi_0 pypi
mdit-py-plugins 0.4.0 pypi_0 pypi
mdurl 0.1.2 pypi_0 pypi
multidict 6.0.4 pypi_0 pypi
mysql-connector-python 8.0.29 pypi_0 pypi
mysqlclient 2.2.1 pypi_0 pypi
ncurses 6.4 hcec6c5f_0
openssl 3.0.12 hca72f7f_0
opentelemetry-api 1.22.0 pypi_0 pypi
opentelemetry-exporter-otlp 1.22.0 pypi_0 pypi
opentelemetry-exporter-otlp-proto-common 1.22.0 pypi_0
pypi
opentelemetry-exporter-otlp-proto-grpc 1.22.0 pypi_0
pypi
opentelemetry-exporter-otlp-proto-http 1.22.0 pypi_0
pypi
opentelemetry-proto 1.22.0 pypi_0 pypi
opentelemetry-sdk 1.22.0 pypi_0 pypi
opentelemetry-semantic-conventions 0.43b0 pypi_0 pypi
ordered-set 4.1.0 pypi_0 pypi
packaging 23.2 pypi_0 pypi
paramiko 3.4.0 pypi_0 pypi
pathspec 0.12.1 pypi_0 pypi
pendulum 3.0.0 pypi_0 pypi
pip 23.3.1 py311hecd8cb5_0
pluggy 1.3.0 pypi_0 pypi
ply 3.11 pypi_0 pypi
prison 0.2.1 pypi_0 pypi
prometheus-client 0.19.0 pypi_0 pypi
prompt-toolkit 3.0.43 pypi_0 pypi
protobuf 4.25.2 pypi_0 pypi
psutil 5.9.7 pypi_0 pypi
psycopg2-binary 2.9.9 pypi_0 pypi
pyasn1 0.5.1 pypi_0 pypi
pyasn1-modules 0.3.0 pypi_0 pypi
pycparser 2.21 pypi_0 pypi
pydantic 2.5.3 pypi_0 pypi
pydantic-core 2.14.6 pypi_0 pypi
pygments 2.17.2 pypi_0 pypi
pyjwt 2.8.0 pypi_0 pypi
pynacl 1.5.0 pypi_0 pypi
python 3.11.7 hf27a42d_0
python-daemon 3.0.1 pypi_0 pypi
python-dateutil 2.8.2 pypi_0 pypi
python-ldap 3.4.4 pypi_0 pypi
python-nvd3 0.15.0 pypi_0 pypi
python-slugify 8.0.1 pypi_0 pypi
python_abi 3.11 2_cp311 conda-forge
pytz 2023.3.post1 pypi_0 pypi
pyyaml 6.0.1 pypi_0 pypi
re2 2023.06.02 hd34609a_0 conda-forge
readline 8.2 hca72f7f_0
redis 4.6.0 pypi_0 pypi
redshift-connector 2.0.918 pypi_0 pypi
referencing 0.32.1 pypi_0 pypi
requests 2.31.0 pypi_0 pypi
requests-toolbelt 1.0.0 pypi_0 pypi
rfc3339-validator 0.1.4 pypi_0 pypi
rfc3986 1.5.0 pypi_0 pypi
rich 13.7.0 pypi_0 pypi
rich-argparse 1.4.0 pypi_0 pypi
rpds-py 0.17.1 pypi_0 pypi
s3transfer 0.8.2 pypi_0 pypi
scramp 1.4.4 pypi_0 pypi
setproctitle 1.3.3 pypi_0 pypi
setuptools 68.2.2 py311hecd8cb5_0
six 1.16.0 pypi_0 pypi
slack-sdk 3.26.2 pypi_0 pypi
sniffio 1.3.0 pypi_0 pypi
soupsieve 2.5 pypi_0 pypi
sqlalchemy 1.4.51 pypi_0 pypi
sqlalchemy-jsonfield 1.0.2 pypi_0 pypi
sqlalchemy-redshift 0.8.14 pypi_0 pypi
sqlalchemy-utils 0.41.1 pypi_0 pypi
sqlite 3.41.2 h6c40b1e_0
sqlparse 0.4.4 pypi_0 pypi
sshtunnel 0.4.0 pypi_0 pypi
tabulate 0.9.0 pypi_0 pypi
tenacity 8.2.3 pypi_0 pypi
termcolor 2.4.0 pypi_0 pypi
text-unidecode 1.3 pypi_0 pypi
time-machine 2.13.0 pypi_0 pypi
tk 8.6.12 h5d9f67b_0
tornado 6.4 pypi_0 pypi
typing-extensions 4.9.0 pypi_0 pypi
tzdata 2023.4 pypi_0 pypi
uc-micro-py 1.0.2 pypi_0 pypi
unicodecsv 0.14.1 pypi_0 pypi
universal-pathlib 0.1.4 pypi_0 pypi
urllib3 2.0.7 pypi_0 pypi
vine 5.1.0 pypi_0 pypi
watchtower 3.0.1 pypi_0 pypi
wcwidth 0.2.13 pypi_0 pypi
werkzeug 2.2.3 pypi_0 pypi
wheel 0.41.2 py311hecd8cb5_0
wrapt 1.16.0 pypi_0 pypi
wtforms 3.1.2 pypi_0 pypi
xz 5.4.5 h6c40b1e_0
yarl 1.9.4 pypi_0 pypi
zipp 3.17.0 pypi_0 pypi
zlib 1.2.13 h4dc903c_0
zope-event 5.0 pypi_0 pypi
zope-interface 6.1 pypi_0 pypi
```
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of
Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
