Xrampino opened a new issue #19136:
URL: https://github.com/apache/airflow/issues/19136
### Apache Airflow version
2.2.0 (latest released)
### Operating System
Ubuntu 21.10
### Versions of Apache Airflow Providers
apache-airflow-providers-amazon==2.3.0
apache-airflow-providers-celery==2.1.0
apache-airflow-providers-ftp==2.0.1
apache-airflow-providers-http==2.0.1
apache-airflow-providers-imap==2.0.1
apache-airflow-providers-postgres==2.3.0
apache-airflow-providers-sqlite==2.0.1
apache-airflow-providers-ssh==2.2.0
### Deployment
Virtualenv installation
### Deployment details
Airflow DB is a local PostgreSQL 12 server
I use CeleryExecutor
`cryptography==35.0.0`
### What happened
I have periodically (maybe every 30 minutes) broken DAGs, which last for a
couple of minutes, then are not broken anymore. With this traceback:
```
Broken DAG: [/opt/airflow2/dags/checks.py] Traceback (most recent call last):
File "/opt/airflow2/dags/checks.py", line 12, in <module>
sample_size = int(Variable.get("sample_size") or "1000")
File
"/opt/venv-airflow/lib/python3.9/site-packages/airflow/models/variable.py",
line 140, in get
raise KeyError(f'Variable {key} does not exist')
KeyError: 'Variable sample_size does not exist'
```
While the variable exists, is accessible from the UI, and the command line
can also list them with no issue, etc.. I didn't have that with Airflow 2.1.0.
I also have this error for another DAG, it arrives at the same time as the
others broken DAGs, and disappear at the same time, so I'd suppose it is
connected
```
Broken DAG: [/opt/airflow2/dags/spreadsheets.py] Traceback (most recent call
last):
File
"/opt/venv-airflow/lib/python3.9/site-packages/cryptography/x509/certificate_transparency.py",
line 13, in <module>
class LogEntryType(utils.Enum):
File
"/opt/venv-airflow/lib/python3.9/site-packages/cryptography/utils.py", line
115, in __getattr__
AttributeError: module 'cryptography.utils' has no attribute 'Enum'
```
At those time, PostgreSQL logs show those lines
```
2021-10-21 15:44:51.632 UTC [153368] airflow_user@airflow_db LOG: could not
receive data from client: Connection reset by peer
2021-10-21 15:44:53.268 UTC [153629] airflow_user@airflow_db LOG: could not
receive data from client: Connection reset by peer
2021-10-21 15:44:54.150 UTC [153473] airflow_user@airflow_db LOG: could not
receive data from client: Connection reset by peer
....
```
I don't know if it's linked but `airflow scheduler` logs show a lot of those
lines :
```
[2021-10-21 13:52:02,790] {connection.py:631} WARNING - No hostname was
supplied. Reverting to default 'None'
```
### What you expected to happen
No periodical Broken DAGs
### How to reproduce
_No response_
### Anything else
_No response_
### Are you willing to submit PR?
- [X] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of
Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
