lihan opened a new issue, #27259:
URL: https://github.com/apache/airflow/issues/27259
### Apache Airflow version
2.4.2
### What happened
* Was running on version 2.3.2, out of sudden, scheduler keeps crashing and
restarting.
* It appears that one particular pipeline cannot updated to be successful
(after all tasks succeeded)
## Symptom 1
This is when trying to mark the pipeline success (Either manually or by the
Airflow Scheduler). The traceback log appears in both the webserver as well as
the scheduler. Marking the dag failure does not cause error.
At this time, access
the dag detail view of this dag works. (See attached video as well)
https://user-images.githubusercontent.com/655051/197767297-f75be8e1-1fab-49ce-be0d-2f4aec793cdf.mov
## Sumptom 2
* Upgraded to version 2.4.2
* Trying to recover the issue with `airflow dags reserialize` (on version
2.4.2), the command succeeded but did not resolve the issue.
* The error shows up when access the detail view of the dag. Below query
returns 2 records.
```
select *
from dag
where dag_id = 'my_problem_dag';
```
```
File
"/home/airflow/.local/lib/python3.8/site-packages/airflow/www/templates/airflow/grid.html",
line 22, in top-level template code
{% from 'appbuilder/loading_dots.html' import loading_dots %}
File
"/home/airflow/.local/lib/python3.8/site-packages/airflow/www/templates/airflow/dag.html",
line 30, in top-level template code
{% set dag_is_paused = dag.get_is_paused() %}
File
"/home/airflow/.local/lib/python3.8/site-packages/airflow/utils/session.py",
line 71, in wrapper
return func(*args, session=session, **kwargs)
File
"/home/airflow/.local/lib/python3.8/site-packages/airflow/models/dag.py", line
1126, in get_is_paused
return session.query(DagModel.is_paused).filter(DagModel.dag_id ==
self.dag_id).scalar()
File
"/home/airflow/.local/lib/python3.8/site-packages/sqlalchemy/orm/query.py",
line 2879, in scalar
ret = self.one()
File
"/home/airflow/.local/lib/python3.8/site-packages/sqlalchemy/orm/query.py",
line 2856, in one
return self._iter().one()
File
"/home/airflow/.local/lib/python3.8/site-packages/sqlalchemy/engine/result.py",
line 1190, in one
return self._only_one_row(
File
"/home/airflow/.local/lib/python3.8/site-packages/sqlalchemy/engine/result.py",
line 613, in _only_one_row
raise exc.MultipleResultsFound(
sqlalchemy.exc.MultipleResultsFound: Multiple rows were found when exactly
one was required
```
### What you think should happen instead
* We were running 2.3.2 for a while and had no problem.
* The problematic pipeline was not modified for the last six months
### How to reproduce
_No response_
### Operating System
* We were running 2.3.2 for a while and had no problem.
### Versions of Apache Airflow Providers
Not related to this, but here is the list
```apache-airflow-providers-amazon==5.0.0
apache-airflow-providers-cncf-kubernetes==4.3.0
apache-airflow-providers-common-sql==1.1.0
apache-airflow-providers-docker==3.1.0
apache-airflow-providers-ftp==3.1.0
apache-airflow-providers-google==8.3.0
apache-airflow-providers-http==4.0.0
apache-airflow-providers-imap==3.0.0
apache-airflow-providers-mysql==3.2.0
apache-airflow-providers-opsgenie==4.0.0
apache-airflow-providers-postgres==5.2.0
apache-airflow-providers-redis==3.0.0
apache-airflow-providers-sftp==4.0.0
apache-airflow-providers-slack==5.1.0
apache-airflow-providers-sqlite==3.2.0
apache-airflow-providers-ssh==3.1.0
```
### Deployment
Other Docker-based deployment
### Deployment details
Were using official Docker image on GKE
### Anything else
_No response_
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of
Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
