tooptoop4 opened a new issue #11714:
URL: https://github.com/apache/airflow/issues/11714
airflow 1.10.12, mysql 5.7 metastore, rbac, no serialized dags, intermittent
error found twice in the logs:
[2020-10-15 12:28:14,502] {scheduler_job.py:167} ERROR - Got an exception!
Propagating...
Traceback (most recent call last):
File
"/home/ec2-user/venv/lib/python3.7/site-packages/airflow/jobs/scheduler_job.py",
line 159, in _run_file_processor
pickle_dags)
File
"/home/ec2-user/venv/lib/python3.7/site-packages/airflow/utils/db.py", line 74,
in wrapper
return func(*args, **kwargs)
File
"/home/ec2-user/venv/lib/python3.7/site-packages/airflow/jobs/scheduler_job.py",
line 1609, in process_file
dag.sync_to_db()
File
"/home/ec2-user/venv/lib/python3.7/site-packages/airflow/utils/db.py", line 74,
in wrapper
return func(*args, **kwargs)
File
"/home/ec2-user/venv/lib/python3.7/site-packages/airflow/models/dag.py", line
1543, in sync_to_db
session.commit()
File
"/home/ec2-user/venv/lib64/python3.7/site-packages/sqlalchemy/orm/session.py",
line 1042, in commit
self.transaction.commit()
File
"/home/ec2-user/venv/lib64/python3.7/site-packages/sqlalchemy/orm/session.py",
line 504, in commit
self._prepare_impl()
File
"/home/ec2-user/venv/lib64/python3.7/site-packages/sqlalchemy/orm/session.py",
line 483, in _prepare_impl
self.session.flush()
File
"/home/ec2-user/venv/lib64/python3.7/site-packages/sqlalchemy/orm/session.py",
line 2523, in flush
self._flush(objects)
File
"/home/ec2-user/venv/lib64/python3.7/site-packages/sqlalchemy/orm/session.py",
line 2664, in _flush
transaction.rollback(_capture_exception=True)
File
"/home/ec2-user/venv/lib64/python3.7/site-packages/sqlalchemy/util/langhelpers.py",
line 69, in __exit__
exc_value, with_traceback=exc_tb,
File
"/home/ec2-user/venv/lib64/python3.7/site-packages/sqlalchemy/util/compat.py",
line 182, in raise_
raise exception
File
"/home/ec2-user/venv/lib64/python3.7/site-packages/sqlalchemy/orm/session.py",
line 2624, in _flush
flush_context.execute()
File
"/home/ec2-user/venv/lib64/python3.7/site-packages/sqlalchemy/orm/unitofwork.py",
line 422, in execute
rec.execute(self)
File
"/home/ec2-user/venv/lib64/python3.7/site-packages/sqlalchemy/orm/unitofwork.py",
line 589, in execute
uow,
File
"/home/ec2-user/venv/lib64/python3.7/site-packages/sqlalchemy/orm/persistence.py",
line 236, in save_obj
update,
File
"/home/ec2-user/venv/lib64/python3.7/site-packages/sqlalchemy/orm/persistence.py",
line 1028, in _emit_update_statements
% (table.description, len(records), rows)
sqlalchemy.orm.exc.StaleDataError: UPDATE statement on table 'dag' expected
to update 1 row(s); 0 were matched.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]