raman created AIRFLOW-3105:
------------------------------
Summary: Scheduler crashes while handling mysql deadlock condition
Key: AIRFLOW-3105
URL: https://issues.apache.org/jira/browse/AIRFLOW-3105
Project: Apache Airflow
Issue Type: Bug
Components: scheduler
Affects Versions: 1.9.0
Reporter: raman
Airflow scheduler crashes with following error logs
Traceback (most recent call last): File "/usr/src/venv/bin/airflow", line 27,
in <module> args.func(args) File
"/usr/src/venv/local/lib/python2.7/site-packages/airflow/bin/cli.py", line 826,
in scheduler job.run() File
"/usr/src/venv/local/lib/python2.7/site-packages/airflow/jobs.py", line 198, in
run self._execute() File
"/usr/src/venv/local/lib/python2.7/site-packages/airflow/jobs.py", line 1544,
in _execute self._execute_helper(processor_manager) File
"/usr/src/venv/local/lib/python2.7/site-packages/airflow/jobs.py", line 1656,
in _execute_helper State.NONE) File
"/usr/src/venv/local/lib/python2.7/site-packages/airflow/utils/db.py", line 50,
in wrapper result = func(*args, **kwargs) File
"/usr/src/venv/local/lib/python2.7/site-packages/airflow/jobs.py", line 996, in
_change_state_for_tis_without_dagrun synchronize_session=False) File
"/usr/src/venv/local/lib/python2.7/site-packages/sqlalchemy/orm/query.py", line
3479, in update update_op.exec_() File
"/usr/src/venv/local/lib/python2.7/site-packages/sqlalchemy/orm/persistence.py",
line 1326, in exec_ self._do_exec() File
"/usr/src/venv/local/lib/python2.7/site-packages/sqlalchemy/orm/persistence.py",
line 1493, in _do_exec self._execute_stmt(update_stmt) File
"/usr/src/venv/local/lib/python2.7/site-packages/sqlalchemy/orm/persistence.py",
line 1333, in _execute_stmt mapper=self.mapper) File
"/usr/src/venv/local/lib/python2.7/site-packages/sqlalchemy/orm/session.py",
line 1176, in execute bind, close_with_result=True).execute(clause, params or
{}) File
"/usr/src/venv/local/lib/python2.7/site-packages/sqlalchemy/engine/base.py",
line 948, in execute return meth(self, multiparams, params) File
"/usr/src/venv/local/lib/python2.7/site-packages/sqlalchemy/sql/elements.py",
line 269, in _execute_on_connection return
connection._execute_clauseelement(self, multiparams, params) File
"/usr/src/venv/local/lib/python2.7/site-packages/sqlalchemy/engine/base.py",
line 1060, in _execute_clauseelement compiled_sql, distilled_params File
"/usr/src/venv/local/lib/python2.7/site-packages/sqlalchemy/engine/base.py",
line 1200, in _execute_context context) File
"/usr/src/venv/local/lib/python2.7/site-packages/sqlalchemy/engine/base.py",
line 1413, in _handle_dbapi_exception exc_info File
"/usr/src/venv/local/lib/python2.7/site-packages/sqlalchemy/util/compat.py",
line 265, in raise_from_cause reraise(type(exception), exception, tb=exc_tb,
cause=cause) File
"/usr/src/venv/local/lib/python2.7/site-packages/sqlalchemy/engine/base.py",
line 1193, in _execute_context context) File
"/usr/src/venv/local/lib/python2.7/site-packages/sqlalchemy/engine/default.py",
line 509, in do_execute cursor.execute(statement, parameters) File
"/usr/src/venv/local/lib/python2.7/site-packages/MySQLdb/cursors.py", line 250,
in execute self.errorhandler(self, exc, value) File
"/usr/src/venv/local/lib/python2.7/site-packages/MySQLdb/connections.py", line
50, in defaulterrorhandler raise errorvalue sqlalchemy.exc.OperationalError:
(_mysql_exceptions.OperationalError) (1213, 'Deadlock found when trying to get
lock; try restarting transaction')
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)