MADHANKUMAR C created AIRFLOW-3372:
--------------------------------------
Summary: Unable to start airflow scheduler
Key: AIRFLOW-3372
URL: https://issues.apache.org/jira/browse/AIRFLOW-3372
Project: Apache Airflow
Issue Type: Bug
Components: docker, scheduler
Affects Versions: 1.9.0
Environment: Kubernetes,docker
Reporter: MADHANKUMAR C
*I have installed airflow in kubernetes cluster.When i am installing airflow ,i
am unable to start the scheduler.The below is the log of scheduler container.*
[2018-11-20 12:02:40,860] {{__init__.py:51}} INFO - Using executor
SequentialExecutor
[2018-11-20 12:02:40,973] {{cli_action_loggers.py:69}} ERROR - Failed on
pre-execution callback using <function default_action_log at 0x7f26b730b620>
Traceback (most recent call last):
File "/usr/local/lib/python3.5/dist-packages/sqlalchemy/engine/base.py", line
1182, in _execute_context
context)
File "/usr/local/lib/python3.5/dist-packages/sqlalchemy/engine/default.py",
line 470, in do_execute
cursor.execute(statement, parameters)
sqlite3.OperationalError: no such table: log
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File
"/usr/local/lib/python3.5/dist-packages/airflow/utils/cli_action_loggers.py",
line 67, in on_pre_execution
cb(**kwargs)
File
"/usr/local/lib/python3.5/dist-packages/airflow/utils/cli_action_loggers.py",
line 99, in default_action_log
session.commit()
File "/usr/local/lib/python3.5/dist-packages/sqlalchemy/orm/session.py", line
927, in commit
self.transaction.commit()
File "/usr/local/lib/python3.5/dist-packages/sqlalchemy/orm/session.py", line
467, in commit
self._prepare_impl()
File "/usr/local/lib/python3.5/dist-packages/sqlalchemy/orm/session.py", line
447, in _prepare_impl
self.session.flush()
File "/usr/local/lib/python3.5/dist-packages/sqlalchemy/orm/session.py", line
2209, in flush
self._flush(objects)
File "/usr/local/lib/python3.5/dist-packages/sqlalchemy/orm/session.py", line
2329, in _flush
transaction.rollback(_capture_exception=True)
File "/usr/local/lib/python3.5/dist-packages/sqlalchemy/util/langhelpers.py",
line 66, in __exit__
compat.reraise(exc_type, exc_value, exc_tb)
File "/usr/local/lib/python3.5/dist-packages/sqlalchemy/util/compat.py", line
187, in reraise
raise value
File "/usr/local/lib/python3.5/dist-packages/sqlalchemy/orm/session.py", line
2293, in _flush
flush_context.execute()
File "/usr/local/lib/python3.5/dist-packages/sqlalchemy/orm/unitofwork.py",
line 389, in execute
rec.execute(self)
File "/usr/local/lib/python3.5/dist-packages/sqlalchemy/orm/unitofwork.py",
line 548, in execute
uow
File "/usr/local/lib/python3.5/dist-packages/sqlalchemy/orm/persistence.py",
line 181, in save_obj
mapper, table, insert)
File "/usr/local/lib/python3.5/dist-packages/sqlalchemy/orm/persistence.py",
line 835, in _emit_insert_statements
execute(statement, params)
File "/usr/local/lib/python3.5/dist-packages/sqlalchemy/engine/base.py", line
945, in execute
return meth(self, multiparams, params)
File "/usr/local/lib/python3.5/dist-packages/sqlalchemy/sql/elements.py", line
263, in _execute_on_connection
return connection._execute_clauseelement(self, multiparams, params)
File "/usr/local/lib/python3.5/dist-packages/sqlalchemy/engine/base.py", line
1053, in _execute_clauseelement
compiled_sql, distilled_params
File "/usr/local/lib/python3.5/dist-packages/sqlalchemy/engine/base.py", line
1189, in _execute_context
context)
File "/usr/local/lib/python3.5/dist-packages/sqlalchemy/engine/base.py", line
1402, in _handle_dbapi_exception
exc_info
File "/usr/local/lib/python3.5/dist-packages/sqlalchemy/util/compat.py", line
203, in raise_from_cause
reraise(type(exception), exception, tb=exc_tb, cause=cause)
File "/usr/local/lib/python3.5/dist-packages/sqlalchemy/util/compat.py", line
186, in reraise
raise value.with_traceback(tb)
File "/usr/local/lib/python3.5/dist-packages/sqlalchemy/engine/base.py", line
1182, in _execute_context
context)
File "/usr/local/lib/python3.5/dist-packages/sqlalchemy/engine/default.py",
line 470, in do_execute
cursor.execute(statement, parameters)
sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) no such table: log
[SQL: 'INSERT INTO log (dttm, dag_id, task_id, event, execution_date, owner,
extra) VALUES (?, ?, ?, ?, ?, ?, ?)'] [parameters: ('2018-11-20
12:02:40.969353', None, None, 'cli_scheduler', None, 'airflow', '
{"host_name": "airflow-airflow-scheduler-5b5f8b9549-89dmn", "full_command":
"[\'/usr/local/bin/airflow\', \'scheduler\', \'-n\', \'-1\', \'-p\']"}
')]
____________ _____________
____ |__( )_________ __/__ /________ __
____ /| |_ /__ ___/_ /_ __ /_ __ _ | /| / /
___ ___ | / _ / _ __/ _ / / /_/ /_ |/ |/ /
_/_/ |_/_/ /_/ /_/ /_/ ____/____/|__/
[2018-11-20 12:02:40,977] {{jobs.py:580}} *{color:#FF0000}ERROR - Cannot use
more than 1 thread when using sqlite. Setting max_threads to 1{color}*
/usr/local/lib/python3.5/dist-packages/sqlalchemy/orm/session.py:513:
SAWarning: Session's state has been changed on a non-active transaction - this
state will be discarded.
"Session's state has been changed on "
Traceback (most recent call last):
File "/usr/local/bin/airflow", line 32, in <module>
args.func(args)
File "/usr/local/lib/python3.5/dist-packages/airflow/utils/cli.py", line 74,
in wrapper
return f(*args, **kwargs)
File "/usr/local/lib/python3.5/dist-packages/airflow/bin/cli.py", line 925, in
scheduler
job.run()
File "/usr/local/lib/python3.5/dist-packages/airflow/jobs.py", line 196, in run
session.commit()
File "/usr/local/lib/python3.5/dist-packages/sqlalchemy/orm/session.py", line
927, in commit
self.transaction.commit()
File "/usr/local/lib/python3.5/dist-packages/sqlalchemy/orm/session.py", line
465, in commit
self._assert_active(prepared_ok=True)
File "/usr/local/lib/python3.5/dist-packages/sqlalchemy/orm/session.py", line
276, in _assert_active
% self._rollback_exception
sqlalchemy.exc.InvalidRequestError: This Session's transaction has been rolled
back due to a previous exception during flush. To begin a new transaction with
this Session, first issue Session.rollback(). Original exception was:
(sqlite3.OperationalError) no such table: log [SQL: 'INSERT INTO log (dttm,
dag_id, task_id, event, execution_date, owner, extra) VALUES (?, ?, ?, ?, ?, ?,
?)'] [parameters: ('2018-11-20 12:02:40.969353', None, None, 'cli_scheduler',
None, 'airflow', '
{"host_name": "airflow-airflow-scheduler-5b5f8b9549-89dmn", "full_command":
"[\'/usr/local/bin/airflow\', \'scheduler\', \'-n\', \'-1\', \'-p\']"}
')]
{color:#FF0000}*The pod status is like below*{color}
[root@kubernetes-cpal-master-0 kube-airflow]# *kubectl get pod*
NAME READY STATUS RESTARTS AGE
airflow-airflow-flower-6668559cf7-ll5bn 1/1 Running 0 19m
~{color:#FF0000}*airflow-airflow-scheduler-5b5f8b9549-89dmn 0/1
CrashLoopBackOff 8 19m*{color}~
airflow-airflow-web-89d8fb554-9ztss 1/1 Running 0 19m
airflow-airflow-web-89d8fb554-f4mbm 1/1 Running 0 19m
airflow-airflow-worker-0 1/1 Running 0 19m
airflow-postgresql-9df799579-swg8q 1/1 Running 0 19m
airflow-redis-7d75b85f7-26lsx 1/1 Running 0 19m
centos 0/1 CrashLoopBackOff 1278 29d
logger-deepinsights-fluentd-759ffcfc5d-fjmml 1/1 Running 8 33d
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
