dimberman opened a new issue #7919: Add --debug option to scheduler URL: https://github.com/apache/airflow/issues/7919 **Description** airflow webserver has a --debug param which enables the use of interactive debuggers like ipdb (among other side effects). Unfortunately the airflow scheduler process does not respect debugger instructions, which makes tracing errors very difficult. It just prints the following error and resumes operation: Traceback (most recent call last): File "/Users/jlowin/git/airflow/airflow/jobs.py", line 690, in _do_dags self.process_dag(dag, tis_out) File "/Users/jlowin/git/airflow/airflow/jobs.py", line 521, in process_dag run.update_state() File "/Users/jlowin/git/airflow/airflow/utils/db.py", line 53, in wrapper result = func(*args, **kwargs) File "/Users/jlowin/git/airflow/airflow/models.py", line 3471, in update_state all_deadlocked = (has_unfinished_tasks and no_dependencies_met) File "/Users/jlowin/git/airflow/airflow/models.py", line 3471, in update_state all_deadlocked = (has_unfinished_tasks and no_dependencies_met) File "/Users/jlowin/anaconda3/lib/python3.5/bdb.py", line 48, in trace_dispatch return self.dispatch_line(frame) File "/Users/jlowin/anaconda3/lib/python3.5/bdb.py", line 67, in dispatch_line if self.quitting: raise BdbQuit bdb.BdbQuit Bolke de Bruin I'm assigning this to you for now because I suspect it's related to the subprocess/daemonizing changes you made though I'm not sure. If we can enable ipdb it will make future scheduler work so much easier! **Use case / motivation** **Related Issues** Moved here from https://issues.apache.org/jira/browse/AIRFLOW-174
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
