ashb commented on issue #6905: [AIRFLOW-6361] Run LocalTaskJob directly in Celery task URL: https://github.com/apache/airflow/pull/6905#issuecomment-569713841 > @ashb I tested locally and this does not happen because a new Dagbag is created each time CLI command is called. Oh yes, we recreate a new dag bag. The only thing that would be preloaded then is modules or plugins. This is okay, but should be written down somewhere. (I'm not sure where - we don't have anything like this in the docs right now) > I would also like to make LocalTaskJob independent of DAG and operator and only use information from TaskInstance. It seems to me that there is no need to load the entire DAG in LocalTaskJob. This can further increase performance. Yes totally!
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
