[
https://issues.apache.org/jira/browse/AIRFLOW-774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16111825#comment-16111825
]
Dan Davydov commented on AIRFLOW-774:
-------------------------------------
Yes to master, IIRC they should appear starting from release 1.8.1.
This is the JIRA:
https://issues.apache.org/jira/browse/AIRFLOW-780
Yep only fixed the import errors, not the stats. The changes should be similar
though (pull the stats logic out to the top-level which aggregates each
individual parsing subprocesses errors).
> dagbag_size/collect_dags/dagbag_import_errors stats incorrect
> -------------------------------------------------------------
>
> Key: AIRFLOW-774
> URL: https://issues.apache.org/jira/browse/AIRFLOW-774
> Project: Apache Airflow
> Issue Type: Bug
> Components: logging
> Reporter: Dan Davydov
>
> After the multiprocessor change was made (dag folders are processed in
> parallel), the number of dags reported by airflow is for each of these
> subprocesses which is inaccurate, and potentially orders of magnitude less
> than the actual number of dags. These individual processes stats should be
> aggregated. The collect_dags/dagbag_import_errors stats should also be fixed
> (time it takes to parse the dags).
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
