[
https://issues.apache.org/jira/browse/AIRFLOW-3885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16771476#comment-16771476
]
ASF subversion and git services commented on AIRFLOW-3885:
----------------------------------------------------------
Commit c4b9d885f47b831f177532ab41a03cf5a8d73253 in airflow's branch
refs/heads/master from Andrew Stahlman
[ https://gitbox.apache.org/repos/asf?p=airflow.git;h=c4b9d88 ]
[AIRFLOW-3885] ~10x speed-up of SchedulerJobTest suite (#4730)
The SchedulerJobTest suite now takes ~90 seconds on my laptop (down from
~900 seconds == 15 minutes) on Jenkins.
There are a few optimizations here:
1. Don't sleep() for 1 second every scheduling loop (in unit tests)
2. Don't process the example DAGs
3. Use `subdir` to process only the DAGs we need, for a couple of tests
that actually run the scheduler
4. Only load the DagBag once instead of before each test
I've also added a few tables to the list of tables that are cleaned up
in between test runs to make the tests re-entrant.
> Improve Travis buildtime
> ------------------------
>
> Key: AIRFLOW-3885
> URL: https://issues.apache.org/jira/browse/AIRFLOW-3885
> Project: Apache Airflow
> Issue Type: Bug
> Components: travis
> Affects Versions: 1.10.2
> Reporter: Drew Sonne
> Assignee: Drew Sonne
> Priority: Major
> Fix For: 1.10.3
>
>
> * Remove the "install" action on the "pre-test" stage to avoid performing
> lengthy Docker pulls to perform pre-checks
> * Set nosetests to return on any test failures
> ** Given the lengthy runtime of the airflow CI test suites, if any tests
> fail, we should fail immediately and return the failed test locally. Users
> can run the tests locally to get full lists of failed tests.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
