[
https://issues.apache.org/jira/browse/AIRFLOW-2488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ash Berlin-Taylor updated AIRFLOW-2488:
---------------------------------------
Description:
Some of the tests take far to long:
{noformat}
[success] 10.48% tests.test_jobs.BackfillJobTest.test_backfill_examples:
177.9813s
[success] 6.24% tests.test_jobs.BackfillJobTest.test_backfill_multi_dates:
106.0157s
[success] 3.59% tests.transplant_class.<locals>.C.test_backfill: 61.0503s
[success] 3.55%
tests.contrib.sensors.test_python_sensor.PythonSensorTests.test_python_sensor_false:
60.2099s
[success] 2.66%
tests.test_impersonation.ImpersonationTest.test_impersonation_subdag: 45.1117s
[success] 1.86%
tests.test_jobs.SchedulerJobTest.test_dagrun_root_after_dagrun_unfinished:
31.5533s
[success] 1.77%
tests.executors.test_celery_executor.CeleryExecutorTest.test_celery_integration_1_redis_redis_6379_0:
30.0873s
[success] 1.48%
tests.operators.test_subdag_operator.SubDagOperatorTests.test_subdag_deadlock:
25.0747s
[success] 1.40%
tests.test_jobs.SchedulerJobTest.test_new_import_error_replaces_old: 23.7093s
[success] 1.36% tests.test_jobs.SchedulerJobTest.test_dagrun_success: 23.1645s
[success] 1.33%
tests.test_jobs.BackfillJobTest.test_cli_backfill_depends_on_past_backwards:
22.5161s
[success] 1.30%
tests.test_jobs.SchedulerJobTest.test_dagrun_deadlock_ignore_depends_on_past:
22.1402s
[success] 1.30%
tests.test_jobs.SchedulerJobTest.test_dagrun_deadlock_ignore_depends_on_past_advance_ex_date:
22.1153s
[success] 1.28%
tests.test_jobs.BackfillJobTest.test_cli_backfill_depends_on_past: 21.7944s
[success] 1.27%
tests.test_jobs.SchedulerJobTest.test_dagrun_root_fail_unfinished: 21.5010s
[success] 1.25%
tests.test_jobs.BackfillJobTest.test_run_ignores_all_dependencies: 21.3037s
[success] 1.25% tests.test_jobs.SchedulerJobTest.test_dagrun_root_fail: 21.1455s
[success] 1.20%
tests.test_impersonation.ImpersonationTest.test_impersonation_custom: 20.3233s
[success] 1.19%
tests.executors.test_celery_executor.CeleryExecutorTest.test_celery_integration_0_amqp_guest_guest_rabbitmq_5672:
20.1648s
[success] 1.14% tests.test_jobs.BackfillJobTest.test_backfill_run_backwards:
19.4043s
[success] 1.06% tests.cli.test_cli.TestCLI.test_next_execution: 17.9290s
{noformat}
(List updated April 23, 2019)
These tests should be refactored to make them faster.
was:
Some of the tests take far to long:
{{[success] 14.51% tests.BackfillJobTest.test_backfill_examples: 259.7899s
[success] 4.29% tests.hooks.test_s3_hook.TestS3Hook.test_list_keys_paged:
76.7397s
[success] 4.18% tests.hooks.test_s3_hook.TestS3Hook.test_list_prefixes_paged:
74.8025s
[success] 2.58% tests.BackfillJobTest.test_backfill_multi_dates: 46.1206s
[success] 2.38% tests.SchedulerJobTest.test_scheduler_start_date: 42.5719s
[success] 1.95% tests.CoreTest.test_schedule_dag_no_end_date_up_to_today_only:
34.9399s
[success] 1.71% tests.CliTests.test_backfill: 30.5825s
[success] 1.70% tests.SchedulerJobTest.test_scheduler_multiprocessing: 30.3580s
[success] 1.68%
tests.contrib.hooks.test_gcp_mlengine_hook.TestMLEngineHook.test_create_mlengine_job:
30.0609s
[success] 1.68% tests.SchedulerJobTest.test_new_import_error_replaces_old:
29.9968s}}
These tests should be refactored to make them faster.
> Speed up the CI
> ---------------
>
> Key: AIRFLOW-2488
> URL: https://issues.apache.org/jira/browse/AIRFLOW-2488
> Project: Apache Airflow
> Issue Type: Improvement
> Reporter: Fokko Driesprong
> Priority: Major
>
> Some of the tests take far to long:
> {noformat}
> [success] 10.48% tests.test_jobs.BackfillJobTest.test_backfill_examples:
> 177.9813s
> [success] 6.24% tests.test_jobs.BackfillJobTest.test_backfill_multi_dates:
> 106.0157s
> [success] 3.59% tests.transplant_class.<locals>.C.test_backfill: 61.0503s
> [success] 3.55%
> tests.contrib.sensors.test_python_sensor.PythonSensorTests.test_python_sensor_false:
> 60.2099s
> [success] 2.66%
> tests.test_impersonation.ImpersonationTest.test_impersonation_subdag: 45.1117s
> [success] 1.86%
> tests.test_jobs.SchedulerJobTest.test_dagrun_root_after_dagrun_unfinished:
> 31.5533s
> [success] 1.77%
> tests.executors.test_celery_executor.CeleryExecutorTest.test_celery_integration_1_redis_redis_6379_0:
> 30.0873s
> [success] 1.48%
> tests.operators.test_subdag_operator.SubDagOperatorTests.test_subdag_deadlock:
> 25.0747s
> [success] 1.40%
> tests.test_jobs.SchedulerJobTest.test_new_import_error_replaces_old: 23.7093s
> [success] 1.36% tests.test_jobs.SchedulerJobTest.test_dagrun_success: 23.1645s
> [success] 1.33%
> tests.test_jobs.BackfillJobTest.test_cli_backfill_depends_on_past_backwards:
> 22.5161s
> [success] 1.30%
> tests.test_jobs.SchedulerJobTest.test_dagrun_deadlock_ignore_depends_on_past:
> 22.1402s
> [success] 1.30%
> tests.test_jobs.SchedulerJobTest.test_dagrun_deadlock_ignore_depends_on_past_advance_ex_date:
> 22.1153s
> [success] 1.28%
> tests.test_jobs.BackfillJobTest.test_cli_backfill_depends_on_past: 21.7944s
> [success] 1.27%
> tests.test_jobs.SchedulerJobTest.test_dagrun_root_fail_unfinished: 21.5010s
> [success] 1.25%
> tests.test_jobs.BackfillJobTest.test_run_ignores_all_dependencies: 21.3037s
> [success] 1.25% tests.test_jobs.SchedulerJobTest.test_dagrun_root_fail:
> 21.1455s
> [success] 1.20%
> tests.test_impersonation.ImpersonationTest.test_impersonation_custom: 20.3233s
> [success] 1.19%
> tests.executors.test_celery_executor.CeleryExecutorTest.test_celery_integration_0_amqp_guest_guest_rabbitmq_5672:
> 20.1648s
> [success] 1.14% tests.test_jobs.BackfillJobTest.test_backfill_run_backwards:
> 19.4043s
> [success] 1.06% tests.cli.test_cli.TestCLI.test_next_execution: 17.9290s
> {noformat}
> (List updated April 23, 2019)
> These tests should be refactored to make them faster.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
