Public bug reported: Some db migration tests succeed, while the same migrations, applied by db_sync fail. A good example of this is bug #1405673: migration 44 seems to be tested, but failes when applied in real life.
To illustrate the issue, http://paste.openstack.org/show/155081/ can be applied. The tests will be very slow, but reliable (because the db will be in file, not in memory) and will fail. Here's the output: (.venv)breton@bbobrov-pc ~/src/keystone (bug/1405673*) $ ./run_tests.sh SqlUpgradeTests tools/with_venv.sh keystone.tests.test_sql_upgrade.SqlUpgradeTests test_blank_db_to_start OK 0.50 test_downgrade_endpoint_enabled_cols FAIL test_downgrade_service_enabled_cols OK 20.78 test_add_actor_id_index OK 25.44 test_endpoint_region_downgrade_columns OK 27.31 test_downgrade_endpoint_enabled_data FAIL test_id_mapping OK 21.70 test_assignment_table_migration OK 25.05 test_limited_trusts_upgrade OK 18.93 test_downgrade_service_enabled_data OK 24.67 test_downgrade_to_db_init_version FAIL test_project_parent_id_downgrade OK 39.04 test_endpoint_region_migration OK 46.27 test_endpoint_region_upgrade_columns OK 36.07 test_region_url_downgrade OK 36.40 test_limited_trusts_downgrade OK 31.71 test_limited_trusts_downgrade_trusts_cleanup OK 33.84 test_region_url_upgrade OK 38.80 test_project_parent_id_upgrade OK 49.62 test_project_parent_id_cleanup OK 52.02 test_two_steps_forward_one_step_back FAIL test_region_migration OK 34.42 test_remove_actor_id_index OK 48.16 test_start_version_db_init_version OK 0.95 test_upgrade_endpoint_enabled_cols OK 29.47 test_region_url_cleanup OK 42.90 test_token_user_id_and_trust_id_index_downgrade OK 96.98 test_upgrade_endpoint_enabled_data OK 101.70 test_token_user_id_and_trust_id_index_upgrade OK 125.88 test_upgrade_region_unique_description FAIL test_upgrade_region_non_unique_description OK 91.90 test_upgrade_add_initial_tables OK 65.13 test_upgrade_service_enabled_data OK 97.24 test_upgrade_service_enabled_cols OK 80.83 [...] Ran 34 tests in 557.405s FAILED (failures=5) ** Affects: keystone Importance: Undecided Status: New -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to Keystone. https://bugs.launchpad.net/bugs/1406314 Title: db migration tests falsely succeed Status in OpenStack Identity (Keystone): New Bug description: Some db migration tests succeed, while the same migrations, applied by db_sync fail. A good example of this is bug #1405673: migration 44 seems to be tested, but failes when applied in real life. To illustrate the issue, http://paste.openstack.org/show/155081/ can be applied. The tests will be very slow, but reliable (because the db will be in file, not in memory) and will fail. Here's the output: (.venv)breton@bbobrov-pc ~/src/keystone (bug/1405673*) $ ./run_tests.sh SqlUpgradeTests tools/with_venv.sh keystone.tests.test_sql_upgrade.SqlUpgradeTests test_blank_db_to_start OK 0.50 test_downgrade_endpoint_enabled_cols FAIL test_downgrade_service_enabled_cols OK 20.78 test_add_actor_id_index OK 25.44 test_endpoint_region_downgrade_columns OK 27.31 test_downgrade_endpoint_enabled_data FAIL test_id_mapping OK 21.70 test_assignment_table_migration OK 25.05 test_limited_trusts_upgrade OK 18.93 test_downgrade_service_enabled_data OK 24.67 test_downgrade_to_db_init_version FAIL test_project_parent_id_downgrade OK 39.04 test_endpoint_region_migration OK 46.27 test_endpoint_region_upgrade_columns OK 36.07 test_region_url_downgrade OK 36.40 test_limited_trusts_downgrade OK 31.71 test_limited_trusts_downgrade_trusts_cleanup OK 33.84 test_region_url_upgrade OK 38.80 test_project_parent_id_upgrade OK 49.62 test_project_parent_id_cleanup OK 52.02 test_two_steps_forward_one_step_back FAIL test_region_migration OK 34.42 test_remove_actor_id_index OK 48.16 test_start_version_db_init_version OK 0.95 test_upgrade_endpoint_enabled_cols OK 29.47 test_region_url_cleanup OK 42.90 test_token_user_id_and_trust_id_index_downgrade OK 96.98 test_upgrade_endpoint_enabled_data OK 101.70 test_token_user_id_and_trust_id_index_upgrade OK 125.88 test_upgrade_region_unique_description FAIL test_upgrade_region_non_unique_description OK 91.90 test_upgrade_add_initial_tables OK 65.13 test_upgrade_service_enabled_data OK 97.24 test_upgrade_service_enabled_cols OK 80.83 [...] Ran 34 tests in 557.405s FAILED (failures=5) To manage notifications about this bug go to: https://bugs.launchpad.net/keystone/+bug/1406314/+subscriptions -- Mailing list: https://launchpad.net/~yahoo-eng-team Post to : [email protected] Unsubscribe : https://launchpad.net/~yahoo-eng-team More help : https://help.launchpad.net/ListHelp

