|
Running the acceptance test suite from a git installation of puppet stable at SHA 7b8372d624 on ubuntu-1504-x86_64.yaml results in failing tests.
Method of test execution
cd acceptance
|
bundle install
|
SHA='7b8372d624' CONFIG=config/nodes/ubuntu-1504-x86_64.yaml TESTS=tests bundle exec rake ci:test:git
|
Tests with errors or failures
tests/config/puppet_manages_own_configuration_in_robust_manner.rb errored in 22.92 seconds # exits with 1 rather than 74
|
|
tests/ensure_puppet-agent_paths.rb failed in 1.49 seconds # fails due to non-aio environment
|
|
tests/resource/service/ticket_14297_handle_upstart.rb errored in 3.04 seconds
|
|
tests/modules/uninstall/using_directory_name.rb errored in 2.45 seconds # PMT failure
|
tests/modules/uninstall/using_version_filter.rb errored in 4.87 seconds # PMT failure
|
tests/modules/uninstall/with_module_installed.rb errored in 2.51 seconds # PMT failure
|
tests/modules/upgrade/in_a_secondary_directory.rb errored in 6.88 seconds # PMT failure
|
tests/modules/install/already_installed_elsewhere.rb failed in 10.49 seconds # PMT failure
|
tests/modules/list/with_circular_dependencies.rb failed in 2.46 seconds # PMT failure
|
tests/modules/list/with_invalid_dependencies.rb failed in 2.70 seconds # PMT failure
|
tests/modules/list/with_missing_dependencies.rb failed in 2.71 seconds # PMT failure
|
tests/modules/list/with_repeated_dependencies.rb failed in 3.95 seconds # PMT failure
|
tests/modules/uninstall/with_active_dependency.rb failed in 2.58 seconds # PMT failure
|
Common failures using ubuntu-1404-x86_64
Suspecting that the environment rather than the code or tests may be the issue, I ran the same suite using the ubuntu-1404-x86_64 node configuration. The following tests resulted in errors or failures
tests/config/puppet_manages_own_configuration_in_robust_manner.rb
|
|
tests/ensure_puppet-agent_paths.rb
|
|
tests/modules/install/already_installed_elsewhere.rb
|
tests/modules/list/with_circular_dependencies.rb
|
tests/modules/list/with_invalid_dependencies.rb
|
tests/modules/list/with_missing_dependencies.rb
|
tests/modules/list/with_repeated_dependencies.rb
|
tests/modules/uninstall/with_active_dependency.rb
|
tests/modules/uninstall/using_directory_name.rb
|
tests/modules/uninstall/using_version_filter.rb
|
tests/modules/uninstall/with_module_installed.rb
|
tests/modules/upgrade/in_a_secondary_directory.rb
|
|
