Issue #2851 has been updated by Markus Roberts.
The combination:
touch spec/unit/application/puppetmasterd.rb
ruby spec/unit/application/puppetmasterd.rb
spec/unit/network/rest_authconfig.rb -t 60 --format s --loadby mtime
produces even more dramatic results:
<pre>
- should insert methodfindacl~ ^/catalog/([^/]+)$allow$1authenticatedtrue if
not present
- should not insert methodfindacl~ ^/catalog/([^/]+)$allow$1authenticatedtrue
if present
- should insert methodfindacl/certificate_revocation_list/caauthenticatedtrue
if not present
- should not insert
methodfindacl/certificate_revocation_list/caauthenticatedtrue if present
- should insert methodsaveacl/reportauthenticatedtrue if not present
- should not insert methodsaveacl/reportauthenticatedtrue if present
- should insert methodfindacl/certificate/caauthenticatedfalse if not present
- should not insert methodfindacl/certificate/caauthenticatedfalse if present
- should insert methodfindacl/certificate/authenticatedfalse if not present
- should not insert methodfindacl/certificate/authenticatedfalse if present
- should insert methodfindsaveacl/certificate_requestauthenticatedfalse if not
present
- should not insert methodfindsaveacl/certificate_requestauthenticatedfalse if
present
</pre>
become:
<pre>
- should insert allow$1methodfindauthenticatedtrueacl~ ^/catalog/([^/]+)$ if
not present
- should not insert allow$1methodfindauthenticatedtrueacl~ ^/catalog/([^/]+)$
if present
- should insert methodfindauthenticatedtrueacl/certificate_revocation_list/ca
if not present
- should not insert
methodfindauthenticatedtrueacl/certificate_revocation_list/ca if present
- should insert methodsaveauthenticatedtrueacl/report if not present
- should not insert methodsaveauthenticatedtrueacl/report if present
- should insert methodfindauthenticatedfalseacl/certificate/ca if not present
- should not insert methodfindauthenticatedfalseacl/certificate/ca if present
- should insert methodfindauthenticatedfalseacl/certificate/ if not present
- should not insert methodfindauthenticatedfalseacl/certificate/ if present
- should insert methodfindsaveauthenticatedfalseacl/certificate_request if not
present
- should not insert methodfindsaveauthenticatedfalseacl/certificate_request if
present
</pre>
----------------------------------------
Bug #2851: Test isolation: spec/unit/network/rest_authconfig.rb test
descriptions change if run after certain other tests
http://projects.reductivelabs.com/issues/2851
Author: Markus Roberts
Status: Accepted
Priority: Low
Assigned to: Jesse Wolfe
Category: testing
Target version: 0.25.2
Affected version: 0.25.1
Keywords:
Branch:
The description of two tests in spec/unit/network/rest_authconfig.rb change if
it is run after certain other tests.
To duplicate, first run:
ruby spec/unit/network/rest_authconfig.rb -t 60 --format s --loadby mtime
and then
touch spec/unit/provider/package/pkgdmg.rb
ruby spec/unit/provider/package/pkgdmg.rb
spec/unit/network/rest_authconfig.rb -t 60 --format s --loadby mtime
Comparing the output you will see that the tests:
- should insert methodfindacl~ ^/catalog/([^/]+)$allow$1authenticatedtrue
if not present
- should not insert methodfindacl~
^/catalog/([^/]+)$allow$1authenticatedtrue if present
in the former case are in the later described as:
- should insert methodfindacl~ ^/catalog/([^/]+)$authenticatedtrueallow$1
if not present
- should not insert methodfindacl~
^/catalog/([^/]+)$authenticatedtrueallow$1 if present
This also happens if spec/unit/provider/package/pkgdmg.rb is replaced with any
of the following:
spec/integration/checksum.rb
spec/integration/configurer.rb
spec/integration/file_serving/content.rb
spec/integration/file_serving/fileset.rb
spec/integration/file_serving/metadata.rb
spec/integration/indirector/catalog/compiler.rb
spec/integration/indirector/catalog/queue.rb
spec/integration/indirector/certificate/rest.rb
spec/integration/indirector/certificate_revocation_list/rest.rb
spec/integration/indirector/direct_file_server.rb
spec/integration/indirector/file_content/file_server.rb
spec/integration/indirector/file_metadata/file_server.rb
spec/integration/indirector/report/rest.rb
spec/integration/network/server/mongrel.rb
spec/integration/network/server/webrick.rb
spec/integration/parser/compiler.rb
spec/integration/parser/parser.rb
spec/integration/provider/mailalias/aliases.rb
spec/integration/reference/providers.rb
spec/integration/ssl/certificate_authority.rb
spec/integration/ssl/certificate_request.rb
spec/integration/ssl/certificate_revocation_list.rb
spec/integration/type.rb
spec/integration/type/file.rb
spec/integration/util/file_locking.rb
spec/integration/util/settings.rb
spec/monkey_patches/add_confine_and_runnable_to_rspec_dsl.rb
spec/monkey_patches/alias_should_to_must.rb
spec/shared_behaviours/file_server_terminus.rb
spec/shared_behaviours/memory_terminus.rb
spec/spec_helper.rb
spec/unit/agent/runner.rb
spec/unit/application/filebucket.rb
spec/unit/application/puppet.rb
spec/unit/application/puppetca.rb
spec/unit/application/puppetdoc.rb
spec/unit/application/puppetmasterd.rb
spec/unit/application/puppetqd.rb
spec/unit/application/puppetrun.rb
spec/unit/application/ralsh.rb
spec/unit/configurer.rb
spec/unit/configurer/fact_handler.rb
spec/unit/daemon.rb
spec/unit/file_serving/configuration.rb
spec/unit/file_serving/fileset.rb
spec/unit/file_serving/indirection_hooks.rb
spec/unit/file_serving/metadata.rb
spec/unit/file_serving/mount.rb
spec/unit/file_serving/mount/file.rb
spec/unit/file_serving/mount/modules.rb
spec/unit/file_serving/mount/plugins.rb
spec/unit/indirector/catalog/compiler.rb
spec/unit/indirector/catalog/queue.rb
spec/unit/indirector/catalog/rest.rb
spec/unit/indirector/certificate/ca.rb
spec/unit/indirector/certificate_request/file.rb
spec/unit/indirector/certificate_revocation_list/ca.rb
spec/unit/indirector/certificate_revocation_list/file.rb
spec/unit/indirector/checksum/file.rb
spec/unit/indirector/envelope.rb
spec/unit/indirector/exec.rb
spec/unit/indirector/facts/active_record.rb
spec/unit/indirector/facts/rest.rb
spec/unit/indirector/file.rb
spec/unit/indirector/file_content/rest.rb
spec/unit/indirector/file_metadata/file_server.rb
spec/unit/indirector/file_metadata/rest.rb
spec/unit/indirector/file_server.rb
spec/unit/indirector/key/ca.rb
spec/unit/indirector/key/file.rb
spec/unit/indirector/memory.rb
spec/unit/indirector/node/active_record.rb
spec/unit/indirector/node/plain.rb
spec/unit/indirector/plain.rb
spec/unit/indirector/rest.rb
spec/unit/indirector/runner/rest.rb
spec/unit/indirector/ssl_file.rb
spec/unit/module.rb
spec/unit/network/authconfig.rb
spec/unit/network/client/dipper.rb
spec/unit/network/format.rb
spec/unit/network/format_handler.rb
spec/unit/network/http.rb
spec/unit/network/http/mongrel/rest.rb
spec/unit/network/http/rack.rb
spec/unit/network/http/rack/rest.rb
spec/unit/network/http/webrick.rb
spec/unit/network/rest_authconfig.rb
spec/unit/node/facts.rb
spec/unit/other/checksum.rb
spec/unit/other/selinux.rb
spec/unit/parameter.rb
spec/unit/parser/ast.rb
spec/unit/parser/ast/arithmetic_operator.rb
spec/unit/parser/ast/boolean_operator.rb
spec/unit/parser/ast/comparison_operator.rb
spec/unit/parser/ast/function.rb
spec/unit/parser/ast/leaf.rb
spec/unit/parser/ast/match_operator.rb
spec/unit/parser/ast/minus.rb
spec/unit/parser/ast/node.rb
spec/unit/parser/ast/resource_override.rb
spec/unit/parser/ast/resource_reference.rb
spec/unit/parser/ast/vardef.rb
spec/unit/parser/collector.rb
spec/unit/parser/compiler.rb
spec/unit/parser/files.rb
spec/unit/parser/functions.rb
spec/unit/parser/functions/inline_template.rb
spec/unit/parser/functions/regsubst.rb
spec/unit/parser/functions/require.rb
spec/unit/parser/functions/split.rb
spec/unit/parser/functions/sprintf.rb
spec/unit/parser/functions/template.rb
spec/unit/parser/lexer.rb
spec/unit/parser/loaded_code.rb
spec/unit/parser/parser.rb
spec/unit/parser/resource/reference.rb
spec/unit/parser/scope.rb
spec/unit/parser/templatewrapper.rb
spec/unit/property.rb
spec/unit/property/keyvalue.rb
spec/unit/property/list.rb
spec/unit/property/ordered_list.rb
spec/unit/provider.rb
spec/unit/provider/augeas/augeas.rb
spec/unit/provider/confine.rb
spec/unit/provider/confine/exists.rb
spec/unit/provider/confine/true.rb
spec/unit/provider/confine/variable.rb
spec/unit/provider/confiner.rb
spec/unit/provider/ldap.rb
spec/unit/provider/macauthorization.rb
spec/unit/provider/mcx/mcxcontent.rb
spec/unit/provider/mount/parsed.rb
spec/unit/provider/naginator.rb
spec/unit/provider/package/dpkg.rb
spec/unit/provider/package/pkgdmg.rb
spec/unit/provider/parsedfile.rb
spec/unit/provider/selboolean.rb
spec/unit/provider/selmodule.rb
spec/unit/provider/service/daemontools.rb
spec/unit/provider/service/debian.rb
spec/unit/provider/service/init.rb
spec/unit/provider/service/launchd.rb
spec/unit/provider/service/runit.rb
spec/unit/provider/ssh_authorized_key/parsed.rb
spec/unit/provider/user/hpux.rb
spec/unit/provider/user/ldap.rb
spec/unit/provider/user/useradd.rb
spec/unit/provider/zfs/solaris.rb
spec/unit/rails/param_value.rb
spec/unit/rails/resource.rb
spec/unit/relationship.rb
spec/unit/resource/catalog.rb
spec/unit/resource/reference.rb
spec/unit/simple_graph.rb
spec/unit/ssl/certificate.rb
spec/unit/ssl/certificate_authority.rb
spec/unit/ssl/certificate_authority/interface.rb
spec/unit/ssl/certificate_factory.rb
spec/unit/ssl/certificate_revocation_list.rb
spec/unit/transaction.rb
spec/unit/transaction/change.rb
spec/unit/transaction/report.rb
spec/unit/type.rb
spec/unit/type/exec.rb
spec/unit/type/file/content.rb
spec/unit/type/file/ensure.rb
spec/unit/type/file/group.rb
spec/unit/type/file/owner.rb
spec/unit/type/file/selinux.rb
spec/unit/type/macauthorization.rb
spec/unit/type/mcx.rb
spec/unit/type/package.rb
spec/unit/type/resources.rb
spec/unit/type/selboolean.rb
spec/unit/type/selmodule.rb
spec/unit/type/ssh_authorized_key.rb
spec/unit/type/user.rb
spec/unit/type/zone.rb
spec/unit/util/autoload.rb
spec/unit/util/constant_inflector.rb
spec/unit/util/file_locking.rb
spec/unit/util/filetype.rb
spec/unit/util/ldap/manager.rb
spec/unit/util/loadedfile.rb
spec/unit/util/metric.rb
spec/unit/util/monkey_patches.rb
spec/unit/util/posix.rb
spec/unit/util/queue.rb
spec/unit/util/queue/stomp.rb
spec/unit/util/reference_serializer.rb
spec/unit/util/settings/file_setting.rb
spec/unit/util/user_attr.rb
spec/unit/util/warnings.rb
...and perhaps others.
--
You have received this notification because you have either subscribed to it,
or are involved in it.
To change your notification preferences, please click here:
http://reductivelabs.com/redmine/my/account
--
You received this message because you are subscribed to the Google Groups
"Puppet Bugs" group.
To post to this group, send email to [email protected].
To unsubscribe from this group, send email to
[email protected].
For more options, visit this group at
http://groups.google.com/group/puppet-bugs?hl=en.