Issue #7469 has been reported by Matt Robinson.
----------------------------------------
Bug #7469: rake spec has failures on 2.7.x
https://projects.puppetlabs.com/issues/7469
Author: Matt Robinson
Status: Accepted
Priority: Normal
Assignee:
Category: testing
Target version: 2.7.x
Affected Puppet version: 2.7.0rc2
Keywords: orderdependent test failure
Branch:
Running `rake spec` results in 5 failures on 2.7.x and 3 on 2.7.next. These
are order dependent failures that result from the unit tests being run before
the integration tests. This ordering doesn't seem to happen if you run `rspec
spec`, which is what Jenkins and most devs are running now. However, most
community members may not be since the ability to run `rspec spec` is new in
RSpec 2 and our test wiki documentation says to run `rake spec`. Order
dependent failures should be eliminated regardless - if only RSpec made them
easier to find and debug.
Below are the failures. I haven't yet tracked down where the ordering problem
is yet, but that needs to be done.
1) documentation of faces licensing of Puppet Labs face 'testindirection'
license.
Failure/Error: its :license do should =~ /Apache\s*2/ end
expected: /Apache\s*2/
got: "All Rights Reserved" (using =~)
Diff:
@@ -1,2 +1,2 @@
-/Apache\s*2/
+All Rights Reserved
# ./spec/integration/faces/documentation_spec.rb:46
2) documentation of faces licensing of Puppet Labs face 'testindirection'
copyright.
Failure/Error: its :copyright do should =~ /Puppet Labs/ end
expected: /Puppet Labs/
got: "Unknown copyright owner and years." (using =~)
Diff:
@@ -1,2 +1,2 @@
-/Puppet Labs/
+Unknown copyright owner and years.
# ./spec/integration/faces/documentation_spec.rb:47
3) documentation of faces licensing of Puppet Labs face 'testindirection'
copyright.
Failure/Error: its :copyright do should =~ /2011/ end
expected: /2011/
got: "Unknown copyright owner and years." (using =~)
Diff:
@@ -1,2 +1,2 @@
-/2011/
+Unknown copyright owner and years.
# ./spec/integration/faces/documentation_spec.rb:52
4) Puppet::Transaction should not apply device resources on normal host
Failure/Error: transaction.evaluate
Mocha::ExpectationError:
unexpected invocation: #<Mock:device>.command()
satisfied expectations:
- allowed any number of times, not yet invoked:
Signal.trap(any_parameters)
- allowed any number of times, not yet invoked:
Signal.trap(any_parameters)
- allowed any number of times, not yet invoked:
Signal.trap(any_parameters)
- allowed any number of times, not yet invoked:
Signal.trap(any_parameters)
- allowed any number of times, not yet invoked:
Signal.trap(any_parameters)
- allowed any number of times, not yet invoked:
Signal.trap(any_parameters)
- allowed any number of times, not yet invoked:
Signal.trap(any_parameters)
- allowed any number of times, not yet invoked:
Signal.trap(any_parameters)
- allowed any number of times, not yet invoked:
Signal.trap(any_parameters)
- allowed any number of times, not yet invoked:
Signal.trap(any_parameters)
- allowed any number of times, not yet invoked:
Signal.trap(any_parameters)
- allowed any number of times, not yet invoked:
Puppet::Util::Storage.store(any_parameters)
- expected never, not yet invoked:
#<Puppet::Transaction:0x130773b08>.apply(#<Puppet::Type::Interface:0x130775
db8>, nil)
# ./lib/puppet/provider/interface/cisco.rb:11:in `lookup'
# ./lib/puppet/provider/network_device.rb:16:in `prefetch'
# ./lib/puppet/provider/network_device.rb:14:in `each'
# ./lib/puppet/provider/network_device.rb:14:in `prefetch'
# ./lib/puppet/transaction.rb:237:in `prefetch'
# ./lib/puppet/transaction.rb:234:in `each'
# ./lib/puppet/transaction.rb:234:in `prefetch'
# ./lib/puppet/transaction.rb:252:in `prepare'
# ./lib/puppet/transaction.rb:98:in `evaluate'
# ./spec/integration/transaction_spec.rb:88
5) Puppet::Transaction should apply device resources on device
Failure/Error: transaction.evaluate
Mocha::ExpectationError:
unexpected invocation: #<Mock:device>.command()
unsatisfied expectations:
- expected exactly once, not yet invoked:
#<Puppet::Transaction:0x130723b08>.apply(#<Puppet::Type::Interface:0
x130725d68>, nil)
satisfied expectations:
- allowed any number of times, not yet invoked:
Signal.trap(any_parameters)
- allowed any number of times, not yet invoked:
Signal.trap(any_parameters)
- allowed any number of times, not yet invoked:
Signal.trap(any_parameters)
- allowed any number of times, not yet invoked:
Signal.trap(any_parameters)
- allowed any number of times, not yet invoked:
Signal.trap(any_parameters)
- allowed any number of times, not yet invoked:
Signal.trap(any_parameters)
- allowed any number of times, not yet invoked:
Signal.trap(any_parameters)
- allowed any number of times, not yet invoked:
Signal.trap(any_parameters)
- allowed any number of times, not yet invoked:
Signal.trap(any_parameters)
- allowed any number of times, not yet invoked:
Signal.trap(any_parameters)
- allowed any number of times, not yet invoked:
Signal.trap(any_parameters)
- allowed any number of times, not yet invoked:
Puppet::Util::Storage.store(any_parameters)
# ./lib/puppet/provider/interface/cisco.rb:11:in `lookup'
# ./lib/puppet/provider/network_device.rb:16:in `prefetch'
# ./lib/puppet/provider/network_device.rb:14:in `each'
# ./lib/puppet/provider/network_device.rb:14:in `prefetch'
# ./lib/puppet/transaction.rb:237:in `prefetch'
# ./lib/puppet/transaction.rb:234:in `each'
# ./lib/puppet/transaction.rb:234:in `prefetch'
# ./lib/puppet/transaction.rb:252:in `prepare'
# ./lib/puppet/transaction.rb:98:in `evaluate'
# ./spec/integration/transaction_spec.rb:116
--
You have received this notification because you have either subscribed to it,
or are involved in it.
To change your notification preferences, please click here:
http://projects.puppetlabs.com/my/account
--
You received this message because you are subscribed to the Google Groups
"Puppet Bugs" group.
To post to this group, send email to [email protected].
To unsubscribe from this group, send email to
[email protected].
For more options, visit this group at
http://groups.google.com/group/puppet-bugs?hl=en.
