Issue #7469 has been updated by James Turnbull.

Target version changed from 2.7.x to 2.7.0


----------------------------------------
Bug #7469: rake spec has failures on 2.7.x
https://projects.puppetlabs.com/issues/7469

Author: Matt Robinson
Status: Closed
Priority: Normal
Assignee: 
Category: testing
Target version: 2.7.0
Affected Puppet version: 2.7.0rc2
Keywords: orderdependent test failure
Branch: 


Running `rake spec` results in 5 failures on 2.7.x and 3 on 2.7.next.  These 
are order dependent failures that result from the unit tests being run before 
the integration tests.  This ordering doesn't seem to happen if you run `rspec 
spec`, which is what Jenkins and most devs are running now.  However, most 
community members may not be since the ability to run `rspec spec` is new in 
RSpec 2 and our test wiki documentation says to run `rake spec`.  Order 
dependent failures should be eliminated regardless - if only RSpec made them 
easier to find and debug.

Below are the failures.  I haven't yet tracked down where the ordering problem 
is yet, but that needs to be done.

    1) documentation of faces licensing of Puppet Labs face 'testindirection' 
license.
         Failure/Error: its :license   do should =~ /Apache\s*2/ end
           expected: /Apache\s*2/
                got: "All Rights Reserved" (using =~)
           Diff:
           @@ -1,2 +1,2 @@
           -/Apache\s*2/
           +All Rights Reserved
         # ./spec/integration/faces/documentation_spec.rb:46

      2) documentation of faces licensing of Puppet Labs face 'testindirection' 
copyright.
         Failure/Error: its :copyright do should =~ /Puppet Labs/ end
           expected: /Puppet Labs/
                got: "Unknown copyright owner and years." (using =~)
           Diff:
           @@ -1,2 +1,2 @@
           -/Puppet Labs/
           +Unknown copyright owner and years.
         # ./spec/integration/faces/documentation_spec.rb:47

      3) documentation of faces licensing of Puppet Labs face 'testindirection' 
copyright.
         Failure/Error: its :copyright do should =~ /2011/ end
           expected: /2011/
                got: "Unknown copyright owner and years." (using =~)
           Diff:
           @@ -1,2 +1,2 @@
           -/2011/
           +Unknown copyright owner and years.
         # ./spec/integration/faces/documentation_spec.rb:52

      4) Puppet::Transaction should not apply device resources on normal host
         Failure/Error: transaction.evaluate
         Mocha::ExpectationError:
           unexpected invocation: #<Mock:device>.command()
           satisfied expectations:
           - allowed any number of times, not yet invoked: 
Signal.trap(any_parameters)
           - allowed any number of times, not yet invoked: 
Signal.trap(any_parameters)
           - allowed any number of times, not yet invoked: 
Signal.trap(any_parameters)
           - allowed any number of times, not yet invoked: 
Signal.trap(any_parameters)
           - allowed any number of times, not yet invoked: 
Signal.trap(any_parameters)
           - allowed any number of times, not yet invoked: 
Signal.trap(any_parameters)
           - allowed any number of times, not yet invoked: 
Signal.trap(any_parameters)
           - allowed any number of times, not yet invoked: 
Signal.trap(any_parameters)
           - allowed any number of times, not yet invoked: 
Signal.trap(any_parameters)
           - allowed any number of times, not yet invoked: 
Signal.trap(any_parameters)
           - allowed any number of times, not yet invoked: 
Signal.trap(any_parameters)
           - allowed any number of times, not yet invoked: 
Puppet::Util::Storage.store(any_parameters)
           - expected never, not yet invoked: 
#<Puppet::Transaction:0x130773b08>.apply(#<Puppet::Type::Interface:0x130775
    db8>, nil)
         # ./lib/puppet/provider/interface/cisco.rb:11:in `lookup'
         # ./lib/puppet/provider/network_device.rb:16:in `prefetch'
         # ./lib/puppet/provider/network_device.rb:14:in `each'
         # ./lib/puppet/provider/network_device.rb:14:in `prefetch'
         # ./lib/puppet/transaction.rb:237:in `prefetch'
         # ./lib/puppet/transaction.rb:234:in `each'
         # ./lib/puppet/transaction.rb:234:in `prefetch'
         # ./lib/puppet/transaction.rb:252:in `prepare'
         # ./lib/puppet/transaction.rb:98:in `evaluate'
         # ./spec/integration/transaction_spec.rb:88

      5) Puppet::Transaction should apply device resources on device
         Failure/Error: transaction.evaluate
         Mocha::ExpectationError:
           unexpected invocation: #<Mock:device>.command()
           unsatisfied expectations:
           - expected exactly once, not yet invoked: 
#<Puppet::Transaction:0x130723b08>.apply(#<Puppet::Type::Interface:0
    x130725d68>, nil)
           satisfied expectations:
           - allowed any number of times, not yet invoked: 
Signal.trap(any_parameters)
           - allowed any number of times, not yet invoked: 
Signal.trap(any_parameters)
           - allowed any number of times, not yet invoked: 
Signal.trap(any_parameters)
           - allowed any number of times, not yet invoked: 
Signal.trap(any_parameters)
           - allowed any number of times, not yet invoked: 
Signal.trap(any_parameters)
           - allowed any number of times, not yet invoked: 
Signal.trap(any_parameters)
           - allowed any number of times, not yet invoked: 
Signal.trap(any_parameters)
           - allowed any number of times, not yet invoked: 
Signal.trap(any_parameters)
           - allowed any number of times, not yet invoked: 
Signal.trap(any_parameters)
           - allowed any number of times, not yet invoked: 
Signal.trap(any_parameters)
           - allowed any number of times, not yet invoked: 
Signal.trap(any_parameters)
           - allowed any number of times, not yet invoked: 
Puppet::Util::Storage.store(any_parameters)
         # ./lib/puppet/provider/interface/cisco.rb:11:in `lookup'
         # ./lib/puppet/provider/network_device.rb:16:in `prefetch'
         # ./lib/puppet/provider/network_device.rb:14:in `each'
         # ./lib/puppet/provider/network_device.rb:14:in `prefetch'
         # ./lib/puppet/transaction.rb:237:in `prefetch'
         # ./lib/puppet/transaction.rb:234:in `each'
         # ./lib/puppet/transaction.rb:234:in `prefetch'
         # ./lib/puppet/transaction.rb:252:in `prepare'
         # ./lib/puppet/transaction.rb:98:in `evaluate'
         # ./spec/integration/transaction_spec.rb:116


-- 
You have received this notification because you have either subscribed to it, 
or are involved in it.
To change your notification preferences, please click here: 
http://projects.puppetlabs.com/my/account

-- 
You received this message because you are subscribed to the Google Groups 
"Puppet Bugs" group.
To post to this group, send email to [email protected].
To unsubscribe from this group, send email to 
[email protected].
For more options, visit this group at 
http://groups.google.com/group/puppet-bugs?hl=en.

Reply via email to