Jira (PUP-7271) performance regression in puppet 4.9
Title: Message Title Henrik Lindberg updated an issue Puppet / PUP-7271 performance regression in puppet 4.9 Change By: Henrik Lindberg Sprint: Forge - To Accept Add Comment This message was sent by Atlassian JIRA (v6.4.14#64029-sha1:ae256fe) -- You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com. To post to this group, send email to puppet-bugs@googlegroups.com. Visit this group at https://groups.google.com/group/puppet-bugs. For more options, visit https://groups.google.com/d/optout.
Jira (PUP-7271) performance regression in puppet 4.9
Title: Message Title Henrik Lindberg updated an issue Puppet / PUP-7271 performance regression in puppet 4.9 Change By: Henrik Lindberg Sprint: PDE Triage Add Comment This message was sent by Atlassian JIRA (v6.4.14#64029-sha1:ae256fe) -- You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com. To post to this group, send email to puppet-bugs@googlegroups.com. Visit this group at https://groups.google.com/group/puppet-bugs. For more options, visit https://groups.google.com/d/optout.
Jira (PUP-7271) performance regression in puppet 4.9
Title: Message Title Henrik Lindberg updated an issue Puppet / PUP-7271 performance regression in puppet 4.9 Change By: Henrik Lindberg Fix Version/s: PUP 4.9.z Add Comment This message was sent by Atlassian JIRA (v6.4.14#64029-sha1:ae256fe) -- You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com. To post to this group, send email to puppet-bugs@googlegroups.com. Visit this group at https://groups.google.com/group/puppet-bugs. For more options, visit https://groups.google.com/d/optout.
Jira (PUP-7271) performance regression in puppet 4.9
Title: Message Title Paul Kranenburg commented on PUP-7271 Re: performance regression in puppet 4.9 I'm happy to report that with the 4.9.4 release, catalog compilation times are back to what they in the later 4.8.x releases. For instance, with profiling on, the following line can be seen in the server log: 2017-03-10 22:36:29,305 DEBUG [qtp986262046-70] [c.p.p.LoggingPuppetProfiler] [compiler compile stable __] (8304 ms) Compiled catalog for in environment stable. Thanks! Add Comment This message was sent by Atlassian JIRA (v6.4.14#64029-sha1:ae256fe) -- You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com. To post to this group, send email to puppet-bugs@googlegroups.com. Visit this group at https://groups.google.com/group/puppet-bugs. For more options, visit https://groups.google.com/d/optout.
Jira (PUP-7271) performance regression in puppet 4.9
Title: Message Title Josh Cooper commented on PUP-7271 Re: performance regression in puppet 4.9 Thanks for your help Paul Kranenburg. Wanted to let you know 4.9.4 was released yesterday, let us know what you find. Add Comment This message was sent by Atlassian JIRA (v6.4.14#64029-sha1:ae256fe) -- You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com. To post to this group, send email to puppet-bugs@googlegroups.com. Visit this group at https://groups.google.com/group/puppet-bugs. For more options, visit https://groups.google.com/d/optout.
Jira (PUP-7271) performance regression in puppet 4.9
Title: Message Title Kenn Hussey updated an issue Puppet / PUP-7271 performance regression in puppet 4.9 Change By: Kenn Hussey Labels: flanders-ss Add Comment This message was sent by Atlassian JIRA (v6.4.14#64029-sha1:ae256fe) -- You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com. To post to this group, send email to puppet-bugs@googlegroups.com. Visit this group at https://groups.google.com/group/puppet-bugs. For more options, visit https://groups.google.com/d/optout.
Jira (PUP-7271) performance regression in puppet 4.9
Title: Message Title Paul Kranenburg commented on PUP-7271 Re: performance regression in puppet 4.9 PUP-7309 looks like it may make a difference; I'll re-test with 4.9.4 as soon as possible. Add Comment This message was sent by Atlassian JIRA (v6.4.14#64029-sha1:ae256fe) -- You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com. To post to this group, send email to puppet-bugs@googlegroups.com. Visit this group at https://groups.google.com/group/puppet-bugs. For more options, visit https://groups.google.com/d/optout.
Jira (PUP-7271) performance regression in puppet 4.9
Title: Message Title Thomas Hallgren commented on PUP-7271 Re: performance regression in puppet 4.9 Paul Kranenburg, the logging you get from the Hiera eyaml backend can be turned off by adding: :logger: noop to your hiera.yaml file. This will turn off logging for custom hiera 3 backends only. It does not affect any other logging. Several performance issues have been addressed in PUP-7301, PUP-7303, PUP-7304, and PUP-7305. The problem with interpolations that does not get expanded is resolved in PUP-7289. The :extension: option didn't work properly for eyaml. This has been fixed in PUP-7284. So I guess your eyaml backend perhaps reads the wrong files? All fixes mentioned will be available in the upcoming 4.9.4 release, scheduled to go out this week. Add Comment This message was sent by Atlassian JIRA (v6.4.14#64029-sha1:ae256fe) -- You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com. To post to this group, send email to puppet-bugs@googlegroups.com. Visit this group at https://groups.google.com/group/puppet-bugs. For more options, visit https://groups.google.com/d/optout.
Jira (PUP-7271) performance regression in puppet 4.9
Title: Message Title
Paul Kranenburg commented on PUP-7271
Re: performance regression in puppet 4.9
I have also tries puppet-agent 1.9.2 (puppet core 4.9.3). This seems to break eyaml support altogether.
The hiera keys which are supposed to be decrypted with the server's private keys aren't, and instead end up in the catalog in encoded form. The puppetserver trace log shows that during a hiera key lookup a hierarchy search is on for files with an '.eyaml' suffix. This should not happen since in our hiera.yaml configuration file the following is present:
:eyaml: :datadir: /etc/puppetlabs/code/environments/%
Unknown macro: {environment}
/hieradata :pkcs7_private_key: '/etc/puppetlabs/puppet/keys/eyaml_private_key.pkcs7.pem' :pkcs7_public_key: '/etc/puppetlabs/puppet/keys/eyaml_public_key.pkcs7.pem' :extension: 'yaml'
Add Comment
This message was sent by Atlassian JIRA (v6.4.14#64029-sha1:ae256fe)
--
You received this message because you are subscribed to the Google Groups "Puppet Bugs" group.
To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com.
To post to this group, send email to puppet-bugs@googlegroups.com.
Visit this group at https://groups.google.com/group/puppet-bugs.
For more options, visit https://groups.google.com/d/optout.
Jira (PUP-7271) performance regression in puppet 4.9
Title: Message Title Paul Kranenburg commented on PUP-7271 Re: performance regression in puppet 4.9 I'm seeing the same thing after installing puppet-agent version 1.9.1 (making available puppet core 4.9.2), then restarting puppet server (still at version 2.7.2): much increased catalog compile times lots of 'Using Hiera 1.x backend API to access instance of class Hiera::Backend::Eyaml_backend.' etc. as mentioned above Add Comment This message was sent by Atlassian JIRA (v6.4.14#64029-sha1:ae256fe) -- You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com. To post to this group, send email to puppet-bugs@googlegroups.com. Visit this group at https://groups.google.com/group/puppet-bugs. For more options, visit https://groups.google.com/d/optout.
Jira (PUP-7271) performance regression in puppet 4.9
Title: Message Title Kenn Hussey updated an issue Puppet / PUP-7271 performance regression in puppet 4.9 Change By: Kenn Hussey Flagged: Impediment Add Comment This message was sent by Atlassian JIRA (v6.4.14#64029-sha1:ae256fe) -- You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com. To post to this group, send email to puppet-bugs@googlegroups.com. Visit this group at https://groups.google.com/group/puppet-bugs. For more options, visit https://groups.google.com/d/optout.
Jira (PUP-7271) performance regression in puppet 4.9
Title: Message Title Henrik Lindberg commented on PUP-7271 Re: performance regression in puppet 4.9 We have a 4.9.3 out now as well. Since there is no concrete information here to act on (cannot reproduce) we have to kick this out from 4.9.4. Add Comment This message was sent by Atlassian JIRA (v6.4.14#64029-sha1:ae256fe) -- You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com. To post to this group, send email to puppet-bugs@googlegroups.com. Visit this group at https://groups.google.com/group/puppet-bugs. For more options, visit https://groups.google.com/d/optout.
Jira (PUP-7271) performance regression in puppet 4.9
Title: Message Title Kenn Hussey updated an issue Puppet / PUP-7271 performance regression in puppet 4.9 Change By: Kenn Hussey Flagged: Impediment Add Comment This message was sent by Atlassian JIRA (v6.4.14#64029-sha1:ae256fe) -- You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com. To post to this group, send email to puppet-bugs@googlegroups.com. Visit this group at https://groups.google.com/group/puppet-bugs. For more options, visit https://groups.google.com/d/optout.
Jira (PUP-7271) performance regression in puppet 4.9
Title: Message Title John Duarte updated an issue Puppet / PUP-7271 performance regression in puppet 4.9 Change By: John Duarte Team: Puppet Developer Experience Add Comment This message was sent by Atlassian JIRA (v6.4.14#64029-sha1:ae256fe) -- You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com. To post to this group, send email to puppet-bugs@googlegroups.com. Visit this group at https://groups.google.com/group/puppet-bugs. For more options, visit https://groups.google.com/d/optout.
Jira (PUP-7271) performance regression in puppet 4.9
Title: Message Title John Duarte updated an issue Puppet / PUP-7271 performance regression in puppet 4.9 Change By: John Duarte Sprint: PDE Triage Add Comment This message was sent by Atlassian JIRA (v6.4.14#64029-sha1:ae256fe) -- You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com. To post to this group, send email to puppet-bugs@googlegroups.com. Visit this group at https://groups.google.com/group/puppet-bugs. For more options, visit https://groups.google.com/d/optout.
Jira (PUP-7271) performance regression in puppet 4.9
Title: Message Title Eric Sorenson updated an issue Puppet / PUP-7271 performance regression in puppet 4.9 Change By: Eric Sorenson Affects Version/s: PUP 4.9.2 Add Comment This message was sent by Atlassian JIRA (v6.4.14#64029-sha1:ae256fe) -- You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com. To post to this group, send email to puppet-bugs@googlegroups.com. Visit this group at https://groups.google.com/group/puppet-bugs. For more options, visit https://groups.google.com/d/optout.
Jira (PUP-7271) performance regression in puppet 4.9
Title: Message Title Kenn Hussey updated an issue Puppet / PUP-7271 performance regression in puppet 4.9 Change By: Kenn Hussey Fix Version/s: PUP 4.9.3 Fix Version/s: PUP 4.9.z Add Comment This message was sent by Atlassian JIRA (v6.4.14#64029-sha1:ae256fe) -- You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com. To post to this group, send email to puppet-bugs@googlegroups.com. Visit this group at https://groups.google.com/group/puppet-bugs. For more options, visit https://groups.google.com/d/optout.
Jira (PUP-7271) performance regression in puppet 4.9
Title: Message Title Henrik Lindberg updated an issue Puppet / PUP-7271 performance regression in puppet 4.9 Change By: Henrik Lindberg Priority: Normal Major Add Comment This message was sent by Atlassian JIRA (v6.4.14#64029-sha1:ae256fe) -- You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com. To post to this group, send email to puppet-bugs@googlegroups.com. Visit this group at https://groups.google.com/group/puppet-bugs. For more options, visit https://groups.google.com/d/optout.
Jira (PUP-7271) performance regression in puppet 4.9
Title: Message Title Henrik Lindberg updated an issue Puppet / PUP-7271 performance regression in puppet 4.9 Change By: Henrik Lindberg Fix Version/s: PUP 4.9.3 Add Comment This message was sent by Atlassian JIRA (v6.4.14#64029-sha1:ae256fe) -- You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com. To post to this group, send email to puppet-bugs@googlegroups.com. Visit this group at https://groups.google.com/group/puppet-bugs. For more options, visit https://groups.google.com/d/optout.
Jira (PUP-7271) performance regression in puppet 4.9
Title: Message Title Thomas Hallgren commented on PUP-7271 Re: performance regression in puppet 4.9 This sounds like it could be caused by PUP-7171 , but that was fixed in 4.9.2. Here, 4.9.2 is listed as an affected version although the description refers to 4.9.1. Paul Kranenburg, is problem verified to still be present on 4.9.2? Add Comment This message was sent by Atlassian JIRA (v6.4.14#64029-sha1:ae256fe) -- You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com. To post to this group, send email to puppet-bugs@googlegroups.com. Visit this group at https://groups.google.com/group/puppet-bugs. For more options, visit https://groups.google.com/d/optout.
Jira (PUP-7271) performance regression in puppet 4.9
Title: Message Title Lindsey Smith commented on PUP-7271 Re: performance regression in puppet 4.9 Ping Jeremy Barlow and Thomas Hallgren Add Comment This message was sent by Atlassian JIRA (v6.4.14#64029-sha1:ae256fe) -- You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com. To post to this group, send email to puppet-bugs@googlegroups.com. Visit this group at https://groups.google.com/group/puppet-bugs. For more options, visit https://groups.google.com/d/optout.
Jira (PUP-7271) performance regression in puppet 4.9
Title: Message Title Paul Kranenburg created an issue Puppet / PUP-7271 performance regression in puppet 4.9 Issue Type: Bug Affects Versions: PUP 4.9.2, PUP 4.9.1, PUP 4.9.0 Assignee: Unassigned Created: 2017/02/25 1:51 AM Priority: Normal Reporter: Paul Kranenburg Recently, our puppet servers received a puppet agent update, which implied an update of the puppet engine to version 4.9.1. Immediately there after, catalog compilation time on the servers went up eight-fold, from a typical 10-15 seconds to over a 100 seconds, leading to lengthy queues and many failed client runs. Reversal to puppet engine 4.8.x has brought catalog compilation times back to expected levels. Trace and debug data from a spare puppet server in the same environment strongly suggests that a much more inefficient method of retrieving hiera data is responsible for the performance degradation. Likely culprit is the eyaml backend: in a typical catalog compilation, more than 5000 times the eyaml plugin suffer a "reset" of some sort as, hinted at by the trace log entries. The following is seen in the log file for each inidvidual hiera lookup: [puppetserver] Puppet hiera(): Using Hiera 1.x backend API to access instance of class Hiera::Backend::Eyaml_backend. Lookup recursion will not be detected [puppetserver] Puppet hiera(): [eyaml_backend]: Set option: datadir = /etc/puppetlabs/code/environments/stable/hieradata [puppetserver] Puppet hiera():[eyaml_backend]: Set option: pkcs7_private_key = /etc/puppetlabs/puppet/keys/eyaml_private_key.pkcs7.pem [ lots more]
