Issue #1719 has been updated by ohadlevy.
luke wrote: > ohadlevy wrote: > > ohadlevy wrote: > > > --evaltrace helped.. it now shows a line for each and every package... > > > > > > [...] > > > > > > having quite a lot of packages (1287) it adds up > > > > > > strangely, this problem does not appear on 24-4. > > running the same machine with 0.24-4 and evaltrace showed something > > interesting: > > > > [...] > > > > as you can see, the time is down to 0.00 seconds, but it complains about > > the yum provider. > > I know for a fact that puppet is using yum in order to install packages, I > > wonder why this error comes up. > > > > Thanks > > I think that's a Red Herring - I remember that problem showing up, but people > were obviously still using Yum. > > It does look like it's the packaging system itself that's taking the extra > time, though. Can you tell if prefetching is working? If so, it shouldn't > add significant time per resource. Maybe you've got an older version of yum > w/out the yumhelper.py interfaces? Maybe try manually calling the yumhelper > and verifying it works and in a reasonable timeframe. so Far I've tried the following: # executing manually the yumhelper on 24-7, it takes around a second. # using the yumhelper from 24-4 on 24-7 (as it was changed) no performance difference. # using the yumhelper from 24-7 on 24-4 - 24-4 is still faster # removing the yumhelp from 24-4 and 24-7 --> both remain with the same speed (24-4 is faster than 24-7) (like the yumhelper was never effecting the speed). according to this, it seems that yumhelper has no impact on my performance problem. (as I am always running puppet when it doesn't perform any change) I've tested with yum 2.2 and yum 2.4 (its a RHE4 platform) and there is no difference in performance as well. Any other ideas of what to test? Thanks ---------------------------------------- Bug #1719: Puppetd runtime increase dramaticilly after upgrading to 24.6 http://projects.reductivelabs.com/issues/show/1719 Author: ohadlevy Status: Re-opened Priority: High Assigned to: luke Category: Target version: 0.24.7 Complexity: Unknown Affected version: 0.24.6 Keywords: Puppet runs which usually takes below 40 seconds now take approx 120seconds. out of the puppetmaster reporting directory: using 24.4: <pre> metrics: time: !ruby/object:Puppet::Util::Metric label: Time name: time values: - - :package - Package - 1.05623960494995 - - :file - File - 10.6328134536743 - - :config_retrieval - Config retrieval - 24.5795600414276 - - :filebucket - Filebucket - 0.000156164169311523 - - :schedule - Schedule - 0.00120806694030762 - - :total - Total - 43.2172024250031 - - :yumrepo - Yumrepo - 0.00425291061401367 - - :user - User - 0.00153994560241699 - - :exec - Exec - 1.66444134712219 - - :service - Service - 5.27211761474609 - - :mount - Mount - 0.00152111053466797 - - :host - Host - 0.00335216522216797 </pre> after - 24.6 <pre> metrics: time: !ruby/object:Puppet::Util::Metric label: Time name: time values: - - :host - Host - 0.00355815887451172 - - :file - File - 11.7336454391479 - - :total - Total - 120.841092348099 - - :user - User - 0.058845043182373 - - :mount - Mount - 0.0456039905548096 - - :service - Service - 5.9176561832428 - - :filebucket - Filebucket - 0.000210046768188477 - - :config_retrieval - Config retrieval - 24.3035020828247 - - :yumrepo - Yumrepo - 0.00350379943847656 - - :schedule - Schedule - 0.00127720832824707 - - :exec - Exec - 3.01487517356873 - - :package - Package - 75.758415222168 </pre> Using debug and verbose mode (both on client and server) it looks like puppet just waits for something in between <pre> debug: Calling fileserver.describe </pre> operations. it does not seem to be related to any package command (e.g. rpm, or yum) and puppet does not install or change anything on that system (as all resources were in sync). another thing that I've noticed in my debugging, is that the operation of file { ensure => absent } takes on average 1-2 seconds. downgrading back to 24.4 resolve the problem. ---------------------------------------- You have received this notification because you have either subscribed to it, or are involved in it. To change your notification preferences, please click here: http://reductivelabs.com/redmine/my/account --~--~---------~--~----~------------~-------~--~----~ You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To post to this group, send email to [email protected] To unsubscribe from this group, send email to [email protected] For more options, visit this group at http://groups.google.com/group/puppet-bugs?hl=en -~----------~----~----~----~------~----~------~--~---
