Jira (PUP-10141) Puppetserver 3-4 times more overloaded after upgrade from 5.3 to 6.7.1

[Atanas Stoyanov (JIRA)]

Title: Message Title

Atanas Stoyanov created an issue   Puppet / PUP-10141 Puppetserver 3-4 times more overloaded after upgrade from 5.3 to 6.7.1 Issue Type: Bug Affects Versions: PUP 6.10.1 Assignee: Unassigned Attachments: Screenshot 2019-11-15 at 09.32.35.png, Screenshot 2019-11-15 at 09.32.40.png, Screenshot 2019-11-15 at 09.32.49.png, Screenshot 2019-11-15 at 10.17.18.png Components: Compiler Created: 2019/11/15 1:18 AM Priority: Normal Reporter: Atanas Stoyanov Puppet Version: 6.10.1 Puppet Server Version: 6.7.1 OS Name/Version: Ubuntu Bionic We have a puppet environment of 3 masters and ~250 clients. One of the masters is also serving CA. We have a HA setup with srv records. When we push our puppet code to our internal git, it gets pushed to the puppet masters and there we have different environments depending on the branch. Once we upgraded from puppetserver 5.3 to 6.7.1 the servers started to eat up all the server memory and occasionally die, thus we had to add more ram and CPUs to the VMs, where they are running. The CPU usage of the 3 masters also spiked a lot (see graphs). Also on the clients we noticed a signifficant slowdown in the puppet agent -t, which we assume is caused by the slow catalog compilation on the masters. The client's CPU usage, Memory usage and other stats except for the puppet run time seem unchanged. puppetserver.log does not contain any errors. On the attached images can be clearly seen when the upgrade was performed on 12.11.2019 ~ 11:00 Desired Behavior: Make puppetserver run smooth again   Add Comment   This message was sent by Atlassian JIRA (v7.7.1#77002-sha1:e75ca93) -- You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/puppet-bugs/JIRA.335407.1573809532000.34222.1573809540331%40Atlassian.JIRA.