Jira (PDB-3695) Package GC spends a lot of time when there's probably very little to clean up
Title: Message Title Zachary Kent updated an issue PuppetDB / PDB-3695 Package GC spends a lot of time when there's probably very little to clean up Change By: Zachary Kent Release Notes Summary: Improve package GC in PuppetDB. This patch improves a query used to target packages for deletion. Release Notes: Bug Fix Add Comment This message was sent by Atlassian JIRA (v7.5.1#75006-sha1:7df2574) -- You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com. To post to this group, send email to puppet-bugs@googlegroups.com. Visit this group at https://groups.google.com/group/puppet-bugs. For more options, visit https://groups.google.com/d/optout.
Jira (PDB-3695) Package GC spends a lot of time when there's probably very little to clean up
Title: Message Title Zachary Kent updated an issue PuppetDB / PDB-3695 Package GC spends a lot of time when there's probably very little to clean up Change By: Zachary Kent Fix Version/s: PDB 5.2.0 Add Comment This message was sent by Atlassian JIRA (v7.5.1#75006-sha1:7df2574) -- You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com. To post to this group, send email to puppet-bugs@googlegroups.com. Visit this group at https://groups.google.com/group/puppet-bugs. For more options, visit https://groups.google.com/d/optout.
Jira (PDB-3695) Package GC spends a lot of time when there's probably very little to clean up
Title: Message Title Owen Rodabaugh updated an issue PuppetDB / PDB-3695 Package GC spends a lot of time when there's probably very little to clean up Change By: Owen Rodabaugh CS Priority: Needs Priority Normal CS Impact: It seems like this would hit some of the largest users of PDB but most users who are not bottlenecked at the database won't notice it. It would be nice to have these tunings. As more customers move onto versions with package inspector the priority of this may increase. CS Severity: 3 - Serious CS Business Value: 4 - $ CS Frequency: 2 - 5-25% of Customers Add Comment This message was sent by Atlassian JIRA (v6.4.14#64029-sha1:ae256fe)
Jira (PDB-3695) Package GC spends a lot of time when there's probably very little to clean up
Title: Message Title Nick Walker updated an issue PuppetDB / PDB-3695 Package GC spends a lot of time when there's probably very little to clean up Change By: Nick Walker h1. The ProblemIn our own PE install, we see that package GC spends 3-4 minutes every hour. Since package GC rarely needs to clean up anything it should not run with every GC interval. !Package_GC_Slowness.png|thumbnail!h1. The solutionI don't see a way to make the query any faster. Here's a query plan: https://explain.depesz.com/s/WjzVSo, I suspect the solution is just to run different parts of GC at different times instead of lumping them all together. That's PDB-2428. h1. Workaround https://forge.puppet.com/npwalker/puppetdb_gc. Add Comment This message was sent by Atlassian JIRA (v6.4.14#64029-sha1:ae256fe) -- You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com. To post to this group, send email to puppet-bugs@googlegroups.com. Visit this group at https://groups.google.com/group/puppet-bugs. For more options, visit https://groups.google.com/d/optout.
Jira (PDB-3695) Package GC spends a lot of time when there's probably very little to clean up
Title: Message Title Nick Walker updated an issue PuppetDB / PDB-3695 Package GC spends a lot of time when there's probably very little to clean up Change By: Nick Walker CS Priority: Needs Priority Add Comment This message was sent by Atlassian JIRA (v6.4.14#64029-sha1:ae256fe) -- You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com. To post to this group, send email to puppet-bugs@googlegroups.com. Visit this group at https://groups.google.com/group/puppet-bugs. For more options, visit https://groups.google.com/d/optout.
Jira (PDB-3695) Package GC spends a lot of time when there's probably very little to clean up
Title: Message Title Nick Walker created an issue PuppetDB / PDB-3695 Package GC spends a lot of time when there's probably very little to clean up Issue Type: Bug Assignee: Unassigned Attachments: Package_GC_Slowness.png Created: 2017/09/27 7:39 PM Labels: tcse Priority: Normal Reporter: Nick Walker The Problem In our own PE install, we see that package GC spends 3-4 minutes every hour. Since package GC rarely needs to clean up anything it should not run with every GC interval. The solution I don't see a way to make the query any faster. Here's a query plan: https://explain.depesz.com/s/WjzV So, I suspect the solution is just to run different parts of GC at different times instead of lumping them all together. That's PDB-2428. Workaround https://forge.puppet.com/npwalker/puppetdb_gc.
