Jira (PDB-3854) stockpile/discard used to calculate command queue depth

[Stefan Dietrich (JIRA)]

Title: Message Title

Stefan Dietrich created an issue   PuppetDB / PDB-3854 stockpile/discard used to calculate command queue depth Issue Type: Bug Affects Versions: PDB 4.4.0 Assignee: Unassigned Components: PuppetDB Created: 2018/02/21 5:38 AM Priority: Minor Reporter: Stefan Dietrich Hello, we have noticed a high, fixed command queue depth on our PuppetDB instance. The metrics v1 API is used to monitor puppetlabs.puppetdb.mq:name=global.depth and it became stuck at a fixed point. The load was fairly low. After debugging, we found 20 discarded messages in /opt/puppetlabs/server/data/puppetdb/stockpile/discard/: # ll /opt/puppetlabs/server/data/puppetdb/stockpile/discard/ total 724 -rw------- 1 puppetdb puppetdb 43457 20. Feb 20:09 6684289-1519135763922_report_8_<NODE>.desy.de_err.txt -rw-r----- 1 puppetdb puppetdb 4465 20. Feb 15:09 6684289-1519135763922_report_8_<NODE>.desy.de.json -rw------- 1 puppetdb puppetdb 43457 20. Feb 21:02 6691938-1519138937721_report_8_<NODE>.desy.de_err.txt -rw-r----- 1 puppetdb puppetdb 3450 20. Feb 16:02 6691938-1519138937721_report_8_<NODE>.desy.de.json -rw------- 1 puppetdb puppetdb 43457 21. Feb 00:02 6726883-1519149736935_report_8_<NODE>.desy.de_err.txt -rw-r----- 1 puppetdb puppetdb 3440 20. Feb 19:02 6726883-1519149736935_report_8_<NODE>.desy.de.json After stopping PuppetDB and deleting the discarded files, the queue depth was back to normal values. The Puppet host responsible for this errors had garbage characters in a file. The documentation is not 100% clear, if depth should contain only queued commands or queued + discarded commands. Regards, Stefan Add Comment   This message was sent by Atlassian JIRA (v7.5.1#75006-sha1:7df2574) -- You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com. To post to this group, send email to puppet-bugs@googlegroups.com. Visit this group at https://groups.google.com/group/puppet-bugs. For more options, visit https://groups.google.com/d/optout.