Jira (PDB-5096) Add some initial command processing tests

[Rob Browning (Jira)]

Title: Message Title

Rob Browning created an issue   PuppetDB / PDB-5096 Add some initial command processing tests Issue Type: Improvement Assignee: Unassigned Components: PuppetDB Created: 2021/04/06 5:41 PM Priority: Normal Reporter: Rob Browning Add an initial tool (say ext/bin/check-command-perf ... stockpile-queue.tgz or something) to run some command processing tests against puppetdb, likely via ./pdb, when given a stockpile queue archive. It's fine for it to be a requirement that lein uberjar has already been run. For now, this is just testing command processing, i.e. what's described intentionally side-steps the command ingestion (via http) costs. For the initial version, let's just assume we're using pdbbox, and PDBBOX is set in the environment, and assume pdb is stopped. Then, we'll require that the $PDBBOX/var/stockpile/cmd/q dir be empty, untar the archive into the $PDBBOX/stockpile/cmd/q dir, start ./pdb services -c "$PDBBOX/pdb.ini", and time how long it takes for the queue to become empty. Let's also check relevant metrics at the end to make sure nothing unexpected has happened (i.e. too many commands deferred or sent to the DLO, etc.). Given the metrics checks, we might want to consider writing this in something like clojure (perhaps as a lein alias), python, or ruby, though it might also be feasible in bash with help from jq. At the moment, one way to create a suitable stockpile queue from an existing timeshifted database, for the purposes of working on this ticket, would be to export the database via the archive endpoint, create a new pdbbox, make sure postgresql is stopped, import the export, and then cd "$PDBBOX/var/stockpile/q" && tar czpSf ../stockpile.tgz .. In the longer run, we may want to augment the command described in PDB-5095 to support an output option for writing directly to a stockpile queue instead of a wireformat archive, which should be reasonably easy, and much more efficient than having to round-trip through an export. Perhaps something like: lein timeshift-export ... --out-format stockpile "$PDBBOX/var/stockpile" Add Comment   This message was sent by Atlassian Jira (v8.13.2#813002-sha1:c495a97) -- You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/puppet-bugs/JIRA.394364.1617756098000.2900.1617756120042%40Atlassian.JIRA.