> Vacuum full was running for the whole weekend, so we didn't yet have time to
> rebuild indexes, because that would require more downtime, and we're not
> sure how long it would take. The size of the database didn't drop that much,
> it's now ~370Gb.
Wow. Thats still way too large for the amount of nodes. I imagine
re-indexing might help, we can check first. Can you display how big
each of your relations are? A query like this might help:
SELECT nspname || '.' || relname AS "relation",
pg_size_pretty(pg_relation_size(C.oid)) AS "size"
FROM pg_class C
LEFT JOIN pg_namespace N ON (N.oid = C.relnamespace)
WHERE nspname NOT IN ('pg_catalog', 'information_schema')
ORDER BY pg_relation_size(C.oid) DESC
LIMIT 20;
Also - what are the row counts for each of your tables btw?
If you run this for each table it will get you a row count:
select count(*) from table_name;
I'd be curious to see if any of these are higher than what they should
be based on your node count, maybe some of the space is just large
tables perhaps?
> We already see some improvements. The queue doesn't get insanely large, in
> fact the highest peak we saw since Monday morning was about 20, but mostly
> it's between 0 and 3. That's good. :) One strange benefit is that we now see
> "Resources" and "Resource duplication" values on the Dashboard, those were
> previously just question marks, as you can see on my previous screenshots.
Perhaps the queries were just timing out on the dashboard?
> However, we still get the constraint violations, steadily 2 violations per
> hour. They appear as "Retried" commands on the dashboard. But if the queue
> reaches the size 0, then does this mean these commands get written to the
> database eventually? The violations seem to happen shortly after puppetdb
> starts garbage collection.
>
> You can see it here: http://pastebin.com/B6VR67LW
This should be evident in your puppetdb.log if you trace the uuid of a
command. If commands 'fail' completely, they end up in the DQL located
here:
/var/lib/puppetdb/mq/discarded/
ken.
--
You received this message because you are subscribed to the Google Groups
"Puppet Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to puppet-users+unsubscr...@googlegroups.com.
To post to this group, send email to puppet-users@googlegroups.com.
Visit this group at http://groups.google.com/group/puppet-users?hl=en.
For more options, visit https://groups.google.com/groups/opt_out.
