Hello Wyatt, I think I have ran into an issue with large structured facts. I posted a new message about it, but I was wondering if you have a solution for large partitions and disks facts? I am not sure what to do as I cannot disable facts, and I have a large number of nodes. Your help is appreciated. Thanks,
Mike On Monday, September 28, 2015 at 12:41:43 PM UTC-5, Wyatt Alt wrote: > > On 09/28/2015 05:40 AM, Matt Jarvis wrote: > > We seem to have hit a bit of an issue with puppetdb garbage collection. > Initial symptoms were exceptions in the puppetdb logs : > > Retrying after attempt 6, due to: org.postgresql.util.PSQLException: This > connection has been closed. > > > And on the postgres side : > > > LOG: incomplete message from client > > > Having turned up the logging on postgres, it appears that the query > > > DELETE FROM fact_paths fp > > WHERE fp.id in ( $some_ids ) AND NOT EXISTS (SELECT 1 FROM > facts f > > WHERE f.fact_path_id in ( $some_more_ids ) AND > f.fact_path_id = fp.id > > AND f.factset_id <> $26355) > > > is the cuplrit. This query is absolutely massive, with over 26000 id's > specified as parameters - as soon as the query is executed, postgres > returns incomplete message from client and drops the connection. > > > puppetdb is 2.3.7-1puppetlabs1 > > postgres is 9.3 > > > Does anyone have any clues what's going on here ? > > > Thanks > > > Matt > > DataCentred Limited registered in England and Wales no. 05611763 -- > You received this message because you are subscribed to the Google Groups > "Puppet Users" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [email protected] <javascript:>. > To view this discussion on the web visit > <https://groups.google.com/d/msgid/puppet-users/5fe3bad3-71a7-4348-a9ff-24d8a0284a1c%40googlegroups.com?utm_medium=email&utm_source=footer> > https://groups.google.com/d/msgid/puppet-users/5fe3bad3-71a7-4348-a9ff-24d8a0284a1c%40googlegroups.com > . > For more options, visit https://groups.google.com/d/optout. > > Hey Matt, > > I can reproduce this by inserting a value at the beginning of an extremely > large array-valued structured fact, but we'll need to know more about your > particular data to confirm whether that's your particular issue. This could > be some large custom fact you're creating or something generated by a > module. > > I've created a ticket here around this issue here > https://tickets.puppetlabs.com/browse/PDB-2003 > > can you connect to the database via psql and share (either here or in the > ticket) the output of > > select count(*),name from fact_paths group by name order by count desc; > > ? > > My hope is that that will identify one or more large structured facts > associated with a lot of leaf values, and then we'll need to figure out > where they're coming from. > > Wyatt > > -- You received this message because you are subscribed to the Google Groups "Puppet Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/puppet-users/a8edf4e5-184f-455e-9547-e10aaea6f388%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
