Re: [Puppet Users] puppetdb export - WTF?!

2014-10-13 Thread Wyatt Alt
Hey Jon, you can inform us how many reports you have without rerunning the export. That would be useful information: curl -D - -G http://localhost:8080/v4/reports --data-urlencode 'include-total=true' -o /dev/null obviously substituting your own host if it's different. Also note the dash after

Re: [Puppet Users] puppetdb export - WTF?!

2014-10-12 Thread JonY
I pulled the plug on it after 48 hours. The file is 14Mb at this point. I may start the Postgres server and try the export again. Perhaps if puppetdb isn't running this will be more efficient. On Friday, October 10, 2014 6:13:04 PM UTC-7, Wyatt Alt wrote: Hey Jon, Thanks for the update

Re: [Puppet Users] puppetdb export - WTF?!

2014-10-10 Thread Felix Frank
On 10/09/2014 12:50 PM, JonY wrote: Update: 45 hours - ~75% complete Well, that's nice and all, but... Fro your process list the PDB appears to be running with a max heap size (Xmx) of 1024m. Perhaps increasing this could make a difference? ...have you tried this then? What was the effect?

Re: [Puppet Users] puppetdb export - WTF?!

2014-10-10 Thread Wyatt Alt
Hey Jon, Thanks for the update and the ticket: https://tickets.puppetlabs.com/browse/PDB-947 We've been trying to reproduce this today and have had relatively little luck. As you alluded earlier, it seems like a possible contributor might be the number of reports per node. Would you mind

Re: [Puppet Users] puppetdb export - WTF?!

2014-10-09 Thread JonY
Update: 45 hours - ~75% complete On Tuesday, October 7, 2014 1:32:02 PM UTC-7, JonY wrote: Running for 7 hours now. Has exported ~15-20% of the data. I'm intrigued to see what I end up with. On Tuesday, October 7, 2014 1:19:04 PM UTC-7, Wyatt Alt wrote: Thanks Jony. I've loaded up an

[Puppet Users] puppetdb export - WTF?!

2014-10-07 Thread JonY
(ok - terrribly unprofessional title.. I get it). I'm trying to 'do the right thing' and move from the embedded DB to Postgres. Following the instructions I figured I would dump out the contents of the embedded DB and import this into Postgres. So I start 'puppetdb export --outfile someplace'.

Re: [Puppet Users] puppetdb export - WTF?!

2014-10-07 Thread Wyatt Alt
Hey JonY, Sounds interesting. What version of PuppetDB are you using? Do you have reports, facts, and catalogs, or only some of those? Can you paste your config.ini? Also can you give the output of ps aux |grep java top -n1 free in a gist maybe? Wyatt On Tue, Oct 7, 2014 at 8:30 AM,

Re: [Puppet Users] puppetdb export - WTF?!

2014-10-07 Thread JonY
https://gist.github.com/ce60c590a0531c0b09cd.git # rpm -qa | grep puppet puppet-server-3.7.1-1.el6.noarch puppetlabs-release-6-11.noarch puppetdb-terminus-2.2.0-1.el6.noarch puppet-3.7.1-1.el6.noarch vim-puppet-2.7.20-1.el6.rf.noarch puppetdb-2.2.0-1.el6.noarch Am storing 30 days of data. Yes -