Nothing fancy here. Parse the Apache log for /catalog/ to get catalog sizes though you may need to tweak what you're logging, I'm using the following, but only %b is needed to get bytes of the request. http://httpd.apache.org/docs/current/mod/mod_log_config.html

LogFormat "%v %V %{X-Forwarded-For}i %l %u %t \"%r\" %>s %b \"%{Referer}i\" \"%{User-Agent}i\" %D" combined
  CustomLog /var/log/httpd/<%= @vhostname %>-access_log combined

File service metadata requests is parsing for "GET /$some_env/file_metadata/". BTW in my stats that was 23k req/s if that wasn't clear.

tx/rx is just from the interface. Nothing else on the box so it's all Puppet plus general system stats collection, etc.

Ramin

On 7/8/17 8:25 AM, Soham Chakraborty wrote:
Ramin,

I am interested to know how did you do the tests? I want to run a simulation myself.

On Saturday, July 8, 2017 at 3:44:26 AM UTC+5:30, Ramin K wrote:

    On 7/7/17 9:52 AM, Peter Berghold wrote:
     > Has anybody out there done any sort of study on what Puppet
    produces in
     > terms of I/O packet rate?  I'm being asked to fill in a
    spreadsheet with
     > that information....

    I can share some rough numbers. We do a lot of files so the numbers are
    weird and inefficient. Puppet 3.8.7/Passenger 5.1.5/Ruby 2.0/Apache 2.4
    on the server side.

    avg file metadata per puppetserver: 25k/s
    avg hosts per puppetserver: 1200

    avg catalog size: 15MB (lots and lots of files)

    Peak TX rate: 4MB/s
    Peak RX rate: 1.5MB/s

    I'd suspect the average Puppetserver to be a fraction of that bandwidth
    for the same number of hosts.

    Ramin

--
You received this message because you are subscribed to the Google Groups "Puppet Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-users+unsubscr...@googlegroups.com <mailto:puppet-users+unsubscr...@googlegroups.com>. To view this discussion on the web visit https://groups.google.com/d/msgid/puppet-users/61e5dc0f-a791-4eb9-89e8-714014404cb1%40googlegroups.com <https://groups.google.com/d/msgid/puppet-users/61e5dc0f-a791-4eb9-89e8-714014404cb1%40googlegroups.com?utm_medium=email&utm_source=footer>.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "Puppet 
Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to puppet-users+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/puppet-users/8c78c0a3-0e74-533b-92db-f2a64ae0fdad%40badapple.net.
For more options, visit https://groups.google.com/d/optout.

Reply via email to