On 23 October 2014 20:53, Andy Parker <a...@puppetlabs.com> wrote:
> ** Next PR Triage Wednesday, October 29th @ 10:00 am Pacific. **
>
> *Priorities*
>
> 1. Puppet 3.7.3
> 2. CFacter on the march
> 3. New puppet doc implementation
> 4. Code removal for puppet 4
>
> *Commentary*
> Puppet 3.7.2 is released! There are a couple tickets that didn't make the
> boat (PUP-3302, PUP-3500, PUP-3505, maybe others) and so expect a puppet
> 3.7.3.
>
> Peter and Michael are continuing on cfacter. Solaris support is still in
> the works.
>
> Puppet strings 0.1.1 has been released! It fixes some typos, a bug when
> future parser is already enabled, and provides some examples of how to use
> the markup.
>
> Code removals are plowing ahead. The master branch's lib directory is now
> at 98 KLOC whereas stable is at 101 KLOC.
>
> I'm working on a plan to transition from YAML and PSON to JSON for
> serialization (network and on disk). There are several changes around
> encoding that will need to be handled in order to keep some functionality
> (file content with binary data, non-UTF-8 data in reports). I'm going to be
> sending out an email to puppet-dev soon.
>
> Puppet-dev conversations of note:
> * Behavior of apply + ENC
> The discussion continues at a trickle. Felix has summarized the pros
> and cons of the various options. Please help drive it to a conclusion.
> * Merits of directory environments and opt-in fallback mode?
> The thread has fizzled out. I'm interested in whether others see value
> in the proposal.
>
> *Data*
>
> I have some data about profiling!
>
> I got two different data sets. They were pretty comparable in many ways.
> Data Set 1 (DS1) catalogs took ~11 seconds on average, Data Set 2 (DS2)
> catalogs ~14 seconds. One of the big differences in the setups where that
> DS2 was using the MessagePack serialization whereas DS1 was using the
> default PSON. The average serialization time for each dataset showed a very
> strange outcome: PSON took an average of ~0.03 seconds, and msgpack took ~0.05
> seconds. I plotted a histogram of the serialization times and that showed
> that there was a huge spike in both datasets on the very low end. This
> skewed the average times substantially.
>
> By excluding times <= 0.003 seconds we get
>
> MessagePack
> [image: Inline image 1]
>
> PSON
> [image: Inline image 2]
>
> This indicates that there is actually a benefit to using msgpack. The high
> end of serialization is cut off. There is a large difference in the number
> of measurements in the two datasets, so it is still possible that msgpack
> is not as large of a difference as we expect. We are not going to switch to
> msgpack however. Instead we are going to switch to JSON, but the
> performance differences should be similar. According to various benchmarks
> that I've found online (and don't have links to right now), the difference
> between msgpack and json is negligible.
>
>
>
In my testing the difference in bigger with larger catalogs. When I test it
on one of our catalogs (1985 edges and 1026 resources) I get much more
speed difference comparing JSON and MessagePack on ruby 2.0.0 (included
PSON as well for reference).
Code used for testing: https://gist.github.com/dalen/906dd5b31baf1d36f7db
For serializing I get this:
Encode
======
Date: October 24, 2014
System Information
------------------
Operating System: OS X 10.10 (14A389)
CPU: Intel Core i7 3.5 GHz
Processor Count: 4
Memory: 16 GB
ruby 2.0.0p451 (2014-02-24 revision 45167) [x86_64-darwin13.2.0]
"MessagePack.pack" is up to 97% faster over repetitions
--------------------------------------------------------
MessagePack.pack 0.364662 secs Fastest
JSON.generate 2.711173 secs 86% Slower
PSON.generate 14.690753 secs 97% Slower
And for deserializing I get this:
Decode
======
Date: October 24, 2014
System Information
------------------
Operating System: OS X 10.10 (14A389)
CPU: Intel Core i7 3.5 GHz
Processor Count: 4
Memory: 16 GB
ruby 2.0.0p451 (2014-02-24 revision 45167) [x86_64-darwin13.2.0]
"MessagePack.unpack" is up to 92% faster over repetitions
----------------------------------------------------------
MessagePack.unpack 1.581809 secs Fastest
JSON.parse 3.565996 secs 55% Slower
PSON.parse 19.935312 secs 92% Slower
--
Erik Dalén
--
You received this message because you are subscribed to the Google Groups
"Puppet Developers" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to puppet-dev+unsubscr...@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/puppet-dev/CAAAzDLcrF%2BZ6Xe%3DTNUhZ__dT6%3DXdqqxGBs%3Dx6oTQHD2yqCztmQ%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.
