Issue #8643 has been updated by Jeff Blaine.

And if you give a crap, here's the significant part of what `strace -c` said 
after I ctrl-c'd out after a few hours:

<pre>
% time     seconds  usecs/call     calls    errors syscall
------ ----------- ----------- --------- --------- ----------------
 49.87    1.186253        9723       122           clone
 35.85    0.852770        5046       169        47 wait4
  5.95    0.141598           0    738807    690863 stat
  3.29    0.078256           1    122463        80 read
  0.89    0.021134           0     56762       594 lstat
  0.88    0.020999           1     30781           munmap
  0.68    0.016146           3      5924           brk
  0.68    0.016123           0     67421        56 open
  0.55    0.013136           0     82903     14796 close
...
</pre>

The majority of the `stat()` errors are `ENOENT`s from Ruby trying (and finally 
succeeding) to find the md5 module to import.

On the puppet master side, it spends a majority of its time sitting in 
`select()`

**shrug**
----------------------------------------
Bug #8643: Tree of files = day+ to xfer (note in documentation)
https://projects.puppetlabs.com/issues/8643

Author: Jeff Blaine
Status: Unreviewed
Priority: Normal
Assignee: 
Category: 
Target version: 
Affected Puppet version: 
Keywords: 
Branch: 


I understand the CM conceptual stance on this from Puppetlabs (or so I think), 
and I understand that "make a package" is the answer, but I wanted to report 
this and suggest that the documentation for the 'file' resource is updated to 
reflect reality so that people (like me) are able to accurately set 
expectations for the product depending on their intended usage.

I've spent ~1-2 hours now with this, looking at strace output, etc.

scp -r -p host:/tree-of-14thousand_files_totalling_147MB takes 1 minute to 
complete (between the same hosts used for the puppet run below, and tested 
several times, even during the puppet run).

Puppet 2.6.4 takes a full day (or more, I cancelled it) to do the same with 
that content, averaging 4-6 minutes per file for some unknown reason.


-- 
You have received this notification because you have either subscribed to it, 
or are involved in it.
To change your notification preferences, please click here: 
http://projects.puppetlabs.com/my/account

-- 
You received this message because you are subscribed to the Google Groups 
"Puppet Bugs" group.
To post to this group, send email to [email protected].
To unsubscribe from this group, send email to 
[email protected].
For more options, visit this group at 
http://groups.google.com/group/puppet-bugs?hl=en.

Reply via email to