Re: dogfooding over in clusteradm land

2012-01-03 Thread Don Lewis
On 2 Jan, Don Lewis wrote: On 2 Jan, Don Lewis wrote: On 2 Jan, Florian Smeets wrote: This does not make a difference. I tried on 32K/4K with/without journal and on 16K/2K all exhibit the same problem. At some point during the cvs2svn conversion the sycer starts to use 100% CPU. The

Re: dogfooding over in clusteradm land

2012-01-03 Thread Kostik Belousov
On Tue, Jan 03, 2012 at 12:02:22AM -0800, Don Lewis wrote: On 2 Jan, Don Lewis wrote: On 2 Jan, Don Lewis wrote: On 2 Jan, Florian Smeets wrote: This does not make a difference. I tried on 32K/4K with/without journal and on 16K/2K all exhibit the same problem. At some point during

Re: dogfooding over in clusteradm land

2012-01-03 Thread Don Lewis
On 3 Jan, Kostik Belousov wrote: This sounds very plausible. I think that there is no sense in restarting the scan if it is requested in async mode at all. See below. Would be thrilled if this finally solves the svn2cvs issues. commit 41aaafe5e3be5387949f303b8766da64ee4a521f Author:

Re: dogfooding over in clusteradm land

2012-01-03 Thread Kostik Belousov
On Tue, Jan 03, 2012 at 01:45:26AM -0800, Don Lewis wrote: On 3 Jan, Kostik Belousov wrote: This sounds very plausible. I think that there is no sense in restarting the scan if it is requested in async mode at all. See below. Would be thrilled if this finally solves the svn2cvs

Re: dogfooding over in clusteradm land

2012-01-03 Thread Don Lewis
On 3 Jan, Kostik Belousov wrote: On Tue, Jan 03, 2012 at 01:45:26AM -0800, Don Lewis wrote: On 3 Jan, Kostik Belousov wrote: This sounds very plausible. I think that there is no sense in restarting the scan if it is requested in async mode at all. See below. Would be thrilled if

Re: dogfooding over in clusteradm land

2012-01-03 Thread Kostik Belousov
On Tue, Jan 03, 2012 at 02:57:17AM -0800, Don Lewis wrote: On 3 Jan, Kostik Belousov wrote: On Tue, Jan 03, 2012 at 01:45:26AM -0800, Don Lewis wrote: On 3 Jan, Kostik Belousov wrote: This sounds very plausible. I think that there is no sense in restarting the scan if it is

Re: dogfooding over in clusteradm land

2012-01-03 Thread Don Lewis
On 3 Jan, Kostik Belousov wrote: With your change above, the code will skip the busy page after sleeping if it is running in async mode. It won't make another attempt to write this page because it no longer attempts to rescan. Why would it skip it ? Please note the call to

Re: dogfooding over in clusteradm land

2012-01-03 Thread Florian Smeets
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 03.01.2012 10:18, Kostik Belousov wrote: On Tue, Jan 03, 2012 at 12:02:22AM -0800, Don Lewis wrote: On 2 Jan, Don Lewis wrote: On 2 Jan, Don Lewis wrote: On 2 Jan, Florian Smeets wrote: This does not make a difference. I tried on 32K/4K

Re: dogfooding over in clusteradm land

2012-01-03 Thread Sean Bruno
On Tue, 2012-01-03 at 04:46 -0800, Florian Smeets wrote: Yes, the patch fixes the problem. The cvs2svn run completed this time. 9132.25 real 8387.05 user 403.86 sys I did not see any significant syncer activity in top -S anymore. Thanks a lot. Florian Currently

Re: dogfooding over in clusteradm land

2012-01-02 Thread Florian Smeets
On 29.12.11 01:04, Kirk McKusick wrote: Rather than changing BKVASIZE, I would try running the cvs2svn conversion on a 16K/2K filesystem and see if that sorts out the problem. If it does, it tells us that doubling the main block size and reducing the number of buffers by half is the problem.

Re: dogfooding over in clusteradm land

2012-01-02 Thread Don Lewis
On 2 Jan, Florian Smeets wrote: On 29.12.11 01:04, Kirk McKusick wrote: Rather than changing BKVASIZE, I would try running the cvs2svn conversion on a 16K/2K filesystem and see if that sorts out the problem. If it does, it tells us that doubling the main block size and reducing the number of

Re: dogfooding over in clusteradm land

2012-01-02 Thread Kostik Belousov
On Mon, Jan 02, 2012 at 12:47:03PM -0800, Don Lewis wrote: On 2 Jan, Florian Smeets wrote: On 29.12.11 01:04, Kirk McKusick wrote: Rather than changing BKVASIZE, I would try running the cvs2svn conversion on a 16K/2K filesystem and see if that sorts out the problem. If it does, it tells

Re: dogfooding over in clusteradm land

2012-01-02 Thread Don Lewis
On 2 Jan, Don Lewis wrote: On 2 Jan, Florian Smeets wrote: This does not make a difference. I tried on 32K/4K with/without journal and on 16K/2K all exhibit the same problem. At some point during the cvs2svn conversion the sycer starts to use 100% CPU. The whole process hangs at that point

Re: dogfooding over in clusteradm land

2011-12-28 Thread Kirk McKusick
Rather than changing BKVASIZE, I would try running the cvs2svn conversion on a 16K/2K filesystem and see if that sorts out the problem. If it does, it tells us that doubling the main block size and reducing the number of buffers by half is the problem. If that is the problem, then we will have to

Re: dogfooding over in clusteradm land

2011-12-27 Thread Florian Smeets
On 14.12.11 14:20, Sean Bruno wrote: We're seeing what looks like a syncher/ufs resource starvation on 9.0 on the cvs2svn ports conversion box. I'm not sure what resource is tapped out. Effectively, I cannot access the directory under use and the converter application stalls out waiting for

Re: dogfooding over in clusteradm land

2011-12-16 Thread Ulrich Spörlein
On Thu, 2011-12-15 at 18:39:59 -0800, Doug Barton wrote: On 12/14/2011 05:20, Sean Bruno wrote: We're seeing what looks like a syncher/ufs resource starvation on 9.0 on the cvs2svn ports conversion box. ... sounds like a good reason not to migrate the history to me. :) Sounds more like a

Re: dogfooding over in clusteradm land

2011-12-15 Thread Don Lewis
On 14 Dec, Poul-Henning Kamp wrote: In message 1323868832.5283.9.ca...@hitfishpass-lx.corp.yahoo.com, Sean Bruno writes: We're seeing what looks like a syncher/ufs resource starvation on 9.0 on the cvs2svn ports conversion box. I'm not sure what resource is tapped out. Search mailarcive

Re: dogfooding over in clusteradm land

2011-12-15 Thread Doug Barton
On 12/14/2011 05:20, Sean Bruno wrote: We're seeing what looks like a syncher/ufs resource starvation on 9.0 on the cvs2svn ports conversion box. ... sounds like a good reason not to migrate the history to me. :) -- [^L] Breadth of IT experience, and depth of

dogfooding over in clusteradm land

2011-12-14 Thread Sean Bruno
We're seeing what looks like a syncher/ufs resource starvation on 9.0 on the cvs2svn ports conversion box. I'm not sure what resource is tapped out. Effectively, I cannot access the directory under use and the converter application stalls out waiting for some resource that isn't clear. (Peter

Re: dogfooding over in clusteradm land [cvs2svn for ports]

2011-12-14 Thread Sean Bruno
On Wed, 2011-12-14 at 05:20 -0800, Sean Bruno wrote: We're seeing what looks like a syncher/ufs resource starvation on 9.0 on the cvs2svn ports conversion box. I'm not sure what resource is tapped out. Effectively, I cannot access the directory under use and the converter application stalls

Re: dogfooding over in clusteradm land [cvs2svn for ports]

2011-12-14 Thread Garrett Cooper
On Wed, Dec 14, 2011 at 10:39 AM, Sean Bruno sean...@yahoo-inc.com wrote: On Wed, 2011-12-14 at 05:20 -0800, Sean Bruno wrote: We're seeing what looks like a syncher/ufs resource starvation on 9.0 on the cvs2svn ports conversion box.  I'm not sure what resource is tapped out.  Effectively, I

Re: dogfooding over in clusteradm land

2011-12-14 Thread Poul-Henning Kamp
In message 1323868832.5283.9.ca...@hitfishpass-lx.corp.yahoo.com, Sean Bruno writes: We're seeing what looks like a syncher/ufs resource starvation on 9.0 on the cvs2svn ports conversion box. I'm not sure what resource is tapped out. Search mailarcive for lemming-syncer -- Poul-Henning Kamp