Re: [OpenStack-Infra] zuul-merger and garbage collection

2015-05-12 Thread Antoine Musso
On 12/05/15 16:51, James E. Blair wrote: Clark Boylan writes: >I would expect git gc on zuul merger repos to be safe. git gc only >cleans up unreachable refs if they are 30 days old by default. > However, a big part of the performance impact to zuul-mergers is that there are so many transien

Re: [OpenStack-Infra] zuul-merger and garbage collection

2015-05-12 Thread Heald, Nicola
rom: James E. Blair [cor...@inaugust.com] Sent: 12 May 2015 15:51 To: Clark Boylan Cc: openstack-infra@lists.openstack.org Subject: Re: [OpenStack-Infra] zuul-merger and garbage collection Clark Boylan writes: > I would expect git gc on zuul merger repos to be safe. git gc only > cleans up

Re: [OpenStack-Infra] zuul-merger and garbage collection

2015-05-12 Thread James E. Blair
Clark Boylan writes: > I would expect git gc on zuul merger repos to be safe. git gc only > cleans up unreachable refs if they are 30 days old by default. However, a big part of the performance impact to zuul-mergers is that there are so many transient refs that it creates. So there will be som

Re: [OpenStack-Infra] zuul-merger and garbage collection

2015-05-12 Thread Clark Boylan
On Tue, May 12, 2015, at 01:40 AM, Heald, Nicola wrote: > > From: Clark Boylan [cboy...@sapwetik.org] > > One example we have run into with GitPython is that if the repo is > > repacked (which git can do for you when it decides to) object files may > > not exist any longer and need to be refound i

Re: [OpenStack-Infra] zuul-merger and garbage collection

2015-05-12 Thread Heald, Nicola
From: Clark Boylan [cboy...@sapwetik.org] > One example we have run into with GitPython is that if the repo is > repacked (which git can do for you when it decides to) object files may > not exist any longer and need to be refound in the pack file instead. > The only way to get GitPython to see th

Re: [OpenStack-Infra] zuul-merger and garbage collection

2015-05-11 Thread Clark Boylan
On Mon, May 11, 2015, at 02:25 AM, Heald, Nicola wrote: > Hi all, > > We've noticed that when repos have been in use for a while by > zuul-merger, they have a lot of left over objects that slow down git > operations. Zuul-merger also seems to keep open a bunch of file handles > to various objects,

[OpenStack-Infra] zuul-merger and garbage collection

2015-05-11 Thread Heald, Nicola
Hi all, We've noticed that when repos have been in use for a while by zuul-merger, they have a lot of left over objects that slow down git operations. Zuul-merger also seems to keep open a bunch of file handles to various objects, so running `git gc` on the repos seems dangerous, if they got de