Re: [Yum-devel] Implementing delta metadata

2011-10-06 Thread James Antill
On Thu, 2011-10-06 at 23:53 +0530, Tirtha Chatterjee wrote: > After discussions with a few developers on IRC, we came to draw out a > few points -- > > 1. We need to pass only the metadata that has changed, preferably in > the form of an xml document (along with the checksum of this delta). > The

Re: [Yum-devel] Implementing delta metadata

2011-10-06 Thread Tirtha Chatterjee
After discussions with a few developers on IRC, we came to draw out a few points -- 1. We need to pass only the metadata that has changed, preferably in the form of an xml document (along with the checksum of this delta). The changed or new packages will have all the information just like normal m

Re: [Yum-devel] Implementing delta metadata

2011-09-27 Thread seth vidal
On Mon, 2011-09-26 at 07:21 -0400, Zdenek Pavlas wrote: > Hi! > > Thanks for the interest in improving MD download! > Just a few thoughts (I don't consider myself experienced > in the codebase, esp on the createrepo part). > > - Sharding metadata is very likely not an option. > > The per-file ov

Re: [Yum-devel] Implementing delta metadata

2011-09-26 Thread James Antill
On Mon, 2011-09-26 at 03:33 +0530, Tirtha Chatterjee wrote: > Hi! > > I frequently face this problem with yum where i need to install a > package, and it starts updating all the repo data at once. Since I am > mostly behind a slow internet connection, this is all the more > frustrating. I read up

Re: [Yum-devel] Implementing delta metadata

2011-09-26 Thread Zdenek Pavlas
> I conducted a few tests, and found that the diff size is much less in > general when i perform the diff between xml files, than in case of > sqlite files. > > Also, what is the advantage of using sqlite instead of xml (since I > could not find this anywhere in the wiki)? XML compresses and diff

Re: [Yum-devel] Implementing delta metadata

2011-09-26 Thread Tirtha Chatterjee
On Mon, Sep 26, 2011 at 4:51 PM, Zdenek Pavlas wrote: > Hi! > > Thanks for the interest in improving MD download! > Just a few thoughts (I don't consider myself experienced > in the codebase, esp on the createrepo part). > > - Sharding metadata is very likely not an option. > > The per-file overhe

Re: [Yum-devel] Implementing delta metadata

2011-09-26 Thread Zdenek Pavlas
Hi! Thanks for the interest in improving MD download! Just a few thoughts (I don't consider myself experienced in the codebase, esp on the createrepo part). - Sharding metadata is very likely not an option. The per-file overhead (to download, to store, to query) is significant, and to get a sig