Shawn Walker wrote: > Brock Pytlik wrote: >> I hit send before I meant to, so here's one more piece of performance >> data. >> >> Indexing a repo on ipkg takes about 40min with existing methods and >> has a size of 951M and a RSS of 947M. Indexing with pylucene takes >> roughly 2 hours, whether it's has a size of 155M or a size of 1100M. >> (Specifically, the 155M run took 2 hours and 1 minute while the 1100M >> run took 1 hour and 49 minutes.) > > A one-time penalty of a longer period is palatable if this doesn't > have a negative impact on publishing performance. What are your > thoughts on that? > > The memory usage still seems gargantuan. > > Cheers, Actually, from what I've seen, PyLucene takes the same amount of time to index using 150M of RAM as it does using 1100M of RAM, which seems odd and slightly troubling as it means we can't crank up the RAM usage to speed up indexing. If you mean the search usage yeah, that's rather large.
I don't see publishing performance taking a hit from the publshers point of view since it happens asynchronously anyway. It might mean that it will take longer for the search indices to be ready for consumption, but in general that doesn't hold publication up too much. I haven't tried an import though so I can't say for certain. Brock _______________________________________________ pkg-discuss mailing list [email protected] http://mail.opensolaris.org/mailman/listinfo/pkg-discuss
