Re: xindice_rebuild - file size vastly multiplied

2009-04-21 Thread OKO
Natalia, Regarding DatabaseRebuild.java ... Well, I originally downloaded the binary 1.1 package (Windows), so I did not have a smooth setup for re-compiling the whole thing. As I wanted a very quick test, I did recompile DatabaseRebuild.java, by putting it in a separate directory branch, and

Re: xindice_rebuild - file size vastly multiplied

2009-04-17 Thread Natalia Shilenkova
On Thu, Apr 16, 2009 at 3:32 PM, OKO wrote: [snip] > > The "1.1" vs "1.0" expansion factor is much larger for the case of > collections with few and small files (factor 350) , than for many and small > files (factor 25). > > But nevertheless, I wonder for what kind of databases 1.1 would beat 1.0

Re: xindice_rebuild - file size vastly multiplied

2009-04-16 Thread OKO
Natalia, Thanks for offering some hints. To put some data on the table ... Below some size quantities for two parts of the database (1) a collection with few and small documents (2) a collection with many small documents For each of these I give size of (A) exported format (B) xin

Re: xindice_rebuild - file size vastly multiplied

2009-04-16 Thread Natalia Shilenkova
There was a change in Xindice v1.1 that could possibly be responsible for database size increase. Xindice v1.0 failed to correctly allocate initial file space for a collection according to its page size and page count parameters, so a collection with just a few documents would occupy several Kb on