Re: Disk usage per-field

2010-11-02 Thread Lance Norskog
The Lucene CheckIndex program opens an index and reads many types of data from it. It's easy to start with it and change that to count up the space used by terms and store data for field X. On Tue, Nov 2, 2010 at 5:51 AM, Muneeb Ali wrote: > > Hi, > > I am currently benchmarking solr index with d

Re: Disk usage per-field

2010-11-02 Thread Muneeb Ali
Hi, I am currently benchmarking solr index with different fields to see the impact on its size/ search speed etc. A feature to find the disk usage per field of index would be really handy and save me alot of time. Do we have any updates on this? Has anyone tried writing custom code for it ? -

Re: Disk usage per-field

2010-07-03 Thread Lance Norskog
You can write a Lucene program that walks the various index data structures and tots up estimated values. It's a big job. I would start with the Lucene CheckIndex program since it does most of this. On Sat, Jul 3, 2010 at 4:32 AM, Israel Ekpo wrote: > Currently, this feature is not available. > >

Re: Disk usage per-field

2010-07-03 Thread Israel Ekpo
Currently, this feature is not available. The amount of space a field consumes varies and depends on whether the field is index only, stored only or indexed and stored. It also depends on how the field is analyzed On Fri, Jul 2, 2010 at 2:59 PM, Shawn Heisey wrote: > On 6/30/2010 5:44 PM, Shaw

Re: Disk usage per-field

2010-07-02 Thread Shawn Heisey
On 6/30/2010 5:44 PM, Shawn Heisey wrote: Is it possible for Solr (or Luke/Lucene) to tell me exactly how much of the total index disk space is used by each field? It would also be very nice to know, for each field, how much is used by the index and how much is used for stored data. Still