Re: Get Analyzed/Tokenized Field List

2010-12-24 Thread Erick Erickson
Well, not to my knowledge. In fact there's no guarantee that the #same# index has the #same# analyzer used on the #same# field in different documents, so I don't see how there could be a robust implementation of what you want. You could populate a field with a particular analyzer (or none at all),

Re: Get Analyzed/Tokenized Field List

2010-12-24 Thread Jordon Saardchit
Heh, yes, all stuff I know. My question was if an index contained any meta data which revealed whether or not a certain indexed field had been analyzed or not, which I think you are saying it does not. Our searching and indexing is isolated into 2 completely seperate packages which can be depl

Re: Get Analyzed/Tokenized Field List

2010-12-23 Thread Erick Erickson
I guess I'm missing the point. The fact that it is stored is irrelevant for searching. Stored fields really only govern whether Document.getField("fieldname") returns anything #after# the search. You can find out if a field is stored-only by asking IndexReader.getFields for UNINDEXED, and you can s

Re: Get Analyzed/Tokenized Field List

2010-12-23 Thread Jordon Saardchit
The basic use case is determiniation of rules in regards to building a query. I've got an application that programmatically builds queries (without any pre existing knowledge of the contents of the index it is searching). We have a custom designed analyzer and filter chain. However, it is app

Re: Get Analyzed/Tokenized Field List

2010-12-23 Thread Erick Erickson
Ah, you didn't mention indexed but unstored in your original message, just indexed/analyzed I don't think you can (someone jump in here if I'm wrong, please). The problem is that Lucene doesn't require any sort of schema. So if you are perfectly free to store a field in one document and NOT st

Re: Get Analyzed/Tokenized Field List

2010-12-23 Thread Jordon Saardchit
Yes I have, and after testing each of the various options denoted in IndexReader.FieldOption, I cannot retrieve fieldnames that are indexed (analyzed), and unstored. I figured this would be relatively easy to do and I was simply overlooking something. Is it perhaps not possible to do this? Jo

Re: Get Analyzed/Tokenized Field List

2010-12-23 Thread Erick Erickson
Have you looked at IndexReader.getFieldNames()? Best Erick On Thu, Dec 23, 2010 at 3:23 PM, Jordon Saardchit wrote: > Is there an easy way to retrieve a collection of fields (or field names) > that are analyzed/tokenized from any given index? > > Jordon >