On Apr 12, 2005, at 8:38 AM, Erik Hatcher wrote:
Could you give us a self-contained test case that reproduces this issue?
Erik
Here is a small program that will manifest the error. Hopefully someone can explain the problem. It happens with Lucene 1.4.2 and 1.4.3.
file: SortProblem.java ========================= import java.io.*; import org.apache.lucene.search.*; import org.apache.lucene.index.*; import org.apache.lucene.store.*; import org.apache.lucene.document.*; import org.apache.lucene.analysis.standard.StandardAnalyzer;
/**
* This program demonstrates a problem I'm having with Lucene. If I search for
* documents with a particular field name/value pair and sort them based upon
* another field, I sometimes get a RuntimeException thrown. This happens when the
* Hits comes back empty and the sort field name begins with a letter < "j". For
* the bug to manifest it appears I also need to have an unrelated document in the
* index that is storing version information.
**/
public class SortProblem
{private static String INDEX_DIRECTORY = "SortProblemIndex";
// This is the field name of a field in the dcoument that hold version
// information. The bug happens if this field name has certain values.
// "creatorVal" will fail, but "xreatorVal" will not. Very wierd.
private static String VERSION_CREATOR_KEY = "creatorVer";
private static String INDEX_VERSION_VAL = "indexVersionVal";
private static String INDEX_VERSION_KEY = "indexVersion";
private static String INDEX_VERSION = "1.1";
private static String CREATOR_KEY = "creator";
private static String PARSNIPS_VAL = "Parsnips";public static void main(String[] args)
{
initIndex(INDEX_DIRECTORY);
// The search appears to fail if the fieldName starts with a letter >= "j".
// The first and last search here will work while the middle will fail.
search(INDEX_DIRECTORY, "aaa");
search(INDEX_DIRECTORY, "mmm");
search(INDEX_DIRECTORY, "bbb");
}
private static void initIndex(String directoryName)
{
File indexDir = new File(directoryName);
if (indexDir.exists())
deleteFileOrDirectory(indexDir);
indexDir.mkdir();
try
{
IndexWriter writer = new IndexWriter(indexDir, new StandardAnalyzer(), true);
// Adding the one document which contains version information seems
// necessary to cause some search/sorts to fail.
Document doc = new Document();
doc.add(Field.Keyword(VERSION_CREATOR_KEY, INDEX_VERSION_VAL));
doc.add(Field.Keyword(INDEX_VERSION_KEY, INDEX_VERSION));
writer.addDocument(doc);
writer.close();
}
catch (IOException ioe)
{
ioe.printStackTrace();
}
}
private static void search(String directoryName, String sortFieldName)
{
try
{
File indexDir = new File(directoryName);
Directory fsDir = FSDirectory.getDirectory(indexDir, false);
IndexSearcher searcher = new IndexSearcher(fsDir);
Hits hits;
Query query = new TermQuery(new Term(CREATOR_KEY, PARSNIPS_VAL));
Sort sorter = new Sort(new SortField(sortFieldName, SortField.STRING, true));
try
{
hits = searcher.search(query, sorter);
System.out.println("sort on " + sortFieldName + " successful.");
}
catch (RuntimeException e)
{
System.out.println("sort on " + sortFieldName + " failed.");
e.printStackTrace();
}
}
catch (IOException e)
{
e.printStackTrace();
}
}
private static boolean deleteFileOrDirectory(File dir)
{
if (dir.isDirectory())
{
String[] children = dir.list();
for (int i = 0; i < children.length; i++)
{
boolean success = deleteFileOrDirectory(new File(dir, children[i]));
if (!success)
{
return false;
}
}
}
// The directory is now empty so delete it
return dir.delete();
}
}
On Apr 12, 2005, at 9:19 AM, Bill Tschumy wrote:
This problem is seeming more and more strange. It now looks like if the fieldName I'm sorting on starts is ASCII "j" or above, the RuntimeException is thrown. Any fieldName that starts with "i" or below (including capitals) works. Can anyone think of what could possibly be going on here?
On Apr 11, 2005, at 2:27 PM, Bill Tschumy wrote:
In my application, by default I display all documents that are in the index. I sort them either using a "time modified" or "time created". If I have a newly created empty index, I find I get an error if I sort by "time modified" but not "time created". In either case there are actually no documents that match my query so in reality there is nothing to sort.
Here is my query:
query = new TermQuery(new Term(MyIndexer.CREATOR_KEY, MyIndexer.PARSNIPS_VAL));
String fieldName = sortType == Parsnips.SORT_BY_MODIFIED ? MyIndexer.MODIFIED_KEY : MyIndexer.CREATED_KEY;
Sort sorter = new Sort(new SortField(fieldName, SortField.STRING, true));
hits = searcher.search(query, sorter);
The error I'm getting when using MyIndexer.MODIFIED_KEY (which is "modified") as the sort field is:
java.lang.RuntimeException: no terms in field modified
at org.apache.lucene.search.FieldCacheImpl.getStringIndex(FieldCacheImpl .java:256)
at org.apache.lucene.search.FieldSortedHitQueue.comparatorString(FieldSo rtedHitQueue.java:265)
at org.apache.lucene.search.FieldSortedHitQueue.getCachedComparator(Fiel dSortedHitQueue.java:180)
at org.apache.lucene.search.FieldSortedHitQueue.<init>(FieldSortedHitQue ue.java:58)
at org.apache.lucene.search.IndexSearcher.search(IndexSearcher.java: 122)
at org.apache.lucene.search.Hits.getMoreDocs(Hits.java:64)
at org.apache.lucene.search.Hits.<init>(Hits.java:51)
at org.apache.lucene.search.Searcher.search(Searcher.java:41)
at com.otherwise.parsnips.MySearcher.search(MySearcher.java:170)
at com.otherwise.parsnips.MySearcher.search(MySearcher.java:149)
at com.otherwise.parsnips.Parsnips.<init>(Parsnips.java:163)
at com.otherwise.parsnips.Parsnips.main(Parsnips.java:1205)
I can't understand why I would be getting this for one sort field but not the other given there are 0 hits anyway in a newly created index. Anyone have any thoughts? I am using Lucene 1.4.2.
-- Bill Tschumy Otherwise -- Austin, TX http://www.otherwise.com
--------------------------------------------------------------------- To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
-- Bill Tschumy Otherwise -- Austin, TX http://www.otherwise.com
--------------------------------------------------------------------- To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
--------------------------------------------------------------------- To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
-- Bill Tschumy Otherwise -- Austin, TX http://www.otherwise.com
--------------------------------------------------------------------- To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
