Hi Edwin, I don't know specifically what's causing the exception you're seeing, but note that in Lucene 2.3.0+, the JavaCC-generated version of StandardTokenizer (where your exception originates) has been replaced with a JFlex-generated version - see <http://issues.apache.org/jira/browse/LUCENE-966>.
FYI, indexing speed was much improved in 2.3.0 over previous versions -- up to 10 times faster, according to reports on this list -- is there any particular reason you aren't using 2.3.2 (the most recent release)? Steve On 10/06/2008 at 2:32 PM, Edwin Smith wrote: > Oh, and in case it matters, I'm using Lucene 2.2.0. > > Ed > > > > ----- Original Message ---- > > > I am stumped and have not seen any other reference to this > problem. I am getting the following exception on everything I > try to index. Does anyone know what my problem might be? > > Thanks, > > Ed > > java.lang.ArrayIndexOutOfBoundsException at > org.apache.lucene.analysis.standard.FastCharStream.readChar( at > org.apache.lucene.analysis.standard.FastCharStream.BeginToken( at > org.apache.lucene.analysis.standard.StandardTokenizerTokenMana > ger.getNextToken( at > org.apache.lucene.analysis.standard.StandardTokenizer.jj_ntk( at > org.apache.lucene.analysis.standard.StandardTokenizer.next( at > org.apache.lucene.analysis.standard.StandardFilter.next( at > org.apache.lucene.analysis.LowerCaseFilter.next( at > org.apache.lucene.analysis.StopFilter.next( at > org.apache.lucene.index.DocumentWriter.invertDocument( at > org.apache.lucene.index.DocumentWriter.addDocument( at > org.apache.lucene.index.IndexWriter.buildSingleDocSegment( at > org.apache.lucene.index.IndexWriter.addDocument( at > org.apache.lucene.index.IndexWriter.addDocument( at > com.affinovate.v4.server.search.Indexer.index( at > com.affinovate.v4.server.search.Indexer.perform( at > com.affinovate.v4.server.db.TaskQueue.run( at java.lang.Thread.run(: > 2048FastCharStream.java:46)FastCharStream.java:79)StandardToke > nizerTokenManager.java:1180)StandardTokenizer.java:158)Standar > dTokenizer.java:36)StandardFilter.java:41)LowerCaseFilter.java > > 33)StopFilter.java:107)DocumentWriter.java:219)DocumentWriter > .java:95)IndexWriter.java:1013)IndexWriter.java:1001)IndexWrit > er.java:983)Indexer.java:61)Indexer.java:93)TaskQueue.java:115 > )Thread.java:619) > --------------------------------------------------------------------- To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
