[ https://issues.apache.org/jira/browse/LUCENE-2211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12800709#action_12800709 ]
Uwe Schindler commented on LUCENE-2211: --------------------------------------- Fixed in Lucene 3.0 revision: 899639 > Advances BaseTokenStreamTestCase that uses a fake attribute to check, if > clearAttributes() was called correctly - found bugs in contrib/analyzers > ------------------------------------------------------------------------------------------------------------------------------------------------- > > Key: LUCENE-2211 > URL: https://issues.apache.org/jira/browse/LUCENE-2211 > Project: Lucene - Java > Issue Type: Bug > Components: Analysis, contrib/analyzers > Affects Versions: 2.9, 2.9.1, 3.0 > Reporter: Uwe Schindler > Fix For: 2.9.2, 3.0.1, 3.1 > > Attachments: LUCENE-2211-branch30.patch, LUCENE-2211.patch, > LUCENE-2211.patch, LUCENE-2211.patch, LUCENE-2211.patch, LUCENE-2211.patch, > LUCENE-2211.patch, LUCENE-2211.patch, LUCENE-2211.patch > > > Robert had the idea to use a fake attribute inside BaseTokenStreamTestCase > that records if its clear() method was called. If this is not the case after > incrementToken(), asserTokenStreamContents fails. It also uses the attribute > in TeeSinkTokenFilter, because there a lot of copying, captureState and > restoreState() is used. By the attribute, you can track wonderful, if > save/restore and clearAttributes is correctly implemented. It also verifies > that *before* a captureState() it was also cleared (as the state will also > contain the clear call). Because if you consume tokens in a filter, capture > the consumed tokens and insert them, the capturedStates must also be cleared > before. > In contrib analyzers are some test that fail to pass this additional > assertion. They are not fixed in the attached patch. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. --------------------------------------------------------------------- To unsubscribe, e-mail: java-dev-unsubscr...@lucene.apache.org For additional commands, e-mail: java-dev-h...@lucene.apache.org