[
https://issues.apache.org/jira/browse/LUCENE-3873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael McCandless updated LUCENE-3873:
---------------------------------------
Attachment: LUCENE-3873.patch
Patch... I think it's close, but there are still some nocommits...
I had to rework the original MockGraphTokenFilter to sometimes buffer tokens so
it can set the correct offsets.
I added a few test cases to existing analyzers (SynFilter, Japanese,
Standard), and new direct test cases.
I also created a new MockHoleInjectingTokenFilter...
Tests seem to pass... but it wouldn't surprise me if beasting/jenkins
uncovers something...
> tie MockGraphTokenFilter into all analyzers tests
> -------------------------------------------------
>
> Key: LUCENE-3873
> URL: https://issues.apache.org/jira/browse/LUCENE-3873
> Project: Lucene - Java
> Issue Type: Task
> Components: modules/analysis
> Reporter: Robert Muir
> Assignee: Michael McCandless
> Attachments: LUCENE-3873.patch
>
>
> Mike made a MockGraphTokenFilter on LUCENE-3848.
> Many filters currently arent tested with anything but a simple tokenstream.
> we should test them with this, too, it might find bugs (zero-length terms,
> stacked terms/synonyms, etc)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org
