On Fri, Sep 28, 2012 at 6:59 PM, Robert Muir <[email protected]> wrote: > On Fri, Sep 28, 2012 at 6:31 PM, <[email protected]> wrote: >> + Automaton automaton = (new >> EscapingTokenStreamToAutomaton()).toAutomaton(ts); > >> + replaceSep(automaton); > >> + automaton = Automaton.minimize(automaton); > >> + prefixPaths = FSTUtil.intersectPrefixPaths(automaton, fst); > > Let's open a followup issue for this workflow: I think we should try > to keep all this deterministic (at least optimize for common cases > like no synonyms or things to escape, and set deterministic = false > only if necessary). > > then replace the minimize with determinize (if that will work for > intersectPrefixPaths). that way its a no-op for the common-cases > (since it will already be deterministic).
+1 Mike McCandless http://blog.mikemccandless.com --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
