Re: Automata and Transducer on Lucene 6

2017-04-19 Thread Chris Hostetter
: pairs). It is this kind of : "high-level goal" I asked about. Your answer only adds to the mystery: https://people.apache.org/~hossman/#xyproblem XY Problem Your question appears to be an "XY Problem" ... that is: you are dealing with "X", you are assuming "Y" will help you, and you are asking

Re: Automata and Transducer on Lucene 6

2017-04-19 Thread Dawid Weiss
> Dawid, the thing is that I am not even sure that Automata are the perfect > fit for my project and I thought some literature on it would help me decide > whether to use it or not. Still looks to me like you're approaching the problem from the wrong side or don't want to share the core problem wh

Re: Automata and Transducer on Lucene 6

2017-04-19 Thread Juarez Sampaio
Thanks for the reply everyone! I've spent some time looking at tests and source code and I've learned a lot about Lucene's Automata and FST. Way more productive than scanning javadocs. Thanks for the hint. *> Are you looking for a historical book on Lucene development or are you* *> looking to so

Re: Automata and Transducer on Lucene 6

2017-04-18 Thread Dawid Weiss
> One small correction: we moved away from objects to more compact int[] a > while ago for our automata implementation. Right, forgot about that. There are still some trappy object-heavy utilities like this one: https://github.com/apache/lucene-solr/blob/master/lucene/core/src/java/org/apache/luc

Re: Automata and Transducer on Lucene 6

2017-04-18 Thread Robert Muir
On Tue, Apr 18, 2017 at 5:16 PM, Michael McCandless wrote: > > +1 to use the tests to learn how things work; I don't know of any guide / > high level documentation for these low level classes, sorry. Maybe write > it up yourself and set it free somewhere online ;) For the FST case there are som

Re: Automata and Transducer on Lucene 6

2017-04-18 Thread Michael McCandless
On Tue, Apr 18, 2017 at 2:33 PM, Dawid Weiss wrote: - Automaton etc. are completely independent and used for slightly different > purposes (it's brics library ported to Lucene). Again -- tests will be > helpful to understand how they work. These classes use object > representation of states and n

Re: Automata and Transducer on Lucene 6

2017-04-18 Thread Dawid Weiss
> I'd like to read something written by who designed these classes. What > motivated, usage examples, what it is good for and what it is not good for. > Maybe a history of the development of Automata on Lucene Are you looking for a historical book on Lucene development or are you looking to solve

Automata and Transducer on Lucene 6

2017-04-18 Thread Juarez Sampaio
Hello everyone, Recently I've watched a few videos and read a few blog posts on Lucene's Automata and how one can speed up things by 100x when properly using Automata and Transducers. "I can definitely use a boost like this", right? The problem is that this material I've read was writen to Lucene