Hello all,

I'd like to create an FTS3 tokenizer that filters stop words by
internally creating the simple or porter tokenizers and filtering
its output as needed (ala Lucene's StandardAnalyzer). Eg,

    CREATE VIRTUAL TABLE test
    USING fts3(txt, tokenize=stopword simple w1 ... wN)

However, the xCreate function doesn't take a sqlite3* argument so it
appears a tokenizer can't get at other tokenizers via fts3_tokenizer
as described in the FTS3 docs. I'm considering tweaking xCreate to
take a sqlite3* but before I do - is this something the official
implementation would be interested in adopting?

Regards,
Iker

-- 
Iker Arizmendi
AT&T Labs - Research
Speech and Image Processing Lab


_______________________________________________
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Reply via email to