Hi all,
Anyone know if/how you can call the FTS5 tokeniser functions manually? e.g. I
want to look something up in the fts5vocab table but can't as I need to
split/stem the initial value first before querying the table?
To illustrate:
sqlite> CREATE VIRTUAL TABLE ft1 USING fts5(x, tokenize = porter);
sqlite> INSERT INTO ft1 VALUES('running man');
sqlite> CREATE VIRTUAL TABLE ft1_v_row USING fts5vocab(ft1, row);
sqlite> SELECT * FROM ft1_v_row;
man|1|1
run|1|1
sqlite> SELECT count(*) FROM ft1_v_row WHERE term = 'running';
0
sqlite>
How can I somehow map 'running' => 'run' in order to query the fts5vocab table
to get stats on that term? And how could I tokenise 'running man' => 'run',
'man' in order to look up multiple tokens?
-Matt
?
Matt Hamilton
Quernus
matt at quernus.co.uk
+44 117 325 3025
64 Easton Business Centre
Felix Road, Easton
Bristol, BS5 0HE
Quernus Ltd is a company registered in England and Wales. Registered number:
09076246
