Re: [sqlite] FTS, snippet & Unicode?

2008-08-27 Thread Petite Abeille
On Aug 27, 2008, at 4:52 AM, Alexandre Courbot wrote: > I know there is a patch at > http://www.sqlite.org/cvstrac/tktview?tn=3140,38 that is supposed to > improve Unicode support in FTS3. I suspect it to turn any Unicode > character into a token - however maybe you can use it as a basis to >

Re: [sqlite] FTS, snippet & Unicode?

2008-08-27 Thread Dennis Cote
Alexey Pechnikov wrote: > > Is it included to 3.6.1 or 3.6.2 version? > No, it is not included in either version. The patch was submitted by the mozilla group, but it has not been checked in to SQLite. You can of course apply the patch to your own customized version of SQLite. HTH Dennis

Re: [sqlite] FTS, snippet & Unicode?

2008-08-27 Thread Alexey Pechnikov
Hello! В сообщении от Wednesday 27 August 2008 06:52:09 Alexandre Courbot написал(а): > I know there is a patch at > http://www.sqlite.org/cvstrac/tktview?tn=3140,38 that is supposed to > improve Unicode support in FTS3. I suspect it to turn any Unicode > character into a token - however maybe

Re: [sqlite] FTS, snippet & Unicode?

2008-08-26 Thread Alexandre Courbot
I know there is a patch at http://www.sqlite.org/cvstrac/tktview?tn=3140,38 that is supposed to improve Unicode support in FTS3. I suspect it to turn any Unicode character into a token - however maybe you can use it as a basis to implement what you need. Alex.

[sqlite] FTS, snippet & Unicode?

2008-08-26 Thread Petite Abeille
Hello, % sqlite3 -version 3.5.9 FTS's snippet seems to truncate Unicode sequences at time. For example, given the following text: Motto: ძალა ერთობაშია (Georgian) "Strength is in Unity" FTS's snippet would return the extract bellow for 'Unity, Freedom, Work': “… ��ია (Georgian) "Strength