[sqlite] Unicode support in SQLite

2015-07-06 Thread Aleksey Tulinov
Hello, I'm glad to announce that nunicode SQLite extension was updated to support Unicode 8.0. This extension support the following encodings: UTF-8, UTF-16, UTF-16LE, UTF-16BE and only 230Kb in size (approximately). This extension provides the following Unicode-aware components: - upper(X) -

Re: [sqlite] Unicode support in SQLite

2014-10-14 Thread Aleksey Tulinov
On 14/10/14 17:02, Kevin Benson wrote: https://bitbucket.org/alekseyt/nunicode/downloads/libnusqlite3-1.4-4a0e4773-win32.zip <--- 404 response code Thank you, fixed now. ___ sqlite-users mailing list sqlite-users@sqlite.org

Re: [sqlite] Unicode support in SQLite

2014-10-14 Thread Kevin Benson
On Tue, Oct 14, 2014 at 4:37 AM, Aleksey Tulinov wrote: > Hello, > > I'm glad to announce that nunicode SQLite extension was updated to support > Unicode-conformant case folding and was improved on performance of every > component provided to SQLite. > > You can read

[sqlite] Unicode support in SQLite

2014-10-14 Thread Aleksey Tulinov
Hello, I'm glad to announce that nunicode SQLite extension was updated to support Unicode-conformant case folding and was improved on performance of every component provided to SQLite. You can read about and download this extension at BitBucket page of nunicode library:

Re: [sqlite] Unicode support in SQLite

2014-07-04 Thread Aleksey Tulinov
Hello, I'm glad to announce that nunicode SQLite extension was updated to support Unicode 7.0.0 character set. It also implements LIKE operation which is faster compared to previous releases. This extension provides the following Unicode-aware components: - upper(X) - lower(X) - X LIKE Y

Re: [sqlite] Unicode support in SQLite

2014-04-02 Thread Aleksey Tulinov
Hey, According to previous discussion in this mailing list, i've updated nunicode SQLite extension not to override default NOCASE collation due to possible issues with database indexing. Version 1.2.1 removes nunicode-specific NOCASE and NUNICODE collations and introduces NU630 and

[sqlite] Unicode support in SQLite

2014-01-24 Thread Aleksey Tulinov
Hey, I've just updated nunicode to version 1.2: https://bitbucket.org/alekseyt/nunicode Now all collations are backed by reduced DUCET. Library grew in size a little bit, you'll get Unicode collations for around 200Kb, but at the same time you will also get several languages completely

Re: [sqlite] Unicode support in SQLite

2013-11-10 Thread Gert Van Assche
Very nice! Thanks for sharing, Aleksey. 2013/11/9 Aleksey Tulinov > On 11/04/2013 11:50 AM, Aleksey Tulinov wrote: > > Hey, > > > As you can see, this is truly full Unicode collation and case mapping >> with untailored special casing. Extension provides the

Re: [sqlite] Unicode support in SQLite

2013-11-09 Thread Aleksey Tulinov
On 11/04/2013 11:50 AM, Aleksey Tulinov wrote: Hey, As you can see, this is truly full Unicode collation and case mapping with untailored special casing. Extension provides the following functions, statements and collations: I've updated extension, examples and documentation, now it's

[sqlite] Unicode support in SQLite

2013-11-04 Thread Aleksey Tulinov
Dear SQLite users, I'd like to present you Unicode support extension i've implemented for SQLite, it does full Unicode (6.3.0) collations, case mapping and untailored ordering, and takes only ~100Kb to do that if you link it statically. It's also open source and free (MIT license):

Re: [sqlite] Unicode support

2009-11-20 Thread Nicolas Williams
On Tue, Nov 17, 2009 at 09:31:46PM -0500, Tim Romano wrote: > but if ORDER BY is > relying on an index for ordering, then flip() can have negative > effects. > > > Substr() could have negative effects on ordering too. That is a red > herring. Flip() is merely a function that reverses the

Re: [sqlite] Unicode support

2009-11-17 Thread Tim Romano
but if ORDER BY is relying on an index for ordering, then flip() can have negative effects. Substr() could have negative effects on ordering too. That is a red herring. Flip() is merely a function that reverses the order of codepoints "as found" without knowing anything about what those

Re: [sqlite] Unicode support

2009-11-17 Thread Jean-Christophe Deschamps
Tim, >For those who are insisting on Unicode graphemic codepoint-combination >intelligence: why can't we have a function that simply reverses the >order of the codepoints, and is blissfully ignorant about what those >individual codepoints or codepoint-combinations might signify as >graphemes in

Re: [sqlite] Unicode support

2009-11-17 Thread Tim Romano
For those who are insisting on Unicode graphemic codepoint-combination intelligence: why can't we have a function that simply reverses the order of the codepoints, and is blissfully ignorant about what those individual codepoints or codepoint-combinations might signify as graphemes in a

Re: [sqlite] Unicode support

2009-11-17 Thread Nicolas Williams
On Tue, Nov 17, 2009 at 05:15:16PM -0500, Igor Tandetnik wrote: > Nicolas Williams wrote: > > This is no longer true, either of 'ch' nor 'll'. > > There is a number of contractions in Hungarian that are still very > much in use, but I can't recall them off the top of my

Re: [sqlite] Unicode support

2009-11-17 Thread Beau Wilkinson
esday, November 17, 2009 1:01 PM To: sqlite-users@sqlite.org Subject: Re: [sqlite] Unicode support Simon Slavin <slav...@bigfraud.org> wrote: > On 17 Nov 2009, at 6:37pm, Igor Tandetnik wrote: > >> Simon Slavin <slav...@bigfraud.org> wrote: >>> First split the string in

Re: [sqlite] Unicode support

2009-11-17 Thread Igor Tandetnik
Nicolas Williams wrote: > On Tue, Nov 17, 2009 at 02:01:55PM -0500, Igor Tandetnik wrote: >> This would mean that the result of the hypothetical flip() function >> would be locale-dependent. E.g. in Spanish Traditional sort, a >> combination 'ch' sorts as if it were a

Re: [sqlite] Unicode support

2009-11-17 Thread Beau Wilkinson
till look smart in so refusing. I suggest that this a very detrimental pattern, though. ____________ From: sqlite-users-boun...@sqlite.org [sqlite-users-boun...@sqlite.org] On Behalf Of Igor Tandetnik [itandet...@mvps.org] Sent: Tuesday, November 17, 2009 1:01 PM To:

Re: [sqlite] Unicode support

2009-11-17 Thread Nicolas Williams
On Tue, Nov 17, 2009 at 02:01:55PM -0500, Igor Tandetnik wrote: > This would mean that the result of the hypothetical flip() function > would be locale-dependent. E.g. in Spanish Traditional sort, a > combination 'ch' sorts as if it were a single letter between 'c' and > 'd', forming a single sort

Re: [sqlite] Unicode support

2009-11-17 Thread Igor Tandetnik
Simon Slavin wrote: > On 17 Nov 2009, at 6:37pm, Igor Tandetnik wrote: > >> Simon Slavin wrote: >>> First split the string into characters, then reassemble them in >>> reverse order. >> >> The problem is, in Unicode it's not quite clear what

[sqlite] Unicode support

2009-11-17 Thread Simon Slavin
On 17 Nov 2009, at 6:37pm, Igor Tandetnik wrote: > Simon Slavin wrote: >> On 17 Nov 2009, at 5:52pm, Igor Tandetnik wrote: >> >>> But for your goals, it has to be sortable, right? In a proper >>> Unicode collation, U+0041 U+0301 would behave quite differently from >>>

RE: [sqlite] Unicode support for Sqlite?

2007-12-12 Thread Sreedhar.a
Thankyou all for the quick replies. Best Regards, A.Sreedhar. -Original Message- From: Trevor Talbot [mailto:[EMAIL PROTECTED] Sent: Wednesday, December 12, 2007 5:08 PM To: sqlite-users@sqlite.org Subject: Re: [sqlite] Unicode support for Sqlite? On 12/12/07, Sreedhar.a <[EM

Re: [sqlite] Unicode support for Sqlite?

2007-12-12 Thread Trevor Talbot
On 12/12/07, Sreedhar.a <[EMAIL PROTECTED]> wrote: > I am using the sqlite to store the metadata of audio files. > Is it possible to store the metadata in unicode character format in sqlite. Yes; SQLite assumes all TEXT type data in the database is Unicode. You can work with it in UTF-8 with the

Re: [sqlite] Unicode support for Sqlite?

2007-12-12 Thread Daniel Önnerby
utf-8 and utf-16 ARE unicode formats. But there are some things that sqlite does not handle without the ICU extension. The ICU extension extends SQLite with the following functionallity: 1.1 SQL Scalars upper() and lower() 1.2 Unicode Aware LIKE Operator 1.3 ICU Collation

RE: [sqlite] Unicode support for Sqlite?

2007-12-12 Thread Sreedhar.a
To: sqlite-users@sqlite.org Subject: Re: [sqlite] Unicode support for Sqlite? On 12/12/07, Sreedhar.a <[EMAIL PROTECTED]> wrote: > Does Sqlite support unicode? > I have seen that it supports utf-8 and utf-16. > I want to know whether it supports unicode character formats. Unicode

Re: [sqlite] Unicode support for Sqlite?

2007-12-12 Thread Trevor Talbot
On 12/12/07, Sreedhar.a <[EMAIL PROTECTED]> wrote: > Does Sqlite support unicode? > I have seen that it supports utf-8 and utf-16. > I want to know whether it supports unicode character formats. Unicode is a very large and complex topic, so that question is way too vague to answer. Can you

[sqlite] Unicode support for Sqlite?

2007-12-12 Thread Sreedhar.a
Hi, Does Sqlite support unicode? I have seen that it supports utf-8 and utf-16. I want to know whether it supports unicode character formats. Thanks and Best Regards, A.Sreedhar.

Re: [sqlite] UNICODE Support

2006-08-05 Thread Nathaniel Smith
On Fri, Aug 04, 2006 at 10:02:58PM -0700, Cory Nelson wrote: > On 8/4/06, Trevor Talbot <[EMAIL PROTECTED]> wrote: > >On 8/4/06, Cory Nelson <[EMAIL PROTECTED]> wrote: > > > >> But, since you brought it up - I have no expectations of SQLite > >> integrating a full Unicode locale library, however

Re: [sqlite] UNICODE Support

2006-08-05 Thread Trevor Talbot
On 8/4/06, Cory Nelson <[EMAIL PROTECTED]> wrote: On 8/4/06, Trevor Talbot <[EMAIL PROTECTED]> wrote: > On 8/4/06, Cory Nelson <[EMAIL PROTECTED]> wrote: > > > But, since you brought it up - I have no expectations of SQLite > > integrating a full Unicode locale library, however it would be a

Re: [sqlite] UNICODE Support

2006-08-04 Thread Cory Nelson
On 8/4/06, Trevor Talbot <[EMAIL PROTECTED]> wrote: On 8/4/06, Cory Nelson <[EMAIL PROTECTED]> wrote: > But, since you brought it up - I have no expectations of SQLite > integrating a full Unicode locale library, however it would be a great > improvement if it would respect the current locale

Re: [sqlite] UNICODE Support

2006-08-04 Thread Trevor Talbot
On 8/4/06, Cory Nelson <[EMAIL PROTECTED]> wrote: But, since you brought it up - I have no expectations of SQLite integrating a full Unicode locale library, however it would be a great improvement if it would respect the current locale and use wcs* functions when available, or at least order by

Re: [sqlite] UNICODE Support

2006-08-04 Thread Nuno Lucas
On 8/5/06, Cory Nelson <[EMAIL PROTECTED]> wrote: On 8/4/06, Nuno Lucas <[EMAIL PROTECTED]> wrote: > On 8/4/06, Cory Nelson <[EMAIL PROTECTED]> wrote: > > IE, using memcmp() to compare strings. I've been bitten by this > > before, with SQLite producing unexpected results when using UTF-8. > >

Re: [sqlite] UNICODE Support

2006-08-04 Thread Cory Nelson
On 8/4/06, Nuno Lucas <[EMAIL PROTECTED]> wrote: On 8/4/06, Cory Nelson <[EMAIL PROTECTED]> wrote: > IE, using memcmp() to compare strings. I've been bitten by this > before, with SQLite producing unexpected results when using UTF-8. > Using UTF-16 has worked more reliably in my experience.

Re: [sqlite] UNICODE Support

2006-08-04 Thread Nuno Lucas
On 8/4/06, Cory Nelson <[EMAIL PROTECTED]> wrote: IE, using memcmp() to compare strings. I've been bitten by this before, with SQLite producing unexpected results when using UTF-8. Using UTF-16 has worked more reliably in my experience. SQLite only knows how to sort ASCII, so memcmp does that

Re: [sqlite] UNICODE Support

2006-08-04 Thread Cory Nelson
On 8/4/06, [EMAIL PROTECTED] <[EMAIL PROTECTED]> wrote: "Cory Nelson" <[EMAIL PROTECTED]> wrote: > On 8/3/06, RohitPatel <[EMAIL PROTECTED]> wrote: > > I recommend using utf-16 in the database - sqlite doesn't fully > support utf-8, and some things may give unexpected results if you use >

Re: [sqlite] UNICODE Support

2006-08-04 Thread drh
"Cory Nelson" <[EMAIL PROTECTED]> wrote: > On 8/3/06, RohitPatel <[EMAIL PROTECTED]> wrote: > > I recommend using utf-16 in the database - sqlite doesn't fully > support utf-8, and some things may give unexpected results if you use > it. > Oh really? What exactly is missing from SQLite's

RE: [sqlite] UNICODE Support

2005-06-08 Thread Dennis Volodomanov
12:12 AM To: sqlite-users@sqlite.org Subject: RE: [sqlite] UNICODE Support But what about the SQLite Function's parameters whose data type is LPSTR ? Let me know the details to support wide char ? Regards, Ajay Sonawane -Original Message- From: Martin Engelschalk [mailto:[EMAIL

RE: [sqlite] UNICODE Support

2005-06-08 Thread Ajay
Subject: Re: [sqlite] UNICODE Support Hi, See http://www.sqlite.org/pragma.html, search for 'PRAGMA encoding' /Martin Ajay schrieb: >Hello there, > >Does SQLite support UNICODE? Can I store some Arabic or Chinese text in >database? > >If it does not support UNICODE, Is th

Re: [sqlite] UNICODE Support

2005-06-08 Thread Martin Engelschalk
Hi, See http://www.sqlite.org/pragma.html, search for 'PRAGMA encoding' /Martin Ajay schrieb: Hello there, Does SQLite support UNICODE? Can I store some Arabic or Chinese text in database? If it does not support UNICODE, Is there any workaround for that? Regards, Ajay Sonawane

[sqlite] UNICODE Support

2005-06-08 Thread Ajay
Hello there, Does SQLite support UNICODE? Can I store some Arabic or Chinese text in database? If it does not support UNICODE, Is there any workaround for that? Regards, Ajay Sonawane