[sqlite] Unicode support in SQLite
Hello, I'm glad to announce that nunicode SQLite extension was updated to support Unicode 8.0. This extension support the following encodings: UTF-8, UTF-16, UTF-16LE, UTF-16BE and only 230Kb in size (approximately). This extension provides the following Unicode-aware components: - upper(X) - lower(X) - X LIKE Y ESCAPE Z - COLLATE NU800 : case-sensitive Unicode 8.0.0 collation - COLLATE NU800_NOCASE : case-insensitive Unicode 8.0.0 collation You can read about and download this extension at BitBucket page of nunicode library: https://bitbucket.org/alekseyt/nunicode#markdown-header-sqlite3-extension If you were using previous version of nunicode extension for SQLite, please note that extension was renamed from libnunicode to libnusqlite3. The entry points remained the same: sqlite3_nunicode_init() and nunicode_sqlite3_static_init(). Sorry for the inconvenience. Also note that this version of extension is no longer providing NU700 and NU700_NOCASE collations, they are replaced with NU800 and NU800_NOCASE. Complete changelog is available here: https://bitbucket.org/alekseyt/nunicode/raw/master/CHANGELOG
Re: [sqlite] Unicode support in SQLite
On 14/10/14 17:02, Kevin Benson wrote: https://bitbucket.org/alekseyt/nunicode/downloads/libnusqlite3-1.4-4a0e4773-win32.zip <--- 404 response code Thank you, fixed now. ___ sqlite-users mailing list sqlite-users@sqlite.org http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users
Re: [sqlite] Unicode support in SQLite
On Tue, Oct 14, 2014 at 4:37 AM, Aleksey Tulinov wrote: > Hello, > > I'm glad to announce that nunicode SQLite extension was updated to support > Unicode-conformant case folding and was improved on performance of every > component provided to SQLite. > > You can read about and download this extension at BitBucket page of > nunicode library: https://bitbucket.org/alekseyt/nunicode#markdown- > header-sqlite3-extension > > This extension provides the following Unicode-aware components: > > - upper(X) > - lower(X) > - X LIKE Y ESCAPE Z > - COLLATE NU700 : case-sensitive Unicode 7.0.0 collation > - COLLATE NU700_NOCASE : case-insensitive Unicode 7.0.0 collation > https://bitbucket.org/alekseyt/nunicode/downloads/libnusqlite3-1.4-4a0e4773-win32.zip <--- 404 response code -- -- -- --Ô¿Ô-- K e V i N ___ sqlite-users mailing list sqlite-users@sqlite.org http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users
[sqlite] Unicode support in SQLite
Hello, I'm glad to announce that nunicode SQLite extension was updated to support Unicode-conformant case folding and was improved on performance of every component provided to SQLite. You can read about and download this extension at BitBucket page of nunicode library: https://bitbucket.org/alekseyt/nunicode#markdown-header-sqlite3-extension This extension provides the following Unicode-aware components: - upper(X) - lower(X) - X LIKE Y ESCAPE Z - COLLATE NU700 : case-sensitive Unicode 7.0.0 collation - COLLATE NU700_NOCASE : case-insensitive Unicode 7.0.0 collation ___ sqlite-users mailing list sqlite-users@sqlite.org http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users
Re: [sqlite] Unicode support in SQLite
Hello, I'm glad to announce that nunicode SQLite extension was updated to support Unicode 7.0.0 character set. It also implements LIKE operation which is faster compared to previous releases. This extension provides the following Unicode-aware components: - upper(X) - lower(X) - X LIKE Y ESCAPE Z - COLLATE NU700 : case-sensitive Unicode 7.0.0 collation - COLLATE NU700_NOCASE : case-insensitive Unicode 7.0.0 collation Collation functions implement default Unicode collation (based on DUCET). Previously implemented Unicode 6.3.0 collations NU630 and NU630_NOCASE were removed from this version of extension. You can find implementation details, changelog and downloads at BitBucket page of nunicode library: https://bitbucket.org/alekseyt/nunicode ___ sqlite-users mailing list sqlite-users@sqlite.org http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users
Re: [sqlite] Unicode support in SQLite
Hey, According to previous discussion in this mailing list, i've updated nunicode SQLite extension not to override default NOCASE collation due to possible issues with database indexing. Version 1.2.1 removes nunicode-specific NOCASE and NUNICODE collations and introduces NU630 and NU630_NOCASE collations instead. First is case-sensitive Unicode 6.3.0 collation, second is case-insensitive, both implements default Unicode collation ordering (DUCET). In all other regards, it's not different from 1.2 version of extension and based on the same nunicode 1.2. Full changelog is available here: https://bitbucket.org/alekseyt/nunicode/src/master/CHANGELOG Pre-compiled extensions are available under "Downloads" for Win32 and i386/amd64 Linux. ___ sqlite-users mailing list sqlite-users@sqlite.org http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users
[sqlite] Unicode support in SQLite
Hey, I've just updated nunicode to version 1.2: https://bitbucket.org/alekseyt/nunicode Now all collations are backed by reduced DUCET. Library grew in size a little bit, you'll get Unicode collations for around 200Kb, but at the same time you will also get several languages completely working out of the box as they don't need any collation tailoring. You can also write your own tailoring, this is somewhat described here: https://bitbucket.org/alekseyt/nunicode#markdown-header-custom-collations and also covered in embedded Doxygen doc. ___ sqlite-users mailing list sqlite-users@sqlite.org http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users
Re: [sqlite] Unicode support in SQLite
Very nice! Thanks for sharing, Aleksey. 2013/11/9 Aleksey Tulinov > On 11/04/2013 11:50 AM, Aleksey Tulinov wrote: > > Hey, > > > As you can see, this is truly full Unicode collation and case mapping >> with untailored special casing. Extension provides the following functions, >> statements and collations: >> > > I've updated extension, examples and documentation, now it's easier to > link extension statically. Everything, including new prebuilt binaries, is > available on BitBucket, changelog is available here: > https://bitbucket.org/alekseyt/nunicode/src/master/CHANGELOG > > ___ > sqlite-users mailing list > sqlite-users@sqlite.org > http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users > ___ sqlite-users mailing list sqlite-users@sqlite.org http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users
Re: [sqlite] Unicode support in SQLite
On 11/04/2013 11:50 AM, Aleksey Tulinov wrote: Hey, As you can see, this is truly full Unicode collation and case mapping with untailored special casing. Extension provides the following functions, statements and collations: I've updated extension, examples and documentation, now it's easier to link extension statically. Everything, including new prebuilt binaries, is available on BitBucket, changelog is available here: https://bitbucket.org/alekseyt/nunicode/src/master/CHANGELOG ___ sqlite-users mailing list sqlite-users@sqlite.org http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users
[sqlite] Unicode support in SQLite
Dear SQLite users, I'd like to present you Unicode support extension i've implemented for SQLite, it does full Unicode (6.3.0) collations, case mapping and untailored ordering, and takes only ~100Kb to do that if you link it statically. It's also open source and free (MIT license): https://bitbucket.org/alekseyt/nunicode What it does exactly: sqlite> .load ./sqlite3/libnusqlite3.so sqlite> SELECT 'MASSE' LIKE 'Maße'; 1 sqlite> SELECT 'æ' LIKE 'AE'; 1 sqlite> SELECT 'Masse' == 'Maße' COLLATE NUNICODE; 1 sqlite> SELECT upper('Maße'); MASSE As you can see, this is truly full Unicode collation and case mapping with untailored special casing. Extension provides the following functions, statements and collations: - upper()/lower() - X LIKE Y ESCAPE Z - COLLATE NOCASE - COLLATE NUNICODE Supported encodings: UTF-8, UTF-16 (host-endian), UTF-16BE, UTF-16LE. If you wish to try it, you can find some pre-built binaries for Windows and Linux in downloads section on BitBucket, documentation is embedded into sources. Any ideas? ___ sqlite-users mailing list sqlite-users@sqlite.org http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users