Cory Nelson wrote:
I recommend using utf-16 in the database - sqlite doesn't fully
support utf-8, and some things may give unexpected results if you use
it.
Could you expand a bit on this please?
I haven't seen any bugs as such with sqlite as such but I did have a few
problems storing "foreign" characters through the Python wrappers to
sqlite, where the wrappers barfed converting the "foreign" character.
In one case it was because the source (Windows app) lied about the
encoding - it claimed the text was UTF-8 when it was windows-1252.
In the other case the text came from a Unix box and was supposed to be
7-bit ASCII, but I suspect it was generated by a Windows app, as above.
I think I've got this all sorted in my mind but if you say sqlite has
issues handling UTF-8 then I need to look at it again.
Martin
