Re: [sqlite] No unicode characters in sqlite3 console prg
> Le 13 août 2018 à 14:22, Lars Frederiksen a écrit : > > I use Windows 10 and have tried > chcp 65001 > without any luck. Still the same questionmarks > /Lars Of course. :) That is Windows console. You also have to elect to use an alternate font with your console, one that encompasses enough unicode glyphs for your needs. Click the upper left corner of your console window, choose properties, then font. You might have to find additional fonts and install them. Consider this workflow using a french speaking Windows 10: I:\>chcp Page de codes active : 850 I:\>sqlite3 école.db "create table école (élève text); insert into école values('élisabeth');" Comment: While my code page is 850, I type some extended characters to create a file, a table, a column and a value all using at least one extended character which is properly supported by my code page 850. The input to SQLite is correctly interpreted (see proof later on). But I would not have been able to enter any greek characters or arabic, not part of my code page 850. I:\>sqlite3 école.db SQLite version 3.24.0 2018-06-04 19:24:41 Enter ".help" for usage hints. sqlite> .once test.sql sqlite> .dump sqlite> .q I:\>type test.sql PRAGMA foreign_keys=OFF; BEGIN TRANSACTION; CREATE TABLE ├®cole (├®l├¿ve text); INSERT INTO "├®cole" VALUES('├®lisabeth'); COMMIT; Comment: So when dumping to file, there SQLite properly outputs UTF-8 without my code page settings getting in the way. That is nice and should never ever be changed. The fact that it outputted UTF-8 can clearly be seen above because the various extended characters, encoded as UTF8 appear as individual bytes mapped to my default code page 850. Now switch the console code page to UTF-8 (65001): I:\>chcp 65001 Page de codes active : 65001 I:\>type test.sql PRAGMA foreign_keys=OFF; BEGIN TRANSACTION; CREATE TABLE école (élève text); INSERT INTO "école" VALUES('élisabeth'); COMMIT; And the text file content appears OK, confirming the actuel text file data is UTF-8 (which you could validate by other ways, using a text editor properly supporting the encoding). -- Best Regards, Meilleures salutations, Met vriendelijke groeten, Olivier Mascia ___ sqlite-users mailing list sqlite-users@mailinglists.sqlite.org http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users
Re: [sqlite] No unicode characters in sqlite3 console prg
Hi Simon, I use Windows 10 and have tried chcp 65001 without any luck. Still the same questionmarks /Lars -Oprindelig meddelelse- Fra: sqlite-users [mailto:sqlite-users-boun...@mailinglists.sqlite.org] På vegne af Simon Slavin Sendt: 13. august 2018 14:06 Til: SQLite mailing list Emne: Re: [sqlite] No unicode characters in sqlite3 console prg On 13 Aug 2018, at 1:03pm, Lars Frederiksen wrote: > I use versio 3.19 What operating system ? If you are using Windows, please issue this command before using sqlite3.exe: chcp 65001 Simon. ___ sqlite-users mailing list sqlite-users@mailinglists.sqlite.org http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users ___ sqlite-users mailing list sqlite-users@mailinglists.sqlite.org http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users
Re: [sqlite] No unicode characters in sqlite3 console prg
On 13 Aug 2018, at 1:03pm, Lars Frederiksen wrote: > I use versio 3.19 What operating system ? If you are using Windows, please issue this command before using sqlite3.exe: chcp 65001 Simon. ___ sqlite-users mailing list sqlite-users@mailinglists.sqlite.org http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users
Re: [sqlite] No unicode characters in sqlite3 console prg
I use versio 3.19 Here is a print from cmd: SQLite version 3.19.3 2017-06-08 14:26:16 Enter ".help" for usage hints. Connected to a transient in-memory database. Use ".open FILENAME" to reopen on a persistent database. sqlite> .open flashcard.db sqlite> select * from Gloser; 2|taß???a ?|taverna|[01_16] 3|taß???a ?|taverna|[01_16] 4|taß???a ?|taverna|[01_16] 5|taß???a ?|taverna|[01_16] 16|taß???a ?|taverna|[01_16] 17|taß???a ?|taverna|[01_16] 18|taß???a ?|taverna|[01_16] 19|de µ?? ?e?...|sig mig engang. (egl "du fortæller mig ikke")|[01_08] 20|d?µ?s?f?? ?/?|journalist|[01_08] 21|???µa t?|mønt, småmønt|[01_08] 22|??p??a ?|pige|[01_08] 23|µa??t??a ?|elev, skoleelev (kvindelig)|[01_08] 24|µa??t?? ?|elev, skoleelev (mandlig)|[01_08] 25|µp?? t?|flaske|[01_08] 26|?p??|(konj) som, ligesom, sådan som; eftersom|[01_08] 27|p?t??? t?|glas (Både glas og flaske er intetkøn som vin. Øl er hunkøn)|[01_08] 28|p.?.= pa?ade??µat?? |f.eks. (for eksempel)|[01_08] 29|taß???a ?|taverna|[01_16] 30|taß???a ?|taverna|[01_16] 31|de µ?? ?e?...|sig mig engang. (egl "du fortæller mig ikke")|[01_08] 32|d?µ?s?f?? ?/?|journalist|[01_08] 33|???µa t?|mønt, småmønt|[01_08] 34|??p??a ?|pige|[01_08] 35|µa??t??a ?|elev, skoleelev (kvindelig)|[01_08] 36|µa??t?? ?|elev, skoleelev (mandlig)|[01_08] 37|µp?? t?|flaske|[01_08] 38|?p??|(konj) som, ligesom, sådan som; eftersom|[01_08] 39|p?t??? t?|glas (Både glas og flaske er intetkøn som vin. Øl er hunkøn)|[01_08] 40|p.?.= pa?ade??µat?? |f.eks. (for eksempel)|[01_08] 41|a???|men|[01_10] 42|a???|men|[01_10] 43|a???|men|[01_10] 44|a???|men|[01_10] 45|a???|men|[01_10] 46|a???|men|[01_10] 47|a???|men|[01_10] 48|a???|men|[01_10] The second field should show greek words but only the letters that are identical in danish and greek is shown. The pure greek letters like β, γ, δ, ε, η etc are shown as questionmarks. Do you want me to send you the database? Best Regards Lars -Oprindelig meddelelse- Fra: sqlite-users [mailto:sqlite-users-boun...@mailinglists.sqlite.org] På vegne af Rowan Worth Sendt: 13. august 2018 03:21 Til: SQLite mailing list Emne: Re: [sqlite] No unicode characters in sqlite3 console prg On 12 August 2018 at 00:51, Lars Frederiksen wrote: > Is this an error of my windows 10 cmd prompt or is it a general problem > that > the sqlite3 console is not able to show unicode in the cmd-window.?? > > No problem writing to the database and show (greek) unicode characters in > the cmd prompt as I key them, but when I want to show the data with the SQL > SELECT * FROM Gloser then the greek word is shown with most of its letters > as questionmarks. > What version of sqlite are you using? There was significant efforts to improve windows console unicode handling awhile back, which I think made it in for 3.12/3.13. If you're still seeing issues with a recent sqlite can you provide a short example which reproduces the issue? -Rowan ___ sqlite-users mailing list sqlite-users@mailinglists.sqlite.org http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users ___ sqlite-users mailing list sqlite-users@mailinglists.sqlite.org http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users
Re: [sqlite] No unicode characters in sqlite3 console prg
On 12 August 2018 at 00:51, Lars Frederiksen wrote: > Is this an error of my windows 10 cmd prompt or is it a general problem > that > the sqlite3 console is not able to show unicode in the cmd-window.?? > > No problem writing to the database and show (greek) unicode characters in > the cmd prompt as I key them, but when I want to show the data with the SQL > SELECT * FROM Gloser then the greek word is shown with most of its letters > as questionmarks. > What version of sqlite are you using? There was significant efforts to improve windows console unicode handling awhile back, which I think made it in for 3.12/3.13. If you're still seeing issues with a recent sqlite can you provide a short example which reproduces the issue? -Rowan ___ sqlite-users mailing list sqlite-users@mailinglists.sqlite.org http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users
Re: [sqlite] No unicode characters in sqlite3 console prg
On 11 Aug 2018, at 5:51pm, Lars Frederiksen wrote: > Is this an error of my windows 10 cmd prompt or is it a general problem that > the sqlite3 console is not able to show unicode in the cmd-window.?? It's a Windows thing. But I don't know how to fix it in Windows 10. Does Windows 10 still use code pages in the Console ? Try executing this command at the Console prompt before doing stuff with sqlite3: chcp 65001 Does this make things work properly ? If not, I would google the following string: "windows 10" "code page" console Simon. ___ sqlite-users mailing list sqlite-users@mailinglists.sqlite.org http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users
Re: [sqlite] No unicode characters in sqlite3 console prg
On 11 Aug 2018, at 17:51, Lars Frederiksen wrote: > Is this an error of my windows 10 cmd prompt or is it a general problem that > the sqlite3 console is not able to show unicode in the cmd-window.?? > > No problem writing to the database and show (greek) unicode characters in > the cmd prompt as I key them, but when I want to show the data with the SQL > SELECT * FROM Gloser then the greek word is shown with most of its letters > as questionmarks. Using macOS Mavericks (10.9.5): SQLite version 3.14.0 2016-08-08 13:40:27 Enter ".help" for usage hints. Connected to a transient in-memory database. Use ".open FILENAME" to reopen on a persistent database. sqlite> create table x (q text); sqlite> insert into x values ('∑ß∂π'); sqlite> select * from x; q -- ∑ß∂π Seems to work. -- Cheers -- Tim ___ sqlite-users mailing list sqlite-users@mailinglists.sqlite.org http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users
[sqlite] No unicode characters in sqlite3 console prg
Hello, Is this an error of my windows 10 cmd prompt or is it a general problem that the sqlite3 console is not able to show unicode in the cmd-window.?? No problem writing to the database and show (greek) unicode characters in the cmd prompt as I key them, but when I want to show the data with the SQL SELECT * FROM Gloser then the greek word is shown with most of its letters as questionmarks. It is not necessarily a problem as in my dbgrid of my program the unicode is shown correctly. I am just curious! Best Regards Lars ___ sqlite-users mailing list sqlite-users@mailinglists.sqlite.org http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users