Re: [sqlite] No unicode characters in sqlite3 console prg

2018-08-13 Thread Olivier Mascia
> Le 13 août 2018 à 14:22, Lars Frederiksen  a écrit :
> 
> I use Windows 10 and have tried 
> chcp 65001
> without any luck. Still the same questionmarks
> /Lars

Of course. :) That is Windows console.  You also have to elect to use an 
alternate font with your console, one that encompasses enough unicode glyphs 
for your needs.  Click the upper left corner of your console window, choose 
properties, then font.  You might have to find additional fonts and install 
them.

Consider this workflow using a french speaking Windows 10:


I:\>chcp
Page de codes active : 850

I:\>sqlite3 école.db "create table école (élève text); insert into école 
values('élisabeth');"

Comment: While my code page is 850, I type some extended characters to create a 
file, a table, a column and a value all using at least one extended character 
which is properly supported by my code page 850. The input to SQLite is 
correctly interpreted (see proof later on). But I would not have been able to 
enter any greek characters or arabic, not part of my code page 850.

I:\>sqlite3 école.db
SQLite version 3.24.0 2018-06-04 19:24:41
Enter ".help" for usage hints.
sqlite> .once test.sql
sqlite> .dump
sqlite> .q

I:\>type test.sql
PRAGMA foreign_keys=OFF;
BEGIN TRANSACTION;
CREATE TABLE ├®cole (├®l├¿ve text);
INSERT INTO "├®cole" VALUES('├®lisabeth');
COMMIT;

Comment: So when dumping to file, there SQLite properly outputs UTF-8 without 
my code page settings getting in the way. That is nice and should never ever be 
changed. The fact that it outputted UTF-8 can clearly be seen above because the 
various extended characters, encoded as UTF8 appear as individual bytes mapped 
to my default code page 850.

Now switch the console code page to UTF-8 (65001):

I:\>chcp 65001
Page de codes active : 65001

I:\>type test.sql
PRAGMA foreign_keys=OFF;
BEGIN TRANSACTION;
CREATE TABLE école (élève text);
INSERT INTO "école" VALUES('élisabeth');
COMMIT;

And the text file content appears OK, confirming the actuel text file data is 
UTF-8 (which you could validate by other ways, using a text editor properly 
supporting the encoding).

-- 
Best Regards, Meilleures salutations, Met vriendelijke groeten,
Olivier Mascia


___
sqlite-users mailing list
sqlite-users@mailinglists.sqlite.org
http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users


Re: [sqlite] No unicode characters in sqlite3 console prg

2018-08-13 Thread Lars Frederiksen
Hi Simon,

I use Windows 10 and have tried 
chcp 65001
without any luck. Still the same questionmarks
/Lars


-Oprindelig meddelelse-
Fra: sqlite-users [mailto:sqlite-users-boun...@mailinglists.sqlite.org] På 
vegne af Simon Slavin
Sendt: 13. august 2018 14:06
Til: SQLite mailing list
Emne: Re: [sqlite] No unicode characters in sqlite3 console prg

On 13 Aug 2018, at 1:03pm, Lars Frederiksen  wrote:

> I use versio 3.19

What operating system ?

If you are using Windows, please issue this command before using sqlite3.exe:

chcp 65001

Simon.
___
sqlite-users mailing list
sqlite-users@mailinglists.sqlite.org
http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users

___
sqlite-users mailing list
sqlite-users@mailinglists.sqlite.org
http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users


Re: [sqlite] No unicode characters in sqlite3 console prg

2018-08-13 Thread Simon Slavin
On 13 Aug 2018, at 1:03pm, Lars Frederiksen  wrote:

> I use versio 3.19

What operating system ?

If you are using Windows, please issue this command before using sqlite3.exe:

chcp 65001

Simon.
___
sqlite-users mailing list
sqlite-users@mailinglists.sqlite.org
http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users


Re: [sqlite] No unicode characters in sqlite3 console prg

2018-08-13 Thread Lars Frederiksen
I use versio 3.19

Here is a print from cmd:

SQLite version 3.19.3 2017-06-08 14:26:16
Enter ".help" for usage hints.
Connected to a transient in-memory database.
Use ".open FILENAME" to reopen on a persistent database.
sqlite> .open flashcard.db
sqlite> select * from Gloser;
2|taß???a ?|taverna|[01_16]
3|taß???a ?|taverna|[01_16]
4|taß???a ?|taverna|[01_16]
5|taß???a ?|taverna|[01_16]
16|taß???a ?|taverna|[01_16]
17|taß???a ?|taverna|[01_16]
18|taß???a ?|taverna|[01_16]
19|de µ?? ?e?...|sig mig engang. (egl "du fortæller mig ikke")|[01_08]
20|d?µ?s?f?? ?/?|journalist|[01_08]
21|???µa t?|mønt, småmønt|[01_08]
22|??p??a ?|pige|[01_08]
23|µa??t??a ?|elev, skoleelev (kvindelig)|[01_08]
24|µa??t?? ?|elev, skoleelev (mandlig)|[01_08]
25|µp?? t?|flaske|[01_08]
26|?p??|(konj) som, ligesom, sådan som; eftersom|[01_08]
27|p?t??? t?|glas (Både glas og flaske er intetkøn som vin. Øl er 
hunkøn)|[01_08]
28|p.?.= pa?ade??µat?? |f.eks. (for eksempel)|[01_08]
29|taß???a ?|taverna|[01_16]
30|taß???a ?|taverna|[01_16]
31|de µ?? ?e?...|sig mig engang. (egl "du fortæller mig ikke")|[01_08]
32|d?µ?s?f?? ?/?|journalist|[01_08]
33|???µa t?|mønt, småmønt|[01_08]
34|??p??a ?|pige|[01_08]
35|µa??t??a ?|elev, skoleelev (kvindelig)|[01_08]
36|µa??t?? ?|elev, skoleelev (mandlig)|[01_08]
37|µp?? t?|flaske|[01_08]
38|?p??|(konj) som, ligesom, sådan som; eftersom|[01_08]
39|p?t??? t?|glas (Både glas og flaske er intetkøn som vin. Øl er 
hunkøn)|[01_08]
40|p.?.= pa?ade??µat?? |f.eks. (for eksempel)|[01_08]
41|a???|men|[01_10]
42|a???|men|[01_10]
43|a???|men|[01_10]
44|a???|men|[01_10]
45|a???|men|[01_10]
46|a???|men|[01_10]
47|a???|men|[01_10]
48|a???|men|[01_10]

The second field should show greek words but only the letters that are 
identical in danish and greek is shown. The pure greek letters like β, γ, δ, ε, 
η etc are shown as questionmarks.
Do you want me to send you the database?

Best Regards
Lars

-Oprindelig meddelelse-
Fra: sqlite-users [mailto:sqlite-users-boun...@mailinglists.sqlite.org] På 
vegne af Rowan Worth
Sendt: 13. august 2018 03:21
Til: SQLite mailing list
Emne: Re: [sqlite] No unicode characters in sqlite3 console prg

On 12 August 2018 at 00:51, Lars Frederiksen  wrote:

> Is this an error of my windows 10 cmd prompt or is it a general problem
> that
> the sqlite3 console is not able to show unicode in the cmd-window.??
>
> No problem writing to the database and show (greek) unicode characters in
> the cmd prompt as I key them, but when I want to show the data with the SQL
> SELECT * FROM Gloser then the greek word is shown with most of its letters
> as questionmarks.
>

What version of sqlite are you using? There was significant efforts to
improve windows console unicode handling awhile back, which I think made it
in for 3.12/3.13.

If you're still seeing issues with a recent sqlite can you provide a short
example which reproduces the issue?
-Rowan
___
sqlite-users mailing list
sqlite-users@mailinglists.sqlite.org
http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users

___
sqlite-users mailing list
sqlite-users@mailinglists.sqlite.org
http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users


Re: [sqlite] No unicode characters in sqlite3 console prg

2018-08-12 Thread Rowan Worth
On 12 August 2018 at 00:51, Lars Frederiksen  wrote:

> Is this an error of my windows 10 cmd prompt or is it a general problem
> that
> the sqlite3 console is not able to show unicode in the cmd-window.??
>
> No problem writing to the database and show (greek) unicode characters in
> the cmd prompt as I key them, but when I want to show the data with the SQL
> SELECT * FROM Gloser then the greek word is shown with most of its letters
> as questionmarks.
>

What version of sqlite are you using? There was significant efforts to
improve windows console unicode handling awhile back, which I think made it
in for 3.12/3.13.

If you're still seeing issues with a recent sqlite can you provide a short
example which reproduces the issue?
-Rowan
___
sqlite-users mailing list
sqlite-users@mailinglists.sqlite.org
http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users


Re: [sqlite] No unicode characters in sqlite3 console prg

2018-08-11 Thread Simon Slavin
On 11 Aug 2018, at 5:51pm, Lars Frederiksen  wrote:

> Is this an error of my windows 10 cmd prompt or is it a general problem that
> the sqlite3 console is not able to show unicode in the cmd-window.??

It's a Windows thing.  But I don't know how to fix it in Windows 10.  Does 
Windows 10 still use code pages in the Console ?

Try executing this command at the Console prompt before doing stuff with 
sqlite3:

chcp 65001

Does this make things work properly ?  If not, I would google the following 
string:

"windows 10" "code page" console

Simon.
___
sqlite-users mailing list
sqlite-users@mailinglists.sqlite.org
http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users


Re: [sqlite] No unicode characters in sqlite3 console prg

2018-08-11 Thread Tim Streater
On 11 Aug 2018, at 17:51, Lars Frederiksen  wrote:

> Is this an error of my windows 10 cmd prompt or is it a general problem that
> the sqlite3 console is not able to show unicode in the cmd-window.??
>
> No problem writing to the database and show (greek) unicode characters in
> the cmd prompt as I key them, but when I want to show the data with the SQL
> SELECT * FROM Gloser then the greek word is shown with most of its letters
> as questionmarks.

Using macOS Mavericks (10.9.5):

SQLite version 3.14.0 2016-08-08 13:40:27
Enter ".help" for usage hints.
Connected to a transient in-memory database.
Use ".open FILENAME" to reopen on a persistent database.
sqlite> create table x (q text);
sqlite> insert into x values ('∑ß∂π');
sqlite> select * from x;
q 
--
∑ß∂π


Seems to work.



-- 
Cheers  --  Tim
___
sqlite-users mailing list
sqlite-users@mailinglists.sqlite.org
http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users


[sqlite] No unicode characters in sqlite3 console prg

2018-08-11 Thread Lars Frederiksen
Hello,

 

Is this an error of my windows 10 cmd prompt or is it a general problem that
the sqlite3 console is not able to show unicode in the cmd-window.??

No problem writing to the database and show (greek) unicode characters in
the cmd prompt as I key them, but when I want to show the data with the SQL
SELECT * FROM Gloser then the greek word is shown with most of its letters
as questionmarks.

It is not necessarily a problem as in my dbgrid of my program the unicode is
shown correctly. I am just curious!

 

Best Regards Lars

 

___
sqlite-users mailing list
sqlite-users@mailinglists.sqlite.org
http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users