[issue6010] unable to retrieve latin-1 encoded data from sqlite3

[Jesús Cea Avión]

Changes by Jesús Cea Avión j...@jcea.es:


--
nosy: +jcea

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue6010
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue6010] unable to retrieve latin-1 encoded data from sqlite3

[Ezio Melotti]

Ezio Melotti added the comment:

While trying to reproduce the issue I noticed this while inserting values:

import sqlite3
db = sqlite3.connect(':memory:')
cur = db.cursor()
cur.execute(create table foo (x))
# this works fine
cur.execute(uinsert into foo values ('café').encode('latin1'))
# this fails
cur.execute(uinsert into foo values (?), (u'café'.encode('latin1'),))
# this fails too
cur.execute(insert into foo values (?), (u'café'.encode('latin1'),))

The error is:
 sqlite3.ProgrammingError: You must not use 8-bit bytestrings unless you use a 
text_factory that can interpret 8-bit bytestrings (like text_factory = str). It 
is highly recommended that you instead just switch your application to Unicode 
strings.

Should this be reported in the first case too? (This would be 
backward-incompatible, but, unless it's expected to work, we can always add a 
warning.)

--
components: +Library (Lib) -None
nosy: +ezio.melotti
versions: +Python 2.7 -Python 2.5

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue6010
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue6010] unable to retrieve latin-1 encoded data from sqlite3

[Martin v. Löwis]

Martin v. Löwis mar...@v.loewis.de added the comment:

This is not a bug. By default, pysqlite decodes all strings to Unicode,
assuming UTF-8 encoding (which SQLite assumes when parsing statements).

To override this default, you need to change the connection's text_factory:

py import sqlite3
py db = sqlite3.connect(':memory:')
py db.text_factory = str
py cur = db.cursor()
py cur.execute(create table foo (x))
sqlite3.Cursor object at 0xb7cfb500
py cur.execute(insert into foo values ('café'))
sqlite3.Cursor object at 0xb7cfb500
py cur.execute(select * from foo)
sqlite3.Cursor object at 0xb7cfb500
py _.fetchall()
[('caf\xe9',)]

--
nosy: +loewis
resolution:  - invalid
status: open - closed

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue6010
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue6010] unable to retrieve latin-1 encoded data from sqlite3

[izarf]

New submission from izarf izarf.m...@gmail.com:

it is impossible to retrieve a latin-1 encoded string from sqlite3 database.

How to:
1. create a new db.
2. create a new table with text field.
3. insert a row with data like åäö

4. select all rows from table
5. write:
 for data in cursor1:
   var = data

you will now get an error explaining something like ascii couldn't decode

--
components: None
messages: 87672
nosy: izarf
severity: normal
status: open
title: unable to retrieve latin-1 encoded data from sqlite3
type: behavior
versions: Python 2.5

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue6010
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue6010] unable to retrieve latin-1 encoded data from sqlite3

[Amaury Forgeot d'Arc]

Amaury Forgeot d'Arc amaur...@gmail.com added the comment:

Confirmed here, tested with python2.6 
on Linux with sys.stding.encoding == 'ISO-8859-1'
on Windows with sys.stdin.encoding == 'cp437'

 import sqlite3
 db = sqlite3.connect(':memory:')
 cur = db.cursor()
 cur.execute(create table foo (x))
 cur.execute(insert into foo values ('café'))
 cur.execute(select * from foo)
Traceback (most recent call last):
  File stdin, line 1, in module
sqlite3.OperationalError: Could not decode to UTF-8 column 'x' with text
'café'


It seems that sqlite3 expects strings to be utf-8 encoded.
It works fine if you pass unicode strings, and with python 3.0.

--
nosy: +amaury.forgeotdarc

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue6010
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com