[issue13441] TestEnUSCollation.test_strxfrm() fails on Solaris

2011-12-08 Thread Stefan Krah

Changes by Stefan Krah stefan-use...@bytereef.org:


--
nosy: +skrah

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue13441
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue5689] Support xz compression in tarfile module

2011-12-08 Thread Lars Gustäbel

Lars Gustäbel l...@gustaebel.de added the comment:

For those who want to test it first, I post the current state of the patch 
here. It is ready for commit, there are no failing tests. If nobody objects, I 
will apply it this weekend.

--
Added file: http://bugs.python.org/file23880/2011-12-08-tarfile-lzma.diff

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue5689
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue5689] Support xz compression in tarfile module

2011-12-08 Thread STINNER Victor

STINNER Victor victor.stin...@haypocalc.com added the comment:

Some comments about 2011-12-08-tarfile-lzma.diff:

 elif self.buf.startswith(b\x5d\x00\x00\x80) or self.buf.startswith(b...

Micro-optimization: you can use self.buf.startswith((b\x5d\x00\x00\x80, 
b\xfd7zXZ)) here.

 raise ValueError(mode must be 'r' or 'w'.)

Error messages usually don't end with a dot (or am I wrong?).

It would be better to use a skip instead of just return here:

def test_no_name_argument(self):
  if self.mode.endswith(bz2) or self.mode.endswith(xz):
# BZ2File and LZMAFile have no name attribute.
return

In _Stream.__init__, for zlib:

 self.exception = zlib.error

Could you add a test for this change?

--
nosy: +haypo

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue5689
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue13441] TestEnUSCollation.test_strxfrm() fails on Solaris

2011-12-08 Thread STINNER Victor

STINNER Victor victor.stin...@haypocalc.com added the comment:

See also the issue #7442.

--

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue13441
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue7136] Idle File Menu Option Improvement

2011-12-08 Thread maniram maniram

maniram maniram maniandra...@gmail.com added the comment:

+1 on renaming New Window to New File

--
nosy: +maniram.maniram

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue7136
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue5905] strptime fails in non-UTF locale

2011-12-08 Thread STINNER Victor

STINNER Victor victor.stin...@haypocalc.com added the comment:

Oh! I think that I understood the problem: if HAVE_WCSFTIME is not defined, 
timemodule.c uses strftime(), instead of wcsftime(), encode input format and 
decode the format. It uses UTF-8 to encode/decode, whereas the right encoding 
is the locale encoding. Attached patch should fix this issue.

@Antoine: Do you have any idea why HAVE_WCSFTIME was not defined?

wcsftime() is defined in wchar.h on Ubuntu. In configure, it is tested using 
AC_CHECK_FUNCS(wcsftime)

--
components: +Unicode
keywords: +patch
resolution: invalid - 
status: closed - open
Added file: http://bugs.python.org/file23881/tzname_encoding.patch

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue5905
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue1062] nice to have a way to tell if a socket is bound

2011-12-08 Thread maniram maniram

maniram maniram maniandra...@gmail.com added the comment:

perhaps you can subclass socket.socket and make a function wrapper around bind 
and connect that sets a variable if called
like:
class sock(socket.socket):
def bind(self,*args):
self.is_bound = True

--
nosy: +maniram.maniram

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue1062
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue1062] nice to have a way to tell if a socket is bound

2011-12-08 Thread maniram maniram

maniram maniram maniandra...@gmail.com added the comment:

oops should be
class sock(socket.socket):
_bind = socket.socket.bind
def bind(self,*args):
self.is_bound = True
self._bind(self,*args)

--

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue1062
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue13555] cPickle MemoryError when loading large file (while pickle works)

2011-12-08 Thread Phillies

New submission from Phillies p...@bethgelab.org:

When I try to load a large file (1GB) cPickle crashes with a MemoryError:
$python test.py
Traceback (most recent call last):
  File /tmp/test.py, line 8, in module
A2 = cPickle.load(f2)
MemoryError

test.py contains following code:
import numpy as np
import cPickle
A = np.random.randn(196,24)
f = open('test.pydat', 'w')
cPickle.dump(A,f)
f.close()
f2 = open('test.pydat', 'rb')
A2 = cPickle.load(f2)

System:
cPickle 1.71
python 2.7.2
Ubuntu 11.10 amd64

Memory is not an issue as a) pickle works nicely and b) my computer has 122GB 
free RAM

--
components: None
messages: 149027
nosy: phillies
priority: normal
severity: normal
status: open
title: cPickle MemoryError when loading large file (while pickle works)
type: crash
versions: Python 2.7

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue13555
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue13555] cPickle MemoryError when loading large file (while pickle works)

2011-12-08 Thread maniram maniram

maniram maniram maniandra...@gmail.com added the comment:

Maybe Ubuntu doesn't think it is safe to allocate the memory.

--
nosy: +maniram.maniram

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue13555
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue13555] cPickle MemoryError when loading large file (while pickle works)

2011-12-08 Thread Philipp Lies

Philipp Lies p...@bethgelab.org added the comment:

Well, replace cPickle by pickle and it works. So if there is a memory 
allocation problem cPickle should be able to handle it, especially since it 
should be completely compatible to pickle.

--

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue13555
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue13546] sys.setrecursionlimit() crashes IDLE

2011-12-08 Thread Mark Dickinson

Mark Dickinson dicki...@gmail.com added the comment:

Style nit:  how about

'except ValueError as e'

instead of

'except ValueError, e'

(Actually, why do we need e?)

--
nosy: +mark.dickinson

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue13546
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue13549] Incorrect nested list comprehension documentation

2011-12-08 Thread Mark Dickinson

Mark Dickinson dicki...@gmail.com added the comment:

Isn't the documentation that you refer to about *nested* list comprehensions, 
rather than list comprehensions with multiple 'for' clauses?

E.g.,:

[number for row in matrix for number in row]

is not a nested list comprehension:  it's merely a list comprehension with two 
'for' clauses.  But:

[[number for number in row] for row in matrix]

*is* a nested list comprehension (a list comprehension for which the initial 
expression is itself a list comprehension), and there the advice to read from 
right to left seems to make sense to me.

--
nosy: +mark.dickinson

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue13549
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue13549] Incorrect nested list comprehension documentation

2011-12-08 Thread Mark Dickinson

Mark Dickinson dicki...@gmail.com added the comment:

Mind you, I'm not at all sure about that use of 'apprehension'...

--

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue13549
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue13441] TestEnUSCollation.test_strxfrm() fails on Solaris

2011-12-08 Thread Stefan Krah

Stefan Krah stefan-use...@bytereef.org added the comment:

localeconv_wchar.c runs fine on Ubuntu with hu_HU and fi_FI.

I tried on OpenSolaris, but I only have UTF-8 locales. The package
with ISO locales seems to be SUNWlang-cs-extra, but Oracle took down
http://pkg.opensolaris.org/release/ .

--

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue13441
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue13555] cPickle MemoryError when loading large file (while pickle works)

2011-12-08 Thread maniram maniram

maniram maniram maniandra...@gmail.com added the comment:

Have you checked the system monitor after all cPickle can use more memory than 
1GB.

--

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue13555
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue13555] cPickle MemoryError when loading large file (while pickle works)

2011-12-08 Thread Antoine Pitrou

Antoine Pitrou pit...@free.fr added the comment:

Is there a way to reproduce that doesn't involve numpy?

--
components: +Extension Modules -None
nosy: +pitrou

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue13555
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue13555] cPickle MemoryError when loading large file (while pickle works)

2011-12-08 Thread Antoine Pitrou

Changes by Antoine Pitrou pit...@free.fr:


--
nosy: +mark.dickinson

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue13555
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue13549] Incorrect nested list comprehension documentation

2011-12-08 Thread Ezio Melotti

Ezio Melotti ezio.melo...@gmail.com added the comment:

This section could be clearer imho.
First of all there's nothing special about nested list comprehensions.  In 
[expr for elem in seq], expr might be any expression -- including a listcomp.  
As with any other expression, the nested listcomp will be executed for each 
elem in seq, so there's really nothing new to explain here.
The reading order is always from left to right, with the expression at the 
end:
[expr for x in seq1 for y in seq2 for z in seq3]
  ^ ^ ^
 last firstsecond third...

So I agree that To avoid apprehension when nesting list comprehensions, read 
from right to left. is a bit confusing/wrongish (is actually correct for 
listcomp with only a single for, but that's just a coincidence and it's not 
related to nested listcomps).

The previous section could also be a little clearer, showing the classic 
example:
squares = [x**2 for x in range(10)]
and saying that it's equivalent to
squares = []
for x in range(10):
squares.append(x**2)

and, similarly, that
combs = [(c1, c2) for c1 in 'abc' for c2 in 'xyz']
is equivalent to
combs = []
for c1 in 'abc':
for c2 in 'xyz':
combs.append((c1, c2))

Showing the reading direction with these two equivalents and saying that 
nested listcomps follow the same rule (because there's nothing different about 
them), should be enough to make things clear.

In addition, the example with the matrix shouldn't use print in the expanded 
version, but rather something like:
res = []
for i in [0, 1, 2]:
res.append([row[i] for row in mat])
print res

--
nosy: +ezio.melotti
stage:  - needs patch
versions: +Python 3.2, Python 3.3 -Python 2.6

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue13549
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue13546] sys.setrecursionlimit() crashes IDLE

2011-12-08 Thread Amaury Forgeot d'Arc

Amaury Forgeot d'Arc amaur...@gmail.com added the comment:

'e' is used in the comment above: isinstance(e, ValueError) used to fail...
I agree to use the modern 'as' syntax.

--

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue13546
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue5905] strptime fails in non-UTF locale

2011-12-08 Thread Antoine Pitrou

Antoine Pitrou pit...@free.fr added the comment:

Well, it seems defined here:

$ grep HAVE_WCSFTIME pyconfig.h
1071:#define HAVE_WCSFTIME 1

 Attached patch should fix this issue.

I'm sorry, I can't test the patch, because my Linux distro (Mageia) doesn't 
have the fr_FR.ISO8859-15 locale anymore :-(

--

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue5905
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue13549] Incorrect nested list comprehension documentation

2011-12-08 Thread Ezio Melotti

Changes by Ezio Melotti ezio.melo...@gmail.com:


--
assignee: docs@python - ezio.melotti
keywords: +patch
nosy: +eric.araujo, terry.reedy
stage: needs patch - commit review
Added file: http://bugs.python.org/file23882/issue13549.diff

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue13549
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue13549] Incorrect nested list comprehension documentation

2011-12-08 Thread Éric Araujo

Éric Araujo mer...@netwok.org added the comment:

I welcome improvements to this part of the docs.  Nested list comps had me 
quite confused at first: I had to write and execute them to understand how it 
worked.  So, the patch looks good to me.  Remarks:

- I’d recommend a few whitespace beautifications, like in ``for x in [1,2,3]`` 
and ``range(1,6)``.

- You changed “If the expression would evaluate to a tuple, it must be 
parenthesized” to “If the expression is a tuple (e.g. the ``(x, y)`` +in this 
example), it must be parenthesized”, I guess because either the concept that an 
expression evaluates to something is (a) incorrect or (b) not appropriate at 
this stage of the tutorial.  I think there is an example that makes that line 
more understandable, but it’s in the section about tuples, not here in the 
listcomp section; you may or may not want to improve that too.

- +1 for the removal of the half-joking half-recommendation not to use nested 
list comps (“If you've got the stomach for it, list comprehensions can be 
nested. They are a powerful tool but -- like all powerful tools -- they need to 
be used carefully, if at all.”).

- Maybe a link to the itertools module is appropriate (either after the 
combinations example, or after the link to the built-in zip function).

--

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue13549
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue5689] Support xz compression in tarfile module

2011-12-08 Thread Éric Araujo

Éric Araujo mer...@netwok.org added the comment:

Patch looks great.  I did a review on Rietveld.

--

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue5689
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue6715] xz compressor support

2011-12-08 Thread Éric Araujo

Éric Araujo mer...@netwok.org added the comment:

I’ll commit my doc patch to all branches later.

I checked the 4 red 3.3 builbots and they can’t build _lzma.

--

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue6715
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue1757072] Zipfile robustness

2011-12-08 Thread James C. Ahlstrom

James C. Ahlstrom ahlstro...@users.sourceforge.net added the comment:

I received a bug report from a user.  He had a zip file created by Mac OS 
10.5.8 that the zipfile module claimed was not a valid zip file.  The traceback 
went to function _EndRecData(fpin).  The file had a valid comment appended, but 
recorded a comment length of zero.  I am posting to this thread because it 
seems related.

The zero comment length is incorrect, but the file is read without complaint by 
other software.  Note that this is not end of file garbage; the comment is 
valid.

The _EndRecData(fpin) function is reading the End of Central Directory 
record.  The endrec[7] is the comment length, but of more interest is endrec[6] 
which is the start of the Central Directory.  This is a file offset, and if 
valid it points to a Central Directory record.  These records start with a 
known string PK\001\002.

I propose that the correct fix is to delete the test for correct comment 
length, and replace it with a test that reads four bytes at offset endrec[6] 
and makes sure it is PK\001\002 and a valid record.  This is viewed not as a 
hack for defective software, but rather as an improved sanity check, since 
finding the Central Directory is vital to reading a zip file.  This code 
replaces the end of _EndRecData(fpin), and was taken from Python2.5 (so check 
against the relevant version):

if start = 0: # Correct signature string was found
endrec = struct.unpack(structEndArchive, data[start:start+22])
endrec = list(endrec)
comment = data[start+22:]

## Relevant changes here
fpin.seek(endrec[6], 0) # Seek to the start of the central 
directory
dat = fpin.read(4)  # Read four bytes
# Note: Mac OS is known to add a comment, but record the length as zero.
if dat == stringCentralDir: # Success
##
# Append the archive comment and start offset
endrec.append(comment)
endrec.append(filesize - END_BLOCK + start)
if endrec[-4] == -1 or endrec[-4] == 0x:
return _EndRecData64(fpin, - END_BLOCK + start, endrec)
return endrec
return  # Error, return None

--
nosy: +ahlstromjc

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue1757072
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue13549] Incorrect nested list comprehension documentation

2011-12-08 Thread Ezio Melotti

Ezio Melotti ezio.melo...@gmail.com added the comment:

 - I’d recommend a few whitespace beautifications,
 like in ``for x in [1,2,3]`` and ``range(1,6)``.
Leaving the space out in [1,2,3] makes the expression a bit more readable IMHO*.


  I think there is an example that makes that line more
 understandable, but it’s in the section about tuples, not here in the 
 listcomp section; you may or may not want to improve that too.
What needs to be parenthesized are tuple literals, and I think people at this 
point of the tutorial still think that () are required to make a tuple, so they 
would probably put them anyway.  IOW the example that uses them, the note, and 
the example that fails are probably enough already.

 - Maybe a link to the itertools module is appropriate (either after 
 the combinations example, or after the link to the built-in zip 
 function).
I was going to add it, but then realized that itertools' functions don't return 
lists, so they are a bit unrelated (and maybe it's too early to introduce 
itertools at this point of the tutorial).


* the idea is to separate better different elements, even if the single 
elements are a bit less readable:
2 * 3  is ok (you are multiplying two numbers)
2*3 + 4*5  is ok (you are adding two products)
2 * 3 + 4 * 5  is less readable (you have to parse the operations)
2 * 3+4 * 5is misleading (it looks like the product of 3 numbers)
Similarly:
[(1,2,3), (3,4,5), (5,6,7)]  is ok (you have a list with 3 tuples)
[(1, 2, 3), (3, 4, 5), (5, 6, 7)]  is less readable (the space are used to 
separate both the tuples and the elements in there, and you have to parse the 
() to see where the tuples start and end).
YMMV though.

--

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue13549
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue1757072] Zipfile robustness

2011-12-08 Thread R. David Murray

R. David Murray rdmur...@bitdance.com added the comment:

I'm pretty sure that what you are reporting has been fixed by the 'garbage' fix 
I mentioned (which might better be called the 'more flexible handling of 
comments' patch).  Though not in 2.5 (or 2.6) since they are no longer in 
maintenance.  If you could confirm this by testing against 2.7 or 3.2, that 
would be great.

--

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue1757072
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue13511] ./configure --includedir, --libdir accept multiple

2011-12-08 Thread Ray

Ray rpq...@hotmail.com added the comment:

Compiling using the includedir/libdir flags with colon as separators for the 
multiple directories got me an error after performing 'make':

Makefile:782: *** target pattern contains no `%'.  Stop.

Additionally, I would like to emphasize the fact that I could not find another 
way to specify multiple lib and include directories when compiling Python 2.7 
on Linux using the current setup.py.

--

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue13511
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue13556] When tzinfo.utcoffset is out-of-bounds, the exception message is misleading

2011-12-08 Thread Jean-Paul Calderone

New submission from Jean-Paul Calderone invalid@example.invalid:

When a timezone produces an out-of-bounds utc offset, the resulting exception 
always claims that the offset was 1440, rather than whatever it was.  Example:

from datetime import timedelta, datetime, tzinfo

class X(tzinfo):
def utcoffset(self, time):
return timedelta(days=2)

datetime.now(tz=X())

--
components: Library (Lib)
messages: 149046
nosy: exarkun
priority: normal
severity: normal
status: open
title: When tzinfo.utcoffset is out-of-bounds, the exception message is 
misleading
type: behavior
versions: Python 2.7

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue13556
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue6715] xz compressor support

2011-12-08 Thread Nadeem Vawda

Nadeem Vawda nadeem.va...@gmail.com added the comment:

 I’ll commit my doc patch to all branches later.

OK, great.

 I checked the 4 red 3.3 builbots and they can’t build _lzma.

For the record, the 3.x buildbots that currently aren't able to build the
_lzma module are:

* x86 Ubuntu Shared
* sparc solaris10 gcc
* AMD64 Snow Leopard 2
* x86 debian parallel
* ARM Ubuntu
* x86 Tiger
* AMD64 OpenIndiana
* x86 OpenIndiana
* x86 FreeBSD 7.2
* x86 FreeBSD 6.4

Additionally, the AMD64 debian bigmem, PPC Tiger and PPC Leopard builders
have been offline/broken since before changeset 74d182cf0187 was committed.

--

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue6715
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue6715] xz compressor support

2011-12-08 Thread Antoine Pitrou

Antoine Pitrou pit...@free.fr added the comment:

Le jeudi 08 décembre 2011 à 17:40 +, Nadeem Vawda a écrit :
 Nadeem Vawda nadeem.va...@gmail.com added the comment:
 
  I’ll commit my doc patch to all branches later.
 
 OK, great.
 
  I checked the 4 red 3.3 builbots and they can’t build _lzma.
 
 For the record, the 3.x buildbots that currently aren't able to build the
 _lzma module are:

Ok, I've e-mailed the owners.

Will someone write an entry in the what's new file for 3.3?
(Doc/whatsnew/3.3.rst)

Regards

Antoine.

--

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue6715
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue13555] cPickle MemoryError when loading large file (while pickle works)

2011-12-08 Thread Charles-François Natali

Charles-François Natali neolo...@free.fr added the comment:

 my computer has 122GB free RAM

122, or 1.22?

 Well, replace cPickle by pickle and it works.

cPickle makes some direct call to malloc()/realloc()/free(), contrarily to 
pickle which uses pymalloc. This could lead to heap fragmentation.

What does the following return ?
$ /usr/bin/time -v python test.py

--
nosy: +neologix

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue13555
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue13557] exec of list comprehension fails on NameError

2011-12-08 Thread Stephan R.A. Deibel

New submission from Stephan R.A. Deibel sdei...@wingware.com:

Calling exec() on code that includes a list comprehension that references a 
defined local variable x fails incorrectly on NameError: global name 'x' not 
defined.

--
files: execlistcomp.py
messages: 149050
nosy: sdeibel
priority: normal
severity: normal
status: open
title: exec of list comprehension fails on NameError
type: behavior
versions: Python 3.2
Added file: http://bugs.python.org/file23883/execlistcomp.py

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue13557
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue13558] multiprocessing package incompatible with PyObjC

2011-12-08 Thread Trevor Bentley

New submission from Trevor Bentley mrme...@gmail.com:

The multiprocessing package appears to spawn a new process by calling only 
fork().  Apple's CoreFoundation libraries (and possibly more, I do not know the 
full extent) *require* new processes to be spawned with the full fork()+exec*() 
combo.

When using PyObjC to access native Mac libraries, Python's multithreading 
library is not usable.  The error thrown is:


The process has forked and you cannot use this CoreFoundation functionality 
safely. You MUST exec().
Break on 
__THE_PROCESS_HAS_FORKED_AND_YOU_CANNOT_USE_THIS_COREFOUNDATION_FUNCTIONALITY___YOU_MUST_EXEC__()
 to debug.


Test code: https://gist.github.com/1448398

--
assignee: ronaldoussoren
components: Macintosh
files: threadtest3.py
messages: 149051
nosy: mrmekon, ronaldoussoren
priority: normal
severity: normal
status: open
title: multiprocessing package incompatible with PyObjC
type: behavior
versions: Python 2.7
Added file: http://bugs.python.org/file23884/threadtest3.py

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue13558
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue13558] multiprocessing package incompatible with PyObjC

2011-12-08 Thread Antoine Pitrou

Changes by Antoine Pitrou pit...@free.fr:


--
nosy: +ned.deily
versions: +Python 3.2, Python 3.3

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue13558
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue13559] Use sendfile where possible in httplib

2011-12-08 Thread Benjamin Peterson

New submission from Benjamin Peterson benja...@python.org:

HTTPConnection.send() should use os.sendfile when possible to avoid copying 
data into userspace and back.

--
components: Library (Lib)
keywords: easy
messages: 149052
nosy: benjamin.peterson
priority: normal
severity: normal
stage: needs patch
status: open
title: Use sendfile where possible in httplib
type: feature request
versions: Python 3.3

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue13559
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue13559] Use sendfile where possible in httplib

2011-12-08 Thread Antoine Pitrou

Changes by Antoine Pitrou pit...@free.fr:


--
nosy: +giampaolo.rodola, orsenthil

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue13559
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue13558] multiprocessing package incompatible with PyObjC

2011-12-08 Thread Ned Deily

Ned Deily n...@acm.org added the comment:

(Reference original discussion in pyobjc-dev mailing list archived here:  
http://comments.gmane.org/gmane.comp.python.pyobjc.devel/5965)

--

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue13558
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue13405] Add DTrace probes

2011-12-08 Thread Stan Cox

Stan Cox s...@redhat.com added the comment:

The patch works for systemtap except for one minor nit.  pydtrace.h, created by 
stap from pydtrace.d, is stap specific.  Could pydtrace.h not be included in 
srcdir/Include so that it is always created at build time in 
blddir/Include?   If PyEval_GetFrame() were passed via function__entry then 
stap would be able to do something akin to what the ustack helper phelper.d is 
doing.

--
nosy: +scox

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue13405
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue11149] [PATCH] Configure should enable -fwrapv for clang

2011-12-08 Thread Roundup Robot

Roundup Robot devn...@psf.upfronthosting.co.za added the comment:

New changeset 7efad6256e58 by Stefan Krah in branch '3.2':
Issue #11149: Also enable -fwrapv if $CC is a full path
http://hg.python.org/cpython/rev/7efad6256e58

New changeset e48df59af394 by Stefan Krah in branch 'default':
Merge second fix for issue #11149.
http://hg.python.org/cpython/rev/e48df59af394

New changeset 9d329adbbb01 by Stefan Krah in branch '2.7':
Backport second fix for issue #11149.
http://hg.python.org/cpython/rev/9d329adbbb01

--

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue11149
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue13549] Incorrect nested list comprehension documentation

2011-12-08 Thread Terry J. Reedy

Terry J. Reedy tjre...@udel.edu added the comment:

Comments:

1. The first sentence is a bit too opinionated for my taste. Consider:

map(f, seq)
[f(x) for x in seq]

The map is *more* concise, by 8 chars, than the list comp and, in *my* opinion, 
clearer and easier to read without the extra boilerplate and extraneous dummy 
variable. I would write the first sentence more like:

List comprehensions provide a concise way to create lists without having to 
use either a blank list followed by list.append or combinations of map, filter, 
and lambda expressions.

2. The added examples are nice and should help.

3. In a list comprehension might contain arbitrary expressions, including 
other listcomps. is not a sentence. I think this in meant to say: The initial 
expression in a list comprehension can be any arbitrary expression, including 
another list comprehension.

4. I completely agree with removing the scary hobgoblin stuff. In fact, I think 
the platitudinous next sentence Nested list comprehensions are a powerful tool 
but -- like all powerful tools -- they need to be used carefully, if at all. 
could also go. It does not add anything not better said in what follows. Python 
is a powerful tool, but -- like all powerful tools -- it needs to by used 
carefully. Yeah, right ;-).

I believe the later sentence To avoid apprehension when nesting list 
comprehensions, read from right to left. means to say To avoid 
mis-apprehandion [or misunderstanding] when nesting list comprehension, read 
from outside in. But even this only indirectly points to what I think is the 
real danger -- which is to read the nested l.c. as unnested, and hence to get 
the order of the clauses wrong. In other words, reading
   [[f(x,y) for x in xseq] for y in yseq]
as
   [ f(x,y) for x in xseq  for y in yseq]
I initally made that mistake when reading the nested example. So I think the 
appropriate warning sentence should be something like:
The main danger to avoid is reading nested comprehensions as if they were one 
comprehension with multiple for clauses. This could go after the revised 
initial sentence in place of the useless platitude.

4. The example is more confusing than need be because of using a symmetric 
matrix. The literal [0,1,2] is both range(len(mat)) and range(len(mat[0])) but 
it is only the latter that is relevant. So I strongly urge using an asymmetric 
matrix (3x4) and suggest using range(4) instead of [0,1,2,3]

So, change Consider the following example of a 3x3 matrix held as a list 
containing three lists, one list per row:: to
Suppose one has a 3x4 matrix implemented as a list of 3 lists of length 4::

Change mat display accordingly, using 1 to 12.

Change Now, if you wanted to swap rows and columns, you could use this list 
comprehension:: to
The following list comprehension will transpose rows and columns.
 [[row[i] for row in mat] for i in range(4)]
[[1, 5, 9], [2, 6, 10], [3, 7, 11], [4, 8, 12]]

I think the more verbose version (slightly modified to match the below) should 
be followed by an even more (completely) verbose version:

trans = []
for i in range(4):
transrow = []
for row in mat:
transrow.append(row[i])
trans.append(transrow)
print(trans)

5. In real world, should be In the real world,.

--

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue13549
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue13547] Clean Lib/_sysconfigdata.py and Modules/_testembed

2011-12-08 Thread Roundup Robot

Roundup Robot devn...@psf.upfronthosting.co.za added the comment:

New changeset 8ed2c4d4df62 by Stefan Krah in branch '3.2':
Issue #13547: clean Lib/_sysconfigdata.py and Modules/_testembed
http://hg.python.org/cpython/rev/8ed2c4d4df62

New changeset 053c95ad09cf by Stefan Krah in branch 'default':
Merge fix for issue #13547.
http://hg.python.org/cpython/rev/053c95ad09cf

--
nosy: +python-dev

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue13547
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue13441] TestEnUSCollation.test_strxfrm() fails on Solaris

2011-12-08 Thread Roundup Robot

Roundup Robot devn...@psf.upfronthosting.co.za added the comment:

New changeset 93bab8400ca5 by Victor Stinner in branch 'default':
Issue #13441: Log the locale when localeconv() fails
http://hg.python.org/cpython/rev/93bab8400ca5

--

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue13441
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue13441] TestEnUSCollation.test_strxfrm() fails on Solaris

2011-12-08 Thread STINNER Victor

STINNER Victor victor.stin...@haypocalc.com added the comment:

Changeset 489ea02ed351 changed PyUnicode_FromWideChar() and 
PyUnicode_FromUnicode(): raise a ValueError if a character in not in range 
[U+; U+10].

test__locale errors:

==
ERROR: test_float_parsing (test.test__locale._LocaleTests)
--
Traceback (most recent call last):
  File /home2/buildbot/slave/3.x.loewis-sun/build/Lib/test/test__locale.py, 
line 134, in test_float_parsing
if localeconv()['decimal_point'] != '.':
ValueError: character U+3020 is not in range [U+; U+10]

==
ERROR: test_lc_numeric_basic (test.test__locale._LocaleTests)
--
Traceback (most recent call last):
  File /home2/buildbot/slave/3.x.loewis-sun/build/Lib/test/test__locale.py, 
line 105, in test_lc_numeric_basic
li_radixchar = localeconv()[lc]
ValueError: character U+3020 is not in range [U+; U+10]

==
ERROR: test_lc_numeric_localeconv (test.test__locale._LocaleTests)
--
Traceback (most recent call last):
  File /home2/buildbot/slave/3.x.loewis-sun/build/Lib/test/test__locale.py, 
line 91, in test_lc_numeric_localeconv
self.numeric_tester('localeconv', localeconv()[lc], lc, loc)
ValueError: character U+3020 is not in range [U+; U+10]

==
ERROR: test_lc_numeric_nl_langinfo (test.test__locale._LocaleTests)
--
Traceback (most recent call last):
  File /home2/buildbot/slave/3.x.loewis-sun/build/Lib/test/test__locale.py, 
line 79, in test_lc_numeric_nl_langinfo
self.numeric_tester('nl_langinfo', nl_langinfo(li), lc, loc)
ValueError: character U+3020 is not in range [U+; U+10]

--

If the issue is specific to the hu_HU locale, a possible workaround is to skip 
this locale on Solaris. I changed to test to display the locale on failure.

--

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue13441
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue13549] Incorrect nested list comprehension documentation

2011-12-08 Thread Ezio Melotti

Changes by Ezio Melotti ezio.melo...@gmail.com:


Added file: http://bugs.python.org/file23885/issue13549-2.diff

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue13549
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue13560] Add PyUnicode_DecodeLocale and PyUnicode_DecodeLocaleAndSize

2011-12-08 Thread STINNER Victor

New submission from STINNER Victor victor.stin...@haypocalc.com:

To decode byte string from the locale encoding (LC_CTYPE), 
PyUnicode_DecodeFSDefault() can be used, but this function uses a constant 
encoding set at startup (the locale encoding at startup). The right method is 
currently to call _Py_char2wchar() and then PyUnicode_FromWideChar(). 
_Py_char2wchar() is a low level function, it doesn't raise nice Python 
exception, but just return NULL on error and write a message to stderr using 
fprintf() (!).

Attached patch adds PyUnicode_DecodeLocale() and 
PyUnicode_DecodeLocaleAndSize() to offer a high level API to decode data from 
the *current* locale encoding. These functions fail with an OSError  or 
MemoryError if decoding fails (instead of a generic ValueError), and don't 
write to stderr anymore. They are a surrogateescape argument to choose to 
escape undecodable bytes or to fail with an error.

The patch only uses the function in _localemodule.c, but other functions may 
have to be fixed to use the new function. The tzname_encoding.patch of issue 
#5905 should maybe use it for example.

--
components: Unicode
messages: 149060
nosy: ezio.melotti, haypo, loewis
priority: normal
severity: normal
status: open
title: Add PyUnicode_DecodeLocale and PyUnicode_DecodeLocaleAndSize
versions: Python 3.3

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue13560
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue13560] Add PyUnicode_DecodeLocale and PyUnicode_DecodeLocaleAndSize

2011-12-08 Thread STINNER Victor

Changes by STINNER Victor victor.stin...@haypocalc.com:


--
keywords: +patch
Added file: http://bugs.python.org/file23886/pyunicode_decodelocale.patch

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue13560
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue13543] shlex with string ending in space gives ValueError: No closing quotation

2011-12-08 Thread ekorn

ekorn jono...@gmail.com added the comment:

FYI, Min RK commented on the IPython issue:
https://github.com/ipython/ipython/issues/1109#issuecomment-3071470

In short, 
shlex.shlex('blob f( )', posix=False)
fails, whereas 
shlex.shlex('blob f(  )', posix=False)

The problem appears to be that Python source obviously doesn't sit well with 
non-posix whitespace-split shlex. [...] if you lead all your open-quotes with 
whitespace, you should be fine (works for all given examples, at least). [...] 
I have no idea whether this is a Python bug or not, since I don't know what the 
reference standard is, but this is definitely an IPython bug.  We should not be 
trying to use shlex to parse Python code as if it were command-line arguments.

--

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue13543
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue6715] xz compressor support

2011-12-08 Thread Roundup Robot

Roundup Robot devn...@psf.upfronthosting.co.za added the comment:

New changeset 66df5ace0eee by Nadeem Vawda in branch 'default':
What's New in Python 3.3: Add entry for lzma module (issue #6715).
http://hg.python.org/cpython/rev/66df5ace0eee

--

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue6715
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue6715] xz compressor support

2011-12-08 Thread Nadeem Vawda

Nadeem Vawda nadeem.va...@gmail.com added the comment:

 Ok, I've e-mailed the owners.

Thanks. I was just thinking I should send a reminder, in case they
missed the note in my announcement on python-dev.

 Will someone write an entry in the what's new file for 3.3?

Done

--

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue6715
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue13441] TestEnUSCollation.test_strxfrm() fails on Solaris

2011-12-08 Thread Roundup Robot

Roundup Robot devn...@psf.upfronthosting.co.za added the comment:

New changeset 87c6be1e393a by Victor Stinner in branch 'default':
Issue #13441: Don't test the hu_HU locale on Solaris to workaround a mbstowcs()
http://hg.python.org/cpython/rev/87c6be1e393a

--

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue13441
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue8515] idle Run Module (F5) does not set __file__ variable

2011-12-08 Thread Roger Serwy

Roger Serwy roger.se...@gmail.com added the comment:

I've encountered this bug several times myself. I applied this patch and it 
corrects the issue.

--
nosy: +serwy
versions: +Python 2.7, Python 3.2, Python 3.3 -Python 2.6

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue8515
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue13549] Incorrect nested list comprehension documentation

2011-12-08 Thread Terry J. Reedy

Terry J. Reedy tjre...@udel.edu added the comment:

v.2 looks great to me.

--

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue13549
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue4691] IDLE Code Caching Windows

2011-12-08 Thread Roger Serwy

Roger Serwy roger.se...@gmail.com added the comment:

Given Amaury's last message, should this issue be closed as being resolved?

--
nosy: +serwy

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue4691
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue7676] IDLE shell shouldn't use TABs

2011-12-08 Thread Roger Serwy

Roger Serwy roger.se...@gmail.com added the comment:

Here's a simple patch to fix this bug.

The   prompt causes the first level of indented code to use 8 spaces. 
Further indented code should use 4 spaces, but still uses 8 spaces likely due 
to the bug described in #8285.

--
keywords: +patch
nosy: +serwy
versions: +Python 3.3
Added file: http://bugs.python.org/file23887/issue7676.patch

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue7676
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue6321] Reload Python modules when running programs

2011-12-08 Thread Roger Serwy

Roger Serwy roger.se...@gmail.com added the comment:

Should this issue be closed? It is related to #4691.

--
nosy: +serwy

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue6321
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue13561] os.listdir documentation should mention surrogateescape

2011-12-08 Thread Michael Foord

New submission from Michael Foord mich...@voidspace.org.uk:

Where os.listdir encounters undecodable bytes from the filesystem it uses the 
surrogateescape handler. As the resulting strings are invalid they can't be 
encoded without an errorhandler, and so can't be printed (for example).

This should be documented.

--
assignee: docs@python
components: Documentation
messages: 149070
nosy: docs@python, michael.foord
priority: normal
severity: normal
stage: needs patch
status: open
title: os.listdir documentation should mention surrogateescape
versions: Python 3.3

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue13561
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue13562] Notes about module load path

2011-12-08 Thread Nam Nguyen

New submission from Nam Nguyen bits...@gmail.com:

A doc patch to remind Python embedder to set sys.path prior to Py_Initialize. 
This is to ensure a controlled module load path to work around these issues:

http://bugs.python.org/issue12989
http://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2008-5983

--
assignee: docs@python
components: Documentation
files: module.load.path.diff
keywords: patch
messages: 149071
nosy: Nam.Nguyen, docs@python
priority: normal
severity: normal
status: open
title: Notes about module load path
type: feature request
versions: Python 2.6, Python 2.7, Python 3.1, Python 3.2
Added file: http://bugs.python.org/file23888/module.load.path.diff

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue13562
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue13505] Bytes objects pickled in 3.x with protocol =2 are unpickled incorrectly in 2.x

2011-12-08 Thread Alexandre Vassalotti

Alexandre Vassalotti alexan...@peadrop.com added the comment:

sbt, the bug is not that the encoding is inefficient. The problem is we cannot 
unpickle bytes streams from Python 3 using Python 2.

--

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue13505
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue13559] Use sendfile where possible in httplib

2011-12-08 Thread Giampaolo Rodola'

Giampaolo Rodola' g.rod...@gmail.com added the comment:

This is not possible for two reasons:

- on most POSIX systems, sendfile() works with mmap-like (regular) files 
only, while HTTPConnection.send() accepts any file-like object as long as it 
provides a read() method

- after read()ing a chunk of data from the file and before send()ing it over 
the socket, the data can be subject to an intermediate conversion 
(datablock.encode(iso-8859-1)):
http://hg.python.org/cpython/file/87c6be1e393a/Lib/http/client.py#l839
...whereas sendfile() can only be used to send a binary file as-is

I think we can use sendfile() in ftplib.py though .
I'll open a ticket for that.

--

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue13559
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue13563] Make use of with statement in ftplib

2011-12-08 Thread Giampaolo Rodola'

New submission from Giampaolo Rodola' g.rod...@gmail.com:

Patch in attachment.

--
files: ftplib.patch
keywords: patch
messages: 149074
nosy: giampaolo.rodola, pitrou
priority: normal
severity: normal
status: open
title: Make use of with statement in ftplib
versions: Python 3.3
Added file: http://bugs.python.org/file23889/ftplib.patch

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue13563
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue13559] Use sendfile where possible in httplib

2011-12-08 Thread Benjamin Peterson

Benjamin Peterson benja...@python.org added the comment:

2011/12/8 Giampaolo Rodola' rep...@bugs.python.org:

 Giampaolo Rodola' g.rod...@gmail.com added the comment:

 This is not possible for two reasons:

 - on most POSIX systems, sendfile() works with mmap-like (regular) files 
 only, while HTTPConnection.send() accepts any file-like object as long as it 
 provides a read() method

 - after read()ing a chunk of data from the file and before send()ing it over 
 the socket, the data can be subject to an intermediate conversion 
 (datablock.encode(iso-8859-1)):
 http://hg.python.org/cpython/file/87c6be1e393a/Lib/http/client.py#l839
 ...whereas sendfile() can only be used to send a binary file as-is

I presume you could check for a binary mode, though? Also, you can
catch EINVAl on invalid fds.

--

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue13559
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue13564] ftplib and sendfile()

2011-12-08 Thread Giampaolo Rodola'

New submission from Giampaolo Rodola' g.rod...@gmail.com:

In attachment.
This is actually just an excuse to store the patch somewhere and possibly 
collect opinions as I don't really think this should go in because:

- it's UNIX only
- as such, deciding whether using sendfile() should probably be done silently 
(no explicit argument)
- on the other hand, I don't think it's safe to decide this automatically 
because:
- the input fd should be a regular file and it's not clear how to determine 
this beforehand 
- in case of disconnection OSError is raised instead of socket.error (minor 
backward compatibility issue)

--
files: ftplib-sendfile.patch
keywords: patch
messages: 149076
nosy: giampaolo.rodola
priority: normal
severity: normal
stage: patch review
status: open
title: ftplib and sendfile()
type: feature request
versions: Python 3.3
Added file: http://bugs.python.org/file23890/ftplib-sendfile.patch

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue13564
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue13559] Use sendfile where possible in httplib

2011-12-08 Thread Giampaolo Rodola'

Giampaolo Rodola' g.rod...@gmail.com added the comment:

ftplib's sendfile support is not tracked as issue13559.
Considerations I made there should apply here as well.

--

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue13559
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue13559] Use sendfile where possible in httplib

2011-12-08 Thread Giampaolo Rodola'

Giampaolo Rodola' g.rod...@gmail.com added the comment:

Ops! I meant issue13564.

--

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue13559
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com



[issue2775] Implement PEP 3108

2011-12-08 Thread Alexandre Vassalotti

Alexandre Vassalotti alexan...@peadrop.com added the comment:

Brett, issue 2919 had a patch that merges profile/cProfile for a while now but 
nobody test it yet.

All I need it someone to download the patch, install it, test it on some random 
script and tell me if it works. I don't need more.

--

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue2775
___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com