[issue10995] mailbox.py open() calls don't set encoding

2011-01-24 Thread Steffen Daode Nurpmeso
New submission from Steffen Daode Nurpmeso sdao...@googlemail.com: I'm using the en_GB.UTF-8 locale and thus the entire I/O layer defaults to use UTF-8 encoding. Perfect. The problem is that mailboxes are *not* and *never* in UTF-8, generally speaking, according to RFC mail standards! So i

[issue9124] Mailbox module should use binary I/O, not text I/O

2011-01-25 Thread Steffen Daode Nurpmeso
Steffen Daode Nurpmeso sdao...@googlemail.com added the comment: Re-New to Python - Re-Started with Py3K in 2011. 'Found myself in a dead-end after 10 days of work because a KOI8-R spam mail causes the file I/O decoding process to fail - and there is NO WAY TO HANDLE THIS with mailbox.py! (Went

[issue9124] Mailbox module should use binary I/O, not text I/O

2011-01-26 Thread Steffen Daode Nurpmeso
Steffen Daode Nurpmeso sdao...@googlemail.com added the comment: This message will not help anyone. And it's not a chat, but because it seems i really made the horses gone grazy (direct translation of a german proverb): - msg127002: RDM, i didn't know all of that and i am really sorry. Now I

[issue11022] locale.setlocale() doesn't change I/O codec, os.environ[] does

2011-01-27 Thread Steffen Daode Nurpmeso
New submission from Steffen Daode Nurpmeso sdao...@googlemail.com: This bug may be based on same problem as Issue 6203. - My system locale is en_GB.UTF-8. - Given a latin1 text file, open()+ will fail with 'UnicodeDecodeError: 'utf8' codec can't decode byte 0xf6...' - Using locale.setlocale

[issue11022] locale.setlocale() doesn't change I/O codec, os.environ[] does

2011-01-27 Thread Steffen Daode Nurpmeso
Changes by Steffen Daode Nurpmeso sdao...@googlemail.com: -- type: - behavior ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue11022 ___ ___ Python

[issue11022] locale.setlocale() doesn't change I/O codec, os.environ[] does

2011-01-27 Thread Steffen Daode Nurpmeso
Steffen Daode Nurpmeso sdao...@googlemail.com added the comment: Anyway, I don't know understand why do you change your locale, because you know that your file encoding is Latin1. Why don't you use directly: open(filename, encoding='latin1')? Fortunately Issue 9124 is being solved soon due

[issue9124] Mailbox module should use binary I/O, not text I/O

2011-01-28 Thread Steffen Daode Nurpmeso
Steffen Daode Nurpmeso sdao...@googlemail.com added the comment: After cloning branches/py3k (i now have three different detached repo snakes in my arena (2.7,3.1,py3k), by the way - not bad for a greenhorn, huh?). I've applied RDMs patch from msg127245. Note: the test mails are *malformed

[issue11046] darwin/MacOS X setup.py hack

2011-01-28 Thread Steffen Daode Nurpmeso
New submission from Steffen Daode Nurpmeso sdao...@googlemail.com: I always hated GNU Autoconf and M4. After cloning branches/py3k today i needed two and a half hour to build and compile a Python which includes the readline module. I'll attach a primitive setup.py patch which should better

[issue9124] Mailbox module should use binary I/O, not text I/O

2011-01-28 Thread Steffen Daode Nurpmeso
Steffen Daode Nurpmeso sdao...@googlemail.com added the comment: Indeed i tried to create tracebacks (even with import traceback), but these all end up in my code (and all the time). I have not yet figured out how to create tracebacks which leave my code and reach the source, which surely

[issue11046] darwin/MacOS X setup.py hack

2011-01-28 Thread Steffen Daode Nurpmeso
Steffen Daode Nurpmeso sdao...@googlemail.com added the comment: Ok, thanks. Mac/README is not for me, though, i'm only a simple Ex-FreeBSD user which buyed good hardware with the wrong operating system. All these mysterious frameworks and AvailabilityMacros.h really make you weird

[issue9124] Mailbox module should use binary I/O, not text I/O

2011-01-28 Thread Steffen Daode Nurpmeso
Steffen Daode Nurpmeso sdao...@googlemail.com added the comment: You're indeed right, i've overseen a try..catch! I'll even be able to give you some fast code hints now (and i'll be offline the next few hours - the mails are simply mails with illegal charsets, say): Traceback (most recent call

[issue11046] darwin/MacOS X setup.py hack

2011-01-28 Thread Steffen Daode Nurpmeso
Steffen Daode Nurpmeso sdao...@googlemail.com added the comment: Thank you, RO, exactly that very line would be great as an add-on for the mentioned file - and (better: but - i'm lazy) it would be even better if that hint would appear somewhere in 'configure --help'! That would make the apple

[issue9124] Mailbox module should use binary I/O, not text I/O

2011-01-28 Thread Steffen Daode Nurpmeso
Steffen Daode Nurpmeso sdao...@googlemail.com added the comment: What is the data type returned by your get_msg? I bet it is string, and email can't handle messages in string format that have non-ASCII characters (Now i see that the local names 'box', 'mbox' and 'mailbox' have become

[issue9124] Mailbox module should use binary I/O, not text I/O

2011-01-28 Thread Steffen Daode Nurpmeso
Steffen Daode Nurpmeso sdao...@googlemail.com added the comment: I missed your mailbox3.patch, but now i've merged it in. One error changed, it now happens when a re.search is applied to a header value and thus seems to match what you say. I'm not able to understand this error this evening

[issue9124] Mailbox module should use binary I/O, not text I/O

2011-01-29 Thread Steffen Daode Nurpmeso
Steffen Daode Nurpmeso sdao...@googlemail.com added the comment: RDM: it seems i was too tired to get your messages right last evening! Indeed it's now completely my fault, i should inspect the content further in respect to the str/bytes etc. stuff! Thus - i will now need three or four days

[issue11046] setup.py/configure [darwin]

2011-01-29 Thread Steffen Daode Nurpmeso
Steffen Daode Nurpmeso sdao...@googlemail.com added the comment: Let me summarize this thread: - For darwin/MacOS X there exists an undocumented MACOSX_DEPLOYMENT_TARGET switch, which makes its way all through the build-system and the 'sysconfig' module. Even though 'configure' auto-detects

[issue11046] setup.py/configure [darwin]

2011-01-29 Thread Steffen Daode Nurpmeso
Changes by Steffen Daode Nurpmeso sdao...@googlemail.com: Removed file: http://bugs.python.org/file20575/DIFF ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue11046

[issue11046] setup.py/configure [darwin]

2011-01-29 Thread Steffen Daode Nurpmeso
Changes by Steffen Daode Nurpmeso sdao...@googlemail.com: Removed file: http://bugs.python.org/file20582/DIFF ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue11046

[issue11059] code.python.org repo failures introduced!

2011-01-29 Thread Steffen Daode Nurpmeso
New submission from Steffen Daode Nurpmeso sdao...@googlemail.com: ... because i don't know where to place this message, i do place it here. Whatever has happened in the last 90 minutes, cloning from code.python.org/hg results in mercurial panics! Please see http://mercurial.selenic.com/bts

[issue11059] code.python.org repo failures introduced!

2011-01-29 Thread Steffen Daode Nurpmeso
Steffen Daode Nurpmeso sdao...@googlemail.com added the comment: MAN!! Forget it - it's ok again; it's maybe really a mercurial non-atomicity failure. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue11059

[issue11059] code.python.org repo failures introduced!

2011-01-29 Thread Steffen Daode Nurpmeso
Changes by Steffen Daode Nurpmeso sdao...@googlemail.com: -- status: open - closed ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue11059

[issue11059] code.python.org repo failures introduced!

2011-01-29 Thread Steffen Daode Nurpmeso
Steffen Daode Nurpmeso sdao...@googlemail.com added the comment: Nope. In the meanwhile i've accomplished to clone py3k once again, but branches/release2.7-maint fails over and over again. I've added another message to http://mercurial.selenic.com/bts/issue2239. Have a nice weekend

[issue11022] locale.setlocale() doesn't change I/O codec, os.environ does

2011-01-29 Thread Steffen Daode Nurpmeso
Steffen Daode Nurpmeso sdao...@googlemail.com added the comment: Also in respect to Issue 6203 i could talk about a project which did not link against anything in the end, only ld(1) and syscalls and the undocumented third 'char **envp' arg to UNIX main()s. Thus: all of you should be *very

[issue6203] 3.x locale does not default to C, contrary to the documentation and to 2.x behavior

2011-01-29 Thread Steffen Daode Nurpmeso
Steffen Daode Nurpmeso sdao...@googlemail.com added the comment: User lemburg pointed me to this, but no, i've posted msg127416 to Issue 11022. -- nosy: +sdaoden ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue6203

[issue11059] Mercurial fails on code.python.org repo

2011-01-30 Thread Steffen Daode Nurpmeso
Steffen Daode Nurpmeso sdao...@googlemail.com added the comment: 'Had to look on a sunday once again, and it is still impossible to clone branches/release2.7-maint. In the meanwhile the Mercurial people from http://mercurial.selenic.com reacted - they play the ball back to python.org. *However

[issue11059] Mercurial fails on code.python.org repo

2011-01-30 Thread Steffen Daode Nurpmeso
Steffen Daode Nurpmeso sdao...@googlemail.com added the comment: http://mercurial.selenic.com/bts/issue2595 says code.python.org/hg often seems unstable., so it seems to be a well known thing. I leave this issue now open nevertheless, and let some experienced Python.org user decide what

[issue11022] locale.setlocale() doesn't change I/O codec, os.environ does

2011-02-01 Thread Steffen Daode Nurpmeso
Steffen Daode Nurpmeso sdao...@googlemail.com added the comment: Most of this is much too loud for a newbie who is about to read PEP 7 anyway. And if this community has chosen to try (?!?) not to break compatibility with code which does not have a notion of a locale setting (i.e. naively uses

[issue11116] mailbox and email errors

2011-02-04 Thread Steffen Daode Nurpmeso
New submission from Steffen Daode Nurpmeso sdao...@googlemail.com: Following Issue 9124 discussion: it took longer than i thought, but now i could rework my thing and got errors. I've also tried Lib/test/test_mailbox.py, and that produces 0xA errors and 0xA failures. I'll attach the entire

[issue11116] mailbox and email errors

2011-02-04 Thread Steffen Daode Nurpmeso
Steffen Daode Nurpmeso sdao...@googlemail.com added the comment: Oops - please be aware that these outputs were saved at the end of a frustrating session. I'm doing things to show *you* what's passed around and the like, i.e. that the message is indeed a mboxMessage etc. The error which

[issue11116] mailbox and email errors

2011-02-04 Thread Steffen Daode Nurpmeso
Steffen Daode Nurpmeso sdao...@googlemail.com added the comment: This simplemost patch (email_header.patch) seems to work at first glance. It heals *everything* (except for babyl format, see issue 11062). (I feel a bit like Charlie Chaplin and i think you know what i mean

[issue11116] mailbox and email errors

2011-02-04 Thread Steffen Daode Nurpmeso
Changes by Steffen Daode Nurpmeso sdao...@googlemail.com: Removed file: http://bugs.python.org/file20673/email_mbox.txt ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue6

[issue11116] (mailbox and) email (errors) - patch

2011-02-04 Thread Steffen Daode Nurpmeso
Changes by Steffen Daode Nurpmeso sdao...@googlemail.com: -- title: mailbox and email errors - (mailbox and) email (errors) - patch ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue6

[issue11116] mailbox and email errors

2011-02-04 Thread Steffen Daode Nurpmeso
Steffen Daode Nurpmeso sdao...@googlemail.com added the comment: You're right, the python3 executable is indeed 20:05 ~/tmp $ python3 -V Python 3.2rc1+ The relevant .py files (mailbox.py, email/*.py, (email/mime/*.py), test/test_mailbox.py are symlinked to the repo files. (And, different

[issue11116] mailbox and email errors

2011-02-04 Thread Steffen Daode Nurpmeso
Steffen Daode Nurpmeso sdao...@googlemail.com added the comment: P.S.: it's that messed UNIX with the nice user-experience *G*UI. And the __pycache__ files state 'cpython-32'. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org

[issue11116] mailbox and email errors

2011-02-04 Thread Steffen Daode Nurpmeso
Steffen Daode Nurpmeso sdao...@googlemail.com added the comment: Dear RDM, now i'm really ashamed. To be absolutely sure that i am up-to-date if diff'd and found that test_mailbox.py contained a sys.exit(1) i've inserted this - it was the lunch break, really! Forget everything i've posted

[issue11116] mailbox and email errors

2011-02-04 Thread Steffen Daode Nurpmeso
Steffen Daode Nurpmeso sdao...@googlemail.com added the comment: I thought about it. It's worse. You did a good job and i was not even able to create symlinks the way it should have been done. This is a real shame - for me. -- ___ Python tracker

[issue11116] mailbox and email errors

2011-02-04 Thread Steffen Daode Nurpmeso
Steffen Daode Nurpmeso sdao...@googlemail.com added the comment: However, as a last peep from me before i'll burn to ashes, and now with all fresh Python 3.2rc2+ all through, i do want to ask a question. I'm still not finished with my broken thing, so the usual exception still occurs

[issue11116] mailbox and email errors

2011-02-05 Thread Steffen Daode Nurpmeso
Steffen Daode Nurpmeso sdao...@googlemail.com added the comment: Well, here is the long-asked-for 'fp_mailbox.py' test thing. Note: it generates a 'test.mbox' in CWD! print(USAGE: fp_mailbox.py 0|1|2, 0 = use raw UTF-8 string, 1 = use UTF-8 string

[issue11046] setup.py/configure [darwin]

2011-02-05 Thread Steffen Daode Nurpmeso
Steffen Daode Nurpmeso sdao...@googlemail.com added the comment: ronaldoussoren: thanks for the MACOSX_DEPLOYMENT_TARGET=10.5 hint!! I did Py3K yesterday, and it was a matter of 'configure --prefix=x YZ make make install' as if it were a real UNIX! I *really* think there should

[issue11116] mailbox and email errors

2011-02-06 Thread Steffen Daode Nurpmeso
Steffen Daode Nurpmeso sdao...@googlemail.com added the comment: Thanks for spending your free time, almost alone in such a widespread area like this. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue6

[issue11216] email.message.Message set_charset does not encode properly?

2011-02-15 Thread Steffen Daode Nurpmeso
Steffen Daode Nurpmeso sdao...@googlemail.com added the comment: Shay.Rojansky: because of the fact that i needed a free last saturday for just having the time to click around a bit to find the relevant docs in the python.org jungle ... http://wiki.python.org/moin/Email%20SIG and *especially

[issue11222] Python3.2rc3 fails to build on Mac OS X with a non-framework build

2011-02-16 Thread Steffen Daode Nurpmeso
Steffen Daode Nurpmeso sdao...@googlemail.com added the comment: I have not tried 3.2 yet, but Issue 11046 may be of interest for you! Try the undocumented: configure ...[other args]... MACOSX_DEPLOYMENT_TARGET=10.5 in the meanwhile - it may help you out. -- nosy: +ronaldoussoren

[issue11222] Python3.2rc3 fails to build on Mac OS X with a non-framework build

2011-02-16 Thread Steffen Daode Nurpmeso
Steffen Daode Nurpmeso sdao...@googlemail.com added the comment: Ooops. In fact 3.2 did well with that undocumented thing either. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue11222

[issue11222] Python3.2rc3 fails to build on Mac OS X with a non-framework build

2011-02-16 Thread Steffen Daode Nurpmeso
Steffen Daode Nurpmeso sdao...@googlemail.com added the comment: Aeh, your patch does it. You may be interested of all Mac OS X compilation notes?? /usr/bin/ranlib: file: libpython3.2m.a(dynamic_annotations.o) has no symbols /usr/bin/ranlib: file: libpython3.2m.a(pymath.o) has no symbols ranlib

[issue11243] email/message.py str conversion [patch]

2011-02-18 Thread Steffen Daode Nurpmeso
New submission from Steffen Daode Nurpmeso sdao...@googlemail.com: Hy David, while hacking a bit on my thing i've found two places where header.Header needs to be explicitely converted via str(). Have a nice weekend. -- files: email_message.patch keywords: patch messages: 128782 nosy

[issue11243] email/message.py str conversion [patch]

2011-02-18 Thread Steffen Daode Nurpmeso
Steffen Daode Nurpmeso sdao...@googlemail.com added the comment: (Will get that tracker right as time goes by.) -- type: - behavior versions: +Python 3.2 ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue11243

[issue11243] email/message.py str conversion

2011-02-18 Thread Steffen Daode Nurpmeso
Steffen Daode Nurpmeso sdao...@googlemail.com added the comment: We all know EMail 6.0 will blow them off the streets in the end. -- components: +Library (Lib) ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue11243

[issue11243] email/message.py str conversion

2011-02-18 Thread Steffen Daode Nurpmeso
Steffen Daode Nurpmeso sdao...@googlemail.com added the comment: P.S.: maybe this completes the byte. Have a nice weekend nevertheless - if you can. Traceback (most recent call last): File /Users/steffen/usr/bin/s-postman.py, line 1419, in _walk self._tickets.extend

[issue11243] email/message.py str conversion

2011-02-19 Thread Steffen Daode Nurpmeso
Steffen Daode Nurpmeso sdao...@googlemail.com added the comment: I also got this now, it happens with and without the str() patch stuff. (Note that message.py line numbers are off by 1-2 lines ..). I don't know more about that in the moment, but the only thing that's changed is that i do

[issue11243] email/message.py str conversion

2011-02-19 Thread Steffen Daode Nurpmeso
Steffen Daode Nurpmeso sdao...@googlemail.com added the comment: The latter one was my fault, i did LIST.append(name, HEADER.append(xy)), assuming that HEADER.append() returns self though it doesn't. Sorry. However - shouldn't Message.__setitem__ check for valid arguments (see msg128846 code

[issue11243] email/message.py str conversion

2011-02-19 Thread Steffen Daode Nurpmeso
Steffen Daode Nurpmeso sdao...@googlemail.com added the comment: However, maybe that 5.1 message.py thing doesn't like header.Header instances. Also extending msg128846, this one is related to the str() issue - added an extended email_message.2.patch. Traceback (most recent call last

[issue11243] email/message.py str conversion

2011-02-19 Thread Steffen Daode Nurpmeso
Changes by Steffen Daode Nurpmeso sdao...@googlemail.com: Removed file: http://bugs.python.org/file20784/email_message.patch ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue11243

[issue11243] email/message.py str conversion

2011-02-19 Thread Steffen Daode Nurpmeso
Steffen Daode Nurpmeso sdao...@googlemail.com added the comment: David, i'm going down now. I'll raise the type to 'crash', because, in fact, EMail 5.1 doesn't really take care of header.Header objects in message.Message headers, which doesn't sound pretty useful to me! The patch

[issue11243] email/message.py str conversion

2011-02-19 Thread Steffen Daode Nurpmeso
Steffen Daode Nurpmeso sdao...@googlemail.com added the comment: ... as a last though of mine, here is a header of the well known spam mail: From MAILER-DAEMON Sat Feb 19 15:58:47 2011 Date: =?latin1?q?Tue=2C_4_Jan_2011_17=3A37=3A26_+0100_=28CET=29?= From: =?latin1?q?=22SAJATNAPTAR=2ECOM=22_

[issue11243] email/message.py str conversion

2011-02-22 Thread Steffen Daode Nurpmeso
Steffen Daode Nurpmeso sdao...@googlemail.com added the comment: (Of course you're right. It just reads, passes around and spits out that ... of a mail just the same it came in. Performance is very well, too, just about 1.5 seconds - some two weeks ago it took about 1.1 seconds

[issue11277] test_zlib crashes under Snow Leopard buildbot

2011-02-22 Thread Steffen Daode Nurpmeso
Steffen Daode Nurpmeso sdao...@googlemail.com added the comment: 'Have no glue, but Ned Daily's patch (msg129011) seems to be required for adler, too. (You know...) -- nosy: +sdaoden ___ Python tracker rep...@bugs.python.org http://bugs.python.org

[issue11277] test_zlib crashes under Snow Leopard buildbot

2011-02-22 Thread Steffen Daode Nurpmeso
Steffen Daode Nurpmeso sdao...@googlemail.com added the comment: Wait a few minutes, i'll write this simple patch for adler and crc. But excessive testing and such is beyond my current capabilities. -- ___ Python tracker rep...@bugs.python.org http

[issue11277] test_zlib crashes under Snow Leopard buildbot

2011-02-22 Thread Steffen Daode Nurpmeso
Steffen Daode Nurpmeso sdao...@googlemail.com added the comment: Sorry - that was a mess. -- Added file: http://bugs.python.org/file20837/issue11277.patch ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue11277

[issue11277] test_zlib crashes under Snow Leopard buildbot

2011-02-22 Thread Steffen Daode Nurpmeso
Steffen Daode Nurpmeso sdao...@googlemail.com added the comment: I guess not at all. Well. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue11277

[issue11277] test_zlib crashes under Snow Leopard buildbot

2011-02-22 Thread Steffen Daode Nurpmeso
Steffen Daode Nurpmeso sdao...@googlemail.com added the comment: test_zlib.py (with my patch but that's somewhat identical in the end, say) does .s... -- Ran 37 tests in 1.809s OK (skipped=1

[issue11285] io.py standart stream setup crash

2011-02-22 Thread Steffen Daode Nurpmeso
New submission from Steffen Daode Nurpmeso sdao...@googlemail.com: Just pulled 64380ee4bbc5 (r88500) and compiled, Python's busted: Fatal Python error: Py_Initialize: can't initialize sys standard streams Traceback (most recent call last): File /Users/steffen/usr/opt/py3k/lib/python3.3/io.py

[issue11277] test_zlib crashes under Snow Leopard buildbot

2011-02-22 Thread Steffen Daode Nurpmeso
Steffen Daode Nurpmeso sdao...@googlemail.com added the comment: No, i've got no idea of this framework... Just did 'python3 test_zlib.py' directly. Thanks for the switch. But i can't test your thing due to issue11285, so this may take a while (others have more knowledge anyway).. (P.S

[issue11277] test_zlib crashes under Snow Leopard buildbot

2011-02-22 Thread Steffen Daode Nurpmeso
Steffen Daode Nurpmeso sdao...@googlemail.com added the comment: So here is this (with my patch, but this is for real: issue11277.2.patch): == CPython 3.3a0 (py3k, Feb 22 2011, 14:00:52) [GCC 4.2.1 (Apple Inc. build 5664)] == Darwin-10.6.0-i386-64bit little-endian == /private/var/folders

[issue11285] io.py standart stream setup crash

2011-02-22 Thread Steffen Daode Nurpmeso
Steffen Daode Nurpmeso sdao...@googlemail.com added the comment: Let me see some minutes. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue11285

[issue11277] test_zlib crashes under Snow Leopard buildbot

2011-02-22 Thread Steffen Daode Nurpmeso
Changes by Steffen Daode Nurpmeso sdao...@googlemail.com: Removed file: http://bugs.python.org/file20837/issue11277.patch ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue11277

[issue11277] test_zlib crashes under Snow Leopard buildbot

2011-02-22 Thread Steffen Daode Nurpmeso
Steffen Daode Nurpmeso sdao...@googlemail.com added the comment: (Is not that much help for a 4GB error, huh?) -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue11277

[issue11277] test_zlib crashes under Snow Leopard buildbot

2011-02-22 Thread Steffen Daode Nurpmeso
Steffen Daode Nurpmeso sdao...@googlemail.com added the comment: Just stepping ... with c8d1f99f25eb/r88476: == CPython 3.3a0 (py3k, Feb 22 2011, 14:18:19) [GCC 4.2.1 (Apple Inc. build 5664)] == Darwin-10.6.0-i386-64bit little-endian == /private/var/folders/Da/DaZX3-k5G8a57zw6MSmjJTM

[issue11285] io.py standart stream setup crash

2011-02-22 Thread Steffen Daode Nurpmeso
Steffen Daode Nurpmeso sdao...@googlemail.com added the comment: According to adorable but slow Mercurial: The first bad revision is: changeset: 9894:fc8a94cc17a4 branch: py3k user:raymond.hettinger date:Tue Feb 22 01:41:50 2011 +0100 summary: [svn r88490] Issue

[issue11277] test_zlib crashes under Snow Leopard buildbot

2011-02-22 Thread Steffen Daode Nurpmeso
Steffen Daode Nurpmeso sdao...@googlemail.com added the comment: .. even with a self-compiled 1.2.3, INT_MAX/1000 ... nothing. The problem is not crc32(), but the buffer itself: if (pbuf.len 1024*5) { unsigned char *buf = pbuf.buf; Py_ssize_t len = pbuf.len

[issue11277] test_zlib crashes under Snow Leopard buildbot

2011-02-22 Thread Steffen Daode Nurpmeso
Steffen Daode Nurpmeso sdao...@googlemail.com added the comment: (P.S.: of course talking about ChecksumBigBufferTestCase and the 4GB, say.) -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue11277

[issue11277] test_zlib crashes under Snow Leopard buildbot

2011-02-22 Thread Steffen Daode Nurpmeso
Steffen Daode Nurpmeso sdao...@googlemail.com added the comment: Snippet if (pbuf.len 1024*5) { volatile unsigned char *buf = pbuf.buf; Py_ssize_t len = pbuf.len; Py_ssize_t i = 0; volatile unsigned char au[100]; volatile unsigned char*x = au; fprintf(stderr, CRC

[issue11277] test_zlib crashes under Snow Leopard buildbot

2011-02-22 Thread Steffen Daode Nurpmeso
Steffen Daode Nurpmeso sdao...@googlemail.com added the comment: I have a MacBook with 2 GB RAM. Of course i'm a little bit messy, so an entry is half written before it comes to an ... end. msg129091 is real life, though. Antoine, your msg129093 patch of test_zlib.py does

[issue11277] test_zlib crashes under Snow Leopard buildbot

2011-02-22 Thread Steffen Daode Nurpmeso
Steffen Daode Nurpmeso sdao...@googlemail.com added the comment: (That is to say: i think it's better not to assume that these boys plan to *ever* fix it. (Though mmap(2) is not CoreAudio/AudioUnit.)) -- ___ Python tracker rep...@bugs.python.org

[issue11277] test_zlib crashes under Snow Leopard buildbot

2011-02-22 Thread Steffen Daode Nurpmeso
Steffen Daode Nurpmeso sdao...@googlemail.com added the comment: (neologix: SIGBUS is not the same as SIGSEGV. You know. Thanks for this nice bug report. Eight years is a .. time in computer programming - unbelievable, thinking of all these nervous wrecks who ever reported a bug to Apple

[issue11277] test_zlib crashes under Snow Leopard buildbot

2011-02-22 Thread Steffen Daode Nurpmeso
Steffen Daode Nurpmeso sdao...@googlemail.com added the comment: neologix: even with 2 GB RAM top(1) shows more than 600 MB free memory with the 4 GB test up and running ... in an Mac OS X environment ... Lucky me, i don't believe them a single word

[issue11285] io.py standart stream setup crash

2011-02-23 Thread Steffen Daode Nurpmeso
Steffen Daode Nurpmeso sdao...@googlemail.com added the comment: Hmm. Note that this problem does *not* occur if i don't install Python but run it in place, e.g. 'cd Lib/test; ../../python.exe -m test -v -uall test_iter' works just perfect

[issue11285] io.py standart stream setup crash

2011-02-23 Thread Steffen Daode Nurpmeso
Steffen Daode Nurpmeso sdao...@googlemail.com added the comment: ... and the problem is all gone with 8c2935f180fa/r88525. So i'm faitful now and close this early alpha-stage problem. One of the nosy ones may add a nice description, re-open it or so

[issue11285] io.py standart stream setup crash

2011-02-23 Thread Steffen Daode Nurpmeso
Steffen Daode Nurpmeso sdao...@googlemail.com added the comment: (.. should close it, then.) -- status: open - closed ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue11285

[issue11277] test_zlib crashes under Snow Leopard buildbot

2011-02-23 Thread Steffen Daode Nurpmeso
Steffen Daode Nurpmeso sdao...@googlemail.com added the comment: I append a doc_lib_mmap.patch which may be helpful for those poor creatures who plan to write Python scripts for Mac OS X. (It may be a useful add-on anyway.) -- Added file: http://bugs.python.org/file20859

[issue11277] test_zlib crashes under Snow Leopard buildbot

2011-02-23 Thread Steffen Daode Nurpmeso
Changes by Steffen Daode Nurpmeso sdao...@googlemail.com: Removed file: http://bugs.python.org/file20859/doc_lib_mmap.patch ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue11277

[issue11277] test_zlib crashes under Snow Leopard buildbot

2011-02-23 Thread Steffen Daode Nurpmeso
Steffen Daode Nurpmeso sdao...@googlemail.com added the comment: Sorry, i've got that kid running around which sometimes doesn't know what it is doing. But this documentation patch may really be a help. It's my first doc-patch, so it surely needs to be revised, if interest exists

[issue11300] mmap() large file failures on Mac OS X docfix

2011-02-23 Thread Steffen Daode Nurpmeso
New submission from Steffen Daode Nurpmeso sdao...@googlemail.com: Issue 11277 was closed upon the generally accepted conclusion that the failure is that mmap(2) on Mac OS X has a long time known bug (see msg129107, or directly http://lists.apple.com/archives/darwin-development/2003/Jun

[issue11303] b'x'.decode('latin1') is much slower than b'x'.decode('latin-1')

2011-02-24 Thread Steffen Daode Nurpmeso
Steffen Daode Nurpmeso sdao...@googlemail.com added the comment: I wonder what this normalize_encoding() does! Here is a pretty standard version of mine which is a bit more expensive but catches match more cases! This is stripped, of course, and can be rewritten very easily to Python's needs

[issue11303] b'x'.decode('latin1') is much slower than b'x'.decode('latin-1')

2011-02-24 Thread Steffen Daode Nurpmeso
Steffen Daode Nurpmeso sdao...@googlemail.com added the comment: (That is to say, i would do it. But not if _cpython is thrown to trash ,-); i.e. not if there is not a slight chance that it gets actually patched in because this performance issue probably doesn't mean a thing in real life

[issue11303] b'x'.decode('latin1') is much slower than b'x'.decode('latin-1')

2011-02-24 Thread Steffen Daode Nurpmeso
Steffen Daode Nurpmeso sdao...@googlemail.com added the comment: .. i don't have actually invented this algorithm (but don't ask me where i got the idea from years ago), i've just implemented the function you see. The algorithm itself avoids some pitfalls in respect to combining numerics

[issue11303] b'x'.decode('latin1') is much slower than b'x'.decode('latin-1')

2011-02-24 Thread Steffen Daode Nurpmeso
Steffen Daode Nurpmeso sdao...@googlemail.com added the comment: (Everything else is beyond my scope. But normalizing _ to - is possibly a bad idea as far as i can remember the situation three years ago.) -- ___ Python tracker rep

[issue11303] b'x'.decode('latin1') is much slower than b'x'.decode('latin-1')

2011-02-24 Thread Steffen Daode Nurpmeso
Steffen Daode Nurpmeso sdao...@googlemail.com added the comment: P.P.S.: separating alphanumerics is a win for things like, e.g. UTF-16BE: it gets 'utf 16 be' - think about the possible mispellings here and you see this algorithm is a good thing

[issue11303] b'x'.decode('latin1') is much slower than b'x'.decode('latin-1')

2011-02-24 Thread Steffen Daode Nurpmeso
Steffen Daode Nurpmeso sdao...@googlemail.com added the comment: So, well, a-ha, i will boot my laptop this evening and (try to) write a patch for normalize_encoding(), which will match the standart conforming LATIN1 and also will continue to support the illegal latin-1 without actually

[issue11303] b'x'.decode('latin1') is much slower than b'x'.decode('latin-1')

2011-02-24 Thread Steffen Daode Nurpmeso
Steffen Daode Nurpmeso sdao...@googlemail.com added the comment: So happy hacker haypo did it, different however. It's illegal, but since this is a static function which only serves some specific internal strcmp(3)s it may do for the mentioned charsets. I won't boot my laptop this evening

[issue11303] b'x'.decode('latin1') is much slower than b'x'.decode('latin-1')

2011-02-24 Thread Steffen Daode Nurpmeso
Steffen Daode Nurpmeso sdao...@googlemail.com added the comment: That's ok by me. And 'happy hacker haypo' was not ment unfriendly, i've only repeated the first response i've ever posted back to this tracker (guess who was very fast at that time

[issue11303] b'x'.decode('latin1') is much slower than b'x'.decode('latin-1')

2011-02-25 Thread Steffen Daode Nurpmeso
Steffen Daode Nurpmeso sdao...@googlemail.com added the comment: (Not issue related) Ezio and Alexander: after reading your posts and looking back on my code: you're absolutely right. Doing resize(31) is pointless: it doesn't save space (mempool serves [8],16,24,32 there; and: dynamic

[issue11322] encoding package's normalize_encoding() function is too slow

2011-02-26 Thread Steffen Daode Nurpmeso
Changes by Steffen Daode Nurpmeso sdao...@googlemail.com: -- nosy: +sdaoden ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue11322 ___ ___ Python

[issue11277] test_zlib crashes under Snow Leopard buildbot

2011-02-26 Thread Steffen Daode Nurpmeso
Steffen Daode Nurpmeso sdao...@googlemail.com added the comment: 11:12 ~/tmp $ python3 ~/usr/opt/py3k/lib/python3.3/test_zlib.py Bus error Your code snippet: 11:21 ~/tmp $ /usr/bin/time -lp python3 test.py posix.stat_result(st_mode=33184, st_ino=10066605, st_dev=234881025, st_nlink=1, st_uid

[issue11277] test_zlib crashes under Snow Leopard buildbot

2011-02-26 Thread Steffen Daode Nurpmeso
Steffen Daode Nurpmeso sdao...@googlemail.com added the comment: I'll give you the same result again but with additional clock(), just for a heart's pleasure: clock(): 0.100958 , fstat(): posix.stat_result(st_mode=33184, st_ino=10075508, st_dev=234881025, st_nlink=1, st_uid=502, st_gid=20

[issue11303] b'x'.decode('latin1') is much slower than b'x'.decode('latin-1')

2011-02-26 Thread Steffen Daode Nurpmeso
Steffen Daode Nurpmeso sdao...@googlemail.com added the comment: On Fri, Feb 25, 2011 at 03:43:06PM +, Marc-Andre Lemburg wrote: Marc-Andre Lemburg m...@egenix.com added the comment: r88586: Normalized the encoding names for Latin-1 and UTF-8 to 'latin-1' and 'utf-8' in the stdlib

[issue11351] (test_os) os.sendfile() error

2011-02-28 Thread Steffen Daode Nurpmeso
New submission from Steffen Daode Nurpmeso sdao...@googlemail.com: Antoine, i made you noisy because you took care about Issue11323. I'm at r88671 (271057c7c6f3). I'm opening this because the buildbot URL (thanks) doesn't show anything about sendfile(2). 12:47 ~/arena/code.extern.repos/py3k.hg

[issue11351] (test_os) os.sendfile() error

2011-02-28 Thread Steffen Daode Nurpmeso
Steffen Daode Nurpmeso sdao...@googlemail.com added the comment: It's about the headers[]: def test_headers(self): total_sent = 0 sent = os.sendfile(self.sockno, self.fileno, 0, 4096, headers=[bx * 512]) total_sent

[issue11351] (test_os) os.sendfile() error

2011-02-28 Thread Steffen Daode Nurpmeso
Steffen Daode Nurpmeso sdao...@googlemail.com added the comment: posixmodule.c: iov_setup(): IOV[i]: buffer:0x10152b8f0, len:512 iov_setup() leave ok before sendfile: sf=0x7fff5fbfb410, sf.headers=0x10036c780 sf.headers[0].iov_base

[issue11351] (test_os) os.sendfile() error

2011-02-28 Thread Steffen Daode Nurpmeso
Steffen Daode Nurpmeso sdao...@googlemail.com added the comment: Did you know that 'sbytes' is not adjusted to match possibly existent headers and trailers in posixmodule.c? This however is required according to Mac OS X 'man 2 sendfile'. I'll attach a simple, naive patch for a very

[issue11351] Mac OS X os.sendfile()

2011-02-28 Thread Steffen Daode Nurpmeso
Changes by Steffen Daode Nurpmeso sdao...@googlemail.com: -- title: (test_os) os.sendfile() error - Mac OS X os.sendfile() ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue11351

  1   2   3   4   >