[ python-Bugs-1215928 ] Large tarfiles cause overflow
Bugs item #1215928, was opened at 2005-06-06 21:19 Message generated for change (Comment added) made by gustaebel You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=105470&aid=1215928&group_id=5470 Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. Category: Python Library Group: Python 2.4 Status: Open Resolution: None Priority: 5 Submitted By: Tom Emerson (tree) Assigned to: Nobody/Anonymous (nobody) Summary: Large tarfiles cause overflow Initial Comment: I have a 4 gigabyte bz2 compressed tarfile containing some 3.3 million documents. I have a script which opens this file with "r:bz2" and is simply iterating over the contents using next(). With 2.4.1 I still get an Overflow error (originally tried with 2.3.5 as packaged in Mac OS 10.4.1): Traceback (most recent call last): File "extract_part.py", line 47, in ? main(sys.argv) File "extract_part.py", line 39, in main pathnames = find_valid_paths(argv[1], 1024, count) File "extract_part.py", line 13, in find_valid_paths f = tf.next() File "/usr/local/lib/python2.4/tarfile.py", line 1584, in next self.fileobj.seek(self.offset) OverflowError: long int too large to convert to int -- Comment By: Lars Gustäbel (gustaebel) Date: 2005-06-07 15:23 Message: Logged In: YES user_id=642936 A quick look at the problem reveals that this is a bug in bz2.BZ2File. The seek() method does not allow position values >= 2GiB. -- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=105470&aid=1215928&group_id=5470 ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[ python-Bugs-1216562 ] Replace MSVC memory allocator with ptmalloc2
Bugs item #1216562, was opened at 2005-06-07 17:31 Message generated for change (Tracker Item Submitted) made by Item Submitter You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=105470&aid=1216562&group_id=5470 Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. Category: Windows Group: Feature Request Status: Open Resolution: None Priority: 5 Submitted By: Niall Douglas (ned14) Assigned to: Nobody/Anonymous (nobody) Summary: Replace MSVC memory allocator with ptmalloc2 Initial Comment: You can get a port of ptmalloc2 to win32/win64 at http:// www.nedprod.com/programs/Win32/ptmalloc2/. ptmalloc2 is very considerably faster than the MSVC CRT allocator in small object allocations such as those python would frequently make. If one were to replace python's allocator with ptmalloc2, one should expect to see a sizeable speed increase. As to my knowledge python extension modules don't pass malloced blocks between themselves and the core interpreter, there shouldn't be a problem with calling the wrong allocator with the wrong block. However if there were problems, ptmalloc2 allocated blocks are very easily recognisable from MSVC allocated ones and so the core interpreter could easily free any kind of allocated block. The reverse, unfortunately, is not the case unless one forced all python extension modules to use a python provided allocator. -- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=105470&aid=1216562&group_id=5470 ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[ python-Bugs-1170422 ] doc speaks of extensions option while it's *called* ext_modu
Bugs item #1170422, was opened at 2005-03-25 04:56 Message generated for change (Settings changed) made by akuchling You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=105470&aid=1170422&group_id=5470 Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. >Category: Documentation Group: None >Status: Closed >Resolution: Fixed Priority: 5 Submitted By: Jürgen A. Erhard (jae) >Assigned to: A.M. Kuchling (akuchling) Summary: doc speaks of extensions option while it's *called* ext_modu Initial Comment: ext_modules, of course (crap bugtracker) Another minor fix would be to show an import Extension in at least one example. Quite a lot easier to see for the impatient. -- >Comment By: A.M. Kuchling (akuchling) Date: 2005-06-07 14:56 Message: Logged In: YES user_id=11375 This refers to the dist.tex file. I've fixed it on both CVS HEAD and 2.4-maint. Thanks for reporting this! -- Comment By: Terry J. Reedy (tjreedy) Date: 2005-03-30 13:29 Message: Logged In: YES user_id=593130 What I understand is that you want something (literally 'extention option'?) replaced by 'ext_module' somewhere. Could you be more specific as to where (which section of which document, or a url) and what something? Giving the current phrase or sentence and your suggested replacement makes a change decision easier. -- Comment By: Jürgen A. Erhard (jae) Date: 2005-03-25 05:03 Message: Logged In: YES user_id=10380 Ouch, forget about the import Extension... it's there, and I was just blind. Note to self: the usual ;-) (I wish I could edit my own submissions) -- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=105470&aid=1170422&group_id=5470 ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[ python-Bugs-1183972 ] dest parameter in optparse
Bugs item #1183972, was opened at 2005-04-15 15:39 Message generated for change (Settings changed) made by akuchling You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=105470&aid=1183972&group_id=5470 Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. Category: Python Library Group: Python 2.3 Status: Open Resolution: None Priority: 5 Submitted By: ahmado (ahmado) >Assigned to: Greg Ward (gward) Summary: dest parameter in optparse Initial Comment: When using the "callback" action, optparse requires that you STILL specify a "dest" parameter, though it is not required or used by the option parser. In fact, if you do not include the "dest" parameter, your options will still work properly, but optparse will generate an exception when calling the "--help" option. Not specifying a "dest" parameter will result in the following Exception when using the default "--help" or "- h" option: File "c:\Python23\lib\optparse.py", line 229, in format_option_strings metavar = option.metavar or option.dest.upper() AttributeError: 'NoneType' object has no attribute 'upper' by simply adding a bogus bug, the --help / -h option works properly even though the dest isn't actually used. -- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=105470&aid=1183972&group_id=5470 ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[ python-Bugs-1172763 ] dumbdbm hoses index on load failure
Bugs item #1172763, was opened at 2005-03-29 15:23 Message generated for change (Comment added) made by akuchling You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=105470&aid=1172763&group_id=5470 Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. Category: Extension Modules Group: Python 2.4 >Status: Closed >Resolution: Fixed Priority: 5 Submitted By: currivan (currivan) >Assigned to: A.M. Kuchling (akuchling) Summary: dumbdbm hoses index on load failure Initial Comment: Using python to read a dumbdbm db created with jython on Windows, the index got erased. The load failed with an exception due to the python os.linesep being "\n", while the jython version created the db with "\r\n". On exit, the python dumbdbm module committed the empty index it had read, destroying the db. commit (or sync) is implicitly being called on exit from python. dumbdbm ignores the flag it was opened with and commits even if it was opened with 'r'. jython doesn't seem to support any other standard dbm implementation, so I'm stuck with dumbdbm. The problem can be worked around by setting os.linesep manually to enforce consistency. -- >Comment By: A.M. Kuchling (akuchling) Date: 2005-06-07 15:58 Message: Logged In: YES user_id=11375 Another fix, and the one I've just applied to the HEAD and 2.4-maint branches, is to strip off whitespace from the lines in the index file. Thanks for reporting this bug! -- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=105470&aid=1172763&group_id=5470 ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[ python-Bugs-1071094 ] some latex reject the pdfinfo macro while generating html
Bugs item #1071094, was opened at 2004-11-22 17:15 Message generated for change (Comment added) made by birkenfeld You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=105470&aid=1071094&group_id=5470 Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. Category: Documentation Group: Python 2.4 Status: Open Resolution: None Priority: 5 Submitted By: Marc-Antoine Parent (maparent) Assigned to: Fred L. Drake, Jr. (fdrake) Summary: some latex reject the pdfinfo macro while generating html Initial Comment: I was building the documentation on OSX. I use the latest LaTeX 2004 from Wierda's teTeX. There is a pdfinfo command in Doc/ texinputs/manual.cls and Doc/texinputs/howto.cls which chokes my version of latex. edited log follows: TEXINPUTS=/.../Python-2.4c1/Doc/commontex: python /.../Python -2.4c1/Doc/tools/mkhowto --html --about html/stdabout.dat -- iconserver ../icons --favicon ../icons/pyfav.png --address "See About this document... for information on suggesting changes." --up-link ../index.html --up- title "Python Documentation Index" --global-module-index "../ modindex.html" --dvips-safe --dir html/api api/api.tex +++ TEXINPUTS=/.../Python-2.4c1/ Doc/api:/.../Python-2.4c1/Doc/ commontex:/.../Python-2.4c1/Doc/ paper-letter:/.../Python-2.4c1/Doc/ texinputs: +++ latex api *** Session transcript and error messages are in /.../Python -2.4c1/Doc/html/api/api.how. *** Exited with status 1. The relevant lines from the transcript are: +++ latex api This is pdfeTeX, Version 3.141592-1.20a-2.2 (Web2C 7.5.3) output format initialized to DVI entering extended mode (/.../Python-2.4c1/Doc/api/api.tex LaTeX2e <2003/12/01> Babel and hyphenation patterns for american, french, german, ngerman, nohyphenation, loaded. (/.../Python-2.4c1/Doc/texinputs/manual.cls Document Class: manual 1998/03/03 Document class (Python manual) (/.../Python-2.4c1/Doc/texinputs/pypaper.sty (/usr/local/teTeX/share/texmf.tetex/tex/latex/psnfss/times.sty) Using Times instead of Computer Modern. ) (/usr/local/teTeX/share/texmf.tetex/tex/latex/fancybox/ fancybox.sty Style option: `fancybox' v1.3 <2000/09/19> (tvz) ) (/usr/local/teTeX/share/texmf.tetex/tex/latex/base/report.cls Document Class: report 2004/02/16 v1.4f Standard LaTeX document class (/usr/local/teTeX/share/texmf.tetex/tex/latex/base/size10.clo)) (/.../Python-2.4c1/Doc/texinputs/fancyhdr.sty) Using fancier footers than usual. (/.../Python-2.4c1/Doc/texinputs/fncychap.sty) Using fancy chapter headings. (/.../Python-2.4c1/Doc/texinputs/python.sty (/usr/local/teTeX/share/texmf.tetex/tex/latex/tools/longtable.sty) (/usr/local/teTeX/share/texmf.tetex/tex/latex/tools/verbatim.sty) (/usr/local/teTeX/share/texmf.tetex/tex/latex/base/alltt.sty))) (/.../Python-2.4c1/Doc/commontex/boilerplate.tex (/.../Python-2.4c1/Doc/commontex/patchlevel.tex)) Writing index file api.idx No file api.aux. (/usr/local/teTeX/share/texmf.tetex/tex/latex/psnfss/ot1ptm.fd) pdfTeX error (ext1): \pdfinfo used while \pdfoutput is not set. { \def \{, } \pdfinfo { /Author ([EMAIL PROTECTED] ) /Title ([EMAIL PROTECTED] ) } } l.12 \maketitle No pages of output. Transcript written on api.log. *** Session transcript and error messages are in /.../Python -2.4c1/Doc/html/api/api.how. *** Exited with status 1. make: *** [html/api/api.html] Error 1 -- >Comment By: Reinhold Birkenfeld (birkenfeld) Date: 2005-06-07 22:33 Message: Logged In: YES user_id=1188172 FWIW, problem exists and patch works for me. Linux 2.6, teTeX 3.0. -- Comment By: Sébastien Maret (bmaret) Date: 2005-06-06 23:29 Message: Logged In: YES user_id=842097 The patch worked for me (MacOSX 10.4.1, teTeX 3.0). Thanks. -- Comment By: Michael Ströder (stroeder) Date: 2005-05-30 11:23 Message: Logged In: YES user_id=64920 This patch I got from a tex expert seems to fix it. It should also be applied to howto.cls. --- manual.cls.orig 2005-05-30 10:02:28.0 +0200 +++ manual.cls 2005-05-30 11:16:58.0 +0200 @@ -6,9 +6,17 @@ \ProvidesClass{manual} [1998/03/03 Document class (Python manual)] +\RequirePackage{ifpdf} [EMAIL PROTECTED] + \ifpdf +[EMAIL PROTECTED] + \else +[EMAIL PROTECTED] + \fi +} + \RequirePackage{pypaper} \RequirePackage{fancybox} - % Change the options here to get a different set of basic options, but only % if you have to. Paper and font size should be adjusted in pypaper.sty. % @@ -64,7 +72,7 @@ \let\footnotesize\small \let\footnoterule\relax [EMAIL PROTECTED] -[EMAIL PROTECTED] +[EMAIL PROTECTED
[ python-Bugs-1216831 ] csv module sometimes raises _csv.Error
Bugs item #1216831, was opened at 2005-06-08 02:42 Message generated for change (Tracker Item Submitted) made by Item Submitter You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=105470&aid=1216831&group_id=5470 Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. Category: Python Library Group: None Status: Open Resolution: None Priority: 5 Submitted By: Mary Gardiner (hypatia) Assigned to: Nobody/Anonymous (nobody) Summary: csv module sometimes raises _csv.Error Initial Comment: Tested on 2.3 (Fedora Core 3) and 2.4 (Ubuntu 5.04). The documentation strongly suggests that the csv module raises csv.Error when there are problems parsing the csv, but in fact it sometimes lets _csv.Error escape the C module, as per this example: >>> import csv, StringIO >>> r = csv.reader(StringIO.StringIO('"xx,qq')) >>> r.next() Traceback (most recent call last): File "", line 1, in ? _csv.Error: newline inside string -- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=105470&aid=1216831&group_id=5470 ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[ python-Bugs-1216831 ] csv module sometimes raises _csv.Error
Bugs item #1216831, was opened at 2005-06-07 21:42 Message generated for change (Settings changed) made by montanaro You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=105470&aid=1216831&group_id=5470 Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. Category: Python Library Group: None >Status: Closed >Resolution: Invalid Priority: 5 Submitted By: Mary Gardiner (hypatia) Assigned to: Nobody/Anonymous (nobody) Summary: csv module sometimes raises _csv.Error Initial Comment: Tested on 2.3 (Fedora Core 3) and 2.4 (Ubuntu 5.04). The documentation strongly suggests that the csv module raises csv.Error when there are problems parsing the csv, but in fact it sometimes lets _csv.Error escape the C module, as per this example: >>> import csv, StringIO >>> r = csv.reader(StringIO.StringIO('"xx,qq')) >>> r.next() Traceback (most recent call last): File "", line 1, in ? _csv.Error: newline inside string -- >Comment By: Skip Montanaro (montanaro) Date: 2005-06-07 21:52 Message: Logged In: YES user_id=44345 csv.Error and _csv.Error are the same object. The object is defined in the low level _csv module, then imported into the csv module. That the name is "_csv.Error" can't be changed in the context of the csv module. -- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=105470&aid=1216831&group_id=5470 ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com