[issue5308] cannot marshal objects with more than 2**31 elements

2013-07-14 Thread Serhiy Storchaka
Changes by Serhiy Storchaka storch...@gmail.com: -- stage: commit review - committed/rejected status: pending - closed ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue5308 ___

[issue5308] cannot marshal objects with more than 2**31 elements

2013-07-11 Thread Serhiy Storchaka
Changes by Serhiy Storchaka storch...@gmail.com: -- resolution: - fixed stage: needs patch - commit review status: open - pending versions: -Python 3.2 ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue5308

[issue5308] cannot marshal objects with more than 2**31 elements

2013-07-11 Thread Roundup Robot
Roundup Robot added the comment: New changeset 1cf2c42af815 by Serhiy Storchaka in branch '2.7': Fix reference leaks introduced by the patch for issue #5308. http://hg.python.org/cpython/rev/1cf2c42af815 New changeset 8b99f2224c3a by Serhiy Storchaka in branch '3.3': Fix reference leaks

[issue5308] cannot marshal objects with more than 2**31 elements

2013-07-01 Thread Serhiy Storchaka
Serhiy Storchaka added the comment: Good catch. There is another resource leak for general bytes-like object (the buffer can be not released). Here is a patch. -- Added file: http://bugs.python.org/file30741/marshal_string_leak.patch ___ Python

[issue5308] cannot marshal objects with more than 2**31 elements

2013-06-30 Thread Christian Heimes
Christian Heimes added the comment: The macro W_SIZE at http://hg.python.org/cpython/file/dbdb6f7f9a1a/Python/marshal.c#l130 has introduced a reference leak at http://hg.python.org/cpython/file/dbdb6f7f9a1a/Python/marshal.c#l390 . Because W_SIZE returns in an error case the reference count of

[issue5308] cannot marshal objects with more than 2**31 elements

2013-02-15 Thread Serhiy Storchaka
Changes by Serhiy Storchaka storch...@gmail.com: -- resolution: - fixed stage: patch review - committed/rejected status: open - closed ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue5308 ___

[issue5308] cannot marshal objects with more than 2**31 elements

2013-02-13 Thread Roundup Robot
Roundup Robot added the comment: New changeset 385d982ce641 by Serhiy Storchaka in branch '2.7': Issue #5308: Raise ValueError when marshalling too large object (a sequence http://hg.python.org/cpython/rev/385d982ce641 New changeset e0464fa28c85 by Serhiy Storchaka in branch '3.2': Issue #5308:

[issue5308] cannot marshal objects with more than 2**31 elements

2013-02-13 Thread Roundup Robot
Roundup Robot added the comment: New changeset 72e75ea25d00 by Serhiy Storchaka in branch '2.7': Fix tests for issue #5308. http://hg.python.org/cpython/rev/72e75ea25d00 New changeset 0407e5e5915e by Serhiy Storchaka in branch '3.3': Cleanup a test for issue #5308.

[issue5308] cannot marshal objects with more than 2**31 elements

2013-02-13 Thread Serhiy Storchaka
Serhiy Storchaka added the comment: Perhaps you could add a bigmem test for this? (assuming you have enough memory somewhere to test it) Some tests require more than 252 GiB of memory. -- ___ Python tracker rep...@bugs.python.org

[issue5308] cannot marshal objects with more than 2**31 elements

2013-02-12 Thread Serhiy Storchaka
Changes by Serhiy Storchaka storch...@gmail.com: -- assignee: - serhiy.storchaka ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue5308 ___ ___

[issue5308] cannot marshal objects with more than 2**31 elements

2013-02-06 Thread Serhiy Storchaka
Changes by Serhiy Storchaka storch...@gmail.com: -- nosy: +serhiy.storchaka versions: +Python 3.4 ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue5308 ___

[issue5308] cannot marshal objects with more than 2**31 elements

2013-02-06 Thread Serhiy Storchaka
Serhiy Storchaka added the comment: Here is a patch for 3.x which adds checks for size overflow (only on 64-bit platform). -- keywords: +patch stage: needs patch - patch review Added file: http://bugs.python.org/file28977/marshal_overflow.patch ___

[issue5308] cannot marshal objects with more than 2**31 elements

2013-02-06 Thread Serhiy Storchaka
Serhiy Storchaka added the comment: And here is a patch for 2.7. -- Added file: http://bugs.python.org/file28978/marshal_overflow-2.7.patch ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue5308

[issue5308] cannot marshal objects with more than 2**31 elements

2013-02-06 Thread Serhiy Storchaka
Serhiy Storchaka added the comment: (And as a matter of principle, INT_MAX isn't really right here: an int might be only 16 bits long on  some strange platforms...). AFAIK Python doesn't support such platforms (and C standard requites at least 32-bit ints). However there are strange

[issue5308] cannot marshal objects with more than 2**31 elements

2013-02-06 Thread Antoine Pitrou
Antoine Pitrou added the comment: Perhaps you could add a bigmem test for this? (assuming you have enough memory somewhere to test it) -- nosy: +pitrou ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue5308

[issue5308] cannot marshal objects with more than 2**31 elements

2013-02-06 Thread Mark Dickinson
Mark Dickinson added the comment: (and C standard requites at least 32-bit ints) No, that's not true: see Annex E of the standard, where the minimum for INT_MAX is declared to be 32767. -- ___ Python tracker rep...@bugs.python.org

[issue5308] cannot marshal objects with more than 2**31 elements

2013-02-06 Thread Eric Snow
Changes by Eric Snow ericsnowcurren...@gmail.com: -- nosy: +eric.snow ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue5308 ___ ___ Python-bugs-list

[issue5308] cannot marshal objects with more than 2**31 elements

2013-02-06 Thread Stefan Krah
Stefan Krah added the comment: Theoretically int may be 16 bits (C99): 5.2.4.2.1 Sizes of integer types limits.h -- maximum value for an object of type int INT_MAX +32767 // 2**15 − 1 I agree that Python wouldn't compile on such a platform anyway. -- nosy: +skrah

[issue5308] cannot marshal objects with more than 2**31 elements

2013-02-06 Thread Stefan Krah
Stefan Krah added the comment: Hmm, Mark was faster. ;) -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue5308 ___ ___ Python-bugs-list mailing

[issue5308] cannot marshal objects with more than 2**31 elements

2013-02-06 Thread Serhiy Storchaka
Serhiy Storchaka added the comment: Perhaps you could add a bigmem test for this? (assuming you have enough memory somewhere to test it) I think this is possible. I now have some experience in the writing of bigmem tests. ;) -- ___ Python

[issue5308] cannot marshal objects with more than 2**31 elements

2013-02-06 Thread Serhiy Storchaka
Serhiy Storchaka added the comment: No, that's not true: see Annex E of the standard, where the minimum for INT_MAX is declared to be 32767. My fault. Do I have to support such a case in the code? -- ___ Python tracker rep...@bugs.python.org

[issue5308] cannot marshal objects with more than 2**31 elements

2013-02-06 Thread Mark Dickinson
Mark Dickinson added the comment: Do I have to support such a case in the code? No, I don't see any need for that: after all, you're making the code *more* portable by replacing those occurrences of INT_MAX with 0x7fff. :-) -- ___ Python

[issue5308] cannot marshal objects with more than 2**31 elements

2013-02-06 Thread Serhiy Storchaka
Serhiy Storchaka added the comment: Perhaps we should change signatures of w_string() and r_string() -- replace int by at least long. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue5308

[issue5308] cannot marshal objects with more than 2**31 elements

2013-02-06 Thread Mark Dickinson
Mark Dickinson added the comment: Hmm, yes, I think that would also make sense. I missed those uses of int. I'll give in, though, and accept that = 32-bit ints are a de facto standard, even if not de jure. -- ___ Python tracker

[issue5308] cannot marshal objects with more than 2**31 elements

2011-06-26 Thread Terry J. Reedy
Changes by Terry J. Reedy tjre...@udel.edu: -- stage: - needs patch versions: +Python 3.2, Python 3.3 -Python 3.1 ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue5308 ___

[issue5308] cannot marshal objects with more than 2**31 elements

2009-06-07 Thread Mark Dickinson
Changes by Mark Dickinson dicki...@gmail.com: -- assignee: marketdickinson - ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue5308 ___ ___

[issue5308] cannot marshal objects with more than 2**31 elements

2009-02-21 Thread Mark Dickinson
Mark Dickinson dicki...@gmail.com added the comment: It wouldn't hurt to add the overflow checks though, would it? -- assignee: - marketdickinson priority: - normal ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue5308

[issue5308] cannot marshal objects with more than 2**31 elements

2009-02-21 Thread Raymond Hettinger
Raymond Hettinger rhettin...@users.sourceforge.net added the comment: Why not. Besides it ought to be fun to write the test case for this one :-) ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue5308

[issue5308] cannot marshal objects with more than 2**31 elements

2009-02-18 Thread Mark Dickinson
New submission from Mark Dickinson dicki...@gmail.com: Two closely related issues in Python/marshal.c, involving writing and reading of variable-length objects (lists, strings, long integers, ...) (1) The w_object function in marshal contains many instances of code like the following: else

[issue5308] cannot marshal objects with more than 2**31 elements

2009-02-18 Thread Raymond Hettinger
Raymond Hettinger rhettin...@users.sourceforge.net added the comment: Given that marshal is primarily about supporting pyc files, do we care? -- nosy: +rhettinger ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue5308