Re: [Python-Dev] Multigigabyte memory usage in the OpenIndiana Buildbot
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 08/09/11 09:18, Antoine Pitrou wrote: Ok, I've added -j4, let's how that works. It is not helping. it is taking tons of memory yet. Another option would be to have a single Python process and fork for each test. That would launch each test in a separate process without requiring a full python interpreter launching each time. Is this the way -j is implemented It uses subprocess actually, so fork() + exec() is used. Yes, does it but fork for each test or simply launch 4 processes, each doing 1/4 of the tests?. BTW, the (nice and helpful) OpenIndiana folks have told me a few hours ago that they would increase my swap limit to 16GB. I am now waiting for this change to be done. Good news :) 16GB of swap activated a few minutes ago. Thanks, Jon and Alastair :-) (OpenIndiana guys). Launching buildbots now and crossing fingers... - -- Jesus Cea Avion _/_/ _/_/_/_/_/_/ j...@jcea.es - http://www.jcea.es/ _/_/_/_/ _/_/_/_/ _/_/ jabber / xmpp:j...@jabber.org _/_/_/_/ _/_/_/_/_/ . _/_/ _/_/_/_/ _/_/ _/_/ Things are not so easy _/_/ _/_/_/_/ _/_/_/_/ _/_/ My name is Dump, Core Dump _/_/_/_/_/_/ _/_/ _/_/ El amor es poner tu felicidad en la felicidad de otro - Leibniz -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.10 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iQCVAwUBTmotPplgi5GaxT1NAQKUzQP/Qm+lyCQeldL1XEkkq1EHY5C/hKvMDz9i qOV29iai/hkeqRWY2Fiu4vSfNTDAEil9eEIJQMGmUyYOMCrfOEoDCYzr+xTWfnNu EWzI6mEe8XWIUicGDAf/dbUEk11wtSrtXA09G0Q5oQWg0b6auQHYv5vhZITwDWSO h9rLBnZ0ZHI= =8Mpw -END PGP SIGNATURE- ___ Python-Dev mailing list Python-Dev@python.org http://mail.python.org/mailman/listinfo/python-dev Unsubscribe: http://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com
Re: [Python-Dev] Multigigabyte memory usage in the OpenIndiana Buildbot
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 08/09/11 09:18, Antoine Pitrou wrote: Ok, I've added -j4, let's how that works. It is not helping. it is taking tons of memory yet. Another option would be to have a single Python process and fork for each test. That would launch each test in a separate process without requiring a full python interpreter launching each time. Is this the way -j is implemented It uses subprocess actually, so fork() + exec() is used. Yes, does it but fork for each test or simply launch 4 processes, each doing 1/4 of the tests?. BTW, the (nice and helpful) OpenIndiana folks have told me a few hours ago that they would increase my swap limit to 16GB. I am now waiting for this change to be done. Good news :) 16GB of swap activated a few minutes ago. Thanks, Jon and Alastair :-) (OpenIndiana guys). Launching buildbots now and crossing fingers... - -- Jesus Cea Avion _/_/ _/_/_/_/_/_/ j...@jcea.es - http://www.jcea.es/ _/_/_/_/ _/_/_/_/ _/_/ jabber / xmpp:j...@jabber.org _/_/_/_/ _/_/_/_/_/ . _/_/ _/_/_/_/ _/_/ _/_/ Things are not so easy _/_/ _/_/_/_/ _/_/_/_/ _/_/ My name is Dump, Core Dump _/_/_/_/_/_/ _/_/ _/_/ El amor es poner tu felicidad en la felicidad de otro - Leibniz -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.10 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iQCVAwUBTmotSplgi5GaxT1NAQIHEwQAhcKKUerwx++/egmYRO86z5XmgiWh/chz j3xNcMau7L2pxqymEUwfQKihXrYS58ocTiRBEyHAl3vMOouRwgS8joT2eQugfjux Cy+Rglw+4yg99n+eGwF0z4QxbEljuBJFIrR/+BKeN0sBdT/n1/PZIkN/cWMLDk8t bw1FtxfSW6s= =F0er -END PGP SIGNATURE- ___ Python-Dev mailing list Python-Dev@python.org http://mail.python.org/mailman/listinfo/python-dev Unsubscribe: http://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com
[Python-Dev] Summary of Python tracker Issues
ACTIVITY SUMMARY (2011-09-02 - 2011-09-09)
Python tracker at http://bugs.python.org/
To view or respond to any of the issues listed below, click on the issue.
Do NOT respond to this message.
Issues counts and deltas:
open3000 (+33)
closed 21727 (+26)
total 24727 (+59)
Open issues with patches: 1287
Issues opened (49)
==
#12887: Documenting all SO_* constants in socket module
http://bugs.python.org/issue12887 opened by sandro.tosi
#12890: cgitb displays p tags when executed in text mode
http://bugs.python.org/issue12890 opened by mcjeff
#12891: Clean up traces of manifest template in packaging
http://bugs.python.org/issue12891 opened by eric.araujo
#12892: UTF-16 and UTF-32 codecs should reject (lone) surrogates
http://bugs.python.org/issue12892 opened by ezio.melotti
#12895: In MSI/EXE installer, allow installing Python modules in free
http://bugs.python.org/issue12895 opened by cool-RR
#12896: Recommended location of the interpreter for Python 3
http://bugs.python.org/issue12896 opened by lregebro
#12897: Support for iterators in multiprocessing map
http://bugs.python.org/issue12897 opened by acooke
#12900: Use universal newlines mode for setup.cfg
http://bugs.python.org/issue12900 opened by eric.araujo
#12901: Nest class/methods directives in documentation
http://bugs.python.org/issue12901 opened by eric.araujo
#12902: help(modules) executes module code
http://bugs.python.org/issue12902 opened by dronus
#12903: test_io.test_interrupte[r]d* blocks on OpenBSD
http://bugs.python.org/issue12903 opened by rpointel
#12904: Change os.utime c functions to use nanosecond precision where
http://bugs.python.org/issue12904 opened by larry
#12905: multiple errors in test_socket on OpenBSD
http://bugs.python.org/issue12905 opened by rpointel
#12907: Update test coverage devguide page
http://bugs.python.org/issue12907 opened by brett.cannon
#12908: Update dev-in-a-box for new coverage steps
http://bugs.python.org/issue12908 opened by brett.cannon
#12910: urrlib.quote quotes too many chars, e.g., '()'
http://bugs.python.org/issue12910 opened by joern
#12911: Expose a private accumulator C API
http://bugs.python.org/issue12911 opened by pitrou
#12912: xmlrpclib.__version__ not bumped with updates
http://bugs.python.org/issue12912 opened by rcritten
#12913: Add a debugging howto
http://bugs.python.org/issue12913 opened by eric.araujo
#12914: Add cram function to textwrap
http://bugs.python.org/issue12914 opened by eric.araujo
#12915: Add inspect.locate and inspect.resolve
http://bugs.python.org/issue12915 opened by eric.araujo
#12916: Add inspect.splitdoc
http://bugs.python.org/issue12916 opened by eric.araujo
#12917: Make visiblename and allmethods functions public
http://bugs.python.org/issue12917 opened by eric.araujo
#12918: New module for terminal utilities
http://bugs.python.org/issue12918 opened by eric.araujo
#12919: Control what module is imported first
http://bugs.python.org/issue12919 opened by brett.cannon
#12920: Inspect.getsource fails to get source of local classes
http://bugs.python.org/issue12920 opened by Popa.Claudiu
#12921: http.server.BaseHTTPRequestHandler.send_error and trailing new
http://bugs.python.org/issue12921 opened by Paul.Upchurch
#12922: StringIO and seek()
http://bugs.python.org/issue12922 opened by terry.reedy
#12923: test_urllib fails in refleak mode
http://bugs.python.org/issue12923 opened by skrah
#12924: Missing call to quote_plus() in test_urllib.test_default_quoti
http://bugs.python.org/issue12924 opened by jon
#12925: python setup.py upload_docs doesn't ask for login and password
http://bugs.python.org/issue12925 opened by cancel
#12926: tarfile tarinfo.extract*() broken with symlinks
http://bugs.python.org/issue12926 opened by Fabio.Erculiani
#12927: test_ctypes: segfault with suncc
http://bugs.python.org/issue12927 opened by skrah
#12930: reindent.py inserts spaces in multiline literals
http://bugs.python.org/issue12930 opened by Dima.Tisnek
#12931: xmlrpclib confuses unicode and string
http://bugs.python.org/issue12931 opened by wosc
#12932: dircmp does not allow non-shallow comparisons
http://bugs.python.org/issue12932 opened by kesmit
#12933: Update or remove claims that distutils requires external progr
http://bugs.python.org/issue12933 opened by eric.araujo
#12934: pysetup doesnât work for the docutils project
http://bugs.python.org/issue12934 opened by eric.araujo
#12935: Typo in findertools.py
http://bugs.python.org/issue12935 opened by karstenw
#12936: armv5tejl: random segfaults in getaddrinfo()
http://bugs.python.org/issue12936 opened by skrah
#12937: Support install options as found in distutils
http://bugs.python.org/issue12937 opened by brett.cannon
#12938: html.escape docstring does not mention single quotes (')
http://bugs.python.org/issue12938 opened by zvin
#12939: Add new io.FileIO using the native Windows API
Re: [Python-Dev] PEP 393 Summer of Code Project
On Thu, Sep 8, 2011 at 10:39 PM, Terry Reedy tjre...@udel.edu wrote: On 9/8/2011 6:15 PM, fwierzbi...@gmail.com wrote: Oops, forgot to add the link for the gory details for Java and 2 byte unicode: http://java.sun.com/developer/technicalArticles/Intl/Supplementary/ This is dated 2004. Basically, they considered several options, tried out 4, and ended up sticking with char[] (sequences) as UTF-16 with char = 16 bit code unit and added 32-bit Character(int) class for low-level manipulation of code points. I did not see the indexing problem mentioned. I get the impression that they encourage sequence forward-backward iteration (cursor-based access) rather than random-access indexing. Hmmm, sorry for the irrelevant link - my lack of expertise here is showing. What I do know is that we (meaning Jim Baker) are taking great pains to always use codepoints even for random access in our unicode code. I can't speak to the performance implications without some deeper study into what Jim has done. -Frank ___ Python-Dev mailing list Python-Dev@python.org http://mail.python.org/mailman/listinfo/python-dev Unsubscribe: http://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com
Re: [Python-Dev] Multigigabyte memory usage in the OpenIndiana Buildbot
Le Fri, 09 Sep 2011 17:14:18 +0200, Jesus Cea j...@jcea.es a écrit : -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 08/09/11 09:18, Antoine Pitrou wrote: Ok, I've added -j4, let's how that works. It is not helping. it is taking tons of memory yet. That's rather strange. Is it for every test or a few select ones? Another option would be to have a single Python process and fork for each test. That would launch each test in a separate process without requiring a full python interpreter launching each time. Is this the way -j is implemented It uses subprocess actually, so fork() + exec() is used. Yes, does it but fork for each test or simply launch 4 processes, each doing 1/4 of the tests?. It forks for each test. Regards Antoine. ___ Python-Dev mailing list Python-Dev@python.org http://mail.python.org/mailman/listinfo/python-dev Unsubscribe: http://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com
Re: [Python-Dev] PEP 393 Summer of Code Project
On 9/9/2011 12:12 PM, fwierzbi...@gmail.com wrote: On Thu, Sep 8, 2011 at 10:39 PM, Terry Reedytjre...@udel.edu wrote: On 9/8/2011 6:15 PM, fwierzbi...@gmail.com wrote: Oops, forgot to add the link for the gory details for Java and2 byte unicode: http://java.sun.com/developer/technicalArticles/Intl/Supplementary/ This is dated 2004. Basically, they considered several options, tried out 4, and ended up sticking with char[] (sequences) as UTF-16 with char = 16 bit code unit and added 32-bit Character(int) class for low-level manipulation of code points. I did not see the indexing problem mentioned. I get the impression that they encourage sequence forward-backward iteration (cursor-based access) rather than random-access indexing. Hmmm, sorry for the irrelevant link - my lack of expertise here is showing. What I do know is that we (meaning Jim Baker) are taking great pains to always use codepoints even for random access in our unicode code. I can't speak to the performance implications without some deeper study into what Jim has done. I am curious how you index by code point rather than code unit with 16-bit code units and how it compares with the method I posted. Is there anything I can read? Reply off list if you want. -- Terry Jan Reedy ___ Python-Dev mailing list Python-Dev@python.org http://mail.python.org/mailman/listinfo/python-dev Unsubscribe: http://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com
Re: [Python-Dev] [Python-checkins] cpython (3.2): Fix PyUnicode_AsWideCharString() doc: size doesn't contain the null character
Am 06.09.2011 10:04, schrieb Victor Stinner: Le 06/09/2011 02:25, Nick Coghlan a écrit : On Tue, Sep 6, 2011 at 10:01 AM, victor.stinner python-check...@python.org wrote: Fix also spelling of the null character. While these cases are legitimately changed to 'null' (since they're lowercase descriptions of the character), I figure it's worth mentioning again that the ASCII name for '\0' actually *is* NUL (i.e. only one 'L'). Strange, but true [1]. Cheers, Nick. [1] https://secure.wikimedia.org/wikipedia/en/wiki/ASCII NUL is an abbreviation used in tables when you don't have enough space to write the full name: null character. Where do you want to mention this abbreviation? I vote to paint the bikeshed BLU. Georg (Seriously, how many more messages will this triviality spawn?) ___ Python-Dev mailing list Python-Dev@python.org http://mail.python.org/mailman/listinfo/python-dev Unsubscribe: http://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com
Re: [Python-Dev] PEP 393 Summer of Code Project
On Fri, Sep 9, 2011 at 10:16 AM, Terry Reedy tjre...@udel.edu wrote:
I am curious how you index by code point rather than code unit with 16-bit
code units and how it compares with the method I posted. Is there anything I
can read? Reply off list if you want.
I'll post on-list until someone complains, just in case there are
interested onlookers :)
There aren't docs, but the code is here:
https://bitbucket.org/jython/jython/src/8a8642e45433/src/org/python/core/PyUnicode.java
Here are (I think) the most relevant bits for random access -- note
that getString() returns the internal representation of the PyUnicode
which is a java.lang.String
@Override
protected PyObject pyget(int i) {
if (isBasicPlane()) {
return Py.makeCharacter(getString().charAt(i), true);
}
int k = 0;
while (i 0) {
int W1 = getString().charAt(k);
if (W1 = 0xD800 W1 0xDC00) {
k += 2;
} else {
k += 1;
}
i--;
}
int codepoint = getString().codePointAt(k);
return Py.makeCharacter(codepoint, true);
}
public boolean isBasicPlane() {
if (plane == Plane.BASIC) {
return true;
} else if (plane == Plane.UNKNOWN) {
plane = (getString().length() == getCodePointCount()) ?
Plane.BASIC : Plane.ASTRAL;
}
return plane == Plane.BASIC;
}
public int getCodePointCount() {
if (codePointCount = 0) {
return codePointCount;
}
codePointCount = getString().codePointCount(0, getString().length());
return codePointCount;
}
-Frank
___
Python-Dev mailing list
Python-Dev@python.org
http://mail.python.org/mailman/listinfo/python-dev
Unsubscribe:
http://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com
Re: [Python-Dev] PEP 393 Summer of Code Project
I, for one, am very interested. It sounds like the 'unicode' datatype
in Jython does not in fact have O(1) indexing characteristics if the
string contains any characters in the astral plane. Interesting. I
wonder if you have heard from anyone about this affecting their app's
performance?
--Guido
On Fri, Sep 9, 2011 at 12:58 PM, fwierzbi...@gmail.com
fwierzbi...@gmail.com wrote:
On Fri, Sep 9, 2011 at 10:16 AM, Terry Reedy tjre...@udel.edu wrote:
I am curious how you index by code point rather than code unit with 16-bit
code units and how it compares with the method I posted. Is there anything I
can read? Reply off list if you want.
I'll post on-list until someone complains, just in case there are
interested onlookers :)
There aren't docs, but the code is here:
https://bitbucket.org/jython/jython/src/8a8642e45433/src/org/python/core/PyUnicode.java
Here are (I think) the most relevant bits for random access -- note
that getString() returns the internal representation of the PyUnicode
which is a java.lang.String
@Override
protected PyObject pyget(int i) {
if (isBasicPlane()) {
return Py.makeCharacter(getString().charAt(i), true);
}
int k = 0;
while (i 0) {
int W1 = getString().charAt(k);
if (W1 = 0xD800 W1 0xDC00) {
k += 2;
} else {
k += 1;
}
i--;
}
int codepoint = getString().codePointAt(k);
return Py.makeCharacter(codepoint, true);
}
public boolean isBasicPlane() {
if (plane == Plane.BASIC) {
return true;
} else if (plane == Plane.UNKNOWN) {
plane = (getString().length() == getCodePointCount()) ?
Plane.BASIC : Plane.ASTRAL;
}
return plane == Plane.BASIC;
}
public int getCodePointCount() {
if (codePointCount = 0) {
return codePointCount;
}
codePointCount = getString().codePointCount(0, getString().length());
return codePointCount;
}
-Frank
___
Python-Dev mailing list
Python-Dev@python.org
http://mail.python.org/mailman/listinfo/python-dev
Unsubscribe:
http://mail.python.org/mailman/options/python-dev/guido%40python.org
--
--Guido van Rossum (python.org/~guido)
___
Python-Dev mailing list
Python-Dev@python.org
http://mail.python.org/mailman/listinfo/python-dev
Unsubscribe:
http://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com
Re: [Python-Dev] PEP 393 Summer of Code Project
On Fri, Sep 9, 2011 at 2:21 PM, Guido van Rossum gu...@python.org wrote: I, for one, am very interested. It sounds like the 'unicode' datatype in Jython does not in fact have O(1) indexing characteristics if the string contains any characters in the astral plane. Interesting. I wonder if you have heard from anyone about this affecting their app's performance? So far we haven't had any complaints - I'm not really sure how often Jython gets used with astral plane characters at this point, but I expect it will happen more in the future, especially once we put together a Jython 3 and Unicode support becomes a stronger expectation. Personally I'm hoping that in that time frame Java will come under pressure to provide a better answer (or we may need to think in the same direction as Dino was thinking in an earlier part of this thread and make a more Python specific String type for Jython) -Frank ___ Python-Dev mailing list Python-Dev@python.org http://mail.python.org/mailman/listinfo/python-dev Unsubscribe: http://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com
Re: [Python-Dev] PEP 393 Summer of Code Project
Well, I'd be interesting how it goes, since if Jython users find this acceptable then maybe we shouldn't be quite so concerned about it for CPython... On the third hand we don't have working code for this approach in CPython, while we do have working code for the PEP 393 solution... --Guido On Fri, Sep 9, 2011 at 3:38 PM, fwierzbi...@gmail.com fwierzbi...@gmail.com wrote: On Fri, Sep 9, 2011 at 2:21 PM, Guido van Rossum gu...@python.org wrote: I, for one, am very interested. It sounds like the 'unicode' datatype in Jython does not in fact have O(1) indexing characteristics if the string contains any characters in the astral plane. Interesting. I wonder if you have heard from anyone about this affecting their app's performance? So far we haven't had any complaints - I'm not really sure how often Jython gets used with astral plane characters at this point, but I expect it will happen more in the future, especially once we put together a Jython 3 and Unicode support becomes a stronger expectation. Personally I'm hoping that in that time frame Java will come under pressure to provide a better answer (or we may need to think in the same direction as Dino was thinking in an earlier part of this thread and make a more Python specific String type for Jython) -Frank -- --Guido van Rossum (python.org/~guido) ___ Python-Dev mailing list Python-Dev@python.org http://mail.python.org/mailman/listinfo/python-dev Unsubscribe: http://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com
Re: [Python-Dev] PEP 393 Summer of Code Project
On 9/9/2011 5:21 PM, Guido van Rossum wrote:
I, for one, am very interested. It sounds like the 'unicode' datatype
in Jython does not in fact have O(1) indexing characteristics if the
string contains any characters in the astral plane. Interesting. I
wonder if you have heard from anyone about this affecting their app's
performance?
--Guido
The question is whether or how often any Jython users are yet
indexing/slicing long strings with astral chars. If a utf-8 xml file is
directly parsed into a DOM, then the longest decoded strings will be
'paragraphs' that are seldom more than 1000 chars.
On Fri, Sep 9, 2011 at 12:58 PM, fwierzbi...@gmail.com
fwierzbi...@gmail.com wrote:
On Fri, Sep 9, 2011 at 10:16 AM, Terry Reedytjre...@udel.edu wrote:
I am curious how you index by code point rather than code unit with 16-bit
code units and how it compares with the method I posted. Is there anything I
can read? Reply off list if you want.
I'll post on-list until someone complains, just in case there are
interested onlookers :)
There aren't docs, but the code is here:
https://bitbucket.org/jython/jython/src/8a8642e45433/src/org/python/core/PyUnicode.java
Here are (I think) the most relevant bits for random access -- note
that getString() returns the internal representation of the PyUnicode
which is a java.lang.String
@Override
protected PyObject pyget(int i) {
if (isBasicPlane()) {
return Py.makeCharacter(getString().charAt(i), true);
}
This is O(1)
int k = 0;
while (i 0) {
int W1 = getString().charAt(k);
if (W1= 0xD800 W1 0xDC00) {
k += 2;
} else {
k += 1;
}
i--;
This is an O(n) linear scan.
}
int codepoint = getString().codePointAt(k);
return Py.makeCharacter(codepoint, true);
}
Near the beginning of this thread, I described and gave a link to my
O(logk) algorithm, where k is the number of supplementary ('astral')
chars. It uses bisect.bisect_left on an int array of length k
constructed with a linear scan much like the one above, with one added
line. The basic idea is to do the linear scan just once and save the
locations (code point indexes) of the astral chars instead of repeating
the scan on every access. That could be done as the string is
constructed. The same array search works for slicing too. Jython is
welcome to use it if you ever decide you need it.
I have in mind to someday do some timing tests with the Python version.
I just do not know how closely results would be to those for compiled C
or Java.
--
Terry Jan Reedy
___
Python-Dev mailing list
Python-Dev@python.org
http://mail.python.org/mailman/listinfo/python-dev
Unsubscribe:
http://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com
Re: [Python-Dev] Multigigabyte memory usage in the OpenIndiana Buildbot
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 09/09/11 19:04, Antoine Pitrou wrote: On 08/09/11 09:18, Antoine Pitrou wrote: Ok, I've added -j4, let's how that works. It is not helping. it is taking tons of memory yet. That's rather strange. Is it for every test or a few select ones? I can't reproduce after stopping the buildbots, delete all its data and restart them. Now I see quite a few python processes running, but memory usage is reasonable. Yes, does it but fork for each test or simply launch 4 processes, each doing 1/4 of the tests?. It forks for each test. So, the memory used should be quite low, then :-). I have committed a few patches in the last hours to get my buildbots green, back again. The memory used was 500MB, compared with 4GB before the -j. Could you reconfigure my buildbots to be able to run all the six (2.7, 3.2, 3.x, in 32 and 64 bits) instances at the same time, again?. I have enough resources now. I really sorry to waste your time... Thanks!. - -- Jesus Cea Avion _/_/ _/_/_/_/_/_/ j...@jcea.es - http://www.jcea.es/ _/_/_/_/ _/_/_/_/ _/_/ jabber / xmpp:j...@jabber.org _/_/_/_/ _/_/_/_/_/ . _/_/ _/_/_/_/ _/_/ _/_/ Things are not so easy _/_/ _/_/_/_/ _/_/_/_/ _/_/ My name is Dump, Core Dump _/_/_/_/_/_/ _/_/ _/_/ El amor es poner tu felicidad en la felicidad de otro - Leibniz -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.10 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iQCVAwUBTmrTMZlgi5GaxT1NAQIIKgP+LE1NCfcCVIX+jau4QSJRAVvZan4rqqYn /tMLaz92/toP2S8FdHKbEPs6hBf6QGgnVxnHWcwTxxTWzfDL8xxGjFgJYh/hcqBi B2zfrp83PjW6hFMeL6E7707DI6YwZRCB+dJIiVejAIEMHVOVG6x12KRLFCWL+AOZ ElpXewoATXI= =fHkz -END PGP SIGNATURE- ___ Python-Dev mailing list Python-Dev@python.org http://mail.python.org/mailman/listinfo/python-dev Unsubscribe: http://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com
Re: [Python-Dev] Multigigabyte memory usage in the OpenIndiana Buildbot
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 10/09/11 05:02, Jesus Cea wrote: I have committed a few patches in the last hours to get my buildbots green, back again. The memory used was 500MB, compared with 4GB before the -j. One of my patches solves a process leak in multiprocessing, when some tests failed. Doing make test leaked quite a few processes, but only in OpenIndiana, where those tests actually failed. That is solved now, both the leak and the test failure. Details: http://bugs.python.org/issue12948 http://bugs.python.org/issue12950 I think the buildbots toke care of this rogue processes after the timeout expires, anyway, but... Could you reconfigure my buildbots to be able to run all the six (2.7, 3.2, 3.x, in 32 and 64 bits) instances at the same time, again?. I have enough resources now. I really sorry to waste your time... Now, a buildbot run of 3.x compiled in 64bits takes around 500MB. I have seen a peak of around 4GB and a few of around 800MB, for a fraction of a second. - -- Jesus Cea Avion _/_/ _/_/_/_/_/_/ j...@jcea.es - http://www.jcea.es/ _/_/_/_/ _/_/_/_/ _/_/ jabber / xmpp:j...@jabber.org _/_/_/_/ _/_/_/_/_/ . _/_/ _/_/_/_/ _/_/ _/_/ Things are not so easy _/_/ _/_/_/_/ _/_/_/_/ _/_/ My name is Dump, Core Dump _/_/_/_/_/_/ _/_/ _/_/ El amor es poner tu felicidad en la felicidad de otro - Leibniz -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.10 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iQCVAwUBTmrY6plgi5GaxT1NAQKvUgP/YlS7wneU5dsWoAmtqauC02gZUi1D4OpQ 7waM8G1q8OHXLbpV1jKmBb/32G+rDp1Tm/XCjlHpK1wJcmwWmdPGAbbQp1o5TduJ z+lbPnzWvMCRLJwZDtZAitn4/7VchoAcdTfIYCyBoK/JEUI1Oq0Mt5XeIgtD+FX9 IjwuWzXISqM= =ojrq -END PGP SIGNATURE- ___ Python-Dev mailing list Python-Dev@python.org http://mail.python.org/mailman/listinfo/python-dev Unsubscribe: http://mail.python.org/mailman/options/python-dev/archive%40mail-archive.com
