[issue12775] immense performance problems related to the garbage collector

2011-08-18 Thread Daniel Svensson
New submission from Daniel Svensson dsvens...@gmail.com: I've noticed problems with the GC in two applications. In one case the application did not respond to SOAP-requests for 9 seconds, every couple of minutes, when it really shouldn't have taken more than 20ms. In another case we had one

[issue12775] immense performance problems related to the garbage collector

2011-08-18 Thread Daniel Svensson
Daniel Svensson dsvens...@gmail.com added the comment: The bug note contains a test script. You just have to generate a huge JSON-blob, or allocate 1 GB or so and pickle it down to file and replace the cjson.decode to pickle.loads, pickle is about 20 times faster without GC

[issue12775] immense performance problems related to the garbage collector

2011-08-18 Thread Daniel Svensson
Daniel Svensson dsvens...@gmail.com added the comment: Or you could disable the GC only when decoding JSON data and reenable it afterwards. JSON was just an example, and disabling/enabling the GC is not safe in a multithreaded environment

[issue12775] immense performance problems related to the garbage collector

2011-08-18 Thread Daniel Svensson
Daniel Svensson dsvens...@gmail.com added the comment: Working on getting a reasonable large file to test with on my laptop where I have 2.6, 2.7, 3.2. The Python version where the problem became apparent was 2.5.2 as the software is deployed on Debian Lenny

[issue12775] immense performance problems related to the garbage collector

2011-08-18 Thread Daniel Svensson
Daniel Svensson dsvens...@gmail.com added the comment: using: (except in python2.5 case where simplejson is used, which ought to be the same thing right?) import time, gc, json, sys def read_json_blob(): t0 = time.time() fd = open(datatest1.json) data = fd.read

[issue12775] immense performance problems related to the garbage collector

2011-08-18 Thread Daniel Svensson
Changes by Daniel Svensson dsvens...@gmail.com: -- versions: -Python 2.7, Python 3.1, Python 3.2, Python 3.3, Python 3.4 ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue12775

[issue12775] immense performance problems related to the garbage collector

2011-08-18 Thread Daniel Svensson
Daniel Svensson dsvens...@gmail.com added the comment: Yes, but this ticket was only opened due to time delta between no-gc and gc, not as much absolute time, but that's a nice improvement. -- ___ Python tracker rep...@bugs.python.org http

[issue4892] Sending Connection-objects over multiprocessing connections fails

2009-08-26 Thread Daniel Svensson
Daniel Svensson dsvens...@gmail.com added the comment: A typical use case would be for a server to receive a connection, and then send that connection over to another process that does the actual work. This used to work with pyprocessing, and the support seems to be available

[issue4892] Sending Connection-objects over multiprocessing connections fails

2009-08-26 Thread Daniel Svensson
Daniel Svensson dsvens...@gmail.com added the comment: And to be clear, I have enabled connection pickling by issuing: multiprocessing.allow_connection_pickling() -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue4892

[issue4892] Sending Connection-objects over multiprocessing connections fails

2009-08-26 Thread Daniel Svensson
Daniel Svensson dsvens...@gmail.com added the comment: When reverting this commit stuff works: http://svn.python.org/view/python/trunk/Lib/multiprocessing/reduction.py?r1=64257r2=65016 -- ___ Python tracker rep...@bugs.python.org http

[issue4892] Sending Connection-objects over multiprocessing connections fails

2009-08-26 Thread Daniel Svensson
Daniel Svensson dsvens...@gmail.com added the comment: Ehm.. completly broken url in prev message.. Revision 65016, Apply Amaury's patch to multiprocessing for issue 3125, removes the copy_reg and replaces it with ForkingPickler.register(), which should resolve the conflict with the global

[issue6175] inet_aton documentation kind of lies

2009-06-02 Thread Daniel Svensson
New submission from Daniel Svensson dsvens...@gmail.com: The documentation for inet_aton specifically says that it's used to Convert an IPv4 address from dotted-quad string format. This however is not really true, it does accept dotted-quad, but not dotted-quad alone, but also these forms from