Re: [Python-Dev] Removing the GIL (Me, not you!)

2007-09-14 Thread Talin
Adam Olsen wrote: > I'm now working on an approach that writes out refcounts in batches to > reduce contention. The initial cost is much higher, but it scales > better too. I've currently got it to just under 50% cost, meaning two > threads is a slight net gain. http://www.research.ibm.com/peopl

Re: [Python-Dev] Removing the GIL (Me, not you!)

2007-09-14 Thread Jon Ribbens
On Fri, Sep 14, 2007 at 03:30:49PM -0400, Jean-Paul Calderone wrote: > > I don't really like the maxint/2 idea because it requires us to > >differentiate between globals and everything else. Plus, it's a hack. I'd > >like a more elegant solution if possible. > > It's not really a solution either.

Re: [Python-Dev] Removing the GIL (Me, not you!)

2007-09-14 Thread Tony Nelson
At 3:30 PM -0400 9/14/07, Jean-Paul Calderone wrote: >On Fri, 14 Sep 2007 14:13:47 -0500, Justin Tulloss <[EMAIL PROTECTED]> wrote: >>Your idea can be combined with the maxint/2 initial refcount for >>> non-disposable objects, which should about eliminate thread-count updates >>> for them. >>> -- >

Re: [Python-Dev] base64 -- should b64encode introduce line breaks?

2007-09-14 Thread Barry Warsaw
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On Sep 14, 2007, at 6:01 PM, Bill Janssen wrote: >> Does anything in textwrap already do the trick? If not, that might >> be the best place to refactor similar code to. > > Yes, textwrap.fill. Thanks for pointing it out. /me tries to remember that

Re: [Python-Dev] Removing the GIL (Me, not you!)

2007-09-14 Thread Greg Ewing
Justin Tulloss wrote: > > What do you think of a model where there is a global > "thread count" that keeps track of how many threads reference an object? I've thought about that sort of thing before. The problem is how you keep track of how many threads reference an object, without introducing

Re: [Python-Dev] Removing the GIL (Me, not you!)

2007-09-14 Thread Adam Olsen
On 9/14/07, Jean-Paul Calderone <[EMAIL PROTECTED]> wrote: > On Fri, 14 Sep 2007 17:43:39 -0400, James Y Knight <[EMAIL PROTECTED]> wrote: > > > >On Sep 14, 2007, at 3:30 PM, Jean-Paul Calderone wrote: > >>On Fri, 14 Sep 2007 14:13:47 -0500, Justin Tulloss <[EMAIL PROTECTED]> > >>wrote: > >>>Your

Re: [Python-Dev] base64 -- should b64encode introduce line breaks?

2007-09-14 Thread Bill Janssen
> Does anything in textwrap already do the trick? If not, that might > be the best place to refactor similar code to. Yes, textwrap.fill. Thanks for pointing it out. Bill ___ Python-Dev mailing list Python-Dev@python.org http://mail.python.org/mailm

Re: [Python-Dev] Removing the GIL (Me, not you!)

2007-09-14 Thread Jean-Paul Calderone
On Fri, 14 Sep 2007 17:43:39 -0400, James Y Knight <[EMAIL PROTECTED]> wrote: > >On Sep 14, 2007, at 3:30 PM, Jean-Paul Calderone wrote: >>On Fri, 14 Sep 2007 14:13:47 -0500, Justin Tulloss <[EMAIL PROTECTED]> >>wrote: >>>Your idea can be combined with the maxint/2 initial refcount for non-di

Re: [Python-Dev] Daily Windows Installers

2007-09-14 Thread David Bolen
Georg Brandl <[EMAIL PROTECTED]> writes: > David Bolen schrieb: >> Georg Brandl <[EMAIL PROTECTED]> writes: (...) >> For the moment I'm probably going to work to ensure we don't get the >> pop-up box (which blocks the rest of the processing) so at least an >> MSI can get created even if the chm is

Re: [Python-Dev] import file extensions

2007-09-14 Thread tomer filiba
On 9/14/07, "Martin v. Löwis" <[EMAIL PROTECTED]> wrote: > The best way would be to not use import, but provide a separate > function (e.g. calling it "require"). > yepp, that's probably the cleanest and quickest solution. i needed to see all the alternatives to realize this though. sorry. --

Re: [Python-Dev] [python] Re: import file extensions

2007-09-14 Thread Michael Foord
Guido van Rossum wrote: > I think you're looking for a PEP 302 style meta hook. > Or even execfile in a context... Michael Foord http://www.manning.com/foord > On 9/14/07, tomer filiba <[EMAIL PROTECTED]> wrote: > >> a quick question: i'm working on a pythonic build system, where the >> bui

Re: [Python-Dev] import file extensions

2007-09-14 Thread Martin v. Löwis
> so i'm wondering, is there a quick way to just add another extension > to import mechanism? or do i have to write a fully fledged import > hook? [this question is off-topic for python-dev] If recompiling Python is an option, the quick way is to edit the interpreter, and add that extension. If

Re: [Python-Dev] import file extensions

2007-09-14 Thread Guido van Rossum
I think you're looking for a PEP 302 style meta hook. On 9/14/07, tomer filiba <[EMAIL PROTECTED]> wrote: > a quick question: i'm working on a pythonic build system, where the > build > scripts are plain python files. but i want to differentiate them from > normal > python files (.py) by a differe

[Python-Dev] import file extensions

2007-09-14 Thread tomer filiba
a quick question: i'm working on a pythonic build system, where the build scripts are plain python files. but i want to differentiate them from normal python files (.py) by a different suffix (say .pyy), but then i can't import them. so i'm wondering, is there a quick way to just add another exten

Re: [Python-Dev] Daily Windows Installers

2007-09-14 Thread Georg Brandl
David Bolen schrieb: > Georg Brandl <[EMAIL PROTECTED]> writes: > >> I hope this isn't due to the files that Sphinx creates. >> I had a nasty crash with HTML Help Workshop when I generated >> an "invalid" index file -- but this was reproducible of course. > > The really annoying thing is that thi

Re: [Python-Dev] Removing the GIL (Me, not you!)

2007-09-14 Thread Steve Holden
Jean-Paul Calderone wrote: > On Fri, 14 Sep 2007 14:13:47 -0500, Justin Tulloss <[EMAIL PROTECTED]> wrote: >> Your idea can be combined with the maxint/2 initial refcount for >>> non-disposable objects, which should about eliminate thread-count updates >>> for them. >>> -- >>> >> I don't really lik

Re: [Python-Dev] base64 -- should b64encode introduce line breaks?

2007-09-14 Thread Barry Warsaw
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On Sep 14, 2007, at 3:20 PM, Bill Janssen wrote: > I think that's probably right. I just added the PEM line-wrapping to > the code in the ssl module. Though I hate to keep adding > line-wrapping code here and there... Perhaps just adding a utility

[Python-Dev] SSL and asyncore update (and SSL_shutdown)

2007-09-14 Thread Bill Janssen
I've now got an HTTPS server (more importantly, one built on asyncore and SocketServer and BaseHTTPServer), running in the test suite. Also, I think that, for the moment, I'm going to take ssl.ssl_shutdown() out of the library. The state machine implemented at the GoogleSprint really only does th

Re: [Python-Dev] Removing the GIL (Me, not you!)

2007-09-14 Thread Jean-Paul Calderone
On Fri, 14 Sep 2007 14:13:47 -0500, Justin Tulloss <[EMAIL PROTECTED]> wrote: >Your idea can be combined with the maxint/2 initial refcount for >> non-disposable objects, which should about eliminate thread-count updates >> for them. >> -- >> > > I don't really like the maxint/2 idea because it req

Re: [Python-Dev] Daily Windows Installers

2007-09-14 Thread David Bolen
Georg Brandl <[EMAIL PROTECTED]> writes: > I hope this isn't due to the files that Sphinx creates. > I had a nasty crash with HTML Help Workshop when I generated > an "invalid" index file -- but this was reproducible of course. The really annoying thing is that this only occurs (so far) in the 3.

Re: [Python-Dev] base64 -- should b64encode introduce line breaks?

2007-09-14 Thread Bill Janssen
> >> I see that base64.b64encode and base64.standard_b64encode no longer > >> introduce line breaks into the output strings, as base64.encodestring > >> does. Shouldn't there be an option on one of them to do this? > > > > See: > > > > http://mail.python.org/pipermail/python-bugs-list/2001-October

Re: [Python-Dev] Removing the GIL (Me, not you!)

2007-09-14 Thread Justin Tulloss
Your idea can be combined with the maxint/2 initial refcount for > non-disposable objects, which should about eliminate thread-count updates > for them. > -- > I don't really like the maxint/2 idea because it requires us to differentiate between globals and everything else. Plus, it's a hack. I'd

Re: [Python-Dev] base64 -- should b64encode introduce line breaks?

2007-09-14 Thread Barry Warsaw
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On Sep 13, 2007, at 2:43 PM, Bill Janssen wrote: >> I see that base64.b64encode and base64.standard_b64encode no longer >> introduce line breaks into the output strings, as base64.encodestring >> does. Shouldn't there be an option on one of them to d

[Python-Dev] Summary of Tracker Issues

2007-09-14 Thread Tracker
ACTIVITY SUMMARY (09/07/07 - 09/14/07) Tracker at http://bugs.python.org/ To view or respond to any of the issues listed below, click on the issue number. Do NOT respond to this message. 1274 open (+24) / 11372 closed (+11) / 12646 total (+35) Average duration of open issues: 672 days. Medi

Re: [Python-Dev] Removing the GIL (Me, not you!)

2007-09-14 Thread Tony Nelson
At 1:51 AM -0500 9/14/07, Justin Tulloss wrote: >On 9/14/07, Adam Olsen <[EMAIL PROTECTED]> wrote: > >> Could be worth a try. A first step might be to just implement >> the atomic refcounting, and run that single-threaded to see >> if it has terribly bad effects on perform

Re: [Python-Dev] Daily Windows Installers

2007-09-14 Thread Martin v. Löwis
> I hope this isn't due to the files that Sphinx creates. > I had a nasty crash with HTML Help Workshop when I generated > an "invalid" index file -- but this was reproducible of course. It's not clear what precisely the problem is, but yes, it must have to do with the input :-) If you fixed that

Re: [Python-Dev] Removing the GIL (Me, not you!)

2007-09-14 Thread Adam Olsen
On 9/14/07, Justin Tulloss <[EMAIL PROTECTED]> wrote: > > On 9/14/07, Adam Olsen <[EMAIL PROTECTED]> wrote: > > > Could be worth a try. A first step might be to just implement > > > the atomic refcounting, and run that single-threaded to see > > > if it has terribly bad effects on performance. > >

Re: [Python-Dev] Daily Windows Installers

2007-09-14 Thread Paul Moore
On 14/09/2007, "Martin v. Löwis" <[EMAIL PROTECTED]> wrote: > Together with David Bolen, I set up a series of buildbot > slaves that create an MSI installer from the 2.5, 2.6, > and 3.0 branches every day. That's good news. Thanks for doing this. Paul.

Re: [Python-Dev] Daily Windows Installers

2007-09-14 Thread Georg Brandl
Martin v. Löwis schrieb: > Together with David Bolen, I set up a series of buildbot > slaves that create an MSI installer from the 2.5, 2.6, > and 3.0 branches every day. The result files are available > from > > http://www.python.org/dev/daily-msi/ > > The buildbot pages themselves are at > > h

[Python-Dev] Decimal news

2007-09-14 Thread Facundo Batista
Hi people! After some months, Decimal is now in the trunk again. It's fully updated to the latest Cowlishaw specification, and complying with the latest test cases (from a few days ago, which even take in consideration some feedback from ours). I want to thank so much to Mark Dickinson, who made

[Python-Dev] Daily Windows Installers

2007-09-14 Thread Martin v. Löwis
Together with David Bolen, I set up a series of buildbot slaves that create an MSI installer from the 2.5, 2.6, and 3.0 branches every day. The result files are available from http://www.python.org/dev/daily-msi/ The buildbot pages themselves are at http://www.python.org/dev/buildbot/msi/ There

Re: [Python-Dev] Removing the GIL (Me, not you!)

2007-09-14 Thread Hrvoje Nikšić
On Thu, 2007-09-13 at 18:38 -0500, [EMAIL PROTECTED] wrote: > Hrvoje> More precisely, Python will call the deallocator appropriate for > Hrvoje> the object type. If that deallocator does nothing, the object > Hrvoje> continues to live. Such objects could also start out with a > Hrvoje