[Python-Dev] Re: my plans for subinterpreters (and a per-interpreter GIL)

2022-01-05 Thread Trent Nelson
On Wed, Jan 05, 2022 at 01:59:21PM -0800, Trent Nelson wrote: > > I did some research on this a few years back. I was curious what sort > of "max reference counts" were encountered in the wild, in long-running > real life programs. For the same reason: I wanted to get s

[Python-Dev] Re: my plans for subinterpreters (and a per-interpreter GIL)

2022-01-05 Thread Trent Nelson
On Wed, Dec 15, 2021 at 02:57:46PM -0800, Guido van Rossum wrote: > On Wed, Dec 15, 2021 at 6:04 AM Antoine Pitrou wrote: > > > On Wed, 15 Dec 2021 14:13:03 +0100 > > Antoine Pitrou wrote: > > > > > Did you try to take into account the envisioned project for adding a > > > "complete" GC and remo

Re: [Python-Dev] Discussion related to memory leaks requested

2016-01-13 Thread Trent Nelson
Gflags/umdh is pretty useful on Windows, I used it to track down a few quirky PyParallel memory leaks. Steps: 1. Enable global flags: gflags –i python.exe +ust 2. Launch Python. 3. Enable the umdh tracer: umdh –p: -f:d1.log 4. Kill it after a short run. 5. Re-l

Re: [Python-Dev] Yet another "A better story for multi-core Python" comment

2015-09-09 Thread Trent Nelson
On Wed, Sep 09, 2015 at 04:52:39PM -0400, Gary Robinson wrote: > I’m going to seriously consider installing Windows or using a > dedicated hosted windows box next time I have this problem so that I > can try your solution. It does seem pretty ideal, although the STM > branch of PyPy (using http://c

Re: [Python-Dev] Yet another "A better story for multi-core Python" comment

2015-09-09 Thread Trent Nelson
On Wed, Sep 09, 2015 at 01:43:19PM -0700, Ethan Furman wrote: > On 09/09/2015 01:33 PM, Trent Nelson wrote: > > >This problem is *exactly* the type of thing that PyParallel excels at [...] > > Sorry if I missed it, but is PyParallel still Windows only? Yeah, still Windows only

Re: [Python-Dev] Yet another "A better story for multi-core Python" comment

2015-09-09 Thread Trent Nelson
On Tue, Sep 08, 2015 at 10:12:37AM -0400, Gary Robinson wrote: > There was a huge data structure that all the analysis needed to > access. Using a database would have slowed things down too much. > Ideally, I needed to access this same structure from many cores at > once. On a Power8 system, for ex

[Python-Dev] PyParallel update

2015-09-06 Thread Trent Nelson
[CC'ing python-dev@ for those that are curious; please drop and keep follow-up discussion to python-ideas@] Hi folks, I've made a lot of progress on PyParallel since the PyCon dev summit (https://speakerdeck.com/trent/pyparallel-pycon-2015-language-summit); I fixed the outstanding breakage with g

Re: [Python-Dev] [python-committers] Can we clean up the buildbots please?

2015-05-22 Thread Trent Nelson
On Fri, May 22, 2015 at 05:24:53PM -0700, Larry Hastings wrote: > On 05/22/2015 05:11 PM, Trent Nelson wrote: > >Do we still support WS2K3? (Can I even install VS 2015 on that? I would > >have thought not.) > > According to PCbuild/readme.txt, no. It says: > >This

Re: [Python-Dev] [python-committers] Can we clean up the buildbots please?

2015-05-22 Thread Trent Nelson
On Fri, May 22, 2015 at 10:06:48PM +, Steve Dower wrote: > The Windows 7 buildbots are failing on test_asdl_parser, but I have no > idea why – the test works for me just fine. Yury and Benjamin made the > most recent changes to Python.asdl, but I have no idea what effect > they would have here,

Re: [Python-Dev] bytes & bytearray

2015-01-20 Thread Trent Nelson
On Tue, Jan 20, 2015 at 11:48:10AM +0200, Paul Sokolovsky wrote: > Hello, > > On Tue, 20 Jan 2015 18:15:02 +1300 > Greg Ewing wrote: > > > Guido van Rossum wrote: > > > On Mon, Jan 19, 2015 at 11:43 AM, Paul Sokolovsky > > > mailto:pmis...@gmail.com>> wrote: > > > > > > b.lower_inplace() >

Re: [Python-Dev] Access control for buildbot

2014-12-10 Thread Trent Nelson
On Dec 10, 2014, at 6:56 AM, jacob toft pedersen wrote: > Hi there > > I was visiting you buildbot page for inspiration and found that i apparently > have the option to force stop/start all your builds without any access > control. > > You may want to put something to enforce access control?

[Python-Dev] PyParallel: alternate async I/O and GIL removal

2013-11-16 Thread Trent Nelson
Hi folks, Video of the presentation I gave last weekend at PyData NYC regarding PyParallel just went live: https://vimeo.com/79539317 Slides are here: https://speakerdeck.com/trent/pyparallel-how-we-removed-the-gil-and-exploited-all-cores-1 The work was driven by the async I/O d

Re: [Python-Dev] The pysandbox project is broken

2013-11-16 Thread Trent Nelson
On Sat, Nov 16, 2013 at 02:53:22AM -0800, Maciej Fijalkowski wrote: > On Fri, Nov 15, 2013 at 6:56 PM, Trent Nelson wrote: > > On Tue, Nov 12, 2013 at 01:16:55PM -0800, Victor Stinner wrote: > >> pysandbox cannot be used in practice > >> ==

Re: [Python-Dev] The pysandbox project is broken

2013-11-15 Thread Trent Nelson
On Nov 15, 2013, at 12:34 PM, Victor Stinner wrote: > 2013/11/15 Trent Nelson : >>This sounds a lot like the work I initially did with PyParallel to >>try and intercept/prevent parallel threads mutating main-thread >>objects. >> >>I ended up arri

Re: [Python-Dev] The pysandbox project is broken

2013-11-15 Thread Trent Nelson
On Tue, Nov 12, 2013 at 01:16:55PM -0800, Victor Stinner wrote: > pysandbox cannot be used in practice > > > To protect the untrusted namespace, pysandbox installs a lot of > different protections. Because of all these protections, it becomes > hard to write Py

Re: [Python-Dev] pyparallel and new memory API discussions...

2013-06-19 Thread Trent Nelson
dent upon the ability to lock main > thread pages as read-only in one fell-swoop -- am I still going to > be able to do that with your new API in place? > """ > > 2013/6/19 Trent Nelson : > > On Wed, Jun 19, 2013 at 08:45:55AM -0700, Victor Stinner

Re: [Python-Dev] pyparallel and new memory API discussions...

2013-06-19 Thread Trent Nelson
On Wed, Jun 19, 2013 at 08:45:55AM -0700, Victor Stinner wrote: > > 1. All memory allocated in a parallel context is localized to a > > private heap. > > How do you allocate memory in this "private" heap? Did you add new > functions to allocate memory? Yup: _PyHeap_Malloc

Re: [Python-Dev] pyparallel and new memory API discussions...

2013-06-19 Thread Trent Nelson
: > 2013/6/19 Trent Nelson : > > > > The new memory API discussions (and PEP) warrant a quick pyparallel > > update: a couple of weeks after PyCon, I came up with a solution for > > the biggest show-stopper that has been plaguing pyparallel since its > > in

[Python-Dev] pyparallel and new memory API discussions...

2013-06-19 Thread Trent Nelson
The new memory API discussions (and PEP) warrant a quick pyparallel update: a couple of weeks after PyCon, I came up with a solution for the biggest show-stopper that has been plaguing pyparallel since its inception: being able to detect the modification of "main thread" Python

Re: [Python-Dev] Slides from today's parallel/async Python talk

2013-04-05 Thread Trent Nelson
On Thu, Apr 04, 2013 at 11:53:01PM -0700, Charles-Fran?ois Natali wrote: > Hello, > > >> async.submit_work(func, args, kwds, callback=None, errback=None) > >> > >> How do you implement arguments passing and return value? > >> > >> e.g. let's say I pass a list as argument: how do you iterate on the

Re: [Python-Dev] Slides from today's parallel/async Python talk

2013-04-04 Thread Trent Nelson
Hi Charles-François, On Thu, Apr 04, 2013 at 01:18:58AM -0700, Charles-François Natali wrote: > Just a quick implementation question (didn't have time to read through > all your emails :-) > > async.submit_work(func, args, kwds, callback=None, errback=None) > > How do you implement arguments pas

Re: [Python-Dev] Post-PyCon updates to PyParallel

2013-03-27 Thread Trent Nelson
On Wed, Mar 27, 2013 at 11:26:51PM -0700, Trent Nelson wrote: > [ python-dev: I've set up a new list for pyparallel discussions: > https://lists.snakebite.net/mailman/listinfo/pyparallel. This > e-mail will be the last I'll send to python-dev@ regarding t

[Python-Dev] Post-PyCon updates to PyParallel

2013-03-27 Thread Trent Nelson
[ python-dev: I've set up a new list for pyparallel discussions: https://lists.snakebite.net/mailman/listinfo/pyparallel. This e-mail will be the last I'll send to python-dev@ regarding the on-going pyparallel work; please drop python-dev@ from the CC and just send to p

Re: [Python-Dev] Slides from today's parallel/async Python talk

2013-03-21 Thread Trent Nelson
http://c2.com/cgi/wiki?BlubParadox ;-) Sent from my iPhone On 21 Mar 2013, at 06:18, "Antoine Pitrou" wrote: > Le Thu, 14 Mar 2013 15:23:37 -0700, > Trent Nelson a écrit : >> >>Don't get me wrong, I grew up with UNIX and love it as much as the >&

Re: [Python-Dev] Slides from today's parallel/async Python talk

2013-03-21 Thread Trent Nelson
urla Molden" wrote: > Den 14. mars 2013 kl. 23:23 skrev Trent Nelson : > >> >> For the record, here are all the Windows calls I'm using that have >> no *direct* POSIX equivalent: >> >> Interlocked singly-linked list

Re: [Python-Dev] Slides from today's parallel/async Python talk

2013-03-21 Thread Trent Nelson
pill...@gmail.com>> wrote: 2013/3/15 Trent Nelson mailto:tr...@snakebite.org>> On Thu, Mar 14, 2013 at 03:50:27PM -0700, "Martin v. Löwis" wrote: > Am 14.03.13 12:59, schrieb Stefan Ring: > > I think you should be able to just take the address of a static > >

Re: [Python-Dev] Slides from today's parallel/async Python talk

2013-03-18 Thread Trent Nelson
On Mon, Mar 18, 2013 at 05:27:33PM -0700, Christian Tismer wrote: > Hi Trent, Hi Christian! Thanks for taking the time to read my walls of text ;-) > > So, the remaining challenge is preventing the use case alluded to > > earlier where someone tries to modify an object that hasn't been "

Re: [Python-Dev] Slides from today's parallel/async Python talk

2013-03-14 Thread Trent Nelson
On Thu, Mar 14, 2013 at 03:56:33PM -0700, "Martin v. Löwis" wrote: > Am 14.03.13 11:23, schrieb Trent Nelson: > > Porting the Py_PXCTX part is trivial compared to the work that is > > going to be required to get this stuff working on POSIX where none > &

Re: [Python-Dev] Slides from today's parallel/async Python talk

2013-03-14 Thread Trent Nelson
On Thu, Mar 14, 2013 at 03:50:27PM -0700, "Martin v. Löwis" wrote: > Am 14.03.13 12:59, schrieb Stefan Ring: > > I think you should be able to just take the address of a static > > __thread variable to achieve the same thing in a more portable way. > > That assumes that the compiler supports __thr

Re: [Python-Dev] Slides from today's parallel/async Python talk

2013-03-14 Thread Trent Nelson
On Thu, Mar 14, 2013 at 12:59:57PM -0700, Stefan Ring wrote: > > Yup, in fact, if I hadn't come up with the __read[gf]sword() trick, > > my only other option would have been TLS (or the GetCurrentThreadId > > /pthread_self() approach in the presentation). TLS is fantastic, > > and

Re: [Python-Dev] Slides from today's parallel/async Python talk

2013-03-14 Thread Trent Nelson
On Thu, Mar 14, 2013 at 02:30:14PM -0700, Trent Nelson wrote: > Then it dawned on me to just add the snapshot/rollback stuff to > normal Context objects. In retrospect, it's silly I didn't think of > this in the first place -- the biggest advantage of the Context &

Re: [Python-Dev] Slides from today's parallel/async Python talk

2013-03-14 Thread Trent Nelson
.) On Thu, Mar 14, 2013 at 11:45:20AM -0700, Trent Nelson wrote: > The basic premise is that parallel 'Context' objects (well, structs) > are allocated for each parallel thread callback. The 'Context' struct: http://hg.python.org/sandbox/trent/file/7148209d5

Re: [Python-Dev] Slides from today's parallel/async Python talk

2013-03-14 Thread Trent Nelson
On Wed, Mar 13, 2013 at 07:05:41PM -0700, Trent Nelson wrote: > Just posted the slides for those that didn't have the benefit of > attending the language summit today: > > > https://speakerdeck.com/trent/parallelizing-the-python-interpreter-an-alterna

Re: [Python-Dev] Slides from today's parallel/async Python talk

2013-03-14 Thread Trent Nelson
On Thu, Mar 14, 2013 at 05:21:09AM -0700, Christian Heimes wrote: > Am 14.03.2013 03:05, schrieb Trent Nelson: > > Just posted the slides for those that didn't have the benefit of > > attending the language summit today: > > > > > > https://s

[Python-Dev] Slides from today's parallel/async Python talk

2013-03-13 Thread Trent Nelson
Just posted the slides for those that didn't have the benefit of attending the language summit today: https://speakerdeck.com/trent/parallelizing-the-python-interpreter-an-alternate-approach-to-async Trent. ___ Python-Dev maili

Re: [Python-Dev] Python Language Summit at PyCon: Agenda

2013-03-02 Thread Trent Nelson
On Wed, Feb 27, 2013 at 08:51:16AM -0800, Michael Foord wrote: > If you have other items you'd like to discuss please let me know and I > can add them to the agenda. Hmm, seems like this might be a good forum to introduce the parallel/async stuff I've been working on the past few months.

[Python-Dev] Arena terminology (PyArena vs obmalloc.c:"arena")

2013-01-09 Thread Trent Nelson
There's no correlation between PyArenas and the extensive use of the term "arena" in obmalloc.c, right? I initially assumed there was, based solely on the common use of the term arena. However, after more investigation, it *appears* as though there's absolutely no correlation.

Re: [Python-Dev] Point of building without threads?

2013-01-08 Thread Trent Nelson
On Tue, Jan 08, 2013 at 06:15:45AM -0800, Stefan Krah wrote: > Trent Nelson wrote: > > All our NetBSD, OpenBSD and DragonFlyBSD slaves use --without-thread. > > Without it, they all wedge in some way or another. (That should be > > fixed*/investigated,

Re: [Python-Dev] Point of building without threads?

2013-01-08 Thread Trent Nelson
[ Weird, I can't see your original e-mail Antoine; hijacking Yury's reply instead. ] On Tue, Jan 08, 2013 at 01:28:25AM -0800, Yury V. Zaytsev wrote: > On Mon, 2012-05-07 at 21:49 +0200, Antoine Pitrou wrote: > > > > I guess a long time ago, threading support in operating systems wasn't

Re: [Python-Dev] PandaBoard, Raspberry Pi coming to Buildbot fleet

2013-01-04 Thread Trent Nelson
On Fri, Jan 04, 2013 at 05:06:22AM -0800, Victor Stinner wrote: > 2013/1/4 Trent Nelson : > > The installation of Ubuntu on the Pandaboard went smoothly. > > However, it crashes after about an hour. Console output: > > > > http://trent.snakebi

Re: [Python-Dev] PandaBoard, Raspberry Pi coming to Buildbot fleet

2013-01-04 Thread Trent Nelson
On Fri, Jan 04, 2013 at 02:48:00AM -0800, Trent Nelson wrote: > On Thu, Dec 20, 2012 at 09:33:27AM -0800, Brian Curtin wrote: > > Last week in Raymond's dictionary thread, the topic of ARM came up, > > along with the relative lack of build slave coverage. Today Trent >

Re: [Python-Dev] PandaBoard, Raspberry Pi coming to Buildbot fleet

2013-01-04 Thread Trent Nelson
On Thu, Dec 20, 2012 at 09:33:27AM -0800, Brian Curtin wrote: > Last week in Raymond's dictionary thread, the topic of ARM came up, > along with the relative lack of build slave coverage. Today Trent > Nelson received the PandaBoard purchased by the PSF, and a Raspberry > Pi

Re: [Python-Dev] Possible GIL/threading issue involving subprocess and PyMem_MALLOC...

2012-12-21 Thread Trent Nelson
On Fri, Dec 21, 2012 at 01:43:11AM -0800, Antoine Pitrou wrote: > Le Fri, 21 Dec 2012 09:31:44 +, > Kristján Valur Jónsson a écrit : > > I ran into this the other day. I had put in hooks in the > > PyMem_MALLOC to track memory per tasklet, and it crashed in those > > cases because it was bein

Re: [Python-Dev] PandaBoard, Raspberry Pi coming to Buildbot fleet

2012-12-20 Thread Trent Nelson
On Thu, Dec 20, 2012 at 03:10:49PM -0800, Eli Bendersky wrote: > > > > > > That's good news. A related question about Snakebite, though. Maybe > I > > > missed something obvious, but is there an overview of how the core > devs can > > > use it? In particular, I'd want

Re: [Python-Dev] Possible GIL/threading issue involving subprocess and PyMem_MALLOC...

2012-12-20 Thread Trent Nelson
On Thu, Dec 20, 2012 at 05:47:40PM -0800, Gregory P. Smith wrote: >On Thu, Dec 20, 2012 at 10:43 AM, Trent Nelson >wrote: > > This seems odd to me so I wanted to see what others think. The unit > test Lib/unittest/test/test_runner.py:Test_TextRunne

Re: [Python-Dev] PandaBoard, Raspberry Pi coming to Buildbot fleet

2012-12-20 Thread Trent Nelson
On Thu, Dec 20, 2012 at 10:52:56AM -0800, Trent Nelson wrote: > I'll work on setting the ARM boards up next week. Does anyone have a preference regarding the operating system? There are a bunch of choices listed here: http://www.omappedia.org/wiki/Main_Page As

Re: [Python-Dev] PandaBoard, Raspberry Pi coming to Buildbot fleet

2012-12-20 Thread Trent Nelson
On Thu, Dec 20, 2012 at 09:33:27AM -0800, Brian Curtin wrote: > Last week in Raymond's dictionary thread, the topic of ARM came up, > along with the relative lack of build slave coverage. Today Trent > Nelson received the PandaBoard purchased by the PSF, and a Raspberry > Pi

Re: [Python-Dev] PandaBoard, Raspberry Pi coming to Buildbot fleet

2012-12-20 Thread Trent Nelson
ative lack of build slave coverage. Today Trent > >> Nelson received the PandaBoard purchased by the PSF, and a Raspberry > >> Pi should be coming shortly as well. > >> > >> http://blog.python.org/2012/12/pandaboard-raspberry-pi-coming-to.html > >> >

[Python-Dev] Possible GIL/threading issue involving subprocess and PyMem_MALLOC...

2012-12-20 Thread Trent Nelson
This seems odd to me so I wanted to see what others think. The unit test Lib/unittest/test/test_runner.py:Test_TextRunner.test_warnings will eventually hit subprocess.Popen._communicate. The `mswindows` implementation of this method relies on threads to buffer stdin/stdout. T

[Python-Dev] Mercurial workflow question...

2012-12-13 Thread Trent Nelson
Scenario: I'm working on a change that I want to actively test on a bunch of Snakebite hosts. Getting the change working is going to be an iterative process -- lots of small commits trying to attack the problem one little bit at a time. Eventually I'll get to a point where I'm

Re: [Python-Dev] More compact dictionaries with faster iteration

2012-12-10 Thread Trent Nelson
On Mon, Dec 10, 2012 at 08:53:17AM -0800, Barry Warsaw wrote: > On Dec 10, 2012, at 05:39 PM, Christian Heimes wrote: > > >I had ARM platforms in mind, too. Unfortunately we don't have any ARM > >platforms for testing and performance measurement. Even Trent's > >Snakebite doesn't have ARM boxes. I

Re: [Python-Dev] python 3.3 module test failures on FreeBSD 9 amd64

2012-12-08 Thread Trent Nelson
On Sat, Dec 08, 2012 at 01:07:43PM -0800, A G wrote: > Ideally I'd like to resolve these and submit a port for python3.3 since > the most recent FreeBSD port is stuck on 3.2. FWIW, the FreeBSD Python port maintainer, Kubilay Kocak, is active on #python-dev@freenode under the nick 'koobs'.

Re: [Python-Dev] Handling support for newer OS features at run time

2012-11-27 Thread Trent Nelson
On Tue, Nov 27, 2012 at 03:14:00PM -0800, Richard Oudkerk wrote: > On 27/11/2012 10:49pm, Trent Nelson wrote: > > Ideally, a Windows binary should make WSAPoll/select.poll() > > available if running on Vista or above, without impacting > > the ability to run on

Re: [Python-Dev] Handling support for newer OS features at run time

2012-11-27 Thread Trent Nelson
On Tue, Nov 27, 2012 at 03:09:12PM -0800, Matthias Klose wrote: > Am 27.11.2012 23:49, schrieb Trent Nelson: > > I don't think we've currently got the ability to do this, right? > > Is there a precedent set anywhere else? I suspect it's not as > > m

[Python-Dev] Handling support for newer OS features at run time

2012-11-27 Thread Trent Nelson
The hackiest part of my WSAPoll patch is this: --- a/PC/pyconfig.h Sun Nov 18 10:42:42 2012 + +++ b/PC/pyconfig.h Sun Nov 18 17:27:29 2012 -0500 @@ -158,12 +158,12 @@ /* set the version macros for the windows headers */ #ifdef MS_WINX64 /* 64 bit only runs on XP or greater */ -#

Re: [Python-Dev] Tru64 support

2012-11-27 Thread Trent Nelson
On Tue, Sep 04, 2012 at 02:24:10AM -0700, Andrew Svetlov wrote: > Is it still up to date? Bug has been created in 2004. > I don't see Tru64 in list of available buildbots. > > Do we need to care about this platform? And how to make sure what > existing code works fine for that? There's a Snak

Re: [Python-Dev] externals?

2012-11-19 Thread Trent Nelson
On Sun, Nov 18, 2012 at 04:18:43AM -0800, mar...@v.loewis.de wrote: > I'd like to stress that we don't need any versioning here. wget and > tar would be sufficient, except that it's Windows, so we have neither > wget nor tar. However, including a PowerShell script may be an option; > most developer

Re: [Python-Dev] externals?

2012-11-16 Thread Trent Nelson
On Thu, Nov 15, 2012 at 01:20:09AM -0800, Kristj?n Valur J?nsson wrote: > Perhaps the unix makefiles get the proper version, but a windows developer > has to fetch those externals manually. Pro-tip: if you're developing on Windows, you're mad if you don't prime your dev env with Tools\bui

Re: [Python-Dev] ctypes is not an acceptable implementation strategy for modules in the standard library?

2012-11-06 Thread Trent Nelson
On Mon, Nov 05, 2012 at 03:36:00AM -0800, Victor Stinner wrote: > I'm not sure that ctypes is always available (available on all platforms). Indeed. Every non-x86 Snakebite platform has pretty serious issues with ctypes. I spent a morning looking into one platform, Solaris 10 on SPAR

Re: [Python-Dev] Bumping autoconf from 2.68 to 2.69

2012-10-16 Thread Trent Nelson
On Tue, Oct 16, 2012 at 08:23:00AM -0700, Brett Cannon wrote: >On Tue, Oct 16, 2012 at 11:18 AM, Tres Seaver >wrote: > > -BEGIN PGP SIGNED MESSAGE- > Hash: SHA1 > On 10/16/2012 09:47 AM, Barry Warsaw wrote: > > On Oct 16, 2012, at 05:3

Re: [Python-Dev] Bumping autoconf from 2.68 to 2.69

2012-10-16 Thread Trent Nelson
On Tue, Oct 16, 2012 at 02:17:35AM -0700, Charles-François Natali wrote: > > It should be sufficient to install autoconf-x.y into /home/user/bin or > > something similar. Installing autoconf from source really takes about > > 3 minutes. > > Well, maybe, maybe not. > autoconf depends on a least m4

Re: [Python-Dev] Bumping autoconf from 2.68 to 2.69

2012-10-16 Thread Trent Nelson
On Tue, Oct 16, 2012 at 12:12:35AM -0700, R. David Murray wrote: > On Mon, 15 Oct 2012 23:18:04 -0700, Ned Deily wrote: > > In article <20121016043352.ga21...@snakebite.org>, > > Trent Nelson wrote: > > > Any objections to regenerating configure with autocon

Re: [Python-Dev] Bumping autoconf from 2.68 to 2.69

2012-10-16 Thread Trent Nelson
On Tue, Oct 16, 2012 at 01:43:37AM -0700, Charles-François Natali wrote: > > My understanding is that we use a specific version of autoconf. > > The reason is that otherwise we end up with useless churn in the repo > > as the generated file changes when different committers use different > > versio

Re: [Python-Dev] Bumping autoconf from 2.68 to 2.69

2012-10-16 Thread Trent Nelson
On Tue, Oct 16, 2012 at 01:04:46AM -0700, Ned Deily wrote: > In article <20121016071236.0792d250...@webabinitio.net>, > "R. David Murray" wrote: > > My understanding is that we use a specific version of autoconf. > > The reason is that otherwise we end up with useless churn in the repo > > as the

Re: [Python-Dev] Bumping autoconf from 2.68 to 2.69

2012-10-16 Thread Trent Nelson
On Tue, Oct 16, 2012 at 12:12:35AM -0700, R. David Murray wrote: > On Mon, 15 Oct 2012 23:18:04 -0700, Ned Deily wrote: > > In article <20121016043352.ga21...@snakebite.org>, > > Trent Nelson wrote: > > > Any objections to regenerating configure with autocon

[Python-Dev] Bumping autoconf from 2.68 to 2.69

2012-10-15 Thread Trent Nelson
Any objections to regenerating configure with autoconf 2.69? The current version is based off 2.68, which was release on the 22nd of September 2010. 2.69 was released on the 24th of April, 2012. (There are some fixes for the more esoteric UNIX platforms that Snakebite will b

Re: [Python-Dev] buildbot with -O

2012-09-30 Thread Trent Nelson
Just as an FYI, we set up a new "optimized" Snakebite slave yesterday on the Mac OS X Mountain Lion box. I also set up remote access to that box in the process -- you can connect to it via the ~/.snakebite/sb 'x8' alias. (That box happens to be the fastest (and most contempora

Re: [Python-Dev] buildbot with -O

2012-09-26 Thread Trent Nelson
On Wed, Sep 26, 2012 at 04:13:42PM -0700, Benjamin Peterson wrote: > 2012/9/26 Maciej Fijalkowski : > > On Thu, Sep 27, 2012 at 1:00 AM, Benjamin Peterson > > wrote: > >> In light of issue #16046, I think it would be helpful to have a > >> buildbot running the testsuite with -O enabled. > > > > H

Re: [Python-Dev] Snakebite v0.1: ready for beta testing.

2012-09-11 Thread Trent Nelson
On Tue, Sep 11, 2012 at 06:16:52AM -0700, Nick Coghlan wrote: > On Tue, Sep 11, 2012 at 10:28 PM, Trent Nelson wrote: > > (Pro-tip though: `sh snakebite.subr` will always do its best to > > re-initialize everything, like fixing permissions when svn update > >

Re: [Python-Dev] Snakebite v0.1: ready for beta testing.

2012-09-11 Thread Trent Nelson
On Tue, Sep 11, 2012 at 05:23:34AM -0700, Brett Cannon wrote: >Very cool, Trent! I also love the retro use of svn as a tie-in to how long >you have been fighting to bring this project to fruition. =) Haha. I probably shouldn't mention that I started writing all the wrapper .snakeb

Re: [Python-Dev] Snakebite v0.1: ready for beta testing.

2012-09-11 Thread Trent Nelson
On Tue, Sep 11, 2012 at 05:20:01AM -0700, Trent Nelson wrote: > Quick start: > > % cd ~ && svn co http://svn.snakebite.net/.snakebite && cd .snakebite && sh > snakebite.subr For those that already have ~/.snakebite, one of these will work:

[Python-Dev] Snakebite v0.1: ready for beta testing.

2012-09-11 Thread Trent Nelson
Quick start: % cd ~ && svn co http://svn.snakebite.net/.snakebite && cd .snakebite && sh snakebite.subr If all goes well, you should see something like this: A.snakebite/snakebite.subr A.snakebite/ssh_config_ext A.snakebite/ssh_known_hosts U .snakebite Checked out revisio

Re: [Python-Dev] Tru64 support

2012-09-04 Thread Trent Nelson
On Tue, Sep 04, 2012 at 02:24:10AM -0700, Andrew Svetlov wrote: > Is it still up to date? Bug has been created in 2004. > I don't see Tru64 in list of available buildbots. > > Do we need to care about this platform? And how to make sure what > existing code works fine for that? > > Or maybe we can

Re: [Python-Dev] Snakebite build slaves and developer SSH/GPG public keys

2012-08-24 Thread Trent Nelson
On Fri, Aug 24, 2012 at 07:39:54AM -0700, Trent Nelson wrote: > On Fri, Aug 24, 2012 at 07:27:09AM -0700, C. Titus Brown wrote: > > Don't forget the heavy Xanax requirements on the part of the technical > > owner of > > the space. Dunno if Trent will put up any picture

Re: [Python-Dev] Snakebite build slaves and developer SSH/GPG public keys

2012-08-24 Thread Trent Nelson
On Fri, Aug 24, 2012 at 07:27:09AM -0700, C. Titus Brown wrote: > On Thu, Aug 23, 2012 at 11:09:14AM +0200, Giampaolo Rodol? wrote: > > > For committers on other Python projects like Buildbot, Django and > > > Twisted that may be reading this -- yes, the plan is to give you > > > guys S

Re: [Python-Dev] Snakebite build slaves and developer SSH/GPG public keys

2012-08-23 Thread Trent Nelson
On Wed, Aug 22, 2012 at 03:28:16PM -0700, Trent Nelson wrote: > Hi folks, > > I've set up a bunch of Snakebite build slaves over the past week. > One of the original goals was to provide Python committers with > full access to the slaves, which I'

Re: [Python-Dev] Snakebite build slaves and developer SSH/GPG public keys

2012-08-23 Thread Trent Nelson
On Thu, Aug 23, 2012 at 02:09:14AM -0700, Giampaolo Rodolà wrote: > > For committers on other Python projects like Buildbot, Django and > > Twisted that may be reading this -- yes, the plan is to give you > > guys Snakebite access/slaves down the track too. I'll start looking > > i

Re: [Python-Dev] [Infrastructure] Snakebite build slaves and developer SSH/GPG public keys

2012-08-23 Thread Trent Nelson
On Thu, Aug 23, 2012 at 12:24:33AM -0700, "Martin v. Löwis" wrote: > On 23.08.2012 02:43, R. David Murray wrote: > > On Thu, 23 Aug 2012 10:53:34 +1200, Noah Kantrowitz > > wrote: > >> For everyone with a record in the Chef server (read: everyone with SSH > >> access to any of the PSF servers at

[Python-Dev] Snakebite build slaves and developer SSH/GPG public keys

2012-08-22 Thread Trent Nelson
Hi folks, I've set up a bunch of Snakebite build slaves over the past week. One of the original goals was to provide Python committers with full access to the slaves, which I'm still keen on providing. What's a nice simple way to achieve that in the interim? Here's what I was

Re: [Python-Dev] Mountain Lion drops sign of zero, breaks test_cmath...

2012-08-17 Thread Trent Nelson
On Fri, Aug 17, 2012 at 06:50:09AM -0700, Stefan Krah wrote: > R. David Murray wrote: > > > --- a/Lib/test/test_cmath.pyThu Aug 16 22:14:43 2012 +0200 > > > +++ b/Lib/test/test_cmath.pyFri Aug 17 07:54:05 2012 + > > > > Open an issue on the tracker and make mark.dickinson (and maybe s

[Python-Dev] Mountain Lion drops sign of zero, breaks test_cmath...

2012-08-17 Thread Trent Nelson
The Mountain Lion build slave I set up earlier this evening fails on test_cmath: == FAIL: test_specific_values (test.test_cmath.CMathTests) --

Re: [Python-Dev] Switching to Visual Studio 2010

2012-02-01 Thread Trent Nelson
On Sun, Jan 29, 2012 at 12:23:14PM -0800, Trent Nelson wrote: > * Updates to externals/(tcl|tk)-8.5.9.x so that they both build with > VS2010. Before I go updating tcl/tk, any thoughts on bumping our support to the latest revision, 8.5.11? I guess the same question appl

Re: [Python-Dev] Switching to Visual Studio 2010

2012-02-01 Thread Trent Nelson
On Thu, Jan 26, 2012 at 12:54:31PM -0800, mar...@v.loewis.de wrote: > > Is this considered a new feature that has to be in by the first beta? > > I'm hoping to have it completed much sooner than that so we can get > > mileage on it, but is there a cutoff for changing the compiler? > > At some point

Re: [Python-Dev] Stable buildbots

2010-11-23 Thread Trent Nelson
On 14-Nov-10 3:48 AM, David Bolen wrote: This is a completely separate issue, though probably around just as long, and like the popup problem its frequency changes over time. By "hung" here I'm referring to cases where something must go wrong with a test and/or its cleanup such that a python_d p

[Python-Dev] Snakebite, buildbot and low hanging fruit -- feedback wanted! (Was Re: SSH access against buildbot boxes)

2010-11-07 Thread Trent Nelson
already usable. Dealing with exactly this problem is one of the goals of the Snakebite project. As far as I know, the folks behind that project are still working on it - I've cc'ed Trent Nelson to see if he can provide any additional info on the topic. Thanks for the ping Nick, I might h

Re: [Python-Dev] IBM P-690 server looking for a home

2010-08-20 Thread Trent Nelson
On 19-Aug-10 10:48 AM, Randall Walls wrote: Greetings, The company I work for has an IBM P-690 server that is in the process of being retired. It is still a viable server, and has seen almost 0 use (it was our failover machine). Unfortunately for us, this machine has little to no resale value, a

Re: [Python-Dev] PEP 7 updated

2010-05-12 Thread Trent Nelson
Does anyone know of a way to teach vim that C sources in a python checkout should have 4-space indents without changing the defaults for other C files? I use this in my vimrc: "" " indentation: use detectindent plugi

[Python-Dev] Python on Windows with CoApp

2010-05-12 Thread Trent Nelson
Howdy folks, Quick e-mail at 34,000ft (aren't wifi-enabled flights great?) to mention a new initiative that's been started by Microsoft called CoApp (Common Opensource Application Publishing Platform). The aim is simple: make open source software rock on Windows ;-) It's probably easiest to

Re: [Python-Dev] Fwd: Broken link to download (Mac OS X)

2010-04-14 Thread Trent Nelson
> > What happened to the big-ass computer farm for Python which was > > being put together by someone at (I think) Michigan State? > > That sounds a lot like Snakebite (www.snakebite.org), which is > still... uhhh, a work in progress ;-) Actually, for those that are interested, here's a copy of t

Re: [Python-Dev] Fwd: Broken link to download (Mac OS X)

2010-04-14 Thread Trent Nelson
> What happened to the big-ass computer farm for Python which was > being put together by someone at (I think) Michigan State? That sounds a lot like Snakebite (www.snakebite.org), which is still... uhhh, a work in progress ;-) We've run into an issue recently that's thwarted progress, but that'l

Re: [Python-Dev] Py_ssize_t support for ctypes arrays and pointers

2009-03-21 Thread Trent Nelson
On Fri, Mar 20, 2009 at 08:00:46PM +0100, Thomas Heller wrote: > Since I do not have a machine with so much memory: Does one > of the buildbots allow to run tests for this feature, or > do I have to wait for the snakebite farm? Will you be at PyCon? The wait might not be as bad as you think ;

Re: [Python-Dev] [snakebite] snakebite for GSoC?

2009-03-20 Thread Trent Nelson
On Thu, Mar 19, 2009 at 10:32:03AM -0700, ajaksu wrote: > Does anyone have good ideas for assigning students to snakebite? Is it > too early? Perhaps a little too early, python-dev@ won't know anything about Snakebite yet as I haven't publicly announced it there ;-) Watch this spa

Re: [Python-Dev] ?spurious? Timeout in BSDDB under MS Windows

2008-09-08 Thread Trent Nelson
On Fri, Sep 05, 2008 at 05:55:13PM +0200, Jesus Cea wrote: > Trent, are you available to look at the ?spurious? timeout failures in > bsddb replication code in the Windows buildbot?. > > Ten seconds timeout should be plenty enough. I can't debug any MS > Windows issue myself; this is a Microsoft-f

Re: [Python-Dev] [Python-3000] what version of bsddb to use/accept for 2.6/3.0

2008-08-29 Thread Trent Nelson
On Sun, Aug 24, 2008 at 06:15:06PM -0700, Neal Norwitz wrote: > It looks like the WIndows buildbots use 4.4.20. Unfortunately, the > Windows bots aren't in great shape either. It won't be that hard to bump 3.0 on Windows to use 4.7 (assuming that the 3.0 bsddb codebase has Jesus's new

Re: [Python-Dev] Any PEP about 2.6 -> 3000 code transition?

2008-08-13 Thread Trent Nelson
> (*) slides: > http://www.interlink.com.au/anthony/tech/talks/OSCON2008/porting3.pdf Hilarious! Seems like that would have been a riot of a session to attend. (I'm kicking myself for attending some other uninteresting talk when yours was on.) Trent. __

Re: [Python-Dev] test_multiprocessing:test_listener_client flakiness

2008-06-19 Thread Trent Nelson
> This is a common problem. Binding to '127.0.0.1' will bind to *only* > that address; Indeed. > binding to "" will bind to *all* addresses the machine > is known by. Agreed again. I believe what we're dealing with here though is a lack of clarity regarding what role the 'address' attribute e

Re: [Python-Dev] test_multiprocessing:test_listener_client flakiness

2008-06-18 Thread Trent Nelson
> Well, on my win2k machine getfqdn('127.0.0.1') returns the actual name > of the machine. This is the name that was stored in server.address. > Hence my patch that simply remove the call to getfqdn. +1 to ditching getfqdn, following patch fixes the issue on my buildbot server: Index: connection.

Re: [Python-Dev] test_multiprocessing: test_listener_client flakiness

2008-06-18 Thread Trent Nelson
> I just found the cause of the problem ten minutes ago: > It seems that when a socket listens on the address "127.0.0.1" or > "localhost", another process cannot connect to it using the machine's > name (even from the same machine). > The best seems to listen with the empty address "". That doesn

Re: [Python-Dev] test_multiprocessing:test_listener_client flakiness

2008-06-18 Thread Trent Nelson
> The server component *is* listening to localhost by default. The > client in the code I pasted has the server's .address attribute passed > into it to tell the client where to connect to. Interestingly enough, I can't coerce test_multiprocessing.test_listener_client to wedge on my XP laptop. W

[Python-Dev] test_multiprocessing: test_listener_client flakiness

2008-06-18 Thread Trent Nelson
I gave my Windows buildbots a little bit of TLC last night. This little chestnut in test_multiprocessing.py around line 1346 is causing my buildbots to wedge more often than not: def test_listener_client(self): for family in self.connection.families: l = self.connection.

  1   2   >