[issue14404] multiprocessing with maxtasksperchild: bug in control logic?
Changes by Jesse Noller jnol...@gmail.com: -- nosy: +asksol, jnoller ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue14404 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue13812] multiprocessing package doesn't flush stderr on child exception
Jesse Noller jnol...@gmail.com added the comment: There's already a bug / pending patch for this behavior here: http://bugs.python.org/issue8713 No need to take it to -ideas. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue13812 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue8713] multiprocessing needs option to eschew fork() under Linux
Jesse Noller jnol...@gmail.com added the comment: On Wednesday, December 21, 2011 at 10:04 AM, Charles-François Natali wrote: While I would tend to agree with you in theory - I don't think we should make it the default - at least not without a LOT of lead time. There's a surprising amount of code relying on the current behavior that I think the best course is to enable this option, and change the docs to steer users in this direction. For users jumping from 2.x into 3.x, I think the less surprises they have the better, and changing the default behavior of the stdlib module in this was would qualify as surprising. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue8713 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue13139] multiprocessing.map skips finally blocks
Jesse Noller jnol...@gmail.com added the comment: Antoine is correct, as he usually is. This is more of a documentation issue than bug. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue13139 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue10348] multiprocessing: use SysV semaphores on FreeBSD
Jesse Noller jnol...@gmail.com added the comment: Charles and Antoine's votes match my own, therefore closing the bug wont fix -- resolution: - wont fix status: open - closed ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue10348 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue4106] multiprocessing occasionally spits out exception during shutdown
Jesse Noller jnol...@gmail.com added the comment: On Wed, Aug 24, 2011 at 3:01 PM, Antoine Pitrou rep...@bugs.python.org wrote: Antoine Pitrou pit...@free.fr added the comment: I can't seem to reproduce this under 3.3. Should it be closed? I don't think so; it's still applicable to 2.x, and a fix should go into 2.7 ideally. http://bugs.python.org/issue9207 is the source of the issue AFAIR -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue4106 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue8713] multiprocessing needs option to eschew fork() under Linux
Jesse Noller jnol...@gmail.com added the comment: No one is currently working on a patch AFAIK -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue8713 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue11657] multiprocessing_{send,recv}fd fail with fds 256
Jesse Noller jnol...@gmail.com added the comment: Yes, Charles - the test is not only welcome, but needed - it just can't rely on reading /etc/fstab ;) -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue11657 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue11657] multiprocessing_{send,recv}fd fail with fds 256
Jesse Noller jnol...@gmail.com added the comment: Charles; you have +commit, it seems. I would welcome the patch and test (just as long as the aforementioned reliance on /etc/fstab was removed). -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue11657 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
Python User Group International Survey
The PSF is happy to launch today an international survey of Pythonuser group organizers to help it better serve the large and ever-expanding international Python user community. The survey contains questions on user group organization, events, demographics, and growth. There are some questions with numerical answers, and while your best guess is fine, you may find it helpful to gather some statistics on your user group membership before starting the survey (example statistics include the number of active members and the size and topics for recent user group events). We expect this survey to take around 30 minutes to complete. We appreciate your time and honesty in answering these questions. The PSF blog post announcing the survey: http://pyfound.blogspot.com/2011/06/tell-us-about-your-user-group.html The survey was written by Jessica McKellar (http://jesstess.com), organizer for the Boston Python Meetup (http://meetup.bostonpython.com), and Jesse Noller (http://jessenoller.com/), PSF board member and PyCon chair with input and feedback from survey specialists and others. https://www.surveymonkey.com/s/BWLG8SZ The survey was pretested with a handful of user group organizers, and their answers were phenomenal. Organizers have tons to say about these topics, and we hope to get a lot of great, actionable data for strengthening the relationship between the PSF and Python user groups out of this effort. Outreach, education, diversity and community building are critical for Python as a community, and the Foundation - this data should greatly assist in our targeting our resources and furthering the mission of the Foundation in all ways. Thank you The Python Software Foundation Jessica McKellar Jesse Noller -- http://mail.python.org/mailman/listinfo/python-announce-list Support the Python Software Foundation: http://www.python.org/psf/donations/
[issue6056] socket.setdefaulttimeout affecting multiprocessing Manager
Jesse Noller jnol...@gmail.com added the comment: I agree derek, I think that would be a fine addition, however we lack a patch and I don't have the current bandwidth to add it. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue6056 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue11969] Can't launch multiproccessing.Process on methods
Jesse Noller jnol...@gmail.com added the comment: Do things like this in the REPL are known not to work. Things are not protected in the if __name__ block so we can import the script properly to run it. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue11969 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue10632] multiprocessing generates a fatal error
Jesse Noller jnol...@gmail.com added the comment: Dupe of issue10517 -- resolution: - duplicate status: open - closed ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue10632 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue10332] Multiprocessing maxtasksperchild results in hang
Jesse Noller jnol...@gmail.com added the comment: Note: I noticed that there are some thread-unsafe operations (the cache that can be modified from different threads, and thread states are modified also from different threads). While this isn't an issue with the current cPython implementation (GIL), I wonder if this should be fixed. Yes. We should fix those. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue10332 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue11743] Rewrite PipeConnection and Connection in pure Python
Jesse Noller jnol...@gmail.com added the comment: Nothing jumps out at me at initial review; I've asked other contributors/interested parties to take a look too. Thanks a ton Antoine for doing this work -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue11743 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue11750] Mutualize win32 functions
Jesse Noller jnol...@gmail.com added the comment: Agreed; I'm not personally the windows expert that should handle that consolidation though. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue11750 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue9205] Parent process hanging in multiprocessing if children terminate unexpectedly
Jesse Noller jnol...@gmail.com added the comment: On Thu, Mar 31, 2011 at 8:25 AM, Antoine Pitrou rep...@bugs.python.org wrote: Antoine Pitrou pit...@free.fr added the comment: Speaking of which, I wonder why we have both multiprocessing.Pool and concurrent.futures.ProcessPoolExecutor. They seem to fill the exact same needs, with different APIs... Brian and I need to work on the consolidation we intend(ed) to occur as people got comfortable with the APIs. My eventual goal is to remove anything but the basic multiprocessing.Process/Queue stuff out of MP and into concurrent.* and support threading backends for it. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue9205 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue9205] Parent process hanging in multiprocessing if children terminate unexpectedly
Jesse Noller jnol...@gmail.com added the comment: On Thu, Mar 31, 2011 at 9:05 AM, Antoine Pitrou rep...@bugs.python.org wrote: Antoine Pitrou pit...@free.fr added the comment: Possible plan for POSIX, where a connection uses a pipe() or socketpair(): exploit the fact that an endpoint becomes ready for reading (indicating EOF) when the other endpoint is closed: r, w = os.pipe() select.select([r], [], [r], 0) ([], [], []) os.close(w) select.select([r], [], [r], 0) ([4], [], []) a, b = socket.socketpair() select.select([b], [], [b], 0) ([], [], []) a.close() select.select([b], [], [b], 0) ([socket.socket object, fd=8, family=1, type=1, proto=0], [], []) So, each Process could have a sentinel fd in the parent process, which becomes ready when the process exits. These sentinel fds can be used in the various select() calls underlying Queue.get(). (I don't understand why _multiprocessing/socket_connection.c in written in C. Rewriting it in Python would make improvements much easier) I concur with you. The only reason it is in C is legacy; I don't see an immediate reason why it should continue to be that way -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue9205 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue11675] multiprocessing Arrays not automatically zeroed.
Jesse Noller jnol...@gmail.com added the comment: I concur with Antoine. I think you're good to go Mark. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue11675 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue11569] multiprocessing/darwin: sysctl(8) mislocation
Jesse Noller jnol...@gmail.com added the comment: Ronald - if you're OK w/ patch 2, please commit! -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue11569 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue11358] Please replace the use of pickle in multiprocessing with json.
Jesse Noller jnol...@gmail.com added the comment: I concur with RDM. We need complex data structures, and switching to JSON represents a non zero amount of work, isn't as fast and pickle works well. If you want to use JSON as a transport, I would do custom subclassing. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue11358 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue3244] multipart/form-data encoding
Jesse Noller jnol...@gmail.com added the comment: Yeah, despite what the RFC says, the most common usage is in web clients, and stuffing it in the email module won't be obvious to 95% of the population I think, unless that's where the implementation lives, but we can add a doc stub in the http docs pointing to it and why. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue3244 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue10845] test_multiprocessing failure under Windows
Jesse Noller jnol...@gmail.com added the comment: I'm fine with that tweak antoine -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue10845 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue4106] multiprocessing occasionally spits out exception during shutdown
Jesse Noller jnol...@gmail.com added the comment: On Tue, Jan 18, 2011 at 6:23 PM, Brian Thorne rep...@bugs.python.org wrote: Brian Thorne hardb...@gmail.com added the comment: With the example script attached I see the exception every time. On Ubuntu 10.10 with Python 2.6 Since the offending line in multiprocesing/queues.py (233) is a debug statement, just commenting it out seems to stop this exception. Looking at the util file shows the logging functions to be all of the form: if _logger: _logger.log(... Could it be possible that after the check the _logger global (or the debug function) is destroyed by the exit handler? Can we convince them to stick around until such a time that they cannot be called? Adding a small delay before joining also seems to work, but is ugly. Why should another Process *have* to have a minimum amount of work to not throw an exception? See http://bugs.python.org/issue9207 - but yes, the problem is that the VM is nuking our imported modules before all the processes are shutdown. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue4106 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
PyCon 2011 - Full talk and tutorial list now available, registration open!
I'm very pleased to announce, on behalf of the PyCon 2011 Program committee, and entire PyCon 2011 volunteer staff, that the full list of PyCon 2011 talks is now public, and available! This was an especially hard year for the PyCon program committee: we had over 200 proposals for only 95 total slots, so we ended up having to reject a lot of excellent proposals. We've spent the better part of the last few months in reviews, meetings and debates selecting which talks would be in the final PyCon program. It was not and easy task - all of the proposal authors really came through in their proposals - the number of high quality proposals we had to chose from was simply staggering. That said - the program committee completed it's work yesterday morning. Acceptance and rejection letters have been sent, and you can now view the full program on the site: http://us.pycon.org/2011/schedule/lists/talks/ This obviously complements the list of tutorials also available: http://us.pycon.org/2011/schedule/lists/tutorials/ Personally, this is my second year acting as the Program Committee chair (and hence, my last) - and between the talk list, and the list of tutorials, our current keynote speaker (http://us.pycon.org/2011/home/keynotes/) and the emerging line of up poster sessions - I'm extremely proud to have been part of the process, and extremely excited about the upcoming conference. It is going to be amazing One behalf of the entire PyCon 2011 staff, I want to again thank every single talk author for their submission(s), and I look forward to seeing all of you, and them at the conference. PyCon is an amazing conference only because of the quality talks, tutorials and community we have. I'm confident this one will knock it out of the park. As a reminder: Early Bird registration (http://us.pycon.org/2011/tickets/) closes January 17th - and we have an attendance cap of 1500 total attendees (speakers are counted against this number, and guaranteed a slot) so be sure to register today! Jesse Noller PyCon 2011 -- http://mail.python.org/mailman/listinfo/python-announce-list Support the Python Software Foundation: http://www.python.org/psf/donations/
PyCon 2011 - Full talk and tutorial list now available, registration open!
I'm very pleased to announce, on behalf of the PyCon 2011 Program committee, and entire PyCon 2011 volunteer staff, that the full list of PyCon 2011 talks is now public, and available! This was an especially hard year for the PyCon program committee: we had over 200 proposals for only 95 total slots, so we ended up having to reject a lot of excellent proposals. We've spent the better part of the last few months in reviews, meetings and debates selecting which talks would be in the final PyCon program. It was not and easy task - all of the proposal authors really came through in their proposals - the number of high quality proposals we had to chose from was simply staggering. That said - the program committee completed it's work yesterday morning. Acceptance and rejection letters have been sent, and you can now view the full program on the site: http://us.pycon.org/2011/schedule/lists/talks/ This obviously complements the list of tutorials also available: http://us.pycon.org/2011/schedule/lists/tutorials/ Personally, this is my second year acting as the Program Committee chair (and hence, my last) - and between the talk list, and the list of tutorials, our current keynote speaker (http://us.pycon.org/2011/home/keynotes/) and the emerging line of up poster sessions - I'm extremely proud to have been part of the process, and extremely excited about the upcoming conference. It is going to be amazing One behalf of the entire PyCon 2011 staff, I want to again thank every single talk author for their submission(s), and I look forward to seeing all of you, and them at the conference. PyCon is an amazing conference only because of the quality talks, tutorials and community we have. I'm confident this one will knock it out of the park. As a reminder: Early Bird registration (http://us.pycon.org/2011/tickets/) closes January 17th - and we have an attendance cap of 1500 total attendees (speakers are counted against this number, and guaranteed a slot) so be sure to register today! Jesse Noller PyCon 2011 -- http://mail.python.org/mailman/listinfo/python-list
[issue5725] process SysV-Semaphore support
Changes by Jesse Noller jnol...@gmail.com: -- nosy: +jnoller ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue5725 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue10348] multiprocessing: use SysV semaphores on FreeBSD
Jesse Noller jnol...@gmail.com added the comment: Adding, or moving, to SYSV semaphores is very low on the list of things to do. If someone were to provide a patch, I'm sure we could consider it. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue10348 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
PyCon 2011 Registration and Financial aid open and available!
[Sorry for that last partial email] I wanted to take a moment and let everyone know that the PyCon 2011 Registration system is now online and accepting registrations for the conference! http://us.pycon.org/2011/tickets/ PyCon 2011 is looking to be the biggest, and most impressive PyCon yet, we've already booked one fantastic keynote speaker, and the program committee is hard at work selecting the talks for the conference - over 200 proposals were submitted! We're filling up the poster sessions, a stunning number of tutorials are being reviewed - this really does look like it's going to be huge. Financial aid is also open and available: http://us.pycon.org/2011/registration/financialaid/ Feel free to reach out to anyone on the PyCon 2011 team to ask any questions you might have. We look forward to seeing you in Atlanta. Jesse Noller PyCon 2011 -- http://mail.python.org/mailman/listinfo/python-announce-list Support the Python Software Foundation: http://www.python.org/psf/donations/
PyCon 2011 Registration and Financial aid open and available!
Just q -- http://mail.python.org/mailman/listinfo/python-list
PyCon 2011 Registration and Financial aid open and available!
[Sorry for that last partial email] I wanted to take a moment and let everyone know that the PyCon 2011 Registration system is now online and accepting registrations for the conference! http://us.pycon.org/2011/tickets/ PyCon 2011 is looking to be the biggest, and most impressive PyCon yet, we've already booked one fantastic keynote speaker, and the program committee is hard at work selecting the talks for the conference - over 200 proposals were submitted! We're filling up the poster sessions, a stunning number of tutorials are being reviewed - this really does look like it's going to be huge. Financial aid is also open and available: http://us.pycon.org/2011/registration/financialaid/ Feel free to reach out to anyone on the PyCon 2011 team to ask any questions you might have. We look forward to seeing you in Atlanta. Jesse Noller PyCon 2011 -- http://mail.python.org/mailman/listinfo/python-list
[issue10527] multiprocessing.Pipe problem: handle out of range in select()
Changes by Jesse Noller jnol...@gmail.com: -- nosy: +asksol ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue10527 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue9162] License for multiprocessing files
Jesse Noller jnol...@gmail.com added the comment: We have to add the BSD header and maintain the copyright clause on all of the multiprocessing files. Apologies for the delay -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue9162 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue8028] self.terminate() from a multiprocessing.Process raises AttributeError exception
Jesse Noller jnol...@gmail.com added the comment: Can you please expand on deeply different? -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue8028 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue9244] multiprocessing.pool: Worker crashes if result can't be encoded
Jesse Noller jnol...@gmail.com added the comment: Fine w/ committing this Ask. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue9244 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue7707] multiprocess.Queue operations during import can lead to deadlocks
Jesse Noller jnol...@gmail.com added the comment: Fine w/ committing this Ask. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue7707 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue8028] self.terminate() from a multiprocessing.Process raises AttributeError exception
Jesse Noller jnol...@gmail.com added the comment: Fine w/ committing this Ask as-is ask. You are correct in the original intent of the code. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue8028 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue6645] multiprocessing build fails on AIX - /dev/urandom (or equivalent) not found
Jesse Noller jnol...@gmail.com added the comment: Closing per Sridhar -- status: open - closed ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue6645 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
PyCon 2011 Reminder: Call for Proposals, Posters and Tutorials - us.pycon.org
PyCon 2011 Reminder: Call for Proposals, Posters and Tutorials - us.pycon.org === Well, it's October 25th! The leaves have turned and the deadline for submitting main-conference talk proposals expires in 7 days (November 1st, 2010)! We are currently accepting main conference talk proposals: http://us.pycon.org/2011/speaker/proposals/ Tutorial Proposals: http://us.pycon.org/2011/speaker/proposals/tutorials/ Poster Proposals: http://us.pycon.org/2011/speaker/posters/cfp/ PyCon 2011 will be held March 9th through the 17th, 2011 in Atlanta, Georgia. (Home of some of the best southern food you can possibly find on Earth!) The PyCon conference days will be March 11-13, preceded by two tutorial days (March 9-10), and followed by four days of development sprints (March 14-17). We are also proud to announce that we have booked our first Keynote speaker - Hilary Mason, her bio: Hilary is the lead scientist at bit.ly, where she is finding sense in vast data sets. She is a former computer science professor with a background in machine learning and data mining, has published numerous academic papers, and regularly releases code on her personal site, http://www.hilarymason.com/. She has discovered two new species, loves to bake cookies, and asks way too many questions. We're really looking forward to having her this year as a keynote speaker! Remember, we've also added an Extreme talk track this year - no introduction, no fluff - only the pure technical meat! For more information on Extreme Talks see: http://us.pycon.org/2011/speaker/extreme/ We look forward to seeing you in Atlanta! Please also note - registration for PyCon 2011 will also be capped at a maximum of 1,500 delegates, including speakers. When registration opens (soon), you're going to want to make sure you register early! Speakers with accepted talks will have a guaranteed slot. We have published all registration prices online at: http://us.pycon.org/2011/tickets/ Important Dates November 1st, 2010: Talk proposals due. December 15th, 2010: Acceptance emails sent. January 19th, 2011: Early bird registration closes. March 9-10th, 2011: Tutorial days at PyCon. March 11-13th, 2011: PyCon main conference. March 14-17th, 2011: PyCon sprints days. Contact Emails: Van Lindberg (Conference Chair) - v...@python.org Jesse Noller (Co-Chair) - jnol...@python.org PyCon Organizers list: pycon-organiz...@python.org -- http://mail.python.org/mailman/listinfo/python-announce-list Support the Python Software Foundation: http://www.python.org/psf/donations/
PyCon 2011 Reminder: Call for Proposals, Posters and Tutorials - us.pycon.org
PyCon 2011 Reminder: Call for Proposals, Posters and Tutorials - us.pycon.org === Well, it's October 25th! The leaves have turned and the deadline for submitting main-conference talk proposals expires in 7 days (November 1st, 2010)! We are currently accepting main conference talk proposals: http://us.pycon.org/2011/speaker/proposals/ Tutorial Proposals: http://us.pycon.org/2011/speaker/proposals/tutorials/ Poster Proposals: http://us.pycon.org/2011/speaker/posters/cfp/ PyCon 2011 will be held March 9th through the 17th, 2011 in Atlanta, Georgia. (Home of some of the best southern food you can possibly find on Earth!) The PyCon conference days will be March 11-13, preceded by two tutorial days (March 9-10), and followed by four days of development sprints (March 14-17). We are also proud to announce that we have booked our first Keynote speaker - Hilary Mason, her bio: Hilary is the lead scientist at bit.ly, where she is finding sense in vast data sets. She is a former computer science professor with a background in machine learning and data mining, has published numerous academic papers, and regularly releases code on her personal site, http://www.hilarymason.com/. She has discovered two new species, loves to bake cookies, and asks way too many questions. We're really looking forward to having her this year as a keynote speaker! Remember, we've also added an Extreme talk track this year - no introduction, no fluff - only the pure technical meat! For more information on Extreme Talks see: http://us.pycon.org/2011/speaker/extreme/ We look forward to seeing you in Atlanta! Please also note - registration for PyCon 2011 will also be capped at a maximum of 1,500 delegates, including speakers. When registration opens (soon), you're going to want to make sure you register early! Speakers with accepted talks will have a guaranteed slot. We have published all registration prices online at: http://us.pycon.org/2011/tickets/ Important Dates November 1st, 2010: Talk proposals due. December 15th, 2010: Acceptance emails sent. January 19th, 2011: Early bird registration closes. March 9-10th, 2011: Tutorial days at PyCon. March 11-13th, 2011: PyCon main conference. March 14-17th, 2011: PyCon sprints days. Contact Emails: Van Lindberg (Conference Chair) - v...@python.org Jesse Noller (Co-Chair) - jnol...@python.org PyCon Organizers list: pycon-organiz...@python.org -- http://mail.python.org/mailman/listinfo/python-list
[issue9935] Faster pickling of instances
Jesse Noller jnol...@gmail.com added the comment: I doubt I, or Ask will have the time to rewrite the entire multiprocessing test suite right now to work around the change Antoine. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue9935 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue6645] multiprocessing build fails on AIX - /dev/urandom (or equivalent) not found
Jesse Noller jnol...@gmail.com added the comment: Sridhar can you confirm if this is still a problem on 3.2? -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue6645 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue6269] threading documentation makes no mention of the GIL
Changes by Jesse Noller jnol...@gmail.com: -- assignee: jnoller - nobody keywords: +easy nosy: +nobody priority: normal - low ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue6269 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue9935] Faster pickling of instances
Jesse Noller jnol...@gmail.com added the comment: On Mon, Oct 25, 2010 at 10:17 AM, Antoine Pitrou rep...@bugs.python.org wrote: Well, I'm not asking anyone to rewrite the entire multiprocessing test suite; and, besides, I've provided a patch myself to improve it in that respect ;) (in issue10173) I just saw that one - I'll poke at that next Of course, it also means the present pickle patch is imperfect, though the result of __reduce__ in this case looks more like a side-effect of an implementation detail than documented behaviour (since the result isn't usable anyway). I may try to come up with a better patch before the 3.2 beta but it's not sure I will find enough time/motivation. Okie doke. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue9935 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue10015] Creating a multiproccess.pool.ThreadPool from a child thread blows up.
Jesse Noller jnol...@gmail.com added the comment: I can not, for the life of me, remember why ThreadPool is there, except as a fallback. It's also not part of the documented interface as well. Additionally, in Python 3 we now have futures. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue10015 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
Call for proposals -- PyCon 2011
Call for proposals -- PyCon 2011 -- http://us.pycon.org/2011/ === Proposal Due date: November 1st, 2010 PyCon is back! With a rocking new website, a great location and more Python hackers and luminaries under one roof than you could possibly shake a stick at. We've also added an Extreme talk track this year - no introduction, no fluff - only the pure technical meat! PyCon 2011 will be held March 9th through the 17th, 2011 in Atlanta, Georgia. (Home of some of the best southern food you can possibly find on Earth!) The PyCon conference days will be March 11-13, preceded by two tutorial days (March 9-10), and followed by four days of development sprints (March 14-17). PyCon 2011 is looking for proposals for the formal presentation tracks (this includes extreme talks). A request for proposals for poster sessions and tutorials will come separately. Want to showcase your skills as a Python Hacker? Want to have hundreds of people see your talk on the subject of your choice? Have some hot button issue you think the community needs to address, or have some package, code or project you simply love talking about? Want to launch your master plan to take over the world with Python? PyCon is your platform for getting the word out and teaching something new to hundreds of people, face to face. In the past, PyCon has had a broad range of presentations, from reports on academic and commercial projects, tutorials on a broad range of subjects, and case studies. All conference speakers are volunteers and come from a myriad of backgrounds: some are new speakers, some have been speaking for years. Everyone is welcome, so bring your passion and your code! We've had some incredible past PyCons, and we're looking to you to help us top them! Online proposal submission is open now! Proposals will be accepted through November 10th, with acceptance notifications coming out by January 20th. To get started, please see: http://us.pycon.org/2011/speaker/ For videos of talks from previous years - check out: http://python.mirocommunity.org/category/conferences For more information on Extreme Talks see: http://us.pycon.org/2011/speaker/extreme/ We look forward to seeing you in Atlanta! Please also note - registration for PyCon 2011 will also be capped at a maximum of 1,500 delegates, including speakers. When registration opens (soon), you're going to want to make sure you register early! Speakers with accepted talks will have a guaranteed slot. Important Dates: * November 1st, 2010: Talk proposals due. * December 15th, 2010: Acceptance emails sent. * January 19th, 2010: Early bird registration closes. * March 9-10th, 2011: Tutorial days at PyCon. * March 11-13th, 2011: PyCon main conference. * March 14-17th, 2011: PyCon sprints days. Contact Emails: Van Lindberg (Conference Chair) - v...@python.org Jesse Noller (Co-Chair) - jnol...@python.org PyCon Organizers list: pycon-organiz...@python.org -- http://mail.python.org/mailman/listinfo/python-announce-list Support the Python Software Foundation: http://www.python.org/psf/donations/
Call for proposals -- PyCon 2011
Call for proposals -- PyCon 2011 -- http://us.pycon.org/2011/ === Proposal Due date: November 1st, 2010 PyCon is back! With a rocking new website, a great location and more Python hackers and luminaries under one roof than you could possibly shake a stick at. We've also added an Extreme talk track this year - no introduction, no fluff - only the pure technical meat! PyCon 2011 will be held March 9th through the 17th, 2011 in Atlanta, Georgia. (Home of some of the best southern food you can possibly find on Earth!) The PyCon conference days will be March 11-13, preceded by two tutorial days (March 9-10), and followed by four days of development sprints (March 14-17). PyCon 2011 is looking for proposals for the formal presentation tracks (this includes extreme talks). A request for proposals for poster sessions and tutorials will come separately. Want to showcase your skills as a Python Hacker? Want to have hundreds of people see your talk on the subject of your choice? Have some hot button issue you think the community needs to address, or have some package, code or project you simply love talking about? Want to launch your master plan to take over the world with Python? PyCon is your platform for getting the word out and teaching something new to hundreds of people, face to face. In the past, PyCon has had a broad range of presentations, from reports on academic and commercial projects, tutorials on a broad range of subjects, and case studies. All conference speakers are volunteers and come from a myriad of backgrounds: some are new speakers, some have been speaking for years. Everyone is welcome, so bring your passion and your code! We've had some incredible past PyCons, and we're looking to you to help us top them! Online proposal submission is open now! Proposals will be accepted through November 10th, with acceptance notifications coming out by January 20th. To get started, please see: http://us.pycon.org/2011/speaker/ For videos of talks from previous years - check out: http://python.mirocommunity.org/category/conferences For more information on Extreme Talks see: http://us.pycon.org/2011/speaker/extreme/ We look forward to seeing you in Atlanta! Please also note - registration for PyCon 2011 will also be capped at a maximum of 1,500 delegates, including speakers. When registration opens (soon), you're going to want to make sure you register early! Speakers with accepted talks will have a guaranteed slot. Important Dates: * November 1st, 2010: Talk proposals due. * December 15th, 2010: Acceptance emails sent. * January 19th, 2010: Early bird registration closes. * March 9-10th, 2011: Tutorial days at PyCon. * March 11-13th, 2011: PyCon main conference. * March 14-17th, 2011: PyCon sprints days. Contact Emails: Van Lindberg (Conference Chair) - v...@python.org Jesse Noller (Co-Chair) - jnol...@python.org PyCon Organizers list: pycon-organiz...@python.org -- http://mail.python.org/mailman/listinfo/python-list
[issue9851] multiprocessing socket timeout will break client
Jesse Noller jnol...@gmail.com added the comment: Duplicate; 9897 -- resolution: - duplicate status: open - closed ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue9851 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue9897] multiprocessing problems
Jesse Noller jnol...@gmail.com added the comment: hume; filing this again doesn't help. I closed issue 9851 as a duplicate of this for you. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue9897 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue9162] License for multiprocessing files
Jesse Noller jnol...@gmail.com added the comment: On Thu, Sep 16, 2010 at 8:15 AM, Michael Fladischer rep...@bugs.python.org wrote: Michael Fladischer mich...@fladi.at added the comment: Is there any timeline on when this will be fixed? It's currently blocking work on a python-related package for Debian. I'll ping the PSF board for the legal recommendations again. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue9162 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue9851] multiprocessing socket timeout will break client
Jesse Noller jnol...@gmail.com added the comment: Calling it stupid doesn't incentivize me to help you, or fix it. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue9851 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue8296] multiprocessing.Pool hangs when issuing KeyboardInterrupt
Jesse Noller jnol...@gmail.com added the comment: If we keep that behavior, the real problem here is that the result handler hangs if the process that reserved a job is gone, which is going to be handled by #9205. Should we mark it as a duplicate? I would tend to agree with your assessment; we're better served just gracefully handling everything per 9205 -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue8296 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue9663] importlib should exclusively open bytecode files
Jesse Noller jnol...@gmail.com added the comment: Nice. -- nosy: +jnoller ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue9663 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue9592] Limitations in objects returned by multiprocessing Pool
Jesse Noller jnol...@gmail.com added the comment: Thanks Freek - we're actually discussing some stuff like this in issue9205 as well -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue9592 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue9592] Limitations in objects returned by multiprocessing Pool
Jesse Noller jnol...@gmail.com added the comment: Florent - Are you running the script from Freek on the buildbots, or are you just updating this bugs with other run failures? I'm having a really hard time separating things. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue9592 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue8428] buildbot: test_multiprocessing timeout (test_notify_all? test_pool_worker_lifetime?)
Jesse Noller jnol...@gmail.com added the comment: Is this intermittent, or consistently failing? Updating it with more buildbot failures doesn't help. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue8428 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue9586] warning: comparison between pointer and integer in multiprocessing build on Tiger
Jesse Noller jnol...@gmail.com added the comment: looks fine mark -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue9586 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue9586] warning: comparison between pointer and integer in multiprocessing build on Tiger
Jesse Noller jnol...@gmail.com added the comment: I agree with Antoine -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue9586 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue8184] multiprocessing.managers will not fail if listening ocket already in use
Jesse Noller jnol...@gmail.com added the comment: Mark - did you observe the behavior in the Op? He's not stating the the code snippet runs fine, but that the second run at the same time on windows to cause a conflict. We need to show that either running it twice, at the same time against the same socket fails on windows as it should or we still have a bug -- status: pending - open ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue8184 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue8426] multiprocessing.Queue fails to get() very large objects
Jesse Noller jnol...@gmail.com added the comment: I don't know that it's unreasonable to send that much data, but it would certainly be slow, and I would not recommend it. Therefore, this is still on the list for when I have time -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue8426 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue6720] multiprocessing logging
Jesse Noller jnol...@gmail.com added the comment: The backport of multiprocessing is currently stale; and there are a few bugs in the tracker assigned to christian or myself in regards to it. If it's not too much trouble, I'd leave this one alone until the exact future of the backport can be resolved. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue6720 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue9513] test_multiprocessing skipped on Windows
Jesse Noller jnol...@gmail.com added the comment: The relative imports have been more of a pain then they've helped. I'm fine with nuking them so long as the test suite passes. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue9513 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue5001] Remove assertion-based checking in multiprocessing
Jesse Noller jnol...@gmail.com added the comment: @Mark Yeah - I'm the current multiprocessing maintainer. If I fix it, I'll just commit it :) I filed this as a to do against myself. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue5001 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue9400] multiprocessing.pool.AsyncResult.get() messes up exceptions
Jesse Noller jnol...@gmail.com added the comment: @ray - you probably don't have the dcon binary on your path. bug.py calls a subprocess call. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue9400 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue9205] Parent process hanging in multiprocessing if children terminate unexpectedly
Jesse Noller jnol...@gmail.com added the comment: (sorry, I thought I had replied to your comment when I hadn't!) I think we can get away with a new optional kwarg. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue9205 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue9205] Parent process hanging in multiprocessing if children terminate unexpectedly
Jesse Noller jnol...@gmail.com added the comment: You two are bigger users of this then I currently am (the curse/blessing of switching jobs), which is why I've let you hash it out. Let me point out: my goal is to deal with errors in a way which does not cause a total crash, a lockup, or hanging processes. Whether or not we lose jobs is another thing entirely, and something I'm torn on. I also need to mention - I think we can add fixes to the behavior to 2.7 - we can not, however, change the API. If we change the API, this fix will be only on Python 3.2 which is not what I suspect either of you want. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue9205 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue9205] Parent process hanging in multiprocessing if children terminate unexpectedly
Jesse Noller jnol...@gmail.com added the comment: Passing the references seems to be a losing game; for _handle_workers - we only need 1 function (debug) - for others (say _join_exited_workers), we need references to reversed/range/len. A possible alternative is to make those threads non-daemon threads; but I'd have to test that. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue9205 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue9244] multiprocessing.pool: Worker crashes if result can't be encoded
Changes by Jesse Noller jnol...@gmail.com: -- assignee: - jnoller nosy: +gdb ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue9244 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue9207] multiprocessing occasionally spits out exception during shutdown (_handle_workers)
Jesse Noller jnol...@gmail.com added the comment: Thank you for doing that footwork Greg, it means a lot to me. I'm leaning towards the patch to swallow the errors - I just wanted to ponder it just a tiny bit longer before I pull the trigger. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue9207 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue9205] Parent process hanging in multiprocessing if children terminate unexpectedly
Jesse Noller jnol...@gmail.com added the comment: Greg - I asked Ask to take a look - his celery package is a huge consumer of multiprocessing, and so I tend to run things past him as well. That said - to both of you - the fundamental problem the shutdown patch is trying to scratch is located in issue 9207 - greg's termination patch just exposes the problem in 9207 a lot more. Focusing specifically on the shutdown patch; our issue is that during interpreter shutdown, sys.modules is iterated, and entries are set to None - for threads which live on well into that cycle can end up losing imported functions/modules/etc. The multiple daemon threads in the Pool code are exposing this as code which executed imported functions (such as the debug() statement in handle_workers) which will fire after the pool has exited and the interpreter is shut down. We can work around the shutdown issue (really, bug 9207) by ignoring the exception such as shutdown.patch does, or passing in references/adding references to the functions those methods need. Or (as Brett suggested) converting them to class methods and adding references to the class. Or passing them in via the signature like this _handle_workers(arg, _debug=debug), etc. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue9205 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue9207] multiprocessing occasionally spits out exception during shutdown (_handle_workers)
Jesse Noller jnol...@gmail.com added the comment: Talking with Brett; the fix should be as simple as keeping a reference to the debug function which we have in the imports. During interpreter shutdown, the sys.modules is iterated and each module replaced with None. Since the _handle_workers thread persists slightly past the point of the parent (and can, it's a daemon thread) debug is vanishing on us. We can go with switching this to a classmethod, and keeping a reference on the class, passing debug directly into the _handle_workers thread (testing this last night fixed it 100% of the time) -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue9207 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue9205] Parent process hanging in multiprocessing if children terminate unexpectedly
Jesse Noller jnol...@gmail.com added the comment: thanks greg; I'm going to take a look and think about this. I'd like to resolve bug 9207 first though -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue9205 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue9205] Parent process hanging in multiprocessing if children terminate unexpectedly
Changes by Jesse Noller jnol...@gmail.com: -- assignee: - jnoller ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue9205 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue9205] Parent process hanging in multiprocessing if children terminate unexpectedly
Jesse Noller jnol...@gmail.com added the comment: Ugh. I'm going to have to think about the cleanest way of handling this case of functions vanishing from us since this is going to be more widespread inside the code. Suggestions welcome. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue9205 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue9205] Parent process hanging in multiprocessing if children terminate unexpectedly
Jesse Noller jnol...@gmail.com added the comment: A+ for creativity; I wouldn't have thought of that ;) -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue9205 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
Call for Applications - PSF Sponsored Sprints
The PSF is happy to open our first call for applications for sprint funding! Have you ever had a group of people together to hack towards a common goal? You've hosted a sprint! Have you ever wanted to get a group of like minded Pythonistas together to hack for a day? You're going to want to hold a sprint! Whether you call them Sprints, Hackfests, Hack-a-thons, or any other name, they're a great way to hang out with like-minded developers and work on common code. Sprints are an unbeatable way to build friendships and contacts that will last for years to come, and they're a great way to learn about something new if you're just starting out. The Python Software Foundation has set aside funds to be distributed to world-wide sprint efforts. We're anticipating 2-3 events per month focused on covering topics to help the entire community: - Python Core bug triage and patch submission (on-boarding new contributors) - Python Core documentation (including process documentation) improvements - Porting libraries/applications to Python 3 - Python website/wiki content improvements - PyPI packaging hosting site improvements - Contribution to other core projects, such as packaging related issues. If you are interested in holding a sprint on any of the topics above and you're looking for some money to help out with sprint costs, we can help (up to a max of $250 USD). Prepare an application including the following information: - Date and Location: Where will the event be? What day and time? - Organizers: Who are the event organizers and sprint coach? Is the sprint being run by a Python user group? - Attendees: How many participants do you expect? - Goal: What is the focus and goal of the sprint? - Budget: How much funding you are requesting, and what will you use it for? - Applications should be sent to: spri...@python.org with the subject Sprint Funding Application - location We encourage anyone - even those who have never held, or been to a sprint - to consider holding one. We will help you as much as we can with welcome packets, advertising, and hooking you up with required resources - anything to make it possible. As part of being approved, the you will need to agree to deliver a report (hopefully, with pictures!) of the sprint to the Sprint Committee, so we can post it on the sprint blog and site: http://www.pythonsprints.com If you have any questions or need more information, contact us by email at spri...@python.org. More information is up on our blog: http://pythonsprints.com/2010/07/8/call-applications-now-open/ -- http://mail.python.org/mailman/listinfo/python-announce-list Support the Python Software Foundation: http://www.python.org/psf/donations/
[issue9207] multiprocessing occasionally spits out exception during shutdown (_handle_workers)
Jesse Noller jnol...@gmail.com added the comment: I'm not sure if there would still be the possibility; the thing which worries me is the debug() function vanishing on us - something not good is happening on interpreter shutdown. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue9207 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue9162] License for multiprocessing files
Jesse Noller jnol...@gmail.com added the comment: Hi Stefan - I'm familiar with the license/etc of the original module. This bug isn't urgent; I shot a quick email to the PSF's secretary Pat to confirm we have a contributor agreement however. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue9162 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue9162] License for multiprocessing files
Jesse Noller jnol...@gmail.com added the comment: Egad No! I gotcha. I'll find out what the deal with the contrib. agreement is. Pretty sure we had to wait on it when we brought it in. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue9162 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue9207] multiprocessing occasionally spits out exception during shutdown (_handle_workers)
Jesse Noller jnol...@gmail.com added the comment: Greg - yeah. it's the same problem. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue9207 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
Call for Applications - PSF Sponsored Sprints
The PSF is happy to open our first call for applications for sprint funding! Have you ever had a group of people together to hack towards a common goal? You've hosted a sprint! Have you ever wanted to get a group of like minded Pythonistas together to hack for a day? You're going to want to hold a sprint! Whether you call them Sprints, Hackfests, Hack-a-thons, or any other name, they're a great way to hang out with like-minded developers and work on common code. Sprints are an unbeatable way to build friendships and contacts that will last for years to come, and they're a great way to learn about something new if you're just starting out. The Python Software Foundation has set aside funds to be distributed to world-wide sprint efforts. We're anticipating 2-3 events per month focused on covering topics to help the entire community: - Python Core bug triage and patch submission (on-boarding new contributors) - Python Core documentation (including process documentation) improvements - Porting libraries/applications to Python 3 - Python website/wiki content improvements - PyPI packaging hosting site improvements - Contribution to other core projects, such as packaging related issues. If you are interested in holding a sprint on any of the topics above and you're looking for some money to help out with sprint costs, we can help (up to a max of $250 USD). Prepare an application including the following information: - Date and Location: Where will the event be? What day and time? - Organizers: Who are the event organizers and sprint coach? Is the sprint being run by a Python user group? - Attendees: How many participants do you expect? - Goal: What is the focus and goal of the sprint? - Budget: How much funding you are requesting, and what will you use it for? - Applications should be sent to: spri...@python.org with the subject Sprint Funding Application - location We encourage anyone - even those who have never held, or been to a sprint - to consider holding one. We will help you as much as we can with welcome packets, advertising, and hooking you up with required resources - anything to make it possible. As part of being approved, the you will need to agree to deliver a report (hopefully, with pictures!) of the sprint to the Sprint Committee, so we can post it on the sprint blog and site: http://www.pythonsprints.com If you have any questions or need more information, contact us by email at spri...@python.org. More information is up on our blog: http://pythonsprints.com/2010/07/8/call-applications-now-open/ -- http://mail.python.org/mailman/listinfo/python-list
[issue4106] multiprocessing occasionally spits out exception during shutdown
Jesse Noller jnol...@gmail.com added the comment: Greg - what platform? -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue4106 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue4106] multiprocessing occasionally spits out exception during shutdown
Jesse Noller jnol...@gmail.com added the comment: Greg - this is actually a different exception then the original bug report; could you please file a new issue with the information you've provided? I'm going to need to find a 64bit ubuntu box as I don't have one right now. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue4106 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue9207] multiprocessing occasionally spits out exception during shutdown
Jesse Noller jnol...@gmail.com added the comment: Thanks greg; so this affects 2.6 as well (not using the backport at all) -- assignee: - jnoller nosy: +jnoller ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue9207 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue9207] multiprocessing occasionally spits out exception during shutdown (_handle_workers)
Changes by Jesse Noller jnol...@gmail.com: -- title: multiprocessing occasionally spits out exception during shutdown - multiprocessing occasionally spits out exception during shutdown (_handle_workers) ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue9207 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue9207] multiprocessing occasionally spits out exception during shutdown (_handle_workers)
Jesse Noller jnol...@gmail.com added the comment: Oh, you mean the backport from google code? The person who stepped up to maintain that has not refreshed that in some time. I need to decide what to do with it long term. I'm pretty sure it's badly out of date. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue9207 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue9207] multiprocessing occasionally spits out exception during shutdown (_handle_workers)
Jesse Noller jnol...@gmail.com added the comment: Wait - so, you are pulling svn trunk, compiling and running your test with the built python executable? I'm not following the multiprocessing-from-trunk distinction unless you're picking the module out of the tree / compiling it and then moving it into some other install. I might be being overly dense. You're running your test with cd src/tree/ ./python your thing - right? Also, what, if any, compile flags are you passing to the python build? -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue9207 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue9207] multiprocessing occasionally spits out exception during shutdown (_handle_workers)
Jesse Noller jnol...@gmail.com added the comment: Alright, I'm fighting ubuntu 64 bit in my vmware install right now, I'll see if I can get it up and running. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue9207 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue9162] License for multiprocessing files
Jesse Noller jnol...@gmail.com added the comment: Yes; the copyright has to stay; but the license data can leave afaik. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue9162 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue9207] multiprocessing occasionally spits out exception during shutdown (_handle_workers)
Jesse Noller jnol...@gmail.com added the comment: I can confirm with a clean ubuntu 64 install, with a clean checkout of release27 that it explodes with that exception, while the stock 2.6.5 does not. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue9207 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue9207] multiprocessing occasionally spits out exception during shutdown (_handle_workers)
Jesse Noller jnol...@gmail.com added the comment: It does not seem to appear on OS/X 10.6.4 - so the only question is does this show up on Ubuntu 32bit -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue9207 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue9207] multiprocessing occasionally spits out exception during shutdown (_handle_workers)
Jesse Noller jnol...@gmail.com added the comment: Correction; it can and does happen on OS/X. So, this is not a platform specific bug. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue9207 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue9207] multiprocessing occasionally spits out exception during shutdown (_handle_workers)
Jesse Noller jnol...@gmail.com added the comment: Greg, can you comment out line 272 in Lib/multiprocessing/pool.py and tell me if you can reproduce? -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue9207 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue9144] Import error for multiprocessing in 2.7rc2 on Windows
Jesse Noller jnol...@gmail.com added the comment: the patch looks good to me - unless someone beats me to it, I'm going to commit it shortly to fix 2.7 -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue9144 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue9144] Import error for multiprocessing in 2.7rc2 on Windows
Jesse Noller jnol...@gmail.com added the comment: Pushed it in r82489 - worked for me on Linux and OS/X. Please let me know if anything else comes up. -- status: open - closed ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue9144 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue8995] Performance issue with multiprocessing queue (3.1 VS 2.6)
Jesse Noller jnol...@gmail.com added the comment: No - I don't know of anything which would trigger this in 3.1 off the top of my head. The performance degradation is pretty worrisome -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue8995 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue8713] multiprocessing needs option to eschew fork() under Linux
Jesse Noller jnol...@gmail.com added the comment: This is on my wish list; but I have not had time to do it. Patch welcome. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue8713 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue8713] multiprocessing needs option to eschew fork() under Linux
Jesse Noller jnol...@gmail.com added the comment: I pretty much agree with (b) an argument - your gut instinct is correct - there's a long standing thread in python-dev which pretty much solidified my thinking about whether or not we need this (we do). Any patch has to be backwards compatible by the way, it can not alter the current default behavior, also, it has to target python3 as 2.7 is nearing final, and this is a behavioral change. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue8713 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue8333] test_multiprocessing: pickling failures
Jesse Noller jnol...@gmail.com added the comment: When did this problem start? -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue8333 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue8237] multiprocessing.Queue() blocks program
Jesse Noller jnol...@gmail.com added the comment: multiprocessing.Queue.Put() acts the same as Queue.put() - if the queue is full, the put call hangs until the queue is no longer full. The process will not exit, as the Queue is full, and it's waiting in put. This works as designed, unless I'm missing something painfully obvious, which is entirely possible. -- resolution: - invalid status: open - closed ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue8237 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
