Re: .split() Qeustion

2013-08-16 Thread Ben Finney
Steven D'Aprano steve+comp.lang.pyt...@pearwood.info writes: Not quite. A mole (abbreviation: mol) is a name for a specific number, like couple (2) or dozen (12) or gross (144), only much bigger: 6.02e23. And I can't believe I still remember that value :-) Avogadro's Number is worth

How to I do this in Python ?

2013-08-16 Thread Ganesh Pal
Hello Friends , Iam a newbie to python , Iam writing a small script that would generate various kinds of files in the specified path . Iam using sub process module to achieve this , I have stuck with few basic problems , any help on this would be great Case (a) : The below code creates the

Re: Want to learn Python

2013-08-16 Thread Nikhil Bansode
On Thursday, August 15, 2013 7:51:43 PM UTC+5:30, prem kumar wrote: Hi All, Presently Iam working with QTP(VBscript)..Now planning to learn PYTHON..Could you please suggest me like is ti good to learn what is the present condition for Python in IT Companies.. Iam not thinking abt

Re: Nested virtual environments

2013-08-16 Thread Luca Cerone
Thanks Marcel, I will give it a try during the weekend and let you know if it worked for me :) If you have a recent version of pip, you can use wheels [1] to save built packages locally. First create a new virtualenv and install the common packages. Then put these packages in a wheel

Options ExecCGI is off in this directory:

2013-08-16 Thread helmut_blass
Hello, I am desperately trying to get my python script running, but I alway get a 403-Error. apache logfile says: Options ExecCGI is off in this directory:/home/user12/cgi-bin/showblogs.py - apache configuration: Directory /home/user12/cgi-bin/ AllowOverride None AddType application/python .py

Re: How to I do this in Python ?

2013-08-16 Thread Steven D'Aprano
Hi Ganesh, and welcome! Unfortunately, you ask your questions in reverse order. The most general (and important) question comes last, and the least important first, so I'm going to slice-and-dice your post and answer from most general to least. On Fri, 16 Aug 2013 11:51:32 +0530, Ganesh Pal

Re: .split() Qeustion

2013-08-16 Thread Roy Smith
In article mailman.613.1376632775.1251.python-l...@python.org, Ben Finney ben+pyt...@benfinney.id.au wrote: Avogadro's Number is worth remembering, for mocking the pseudo-science of homeopathy URL:http://www.1023.org.uk/what-is-homeopathy.php. You have obviously never argued science with a

Re: How to I do this in Python ?

2013-08-16 Thread Roy Smith
In article mailman.614.1376636762.1251.python-l...@python.org, Ganesh Pal ganesh1...@gmail.com wrote: # Creating sparse files in the sparse path sparse_path = os.path.join(path,'sparsefiles') os.makedirs(sparse_path) os.chdir(sparse_path) sparsefiles = dd if=/dev/zero

Re: .split() Qeustion

2013-08-16 Thread wxjmfauth
- A mole is an amount of matter measured in [kg] . The Avogadro's number can only be a dimensionless number, [1] . The Avogadro's constant is the Avogadro's number (of pieces or objects) per mol, [1 / mol]. A chemist has to work and is always working in mole; as his balance can only measure

Re: .split() Qeustion

2013-08-16 Thread Roy Smith
In article 2d88bc0f-fdcb-4685-87ed-c17998dd3...@googlegroups.com, wxjmfa...@gmail.com wrote: A chemist has to work and is always working in mole; as his balance can only measure a mass, the calculation mole - mass is always mandatory. That's because chemists are lazy. The recipe says, Add

Re: .split() Qeustion

2013-08-16 Thread Grant Edwards
On 2013-08-16, Roy Smith r...@panix.com wrote: In article mailman.613.1376632775.1251.python-l...@python.org, Ben Finney ben+pyt...@benfinney.id.au wrote: Avogadro's Number is worth remembering, for mocking the pseudo-science of homeopathy URL:http://www.1023.org.uk/what-is-homeopathy.php.

Proper use of the codecs module.

2013-08-16 Thread Andrew
I have a mixed binary/text file[0], and the text portions use a radically nonstandard character set. I want to read them easily given information about the character encoding and an offset for the beginning of a string. The descriptions of the codecs module and codecs.register() in particular

THRINAXODON ON RAGE.

2013-08-16 Thread THRINA.XODON
THRINAXODON GETS REVENGE AGAINST SMITHSONIAN ASS HOLES. TODAY; THE SMITHSONIAN BURNED THRINAXODON'S HOUSE DOWN; AS HE WENT TO GET GROCERY'S FROM MARK'S. THE ARSONISTS WERE

Re: Options ExecCGI is off in this directory:

2013-08-16 Thread Xavi
You do not say the version of apache. If it's the 2.4 must change allow from all to Require all granted. HTH -- Xavi El 16/08/2013 12:28, helmut_bl...@web.de escribió: Hello, I am desperately trying to get my python script running, but I alway get a 403-Error. apache logfile says: Options

Re: PEP 450 Adding a statistics module to Python

2013-08-16 Thread taldcroft
On Friday, August 9, 2013 9:10:18 PM UTC-4, Steven D'Aprano wrote: I am seeking comments on PEP 450, Adding a statistics module to Python's standard library: http://www.python.org/dev/peps/pep-0450/ Please read the FAQs before asking anything :-) I think this is a super idea.

Re: PEP 450 Adding a statistics module to Python

2013-08-16 Thread chris . barker
I am seeking comments on PEP 450, Adding a statistics module to Python's The trick here is that numpy really is the right way to do this stuff. I like to say: crunching numbers in python without numpy is like doing text processing without using the string object What this is really an

Re: Options ExecCGI is off in this directory:

2013-08-16 Thread helmut_blass
On Friday, August 16, 2013 5:41:56 PM UTC+2, Xavi wrote: You do not say the version of apache. If it's the 2.4 must change allow from all to Require all granted. it is apache2.2.14, so that's not the point. -- http://mail.python.org/mailman/listinfo/python-list

Re: .split() Qeustion

2013-08-16 Thread Gene Heskett
On Friday 16 August 2013 10:07:12 Roy Smith did opine: In article 520da6d1$0$3$c3e8da3$54964...@news.astraweb.com, Steven D'Aprano steve+comp.lang.pyt...@pearwood.info wrote: On Thu, 15 Aug 2013 16:43:41 +0100, Chris Angelico wrote: A mole is as much a number (6e23) as the light

Re: .split() Qeustion

2013-08-16 Thread Gene Heskett
On Friday 16 August 2013 10:27:36 Dave Angel did opine: Roy Smith wrote: In article 520da6d1$0$3$c3e8da3$54964...@news.astraweb.com, Steven D'Aprano steve+comp.lang.pyt...@pearwood.info wrote: On Thu, 15 Aug 2013 16:43:41 +0100, Chris Angelico wrote: A mole is as much a number

Re: PEP 450 Adding a statistics module to Python

2013-08-16 Thread Oscar Benjamin
On 16 August 2013 17:31, chris.bar...@noaa.gov wrote: I am seeking comments on PEP 450, Adding a statistics module to Python's The trick here is that numpy really is the right way to do this stuff. Although it doesn't mention this in the PEP, a significant point that is worth bearing in mind

Lettuce vs Behave

2013-08-16 Thread cutems93
I found that BDD is a very good philosophy for coding and checking my program, and I decided to use either of these two software. However, it seems these two are very similar in the way they function. As professionals, what do you prefer and why? --

Shen video appeal - generating type secure Python

2013-08-16 Thread Mark Tarver
Shen is a hypermodern functional programming language based on a core that is essentially a Lisp, but portable to many major language platforms. One of these platforms is Python. I am asking for support for the Shen project in this video appeal www.shenlanguage.org/appeal.html The video

Re: How to I do this in Python ?

2013-08-16 Thread random832
On Fri, Aug 16, 2013, at 7:47, Roy Smith wrote: There is no need to shell out to dd just to do this. All dd is doing for you is seeking to the offset you specify and closing the file. You can do that entirely in Python code. http://docs.python.org/2.7/library/stdtypes.html#file.seek

Re: PEP 450 Adding a statistics module to Python

2013-08-16 Thread Steven D'Aprano
On Fri, 16 Aug 2013 09:31:34 -0700, chris.barker wrote: I am seeking comments on PEP 450, Adding a statistics module to Python's The trick here is that numpy really is the right way to do this stuff. Numpy does not have a monopoly on the correct algorithms for statistics functions, and a

Re: PEP 450 Adding a statistics module to Python

2013-08-16 Thread chris . barker
On Friday, August 16, 2013 10:15:52 AM UTC-7, Oscar Benjamin wrote: On 16 August 2013 17:31, chris.bar...@noaa.gov wrote: Although it doesn't mention this in the PEP, a significant point that is worth bearing in mind is that numpy is only for CPython, not PyPy, IronPython, Jython etc. See

Re: Proper use of the codecs module.

2013-08-16 Thread Steven D'Aprano
On Fri, 16 Aug 2013 10:02:08 -0400, Andrew wrote: I have a mixed binary/text file[0], and the text portions use a radically nonstandard character set. I want to read them easily given information about the character encoding and an offset for the beginning of a string. Mixed binary/text is

RE: PEP 450 Adding a statistics module to Python

2013-08-16 Thread Prasad, Ramit
CM wrote: On Friday, August 9, 2013 9:10:18 PM UTC-4, Steven D'Aprano wrote: I am seeking comments on PEP 450, Adding a statistics module to Python's standard library: I think it's a very good idea. Good PEP points, too. I hope it happens. +1 especially for non-Cpython versions of

Re: PEP 450 Adding a statistics module to Python

2013-08-16 Thread Oscar Benjamin
On 16 August 2013 20:00, chris.bar...@noaa.gov wrote: One other point -- for performance reason, is would be nice to have some compiled code in there -- this adds incentive to put it in the stdlib -- external packages that need compiling is what makes numpy unacceptable to some folks.

Re: PEP 450 Adding a statistics module to Python

2013-08-16 Thread chris . barker
On Friday, August 16, 2013 11:51:49 AM UTC-7, Steven D'Aprano wrote: The trick here is that numpy really is the right way to do this stuff. Numpy does not have a monopoly on the correct algorithms for statistics functions, indeed not -- in fact, a number of them are quite lame, either

Re: Proper use of the codecs module.

2013-08-16 Thread Andrew
On 16 Aug 2013 19:12:02 GMT, Steven D'Aprano wrote: If you try opening the file in text mode, you'll very likely break the binary parts (e.g. converting the two bytes 0x0D0A to a single byte 0x0A). So best to stick to binary only, extract the text portions of the file, then explicitly

Re: http post goes into $_REQUEST instead into $_FILES

2013-08-16 Thread Piet van Oostrum
cerr ron.egg...@gmail.com writes: Hi, I have a Python script that is executing an http POST to transfer a file from the client to the server. I have achieved this with below code: snip but my problem is, the data gets posted to the sever but arrives in the `$_REQUEST` array and I'm

Re: Proper use of the codecs module.

2013-08-16 Thread Chris Angelico
On Fri, Aug 16, 2013 at 3:02 PM, Andrew andrew@invalid.invalid wrote: I have a mixed binary/text file[0], and the text portions use a radically nonstandard character set. I want to read them easily given information about the character encoding and an offset for the beginning of a string. To

Re: .split() Qeustion

2013-08-16 Thread Gregory Ewing
Gene Heskett wrote: Where a 1 degree shift, may or may not have been noticeable, was the cable equivalent of 7.7601420788892939683e-10 seconds, which was for the small foam cored cables used for such, with a Propagation Velocity of 0.78*C, only a very short length of cable. I'd have figured

Re: The meaning of doubt, was Re: Python Basic Doubt

2013-08-16 Thread David Hutto
You could say that all translated languages lose something in translation. It's all symbolism. I say sunshine, and you might say Great Ball of' Fire in the s ky. Isay x = 10 in python print x and in c++ something like unsigned int x cin x; cout x; or something like that. It's something

Re: Writing a “social network” in Python (was: Open-source vs. closed-source for centralised social-networks?)

2013-08-16 Thread David Hutto
Is this social network app based, or browser based. Either will need an updated server file, or a db field. On Tue, Aug 13, 2013 at 7:08 PM, Ben Finney ben+pyt...@benfinney.id.auwrote: Alec Taylor alec.tayl...@gmail.com writes: Fear open-sourcing fledgling social-networks; as

Re: PEP 450 Adding a statistics module to Python

2013-08-16 Thread Roy Smith
In article 0d60fd90-eb19-4702-acd5-dd7ba0edd...@googlegroups.com, taldcr...@cfa.harvard.edu wrote: Python is showing up in high-school and colllege intro programming courses here in the U.S. Yup. For the past few years, I've been a judge in the NYC Science and Engineering Fair

Re: .split() Qeustion

2013-08-16 Thread Steven D'Aprano
On Fri, 16 Aug 2013 05:27:49 +, Dave Angel wrote: I figure it just under a foot. I once attended a lecture by Grace Hopper where she handed out nanoseconds, pieces of wire about a foot long. Is that based on the speed of light in a vacuum, speed of light in copper, speed of electron

Re: .split() Qeustion

2013-08-16 Thread Chris Angelico
On Sat, Aug 17, 2013 at 3:38 AM, Steven D'Aprano steve+comp.lang.pyt...@pearwood.info wrote: On Fri, 16 Aug 2013 05:27:49 +, Dave Angel wrote: I figure it just under a foot. I once attended a lecture by Grace Hopper where she handed out nanoseconds, pieces of wire about a foot long. Is

Rock, Paper, Scissors game

2013-08-16 Thread Larry Hudson
Some time ago there was a post asking for help on a rock/paper/scissors game. I read that thread at the time it was posted, but since it received several answers I didn't pay too much attention to it. But I can't find that thread again right now. However, the subject stuck (loosely) in my

.split() Qeustion

2013-08-16 Thread Alfonso Andalon Jr.
-- http://mail.python.org/mailman/listinfo/python-list

[issue18743] References to non-existant StringIO module

2013-08-16 Thread Serhiy Storchaka
Changes by Serhiy Storchaka storch...@gmail.com: -- assignee: docs@python - serhiy.storchaka ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue18743 ___

[issue14191] argparse doesn't allow optionals within positionals

2013-08-16 Thread Glenn Linderman
Glenn Linderman added the comment: Paul, is this ready to merge, or are you thinking of more refinements? -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue14191 ___

[issue18738] String formatting (% and str.format) issues with Enum

2013-08-16 Thread Ethan Furman
Ethan Furman added the comment: Eric, please do not feel your time has been wasted. I greatly appreciate the knowledge you shared and I learned much. I feel very strongly that, as much as possible, an Enum should Just Work. Requiring users to write their own __format__ any time they create

[issue18738] String formatting (% and str.format) issues with Enum

2013-08-16 Thread Ethan Furman
Ethan Furman added the comment: This patch contains the previous patch, plus a fix and tests for %i, %d, and %u formatting, and tests only for %f formatting (nothing to fix there, but don't want it breaking in the future ;) . -- Added file:

[issue18753] [c]ElementTree.fromstring fails to parse value]]/value

2013-08-16 Thread Kees Bos
New submission from Kees Bos: ElementTree.fromstring and cElementTree.fromstring fail on parsing value]]/value, but do parse value]]gt;/value $ python Python 2.7.3 (default, Apr 10 2013, 05:09:49) [GCC 4.7.2] on linux2 Type help, copyright, credits or license for more information. from

[issue18720] Switch suitable constants in the socket module to IntEnum

2013-08-16 Thread Charles-François Natali
Charles-François Natali added the comment: I've just had a quick look at the patch, but from what I can see, socket.getaddrinfo() will return a raw integer for the family, and not an AddressFamily instance. That's unfortunate. -- ___ Python tracker

[issue18643] implement socketpair() on Windows

2013-08-16 Thread Charles-François Natali
Charles-François Natali added the comment: I was thinking about dropping the C wrapper from socketmodule.c, and replacing it with a pure Python implementation (e.g. the one posted by Richard on python-dev). What do you think? -- ___ Python tracker

[issue16463] testConnectTimeout of test_timeout TCPTimeoutTestCasefailures fails intermittently

2013-08-16 Thread Charles-François Natali
Charles-François Natali added the comment: Here's an updated patch using the lru_cache decorator. -- Added file: http://bugs.python.org/file31312/connect_timeout-1.diff ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue16463

[issue18748] libgcc_s.so.1 must be installed for pthread_cancel to work

2013-08-16 Thread Charles-François Natali
Charles-François Natali added the comment: Unfortunately, there's not much we can do about it: if dlsym() fails - which is the case here either because read() fails with EBADF, or because the file descriptor now points to another stream (i.e. not libgcc), the libc aborts (here upon

[issue18673] Add and use O_TMPFILE for Linux 3.11

2013-08-16 Thread Roundup Robot
Roundup Robot added the comment: New changeset f6034602410c by Christian Heimes in branch 'default': Issue #18673: Add O_TMPFILE to os module. O_TMPFILE requires Linux kernel http://hg.python.org/cpython/rev/f6034602410c New changeset 815b7bb3b08d by Christian Heimes in branch 'default': Issue

[issue18748] libgcc_s.so.1 must be installed for pthread_cancel to work

2013-08-16 Thread Antoine Pitrou
Antoine Pitrou added the comment: Perhaps the only thing we could do would be try to preload libgcc by calling one of those APIs at startup? But I'm not sure it's a good idea to add such a platform-specific hack (for what is arguably an obscure and rare issue). -- nosy: +pitrou

[issue18673] Add O_TMPFILE to os module

2013-08-16 Thread Christian Heimes
Christian Heimes added the comment: I have added O_TMPFILE to the os module. I like to hold off with the actual use of O_TMPFILE in tempfile until Python 3.5. The feature is too new and I don't have any way to test it. Some people have reported file system corruption in 3.11-rc4, too.

[issue18748] libgcc_s.so.1 must be installed for pthread_cancel to work

2013-08-16 Thread STINNER Victor
Changes by STINNER Victor victor.stin...@gmail.com: -- nosy: +haypo ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue18748 ___ ___ Python-bugs-list

[issue18368] PyOS_StdioReadline() leaks memory when realloc() fails

2013-08-16 Thread Christian Heimes
Changes by Christian Heimes li...@cheimes.de: -- status: pending - closed ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue18368 ___ ___

[issue18740] str is number methods don't recognize '.'

2013-08-16 Thread Ezio Melotti
Ezio Melotti added the comment: it seems try/except is still the best way. :-/ Indeed: http://docs.python.org/dev/glossary#term-eafp -- nosy: +ezio.melotti stage: - committed/rejected ___ Python tracker rep...@bugs.python.org

[issue18748] libgcc_s.so.1 must be installed for pthread_cancel to work

2013-08-16 Thread STINNER Victor
STINNER Victor added the comment: Maries Ionel Cristian ubuntu 12.04.2 What is the version of your libc library? Try something like dpkg -l libc6. -- Could this issue be related to this glibc issue? http://sourceware.org/bugzilla/show_bug.cgi?id=2644 I ran your script on Python 3.4 in a

[issue18748] libgcc_s.so.1 must be installed for pthread_cancel to work

2013-08-16 Thread STINNER Victor
STINNER Victor added the comment: Oh ok, I'm able to reproduce the issue with the system Python 3.3: $ while true; do echo loop; python3.3 bug.py || break; done loop ... loop libgcc_s.so.1 must be installed for pthread_cancel to work Abandon (core dumped) --

[issue18750] '' % [1] doesn't fail

2013-08-16 Thread R. David Murray
R. David Murray added the comment: Hmm. The linked issue says the PyMappingCheck behavior is new in Python3, but this problem exists in Python2 (back to 2.4 at least) as well. Perhaps it is a different bug in Python2. -- ___ Python tracker

[issue18720] Switch suitable constants in the socket module to IntEnum

2013-08-16 Thread Eli Bendersky
Eli Bendersky added the comment: Great catch, Charles-François, thanks. It's actually an interesting example in favor of the approach - it's very nice to see descriptive family names in the data returned by getaddrinfo, instead of obtuse numeric values. The attached patch fixes it in a

[issue18753] [c]ElementTree.fromstring fails to parse value]]/value

2013-08-16 Thread R. David Murray
R. David Murray added the comment: Why do you think this is a bug? (You may well be right; I'm not familiar with the intricacies of XML. But on its face the behavior looks reasonable.) -- nosy: +r.david.murray ___ Python tracker

[issue18750] '' % [1] doesn't fail

2013-08-16 Thread Eric V. Smith
Eric V. Smith added the comment: The code looks basically the same in 2.7, and there PyMapping_Check looks for __getitem__, so maybe issue 5945 is just incorrect in its analysis. In any event, I'm not sure this is worth fixing. There are lots of little corner cases that could be broken.

[issue18720] Switch suitable constants in the socket module to IntEnum

2013-08-16 Thread Eli Bendersky
Eli Bendersky added the comment: Looks nice: for t in socket.getaddrinfo('www.google.com', 'http'): ... t ... (AddressFamily.AF_INET: 2, 1, 6, '', ('74.125.239.112', 80)) (AddressFamily.AF_INET: 2, 2, 17, '', ('74.125.239.112', 80)) (AddressFamily.AF_INET: 2, 1, 6, '', ('74.125.239.116',

[issue18754] Run Python child processes in isolated mode in the test suite?

2013-08-16 Thread STINNER Victor
New submission from STINNER Victor: Python 3.4 has a new command line option to run Python in isolated mode: -I. IMO it would be nice to use this option to make the test suite more independant of the user configuration and the environment. Attached patch modifies the test.script_helper module

[issue18296] test_os.test_trailers() is failing on AMD64 FreeBSD 9.0 dtrace 3.x

2013-08-16 Thread STINNER Victor
STINNER Victor added the comment: The test does now pass with the patch, so I close the issue. -- resolution: - fixed status: open - closed ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue18296

[issue16799] start using argparse.Namespace in regrtest

2013-08-16 Thread Eli Bendersky
Eli Bendersky added the comment: Looks pretty good, Serhiy. I left some comments in Rietveld. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue16799 ___

[issue18755] imp read functions do not try to re-open files that have been closed from previous reads

2013-08-16 Thread Brett Cannon
New submission from Brett Cannon: imp._HackedGetData doesn't check if the file it cached from its constructor is still open or not. Since the path had previously been stored it would make sense to try re-opening the file if the file object has already been closed. -- assignee:

[issue18745] Test enum in test_json is ignorant of infinity value

2013-08-16 Thread Ethan Furman
Changes by Ethan Furman et...@stoneleaf.us: -- assignee: - ethan.furman ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue18745 ___ ___

[issue18734] Berkeley DB versions 4.4-4.9 are not discovered by setup.py

2013-08-16 Thread Jesús Cea Avión
Jesús Cea Avión added the comment: I confirm this. The patch for 5.3 support created a regression. And, in fact, it is not working at all (it missed the 5.x libraries anyway). Reopening the old bug. In the meantime, please check http://www.jcea.es/programacion/pybsddb.htm --

[issue18734] Berkeley DB versions 4.4-4.9 are not discovered by setup.py

2013-08-16 Thread Jesús Cea Avión
Changes by Jesús Cea Avión j...@jcea.es: -- nosy: +doko ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue18734 ___ ___ Python-bugs-list mailing list

[issue17477] update the bsddb module do build with db 5.x versions

2013-08-16 Thread Jesús Cea Avión
Jesús Cea Avión added the comment: This patch is incorrect. It doesn't compile with Berkeley DB 5.x at all, and it doesn't allow to compile against 4.4-4.9 (previously supported). So currently it is a bit regression. Check bug #18734. -- nosy: +Eddie.Stanley resolution: fixed -

[issue17477] update the bsddb module do build with db 5.x versions

2013-08-16 Thread Jesús Cea Avión
Jesús Cea Avión added the comment: Note also that reusing my pybsddb project you are dropping support for several old releases of Berkeley DB that where supported by Python 2.7.4. If somebody were using it, they are left dead in the water, just because doing a minor Python upgrade.

[issue18756] os.urandom() fails under high load

2013-08-16 Thread Christian Heimes
New submission from Christian Heimes: I have seen complains from e.g. Tarek that os.urandom() fails under high load: https://twitter.com/tarek_ziade/status/362281268215418880 The problem is caused by file descriptor limits. os.urandom() opens /dev/urandom for every call. How about

[issue18756] os.urandom() fails under high load

2013-08-16 Thread STINNER Victor
STINNER Victor added the comment: I have seen complains from e.g. Tarek that os.urandom() fails under high load: https://twitter.com/tarek_ziade/status/362281268215418880 dev_urandom_python() should handle ENFILE and ENOENT differently to raise a different exception. Or it should always

[issue18743] References to non-existant StringIO module

2013-08-16 Thread Serhiy Storchaka
Serhiy Storchaka added the comment: Here is a patch. Actually this is a small part of larger problem for which I will open several separated issues. -- keywords: +patch stage: needs patch - patch review Added file: http://bugs.python.org/file31315/doc_StringIO_refs.patch

[issue18618] Need an atexit.register equivalent that also works in subinterps

2013-08-16 Thread Antoine Pitrou
Changes by Antoine Pitrou pit...@free.fr: -- nosy: +christian.heimes ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue18618 ___ ___ Python-bugs-list

[issue18756] os.urandom() fails under high load

2013-08-16 Thread Antoine Pitrou
Antoine Pitrou added the comment: I don't think that's bug in os.urandom(). If os.urandom() doesn't fail, something else will fail soon after. OTOH, the error is clearly misleading. The NotImplementedError should only be raised for certain errnos (such as ENOENT, ENODEV, ENXIO and EACCES), not

[issue18748] libgcc_s.so.1 must be installed for pthread_cancel to work

2013-08-16 Thread Charles-François Natali
Charles-François Natali added the comment: Perhaps the only thing we could do would be try to preload libgcc by calling one of those APIs at startup? Yeah, I was thinking about doing this in PyThread_init_thread() but... But I'm not sure it's a good idea to add such a platform-specific

[issue18754] Run Python child processes in isolated mode in the test suite?

2013-08-16 Thread Brett Cannon
Brett Cannon added the comment: Haven't looked at the patch but the motivation behind it sounds good to me. -- nosy: +brett.cannon ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue18754 ___

[issue18743] References to non-existant StringIO module

2013-08-16 Thread Jesús Cea Avión
Jesús Cea Avión added the comment: Patch is incomplete. I found this error while reading unittest.mock, that you are not patching. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue18743 ___

[issue18756] os.urandom() fails under high load

2013-08-16 Thread Jesús Cea Avión
Jesús Cea Avión added the comment: I agree with Antoine. Exhausting the FDs is not the problem, the problem is the misleading error. -- nosy: +jcea ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue18756

[issue18709] SSL module fails to handle NULL bytes inside subjectAltNames general names (CVE-2013-4238)

2013-08-16 Thread Christian Heimes
Christian Heimes added the comment: For the record PHP has assigned CVE-2013-4248 for the issue. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue18709 ___

[issue18643] implement socketpair() on Windows

2013-08-16 Thread Richard Oudkerk
Richard Oudkerk added the comment: Do you mean you want to use a pure python implementation on Unix? Then you would have to deal with AF_UNIX (which is the default family for socketpair() currently). A pure python implementation which deals with AF_UNIX would have to temporarily create a

[issue18756] os.urandom() fails under high load

2013-08-16 Thread Tarek Ziadé
Tarek Ziadé added the comment: If os.urandom() doesn't fail, something else will fail soon after. the random pool can be exhausted, but this is not soon after I think. In Linux and Mac OS X, ulimit -n defaults to 512 and 256. It's very easy to reach that limit if you write a web app that

[issue18756] os.urandom() fails under high load

2013-08-16 Thread Tarek Ziadé
Tarek Ziadé added the comment: Can tarek tell us more about its usecases: is he directly calling os.urandom() or does he use the random module? How many threads? I was using ws4py inside greenlets. ws4py uses os.urandom() to generate some keys. So one single thread, many greenlets.

[issue18756] os.urandom() fails under high load

2013-08-16 Thread Charles-François Natali
Charles-François Natali added the comment: If os.urandom() doesn't fail, something else will fail soon after. the random pool can be exhausted, but this is not soon after I think. In Linux and Mac OS X, ulimit -n defaults to 512 and 256. I don't think he's referring to the entropy pool, but

[issue18756] os.urandom() fails under high load

2013-08-16 Thread Christian Heimes
Christian Heimes added the comment: Tarek Ziadé added the comment: If os.urandom() doesn't fail, something else will fail soon after. the random pool can be exhausted, but this is not soon after I think. In Linux and Mac OS X, ulimit -n defaults to 512 and 256. It's highly unlikely

[issue18756] os.urandom() fails under high load

2013-08-16 Thread Tarek Ziadé
Tarek Ziadé added the comment: What does high load mean? a web app with a few hundreds concurrent requests. If you mean many concurrent threads, then you should probably go for the random module, no? I use greenlets. But, I don't know - are you suggesting os.urandom() should be marked in

[issue18756] os.urandom() fails under high load

2013-08-16 Thread Charles-François Natali
Charles-François Natali added the comment: 2013/8/16, Tarek Ziadé rep...@bugs.python.org: I use greenlets. But, I don't know - are you suggesting os.urandom() should be marked in the documentation as DOES NOT SCALE and I should use another API ? Which one ? Well, even with greenlets, I

[issue18756] os.urandom() fails under high load

2013-08-16 Thread Tarek Ziadé
Tarek Ziadé added the comment: Well, even with greenlets, I assume you're using at least one FD (socket) per client, no? So you can get EMFILE on socket() just as on os.urandom(). I do many calls on urandom() so that's the FD bottleneck. So os.urandom() isn't your biggest problem here. Of

[issue18756] os.urandom() fails under high load

2013-08-16 Thread Christian Heimes
Christian Heimes added the comment: Am 16.08.2013 18:24, schrieb Charles-François Natali: Well, first we'll have to make the code thread-safe, if we want to keep a persistent FD open. Which means we'll have to add a lock, which is likely to reduce concurrency, and overall throughput. Why

[issue18756] os.urandom() fails under high load

2013-08-16 Thread Antoine Pitrou
Antoine Pitrou added the comment: Well, even with greenlets, I assume you're using at least one FD (socket) per client, no? So you can get EMFILE on socket() just as on os.urandom(). I do many calls on urandom() so that's the FD bottleneck. Unless you're doing many calls *in parallel*

[issue1666318] shutil.copytree doesn't give control over directory permissions

2013-08-16 Thread Catherine Devlin
Catherine Devlin added the comment: Attaching new patch incorporating Vajrasky's suggestion -- Added file: http://bugs.python.org/file31316/test1666318.patch ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue1666318

[issue18706] test failure in test_codeccallbacks

2013-08-16 Thread Ezio Melotti
Changes by Ezio Melotti ezio.melo...@gmail.com: -- resolution: - fixed stage: patch review - committed/rejected status: open - closed ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue18706 ___

[issue18756] os.urandom() fails under high load

2013-08-16 Thread Charles-François Natali
Charles-François Natali added the comment: I do many calls on urandom() so that's the FD bottleneck. So os.urandom() isn't your biggest problem here. Of course it is. But it looks like you know better without having looked at the code. :) So please explain me :-) os.urandom() can only be

[issue18756] os.urandom() fails under high load

2013-08-16 Thread Antoine Pitrou
Antoine Pitrou added the comment: Am 16.08.2013 18:24, schrieb Charles-François Natali: Well, first we'll have to make the code thread-safe, if we want to keep a persistent FD open. Which means we'll have to add a lock, which is likely to reduce concurrency, and overall throughput. Why

[issue18753] [c]ElementTree.fromstring fails to parse value]]/value

2013-08-16 Thread Kees Bos
Kees Bos added the comment: I'm not an expert, but from: http://www.w3.org/TR/REC-xml/#NT-AttValue AttValue ::= '' ([^] | Reference)* '' | ' ([^'] | Reference)* ' which I read as: Any Reference character is valid, except and , which are used for escaping and closing the element.

[issue18753] [c]ElementTree.fromstring fails to parse value]]/value

2013-08-16 Thread Antoine Pitrou
Changes by Antoine Pitrou pit...@free.fr: -- nosy: +eli.bendersky, scoder ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue18753 ___ ___

[issue18756] os.urandom() fails under high load

2013-08-16 Thread Christian Heimes
Christian Heimes added the comment: Am 16.08.2013 18:47, schrieb Charles-François Natali: I don't think it can be fixed. I think Christian's working on a PEP for random number generators, which would probably make it easier, although I din't have a look at it. In the light of the recent

[issue18756] os.urandom() fails under high load

2013-08-16 Thread Tarek Ziadé
Tarek Ziadé added the comment: Unless you're doing many calls *in parallel* it's unlikely to be a bottleneck. That's what we're saying since message 1. Antoine, allo quoi! :) os.urandom() is a convenience function, it doesn't have to be extremely optimized I suggest that you tell it the

[issue18756] os.urandom() fails under high load

2013-08-16 Thread Charles-François Natali
Charles-François Natali added the comment: Why locking? /dev/urandom is a pseudo char device. You can have multiple readers on the same fd without any locking. You must put a lock around the open() call, though, to avoid calling it several times and losing an fd. Exactly (unless the FD is

  1   2   3   >