[issue10195] Memory allocation fault-injection?

Change by Mark Lawrence : -- nosy: -BreamoreBoy ___ Python tracker ___ ___ Python-bugs-list mailing list Unsubscribe:

[issue10195] Memory allocation fault-injection?

Mark Lawrence added the comment: Do you folks want to pick this up again as it seems a handy thing to have in our toolbox? -- nosy: +BreamoreBoy versions: +Python 3.5 -Python 3.2 ___ Python tracker rep...@bugs.python.org

[issue10195] Memory allocation fault-injection?

STINNER Victor added the comment: This feature is implemented in my external project: https://bitbucket.org/haypo/pyfailmalloc It was discussed to integrate it in Python 3.4, but I foscused my efforts on the PEP 445 (malloc API) and 454 (tracemalloc). --

[issue10195] Memory allocation fault-injection?

STINNER Victor added the comment: Related issues: #19817 tracemalloc add a memory limit feature and #19835 Add a MemoryError singleton to fix an unlimited loop when the memory is exhausted. -- ___ Python tracker rep...@bugs.python.org

[issue10195] Memory allocation fault-injection?

Antoine Pitrou pit...@free.fr added the comment: Unless we want to test manually each memory allocation in the interpreter, the only reasonable way seems to be some kind of fuzzing (perhaps using a reproducible random seed). -- nosy: +haypo ___

[issue10195] Memory allocation fault-injection?

STINNER Victor victor.stin...@haypocalc.com added the comment: Don't you know http://www.nongnu.org/failmalloc/? -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue10195 ___

[issue10195] Memory allocation fault-injection?

Antoine Pitrou pit...@free.fr added the comment: Don't you know http://www.nongnu.org/failmalloc/? This doesn't answer the question of what and how to test. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue10195

[issue10195] Memory allocation fault-injection?

Dave Malcolm dmalc...@redhat.com added the comment: Attached is a new approach to doing this, based on Out-Of-Memory Testing within http://sqlite.org/testing.html This reads environment variables, and injects a fault at the given value of serialno, and (optionally) ongoing failures

[issue10195] Memory allocation fault-injection?

Antoine Pitrou pit...@free.fr added the comment: Doing so would imply running each test many tens of thousands of times, so perhaps we could run -c pass to establish at what serialno the interpreter has fully started up, then use that as a starting point when testing other scripts/modules.

[issue10195] Memory allocation fault-injection?

STINNER Victor victor.stin...@haypocalc.com added the comment: ... every call to PyRun_InteractiveOneFlags immediately returns (the PyUnicode_FromString(stdin) in within PySys_GetObject() fails to allocate memory); this leads to a tight loop sending the total refcount to stderr: I think

[issue10195] Memory allocation fault-injection?

New submission from Dave Malcolm dmalc...@redhat.com: We were chatting on #python-dev on possible ways of testing the correct handling of MemoryError. Attached is one idea: adding a sys._inject_malloc_failure() hook, letting you inject a memory-allocation (or reallocation) failure some number

[issue10195] Memory allocation fault-injection?

Benjamin Peterson benja...@python.org added the comment: We should do something like SQLite: http://sqlite.org/testing.html -- nosy: +benjamin.peterson ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue10195