My patch actually addressed two slightly different issues, both of which
have to do with refcounts of transposed slices. I'll address the first
one below since that's the one that's not so obvious.
Here's the code that causes an "Acquisition count is 0" error:
import numpy
cimport numpy
def testfunc():
a = numpy.arange(12).reshape([3,4])
cdef numpy.int_t[:,:] a_view = a
cdef numpy.int_t[:,:] b = a_view[:,:].T
raise Exception() # comment this out and you still get a refcount
error at a different line
testfunc()
On 04/06/2014 06:12 AM, Stefan Behnel wrote:
> Syam Gadde, 27.03.2014 21:29:
>> One problem is that when a memoryview slice is decremented, the .memview
>> and .data fields are not set to NULL, and any error that causes a jump
>> to cleanup code will attempt to decref it again.
> Hmm, I can't see why the additional NULL setting would change anything.
> That's what the call to put_xdecref_memoryviewslice() already did that
> immediately precedes them (it actually calls "__Pyx_XDEC_MEMVIEW()" in
> MemoryView_C.c).
But only if the refcount of the memview goes to zero.Maybe that's what
needs to change?
See the case below (look for the *****'s). memviewslice objects are
defined at the top of the function and on the stack, so they persist
throughout the function. Several memviewslice objects may share the
same base memview object. So if a memviewslice object finished doing
what it needs to do, it needs to decrement the refcount of the memview
object it's pointing to using __PYX_XDEC_MEMVIEW, *and* detach itself
from the memview (that's the setting .memview = NULL part). The reason
the explicit detaching is important is that there are extra
__PYX_XDEC_MEMVIEW() calls in the error cleanup code, presumably to
decrement the reference counts for still attached memviews in the case
there is an error/exception. If the memview field is set to NULL
whenever a slice is done with it, the extra calls to __PYX_XDEC_MEMVIEW
are OK because it checks to see whether .memview is NULL before going
forward. But currently, if an error/exception occurs while the slice is
still attached to the memview, you can end up with a refcount < 0.
If __PYX_XDEC_MEMVIEW did indeed set .memview to NULL on every call,
then this wouldn't be necessary. But I have not tried that to see if it
breaks something else.
/* "testtranspose.pyx":7
* a = numpy.arange(12).reshape([3,4])
* cdef numpy.int_t[:,:] a_view = a
* cdef numpy.int_t[:,:] b = a_view[:,:].T # <<<<<<<<<<<<<<
* raise Exception()
*
*/
__pyx_t_6 = -1;
__pyx_t_5.data = __pyx_v_a_view.data;
__pyx_t_5.memview = __pyx_v_a_view.memview;
__PYX_INC_MEMVIEW(&__pyx_t_5, 0);
__pyx_t_5.shape[0] = __pyx_v_a_view.shape[0];
__pyx_t_5.strides[0] = __pyx_v_a_view.strides[0];
__pyx_t_5.suboffsets[0] = -1;
__pyx_t_5.shape[1] = __pyx_v_a_view.shape[1];
__pyx_t_5.strides[1] = __pyx_v_a_view.strides[1];
__pyx_t_5.suboffsets[1] = -1;
__pyx_t_7 = __pyx_t_5;
if (unlikely(__pyx_memslice_transpose(&__pyx_t_7) == 0))
{__pyx_filename = __p
yx_f[0]; __pyx_lineno = 7; __pyx_clineno = __LINE__; goto __pyx_L1_error;}
__PYX_XDEC_MEMVIEW(&__pyx_t_5, 1);//**************************
__pyx_v_b = __pyx_t_7;
__pyx_t_7.memview = NULL;
__pyx_t_7.data = NULL;
/* "testtranspose.pyx":8
* cdef numpy.int_t[:,:] a_view = a
* cdef numpy.int_t[:,:] b = a_view[:,:].T
* raise Exception() # <<<<<<<<<<<<<<
*
* testfunc()
*/
__pyx_t_1 = __Pyx_PyObject_Call(__pyx_builtin_Exception,
__pyx_empty_tuple, NULL); if (unlikely(!__pyx_t_1)) {__pyx_filename =
__pyx_f[0]; __pyx_lineno = 8; __pyx_clineno = __LINE__; goto
__pyx_L1_error;}
__Pyx_GOTREF(__pyx_t_1);
__Pyx_Raise(__pyx_t_1, 0, 0, 0);
__Pyx_DECREF(__pyx_t_1); __pyx_t_1 = 0;
{__pyx_filename = __pyx_f[0]; __pyx_lineno = 8; __pyx_clineno =
__LINE__; goto __pyx_L1_error;}
/* "testtranspose.pyx":4
* cimport numpy
*
* def testfunc(): # <<<<<<<<<<<<<<
* a = numpy.arange(12).reshape([3,4])
* cdef numpy.int_t[:,:] a_view = a
*/
/* function exit code */
__pyx_L1_error:; // ****** exception causes a jump to here *****
__Pyx_XDECREF(__pyx_t_1);
__Pyx_XDECREF(__pyx_t_2);
__Pyx_XDECREF(__pyx_t_3);
__PYX_XDEC_MEMVIEW(&__pyx_t_4, 1);
__PYX_XDEC_MEMVIEW(&__pyx_t_5, 1); //****************************
__PYX_XDEC_MEMVIEW(&__pyx_t_7, 1);
__Pyx_AddTraceback("testtranspose.testfunc", __pyx_clineno,
__pyx_lineno, __pyx_filename);
__pyx_r = NULL;
__Pyx_XDECREF(__pyx_v_a);
__PYX_XDEC_MEMVIEW(&__pyx_v_a_view, 1);
__PYX_XDEC_MEMVIEW(&__pyx_v_b, 1);
__Pyx_XGIVEREF(__pyx_r);
__Pyx_RefNannyFinishContext();
return __pyx_r;
_______________________________________________
cython-devel mailing list
cython-devel@python.org
https://mail.python.org/mailman/listinfo/cython-devel
