Hi list,
When I do large array manipulations, I get out-of-memory errors.
For instance if the array size is 5000 by 6000, the following codes use
nearly 1G of RAM.
Then my PC displays a Python error box. The try/except won't even catch
it if the error happens in "astype" instead of "array1* array2"
try:
if ( array1.typecode() in cplx_types ):
array1 = abs(array1.astype(Numeric.Complex32))
else:
array1 = array1.astype(Numeric.Float32)
if ( array2.typecode() in cplx_types ):
array2 = abs(array2.astype(Numeric.Complex32))
else:
array2 = array2.astype(Numeric.Float32)
array1 = Numeric.sqrt(array1) * Numeric.sqrt(array2)
return array1
except:
gvutils.error("Memory error occurred\nPlease select a smaller
array")
return None
My questions are:
1) Is there a more memory efficient way instead of using astype?
2) If not, then how do I catch error during astype?
3) Is there a way in Python that detects the available RAM and
limits the array size before he/she can go ahead with the array
multiplications?
i.e. detects the available RAM, say 1G
Assume the worst case - Complex32
Figure out the array size limit and warn user
Thanks,
Shaw Gong
_______________________________________________
Numpy-discussion mailing list
[email protected]
http://projects.scipy.org/mailman/listinfo/numpy-discussion
