Re: [Numpy-discussion] Bus error for Debian / SPARC on current trunk
Hi, On Sun, Mar 4, 2012 at 8:32 PM, Mark Wiebe wrote: > On Sun, Mar 4, 2012 at 10:08 PM, Matthew Brett > wrote: >> >> Hi, >> >> On Sun, Mar 4, 2012 at 11:41 AM, Mark Wiebe wrote: >> > On Sun, Mar 4, 2012 at 11:27 AM, Matthew Brett >> > wrote: >> >> >> >> Hi, >> >> >> >> On Sat, Mar 3, 2012 at 12:07 AM, Matthew Brett >> >> >> >> wrote: >> >> > Hi, >> >> > >> >> > On Fri, Mar 2, 2012 at 9:05 PM, Charles R Harris >> >> > wrote: >> >> >> >> >> >> >> >> >> On Fri, Mar 2, 2012 at 4:36 PM, Matthew Brett >> >> >> >> >> >> wrote: >> >> >>> >> >> >>> Hi, >> >> >>> >> >> >>> Sorry that this report is not complete, I don't have full access to >> >> >>> this box but, on a Debian squeeze machine running linux >> >> >>> 2.6.32-5-sparc64-smp: >> >> >>> >> >> >>> nosetests >> >> >>> >> >> >>> >> >> >>> ~/usr/local/lib/python2.6/site-packages/numpy/lib/tests/test_io.py:TestFromTxt.test_user_missing_values >> >> >>> >> >> >>> test_user_missing_values (test_io.TestFromTxt) ... Bus error >> >> >>> >> >> >>> This on current master : 1.7.0.dev-b9872b4 >> >> >>> >> >> >> >> >> >> Hmm, some tests might have been recently enabled. Any chance of >> >> >> doing a >> >> >> bisection? >> >> >> >> Struggling because compilation is very slow and there are lots of >> >> untestable commits. df907e6 is the first known bad. Here's the >> >> output from a log: >> >> >> >> * df907e6 - (HEAD, refs/bisect/bad) BLD: Failure in single file build >> >> mode because of a static function in two separate files (6 months ago) >> >> [Mark Wiebe] >> >> * 01b200b - (refs/bisect/skip-01b200b10149312f51234448e44b230b1b548046) >> >> BUG: nditer: The nditer was reusing the reduce loop inappropriately >> >> (#1938) (6 months ago) [Mark Wiebe] >> >> * f45fd67 - (refs/bisect/skip-f45fd67fe8eefc8fd2e4b914ab4e376ab5226887) >> >> DOC: Small tweak to release notes (6 months ago) [Mark Wiebe] >> >> * 73be11d - (refs/bisect/skip-73be11db794d115a7d9bd2e822c0d8008bc14a28) >> >> BUG: Some bugs in squeeze and concatenate found by testing SciPy (6 >> >> months ago) [Mark Wiebe] >> >> * c873295 - (refs/bisect/skip-c8732958c8e07f2306029dfde2178faf9c01d049) >> >> TST: missingdata: Finish up NA mask tests for np.std and np.var (6 >> >> months ago) [Mark Wiebe] >> >> * e15712c - (refs/bisect/skip-e15712cf5df41806980f040606744040a433b331) >> >> BUG: nditer: NA masks in arrays with leading 1 dimensions had an issue >> >> (6 months ago) [Mark Wiebe] >> >> * ded81ae - (refs/bisect/skip-ded81ae7d529ac0fba641b7e5e3ecf52e120700f) >> >> ENH: missingdata: Implement tests for np.std, add skipna= and >> >> keepdims= parameters to more functions (6 months ago) [Mark Wiebe] >> >> * a112fc4 - (refs/bisect/skip-a112fc4a6b28fbb85e1b0c6d423095d13cf7b226) >> >> ENH: missingdata: Implement skipna= support for np.std and np.var (6 >> >> months ago) [Mark Wiebe] >> >> * 0fa4f22 - (refs/bisect/skip-0fa4f22fec4b19e2a8c1d93e5a1f955167c9addd) >> >> ENH: missingdata: Support 'skipna=' parameter in np.mean (6 months >> >> ago) [Mark Wiebe] >> >> * bfda229 - (refs/bisect/skip-bfda229ec93d37b1ee2cdd8b9443ec4e34536bbf) >> >> ENH: missingdata: Create count_reduce_items function (6 months ago) >> >> [Mark Wiebe] >> >> * d9b3f90 - (refs/bisect/skip-d9b3f90de3213ece9a78b77088fdec17910e81d9) >> >> ENH: missingdata: Move the Reduce boilerplate into a function >> >> PyArray_ReduceWrapper (6 months ago) [Mark Wiebe] >> >> * 67ece6b - (refs/bisect/skip-67ece6bdd2b35d011893e78154dbff6ab51c7d35) >> >> ENH: missingdata: Finish count_nonzero as a full-fledged reduction >> >> operation (6 months ago) [Mark Wiebe] >> >> * 6bfd819 - (refs/bisect/skip-6bfd819a0897caf6e6db244930c40ed0d17b9e62) >> >> ENH: missingdata: Towards making count_nonzero a full-featured >> >> reduction operation (6 months ago) [Mark Wiebe] >> >> * a1faa1b - (refs/bisect/skip-a1faa1b6883c47333508a0476c1304b0a8a3f64e) >> >> ENH: missingdata: Move some of the refactored reduction code into the >> >> API (6 months ago) [Mark Wiebe] >> >> * f597374 - (refs/bisect/skip-f597374edc298810083799e8539c99fc0a93b319) >> >> ENH: missingdata: Change default to create NA-mask when NAs are in >> >> lists (6 months ago) [Mark Wiebe] >> >> * 965e4cf - (refs/bisect/skip-965e4cff5c4c50e8ff051a3363adc6cf6aa640cd) >> >> ENH: missingdata: trying some more functions to see how they treat NAs >> >> (6 months ago) [Mark Wiebe] >> >> * b1cb211 - (refs/bisect/skip-b1cb211d159c617ee4ebd16266d6f1042417ef75) >> >> ENH: missingdata: Add nastr= parameter to np.set_printoptions() (6 >> >> months ago) [Mark Wiebe] >> >> * ba4d116 - (refs/bisect/skip-ba4d1161fe4943cb720f35c0abfd0581628255d6) >> >> BUG: missingdata: Fix mask usage in PyArray_TakeFrom, add tests for it >> >> (6 months ago) [Mark Wiebe] >> >> * a3a0ee8 - (refs/bisect/skip-a3a0ee8c72fdd55ffacb96bbb1fa9c3569cfb3e9) >> >> BUG: missingdata: The ndmin parameter to np.array wasn't respecting NA >> >> masks (6 months ago) [Mark Wiebe] >> >> * 9194b3a - (refs/bisect/skip-9194b3af704df71aa9b1ff2f53f169848d0f9dc7) >> >> EN
Re: [Numpy-discussion] Bus error for Debian / SPARC on current trunk
On Sun, Mar 4, 2012 at 10:08 PM, Matthew Brett wrote: > Hi, > > On Sun, Mar 4, 2012 at 11:41 AM, Mark Wiebe wrote: > > On Sun, Mar 4, 2012 at 11:27 AM, Matthew Brett > > wrote: > >> > >> Hi, > >> > >> On Sat, Mar 3, 2012 at 12:07 AM, Matthew Brett > > >> wrote: > >> > Hi, > >> > > >> > On Fri, Mar 2, 2012 at 9:05 PM, Charles R Harris > >> > wrote: > >> >> > >> >> > >> >> On Fri, Mar 2, 2012 at 4:36 PM, Matthew Brett < > matthew.br...@gmail.com> > >> >> wrote: > >> >>> > >> >>> Hi, > >> >>> > >> >>> Sorry that this report is not complete, I don't have full access to > >> >>> this box but, on a Debian squeeze machine running linux > >> >>> 2.6.32-5-sparc64-smp: > >> >>> > >> >>> nosetests > >> >>> > >> >>> > ~/usr/local/lib/python2.6/site-packages/numpy/lib/tests/test_io.py:TestFromTxt.test_user_missing_values > >> >>> > >> >>> test_user_missing_values (test_io.TestFromTxt) ... Bus error > >> >>> > >> >>> This on current master : 1.7.0.dev-b9872b4 > >> >>> > >> >> > >> >> Hmm, some tests might have been recently enabled. Any chance of > doing a > >> >> bisection? > >> > >> Struggling because compilation is very slow and there are lots of > >> untestable commits. df907e6 is the first known bad. Here's the > >> output from a log: > >> > >> * df907e6 - (HEAD, refs/bisect/bad) BLD: Failure in single file build > >> mode because of a static function in two separate files (6 months ago) > >> [Mark Wiebe] > >> * 01b200b - (refs/bisect/skip-01b200b10149312f51234448e44b230b1b548046) > >> BUG: nditer: The nditer was reusing the reduce loop inappropriately > >> (#1938) (6 months ago) [Mark Wiebe] > >> * f45fd67 - (refs/bisect/skip-f45fd67fe8eefc8fd2e4b914ab4e376ab5226887) > >> DOC: Small tweak to release notes (6 months ago) [Mark Wiebe] > >> * 73be11d - (refs/bisect/skip-73be11db794d115a7d9bd2e822c0d8008bc14a28) > >> BUG: Some bugs in squeeze and concatenate found by testing SciPy (6 > >> months ago) [Mark Wiebe] > >> * c873295 - (refs/bisect/skip-c8732958c8e07f2306029dfde2178faf9c01d049) > >> TST: missingdata: Finish up NA mask tests for np.std and np.var (6 > >> months ago) [Mark Wiebe] > >> * e15712c - (refs/bisect/skip-e15712cf5df41806980f040606744040a433b331) > >> BUG: nditer: NA masks in arrays with leading 1 dimensions had an issue > >> (6 months ago) [Mark Wiebe] > >> * ded81ae - (refs/bisect/skip-ded81ae7d529ac0fba641b7e5e3ecf52e120700f) > >> ENH: missingdata: Implement tests for np.std, add skipna= and > >> keepdims= parameters to more functions (6 months ago) [Mark Wiebe] > >> * a112fc4 - (refs/bisect/skip-a112fc4a6b28fbb85e1b0c6d423095d13cf7b226) > >> ENH: missingdata: Implement skipna= support for np.std and np.var (6 > >> months ago) [Mark Wiebe] > >> * 0fa4f22 - (refs/bisect/skip-0fa4f22fec4b19e2a8c1d93e5a1f955167c9addd) > >> ENH: missingdata: Support 'skipna=' parameter in np.mean (6 months > >> ago) [Mark Wiebe] > >> * bfda229 - (refs/bisect/skip-bfda229ec93d37b1ee2cdd8b9443ec4e34536bbf) > >> ENH: missingdata: Create count_reduce_items function (6 months ago) > >> [Mark Wiebe] > >> * d9b3f90 - (refs/bisect/skip-d9b3f90de3213ece9a78b77088fdec17910e81d9) > >> ENH: missingdata: Move the Reduce boilerplate into a function > >> PyArray_ReduceWrapper (6 months ago) [Mark Wiebe] > >> * 67ece6b - (refs/bisect/skip-67ece6bdd2b35d011893e78154dbff6ab51c7d35) > >> ENH: missingdata: Finish count_nonzero as a full-fledged reduction > >> operation (6 months ago) [Mark Wiebe] > >> * 6bfd819 - (refs/bisect/skip-6bfd819a0897caf6e6db244930c40ed0d17b9e62) > >> ENH: missingdata: Towards making count_nonzero a full-featured > >> reduction operation (6 months ago) [Mark Wiebe] > >> * a1faa1b - (refs/bisect/skip-a1faa1b6883c47333508a0476c1304b0a8a3f64e) > >> ENH: missingdata: Move some of the refactored reduction code into the > >> API (6 months ago) [Mark Wiebe] > >> * f597374 - (refs/bisect/skip-f597374edc298810083799e8539c99fc0a93b319) > >> ENH: missingdata: Change default to create NA-mask when NAs are in > >> lists (6 months ago) [Mark Wiebe] > >> * 965e4cf - (refs/bisect/skip-965e4cff5c4c50e8ff051a3363adc6cf6aa640cd) > >> ENH: missingdata: trying some more functions to see how they treat NAs > >> (6 months ago) [Mark Wiebe] > >> * b1cb211 - (refs/bisect/skip-b1cb211d159c617ee4ebd16266d6f1042417ef75) > >> ENH: missingdata: Add nastr= parameter to np.set_printoptions() (6 > >> months ago) [Mark Wiebe] > >> * ba4d116 - (refs/bisect/skip-ba4d1161fe4943cb720f35c0abfd0581628255d6) > >> BUG: missingdata: Fix mask usage in PyArray_TakeFrom, add tests for it > >> (6 months ago) [Mark Wiebe] > >> * a3a0ee8 - (refs/bisect/skip-a3a0ee8c72fdd55ffacb96bbb1fa9c3569cfb3e9) > >> BUG: missingdata: The ndmin parameter to np.array wasn't respecting NA > >> masks (6 months ago) [Mark Wiebe] > >> * 9194b3a - (refs/bisect/skip-9194b3af704df71aa9b1ff2f53f169848d0f9dc7) > >> ENH: missingdata: Rewrite PyArray_Concatenate to work with NA masks (6 > >> months ago) [Mark Wiebe] > >> * 99a21ef - (refs/bisect/good-99a21efff4b1f2292dc370c7c9c7
Re: [Numpy-discussion] Bus error for Debian / SPARC on current trunk
Hi, On Sun, Mar 4, 2012 at 11:41 AM, Mark Wiebe wrote: > On Sun, Mar 4, 2012 at 11:27 AM, Matthew Brett > wrote: >> >> Hi, >> >> On Sat, Mar 3, 2012 at 12:07 AM, Matthew Brett >> wrote: >> > Hi, >> > >> > On Fri, Mar 2, 2012 at 9:05 PM, Charles R Harris >> > wrote: >> >> >> >> >> >> On Fri, Mar 2, 2012 at 4:36 PM, Matthew Brett >> >> wrote: >> >>> >> >>> Hi, >> >>> >> >>> Sorry that this report is not complete, I don't have full access to >> >>> this box but, on a Debian squeeze machine running linux >> >>> 2.6.32-5-sparc64-smp: >> >>> >> >>> nosetests >> >>> >> >>> ~/usr/local/lib/python2.6/site-packages/numpy/lib/tests/test_io.py:TestFromTxt.test_user_missing_values >> >>> >> >>> test_user_missing_values (test_io.TestFromTxt) ... Bus error >> >>> >> >>> This on current master : 1.7.0.dev-b9872b4 >> >>> >> >> >> >> Hmm, some tests might have been recently enabled. Any chance of doing a >> >> bisection? >> >> Struggling because compilation is very slow and there are lots of >> untestable commits. df907e6 is the first known bad. Here's the >> output from a log: >> >> * df907e6 - (HEAD, refs/bisect/bad) BLD: Failure in single file build >> mode because of a static function in two separate files (6 months ago) >> [Mark Wiebe] >> * 01b200b - (refs/bisect/skip-01b200b10149312f51234448e44b230b1b548046) >> BUG: nditer: The nditer was reusing the reduce loop inappropriately >> (#1938) (6 months ago) [Mark Wiebe] >> * f45fd67 - (refs/bisect/skip-f45fd67fe8eefc8fd2e4b914ab4e376ab5226887) >> DOC: Small tweak to release notes (6 months ago) [Mark Wiebe] >> * 73be11d - (refs/bisect/skip-73be11db794d115a7d9bd2e822c0d8008bc14a28) >> BUG: Some bugs in squeeze and concatenate found by testing SciPy (6 >> months ago) [Mark Wiebe] >> * c873295 - (refs/bisect/skip-c8732958c8e07f2306029dfde2178faf9c01d049) >> TST: missingdata: Finish up NA mask tests for np.std and np.var (6 >> months ago) [Mark Wiebe] >> * e15712c - (refs/bisect/skip-e15712cf5df41806980f040606744040a433b331) >> BUG: nditer: NA masks in arrays with leading 1 dimensions had an issue >> (6 months ago) [Mark Wiebe] >> * ded81ae - (refs/bisect/skip-ded81ae7d529ac0fba641b7e5e3ecf52e120700f) >> ENH: missingdata: Implement tests for np.std, add skipna= and >> keepdims= parameters to more functions (6 months ago) [Mark Wiebe] >> * a112fc4 - (refs/bisect/skip-a112fc4a6b28fbb85e1b0c6d423095d13cf7b226) >> ENH: missingdata: Implement skipna= support for np.std and np.var (6 >> months ago) [Mark Wiebe] >> * 0fa4f22 - (refs/bisect/skip-0fa4f22fec4b19e2a8c1d93e5a1f955167c9addd) >> ENH: missingdata: Support 'skipna=' parameter in np.mean (6 months >> ago) [Mark Wiebe] >> * bfda229 - (refs/bisect/skip-bfda229ec93d37b1ee2cdd8b9443ec4e34536bbf) >> ENH: missingdata: Create count_reduce_items function (6 months ago) >> [Mark Wiebe] >> * d9b3f90 - (refs/bisect/skip-d9b3f90de3213ece9a78b77088fdec17910e81d9) >> ENH: missingdata: Move the Reduce boilerplate into a function >> PyArray_ReduceWrapper (6 months ago) [Mark Wiebe] >> * 67ece6b - (refs/bisect/skip-67ece6bdd2b35d011893e78154dbff6ab51c7d35) >> ENH: missingdata: Finish count_nonzero as a full-fledged reduction >> operation (6 months ago) [Mark Wiebe] >> * 6bfd819 - (refs/bisect/skip-6bfd819a0897caf6e6db244930c40ed0d17b9e62) >> ENH: missingdata: Towards making count_nonzero a full-featured >> reduction operation (6 months ago) [Mark Wiebe] >> * a1faa1b - (refs/bisect/skip-a1faa1b6883c47333508a0476c1304b0a8a3f64e) >> ENH: missingdata: Move some of the refactored reduction code into the >> API (6 months ago) [Mark Wiebe] >> * f597374 - (refs/bisect/skip-f597374edc298810083799e8539c99fc0a93b319) >> ENH: missingdata: Change default to create NA-mask when NAs are in >> lists (6 months ago) [Mark Wiebe] >> * 965e4cf - (refs/bisect/skip-965e4cff5c4c50e8ff051a3363adc6cf6aa640cd) >> ENH: missingdata: trying some more functions to see how they treat NAs >> (6 months ago) [Mark Wiebe] >> * b1cb211 - (refs/bisect/skip-b1cb211d159c617ee4ebd16266d6f1042417ef75) >> ENH: missingdata: Add nastr= parameter to np.set_printoptions() (6 >> months ago) [Mark Wiebe] >> * ba4d116 - (refs/bisect/skip-ba4d1161fe4943cb720f35c0abfd0581628255d6) >> BUG: missingdata: Fix mask usage in PyArray_TakeFrom, add tests for it >> (6 months ago) [Mark Wiebe] >> * a3a0ee8 - (refs/bisect/skip-a3a0ee8c72fdd55ffacb96bbb1fa9c3569cfb3e9) >> BUG: missingdata: The ndmin parameter to np.array wasn't respecting NA >> masks (6 months ago) [Mark Wiebe] >> * 9194b3a - (refs/bisect/skip-9194b3af704df71aa9b1ff2f53f169848d0f9dc7) >> ENH: missingdata: Rewrite PyArray_Concatenate to work with NA masks (6 >> months ago) [Mark Wiebe] >> * 99a21ef - (refs/bisect/good-99a21efff4b1f2292dc370c7c9c7c58f10385f2a) >> ENH: missingdata: Add NA support to np.diagonal, change np.diagonal to >> always return a view (6 months ago) [Mark Wiebe] >> >> So - the problem arises somewhere between 99a21ef (good) and df907e6 >> (bad) >> >> There seems to be a compilation error for the skipped commi
Re: [Numpy-discussion] C++ Example
On 3/4/12 3:18 PM, Luis Pedro Coelho wrote: > On Saturday, March 03, 2012 04:38:53 PM David Cournapeau wrote: >> I don't think the code is comparable either - some of the stuff done >> in the C code is done in the C++ code your are calling. The C code >> could be significantly improved. > Actually, that's not 100% accurate. The C code calls the same functions. Most > of the extra cruft is that it needs to do all of this error checking and type- > dispatch, while in C++ you can have RAII and templates. > >> Even more important here: almost none >> of this code should be written anymore anyway, C++ or not. This is >> really the kind of code that should be done in cython, as it is mostly >> about wrapping C code into the python C API. > At least last time I read up on it, cython was not able to do multi-type code, > i.e., have code that works on arrays of multiple types. Does it support it > now? > > Best, Coming soon in version 0.16: https://sage.math.washington.edu:8091/hudson/job/cython-docs/doclinks/1/src/userguide/fusedtypes.html -Jeff ___ NumPy-Discussion mailing list NumPy-Discussion@scipy.org http://mail.scipy.org/mailman/listinfo/numpy-discussion
Re: [Numpy-discussion] C++ Example
On Saturday, March 03, 2012 04:38:53 PM David Cournapeau wrote: > I don't think the code is comparable either - some of the stuff done > in the C code is done in the C++ code your are calling. The C code > could be significantly improved. Actually, that's not 100% accurate. The C code calls the same functions. Most of the extra cruft is that it needs to do all of this error checking and type- dispatch, while in C++ you can have RAII and templates. > Even more important here: almost none > of this code should be written anymore anyway, C++ or not. This is > really the kind of code that should be done in cython, as it is mostly > about wrapping C code into the python C API. At least last time I read up on it, cython was not able to do multi-type code, i.e., have code that works on arrays of multiple types. Does it support it now? Best, -- Luis Pedro Coelho | University of Lisbon | http://luispedro.org signature.asc Description: This is a digitally signed message part. ___ NumPy-Discussion mailing list NumPy-Discussion@scipy.org http://mail.scipy.org/mailman/listinfo/numpy-discussion
Re: [Numpy-discussion] test errors on deprecation/runtime warnings
On Sat, Feb 18, 2012 at 10:13 AM, Ralf Gommers wrote: > > > 2012/2/17 Stéfan van der Walt > >> Hi Ralf >> >> On Thu, Feb 16, 2012 at 11:05 AM, Ralf Gommers >> wrote: >> > Last week we merged https://github.com/numpy/numpy/pull/201, which >> causes >> > DeprecationWarning's and RuntimeWarning's to be converted to errors if >> they >> > occur when running the test suite. >> >> It looks like this change affects other packages, too, > > > It does, which is why I wanted to bring it up here. > > >> which may legitimately raise RuntimeWarnings while running their test >> suites >> (unless I read the patch wrong). Would it be an option to rather add >> a flag (False by default) to enable this behaviour, and enable it >> inside of numpy.test() ? >> > > Well, the idea is that this behavior is the correct one for all packages. > It calls attention to those RuntimeWarnings, which may only occur on > certain platforms. If they're legitimate, you silence them in the test > suite of that package. If not, you fix them. Would you agree with that? Or > would you prefer to just ignore DeprecationWarnings and/or RuntimeWarnings > in skimage for example? > > Note that the changed behavior would only be visible for people running > numpy master. > This behavior has been made configurable, and I added instructions in HOWTO_RELEASE to turn it off in maintenance branches, in https://github.com/rgommers/numpy/compare/pull-219-warnings. There is some discussion at https://github.com/numpy/numpy/pull/219. The intention is to merge this soon, so now is the time to comment. Ralf ___ NumPy-Discussion mailing list NumPy-Discussion@scipy.org http://mail.scipy.org/mailman/listinfo/numpy-discussion
Re: [Numpy-discussion] Bus error for Debian / SPARC on current trunk
On Sun, Mar 4, 2012 at 12:27 PM, Matthew Brett wrote: > Hi, > > On Sat, Mar 3, 2012 at 12:07 AM, Matthew Brett > wrote: > > Hi, > > > > On Fri, Mar 2, 2012 at 9:05 PM, Charles R Harris > > wrote: > >> > >> > >> On Fri, Mar 2, 2012 at 4:36 PM, Matthew Brett > >> wrote: > >>> > >>> Hi, > >>> > >>> Sorry that this report is not complete, I don't have full access to > >>> this box but, on a Debian squeeze machine running linux > >>> 2.6.32-5-sparc64-smp: > >>> > >>> nosetests > >>> > ~/usr/local/lib/python2.6/site-packages/numpy/lib/tests/test_io.py:TestFromTxt.test_user_missing_values > >>> > >>> test_user_missing_values (test_io.TestFromTxt) ... Bus error > >>> > >>> This on current master : 1.7.0.dev-b9872b4 > >>> > >> > >> Hmm, some tests might have been recently enabled. Any chance of doing a > >> bisection? > > Struggling because compilation is very slow and there are lots of > untestable commits. df907e6 is the first known bad. Here's the > output from a log: > The effort is much appreciated. At least we are down to a 3 day period. > > * df907e6 - (HEAD, refs/bisect/bad) BLD: Failure in single file build > mode because of a static function in two separate files (6 months ago) > [Mark Wiebe] > * 01b200b - (refs/bisect/skip-01b200b10149312f51234448e44b230b1b548046) > BUG: nditer: The nditer was reusing the reduce loop inappropriately > (#1938) (6 months ago) [Mark Wiebe] > * f45fd67 - (refs/bisect/skip-f45fd67fe8eefc8fd2e4b914ab4e376ab5226887) > DOC: Small tweak to release notes (6 months ago) [Mark Wiebe] > * 73be11d - (refs/bisect/skip-73be11db794d115a7d9bd2e822c0d8008bc14a28) > BUG: Some bugs in squeeze and concatenate found by testing SciPy (6 > months ago) [Mark Wiebe] > * c873295 - (refs/bisect/skip-c8732958c8e07f2306029dfde2178faf9c01d049) > TST: missingdata: Finish up NA mask tests for np.std and np.var (6 > months ago) [Mark Wiebe] > * e15712c - (refs/bisect/skip-e15712cf5df41806980f040606744040a433b331) > BUG: nditer: NA masks in arrays with leading 1 dimensions had an issue > (6 months ago) [Mark Wiebe] > * ded81ae - (refs/bisect/skip-ded81ae7d529ac0fba641b7e5e3ecf52e120700f) > ENH: missingdata: Implement tests for np.std, add skipna= and > keepdims= parameters to more functions (6 months ago) [Mark Wiebe] > * a112fc4 - (refs/bisect/skip-a112fc4a6b28fbb85e1b0c6d423095d13cf7b226) > ENH: missingdata: Implement skipna= support for np.std and np.var (6 > months ago) [Mark Wiebe] > * 0fa4f22 - (refs/bisect/skip-0fa4f22fec4b19e2a8c1d93e5a1f955167c9addd) > ENH: missingdata: Support 'skipna=' parameter in np.mean (6 months > ago) [Mark Wiebe] > * bfda229 - (refs/bisect/skip-bfda229ec93d37b1ee2cdd8b9443ec4e34536bbf) > ENH: missingdata: Create count_reduce_items function (6 months ago) > [Mark Wiebe] > * d9b3f90 - (refs/bisect/skip-d9b3f90de3213ece9a78b77088fdec17910e81d9) > ENH: missingdata: Move the Reduce boilerplate into a function > PyArray_ReduceWrapper (6 months ago) [Mark Wiebe] > * 67ece6b - (refs/bisect/skip-67ece6bdd2b35d011893e78154dbff6ab51c7d35) > ENH: missingdata: Finish count_nonzero as a full-fledged reduction > operation (6 months ago) [Mark Wiebe] > * 6bfd819 - (refs/bisect/skip-6bfd819a0897caf6e6db244930c40ed0d17b9e62) > ENH: missingdata: Towards making count_nonzero a full-featured > reduction operation (6 months ago) [Mark Wiebe] > * a1faa1b - (refs/bisect/skip-a1faa1b6883c47333508a0476c1304b0a8a3f64e) > ENH: missingdata: Move some of the refactored reduction code into the > API (6 months ago) [Mark Wiebe] > * f597374 - (refs/bisect/skip-f597374edc298810083799e8539c99fc0a93b319) > ENH: missingdata: Change default to create NA-mask when NAs are in > lists (6 months ago) [Mark Wiebe] > * 965e4cf - (refs/bisect/skip-965e4cff5c4c50e8ff051a3363adc6cf6aa640cd) > ENH: missingdata: trying some more functions to see how they treat NAs > (6 months ago) [Mark Wiebe] > * b1cb211 - (refs/bisect/skip-b1cb211d159c617ee4ebd16266d6f1042417ef75) > ENH: missingdata: Add nastr= parameter to np.set_printoptions() (6 > months ago) [Mark Wiebe] > * ba4d116 - (refs/bisect/skip-ba4d1161fe4943cb720f35c0abfd0581628255d6) > BUG: missingdata: Fix mask usage in PyArray_TakeFrom, add tests for it > (6 months ago) [Mark Wiebe] > * a3a0ee8 - (refs/bisect/skip-a3a0ee8c72fdd55ffacb96bbb1fa9c3569cfb3e9) > BUG: missingdata: The ndmin parameter to np.array wasn't respecting NA > masks (6 months ago) [Mark Wiebe] > * 9194b3a - (refs/bisect/skip-9194b3af704df71aa9b1ff2f53f169848d0f9dc7) > ENH: missingdata: Rewrite PyArray_Concatenate to work with NA masks (6 > months ago) [Mark Wiebe] > * 99a21ef - (refs/bisect/good-99a21efff4b1f2292dc370c7c9c7c58f10385f2a) > ENH: missingdata: Add NA support to np.diagonal, change np.diagonal to > always return a view (6 months ago) [Mark Wiebe] > > So - the problem arises somewhere between 99a21ef (good) and df907e6 (bad) > > There seems to be a compilation error for the skipped commits - here's > the one I tested, 9194b3a: > > gcc: numpy/core/src/multiarray/multiarraymodule_on
Re: [Numpy-discussion] Bus error for Debian / SPARC on current trunk
On Sun, Mar 4, 2012 at 11:27 AM, Matthew Brett wrote: > Hi, > > On Sat, Mar 3, 2012 at 12:07 AM, Matthew Brett > wrote: > > Hi, > > > > On Fri, Mar 2, 2012 at 9:05 PM, Charles R Harris > > wrote: > >> > >> > >> On Fri, Mar 2, 2012 at 4:36 PM, Matthew Brett > >> wrote: > >>> > >>> Hi, > >>> > >>> Sorry that this report is not complete, I don't have full access to > >>> this box but, on a Debian squeeze machine running linux > >>> 2.6.32-5-sparc64-smp: > >>> > >>> nosetests > >>> > ~/usr/local/lib/python2.6/site-packages/numpy/lib/tests/test_io.py:TestFromTxt.test_user_missing_values > >>> > >>> test_user_missing_values (test_io.TestFromTxt) ... Bus error > >>> > >>> This on current master : 1.7.0.dev-b9872b4 > >>> > >> > >> Hmm, some tests might have been recently enabled. Any chance of doing a > >> bisection? > > Struggling because compilation is very slow and there are lots of > untestable commits. df907e6 is the first known bad. Here's the > output from a log: > > * df907e6 - (HEAD, refs/bisect/bad) BLD: Failure in single file build > mode because of a static function in two separate files (6 months ago) > [Mark Wiebe] > * 01b200b - (refs/bisect/skip-01b200b10149312f51234448e44b230b1b548046) > BUG: nditer: The nditer was reusing the reduce loop inappropriately > (#1938) (6 months ago) [Mark Wiebe] > * f45fd67 - (refs/bisect/skip-f45fd67fe8eefc8fd2e4b914ab4e376ab5226887) > DOC: Small tweak to release notes (6 months ago) [Mark Wiebe] > * 73be11d - (refs/bisect/skip-73be11db794d115a7d9bd2e822c0d8008bc14a28) > BUG: Some bugs in squeeze and concatenate found by testing SciPy (6 > months ago) [Mark Wiebe] > * c873295 - (refs/bisect/skip-c8732958c8e07f2306029dfde2178faf9c01d049) > TST: missingdata: Finish up NA mask tests for np.std and np.var (6 > months ago) [Mark Wiebe] > * e15712c - (refs/bisect/skip-e15712cf5df41806980f040606744040a433b331) > BUG: nditer: NA masks in arrays with leading 1 dimensions had an issue > (6 months ago) [Mark Wiebe] > * ded81ae - (refs/bisect/skip-ded81ae7d529ac0fba641b7e5e3ecf52e120700f) > ENH: missingdata: Implement tests for np.std, add skipna= and > keepdims= parameters to more functions (6 months ago) [Mark Wiebe] > * a112fc4 - (refs/bisect/skip-a112fc4a6b28fbb85e1b0c6d423095d13cf7b226) > ENH: missingdata: Implement skipna= support for np.std and np.var (6 > months ago) [Mark Wiebe] > * 0fa4f22 - (refs/bisect/skip-0fa4f22fec4b19e2a8c1d93e5a1f955167c9addd) > ENH: missingdata: Support 'skipna=' parameter in np.mean (6 months > ago) [Mark Wiebe] > * bfda229 - (refs/bisect/skip-bfda229ec93d37b1ee2cdd8b9443ec4e34536bbf) > ENH: missingdata: Create count_reduce_items function (6 months ago) > [Mark Wiebe] > * d9b3f90 - (refs/bisect/skip-d9b3f90de3213ece9a78b77088fdec17910e81d9) > ENH: missingdata: Move the Reduce boilerplate into a function > PyArray_ReduceWrapper (6 months ago) [Mark Wiebe] > * 67ece6b - (refs/bisect/skip-67ece6bdd2b35d011893e78154dbff6ab51c7d35) > ENH: missingdata: Finish count_nonzero as a full-fledged reduction > operation (6 months ago) [Mark Wiebe] > * 6bfd819 - (refs/bisect/skip-6bfd819a0897caf6e6db244930c40ed0d17b9e62) > ENH: missingdata: Towards making count_nonzero a full-featured > reduction operation (6 months ago) [Mark Wiebe] > * a1faa1b - (refs/bisect/skip-a1faa1b6883c47333508a0476c1304b0a8a3f64e) > ENH: missingdata: Move some of the refactored reduction code into the > API (6 months ago) [Mark Wiebe] > * f597374 - (refs/bisect/skip-f597374edc298810083799e8539c99fc0a93b319) > ENH: missingdata: Change default to create NA-mask when NAs are in > lists (6 months ago) [Mark Wiebe] > * 965e4cf - (refs/bisect/skip-965e4cff5c4c50e8ff051a3363adc6cf6aa640cd) > ENH: missingdata: trying some more functions to see how they treat NAs > (6 months ago) [Mark Wiebe] > * b1cb211 - (refs/bisect/skip-b1cb211d159c617ee4ebd16266d6f1042417ef75) > ENH: missingdata: Add nastr= parameter to np.set_printoptions() (6 > months ago) [Mark Wiebe] > * ba4d116 - (refs/bisect/skip-ba4d1161fe4943cb720f35c0abfd0581628255d6) > BUG: missingdata: Fix mask usage in PyArray_TakeFrom, add tests for it > (6 months ago) [Mark Wiebe] > * a3a0ee8 - (refs/bisect/skip-a3a0ee8c72fdd55ffacb96bbb1fa9c3569cfb3e9) > BUG: missingdata: The ndmin parameter to np.array wasn't respecting NA > masks (6 months ago) [Mark Wiebe] > * 9194b3a - (refs/bisect/skip-9194b3af704df71aa9b1ff2f53f169848d0f9dc7) > ENH: missingdata: Rewrite PyArray_Concatenate to work with NA masks (6 > months ago) [Mark Wiebe] > * 99a21ef - (refs/bisect/good-99a21efff4b1f2292dc370c7c9c7c58f10385f2a) > ENH: missingdata: Add NA support to np.diagonal, change np.diagonal to > always return a view (6 months ago) [Mark Wiebe] > > So - the problem arises somewhere between 99a21ef (good) and df907e6 (bad) > > There seems to be a compilation error for the skipped commits - here's > the one I tested, 9194b3a: > If you enable separate compilation by setting an environment variable, these commits should build as well. $ export ENABLE_SEPA
Re: [Numpy-discussion] Bus error for Debian / SPARC on current trunk
Hi, On Sat, Mar 3, 2012 at 12:07 AM, Matthew Brett wrote: > Hi, > > On Fri, Mar 2, 2012 at 9:05 PM, Charles R Harris > wrote: >> >> >> On Fri, Mar 2, 2012 at 4:36 PM, Matthew Brett >> wrote: >>> >>> Hi, >>> >>> Sorry that this report is not complete, I don't have full access to >>> this box but, on a Debian squeeze machine running linux >>> 2.6.32-5-sparc64-smp: >>> >>> nosetests >>> ~/usr/local/lib/python2.6/site-packages/numpy/lib/tests/test_io.py:TestFromTxt.test_user_missing_values >>> >>> test_user_missing_values (test_io.TestFromTxt) ... Bus error >>> >>> This on current master : 1.7.0.dev-b9872b4 >>> >> >> Hmm, some tests might have been recently enabled. Any chance of doing a >> bisection? Struggling because compilation is very slow and there are lots of untestable commits. df907e6 is the first known bad. Here's the output from a log: * df907e6 - (HEAD, refs/bisect/bad) BLD: Failure in single file build mode because of a static function in two separate files (6 months ago) [Mark Wiebe] * 01b200b - (refs/bisect/skip-01b200b10149312f51234448e44b230b1b548046) BUG: nditer: The nditer was reusing the reduce loop inappropriately (#1938) (6 months ago) [Mark Wiebe] * f45fd67 - (refs/bisect/skip-f45fd67fe8eefc8fd2e4b914ab4e376ab5226887) DOC: Small tweak to release notes (6 months ago) [Mark Wiebe] * 73be11d - (refs/bisect/skip-73be11db794d115a7d9bd2e822c0d8008bc14a28) BUG: Some bugs in squeeze and concatenate found by testing SciPy (6 months ago) [Mark Wiebe] * c873295 - (refs/bisect/skip-c8732958c8e07f2306029dfde2178faf9c01d049) TST: missingdata: Finish up NA mask tests for np.std and np.var (6 months ago) [Mark Wiebe] * e15712c - (refs/bisect/skip-e15712cf5df41806980f040606744040a433b331) BUG: nditer: NA masks in arrays with leading 1 dimensions had an issue (6 months ago) [Mark Wiebe] * ded81ae - (refs/bisect/skip-ded81ae7d529ac0fba641b7e5e3ecf52e120700f) ENH: missingdata: Implement tests for np.std, add skipna= and keepdims= parameters to more functions (6 months ago) [Mark Wiebe] * a112fc4 - (refs/bisect/skip-a112fc4a6b28fbb85e1b0c6d423095d13cf7b226) ENH: missingdata: Implement skipna= support for np.std and np.var (6 months ago) [Mark Wiebe] * 0fa4f22 - (refs/bisect/skip-0fa4f22fec4b19e2a8c1d93e5a1f955167c9addd) ENH: missingdata: Support 'skipna=' parameter in np.mean (6 months ago) [Mark Wiebe] * bfda229 - (refs/bisect/skip-bfda229ec93d37b1ee2cdd8b9443ec4e34536bbf) ENH: missingdata: Create count_reduce_items function (6 months ago) [Mark Wiebe] * d9b3f90 - (refs/bisect/skip-d9b3f90de3213ece9a78b77088fdec17910e81d9) ENH: missingdata: Move the Reduce boilerplate into a function PyArray_ReduceWrapper (6 months ago) [Mark Wiebe] * 67ece6b - (refs/bisect/skip-67ece6bdd2b35d011893e78154dbff6ab51c7d35) ENH: missingdata: Finish count_nonzero as a full-fledged reduction operation (6 months ago) [Mark Wiebe] * 6bfd819 - (refs/bisect/skip-6bfd819a0897caf6e6db244930c40ed0d17b9e62) ENH: missingdata: Towards making count_nonzero a full-featured reduction operation (6 months ago) [Mark Wiebe] * a1faa1b - (refs/bisect/skip-a1faa1b6883c47333508a0476c1304b0a8a3f64e) ENH: missingdata: Move some of the refactored reduction code into the API (6 months ago) [Mark Wiebe] * f597374 - (refs/bisect/skip-f597374edc298810083799e8539c99fc0a93b319) ENH: missingdata: Change default to create NA-mask when NAs are in lists (6 months ago) [Mark Wiebe] * 965e4cf - (refs/bisect/skip-965e4cff5c4c50e8ff051a3363adc6cf6aa640cd) ENH: missingdata: trying some more functions to see how they treat NAs (6 months ago) [Mark Wiebe] * b1cb211 - (refs/bisect/skip-b1cb211d159c617ee4ebd16266d6f1042417ef75) ENH: missingdata: Add nastr= parameter to np.set_printoptions() (6 months ago) [Mark Wiebe] * ba4d116 - (refs/bisect/skip-ba4d1161fe4943cb720f35c0abfd0581628255d6) BUG: missingdata: Fix mask usage in PyArray_TakeFrom, add tests for it (6 months ago) [Mark Wiebe] * a3a0ee8 - (refs/bisect/skip-a3a0ee8c72fdd55ffacb96bbb1fa9c3569cfb3e9) BUG: missingdata: The ndmin parameter to np.array wasn't respecting NA masks (6 months ago) [Mark Wiebe] * 9194b3a - (refs/bisect/skip-9194b3af704df71aa9b1ff2f53f169848d0f9dc7) ENH: missingdata: Rewrite PyArray_Concatenate to work with NA masks (6 months ago) [Mark Wiebe] * 99a21ef - (refs/bisect/good-99a21efff4b1f2292dc370c7c9c7c58f10385f2a) ENH: missingdata: Add NA support to np.diagonal, change np.diagonal to always return a view (6 months ago) [Mark Wiebe] So - the problem arises somewhere between 99a21ef (good) and df907e6 (bad) There seems to be a compilation error for the skipped commits - here's the one I tested, 9194b3a: gcc: numpy/core/src/multiarray/multiarraymodule_onefile.c In file included from numpy/core/src/multiarray/scalartypes.c.src:25, from numpy/core/src/multiarray/multiarraymodule_onefile.c:10: numpy/core/src/multiarray/_datetime.h:9: warning: function declaration isn't a prototype In file included from numpy/core/src/multiarray/multiarraymodule_onefile.c:13: numpy/cor
Re: [Numpy-discussion] copy mask from existing masked array?
Should work with: b = numpy.ma.masked_array(b, mask=a.mask) -=- Olivier Le 4 mars 2012 13:01, Chao YUE a écrit : > Dear all, > > I have a matrix with dimension of (360,720) but with all global data. > I have another land-sea mask matrix with only 2 unique values in it > (land=1, sea=-1). > So I can easily create transform the second array to a masked array. > the problem is, how can I quickly transform the first one to a masked > array using the same mask as the land-sea mask array? > > I hope my question is clear. If not, here is an example: > > In [93]: a=np.arange(10).reshape(2,5) > In [95]: a=np.ma.masked_equal(a,2 > In [96]: a=np.ma.masked_equal(a,8) > > In [97]: a > Out[97]: > masked_array(data = > [[0 1 -- 3 4] > [5 6 7 -- 9]], > mask = > [[False False True False False] > [False False False True False]], >fill_value = 8) > > In [100]: b=np.random.normal(0,2,size=(2,5)) > > I want to convert b to a masked array using exactly the same mask as a. > > thanks to all, > cheers, > > Chao > -- > > *** > Chao YUE > Laboratoire des Sciences du Climat et de l'Environnement (LSCE-IPSL) > UMR 1572 CEA-CNRS-UVSQ > Batiment 712 - Pe 119 > 91191 GIF Sur YVETTE Cedex > Tel: (33) 01 69 08 29 02; Fax:01.69.08.77.16 > > > > > ___ > NumPy-Discussion mailing list > NumPy-Discussion@scipy.org > http://mail.scipy.org/mailman/listinfo/numpy-discussion > > ___ NumPy-Discussion mailing list NumPy-Discussion@scipy.org http://mail.scipy.org/mailman/listinfo/numpy-discussion
[Numpy-discussion] copy mask from existing masked array?
Dear all, I have a matrix with dimension of (360,720) but with all global data. I have another land-sea mask matrix with only 2 unique values in it (land=1, sea=-1). So I can easily create transform the second array to a masked array. the problem is, how can I quickly transform the first one to a masked array using the same mask as the land-sea mask array? I hope my question is clear. If not, here is an example: In [93]: a=np.arange(10).reshape(2,5) In [95]: a=np.ma.masked_equal(a,2 In [96]: a=np.ma.masked_equal(a,8) In [97]: a Out[97]: masked_array(data = [[0 1 -- 3 4] [5 6 7 -- 9]], mask = [[False False True False False] [False False False True False]], fill_value = 8) In [100]: b=np.random.normal(0,2,size=(2,5)) I want to convert b to a masked array using exactly the same mask as a. thanks to all, cheers, Chao -- *** Chao YUE Laboratoire des Sciences du Climat et de l'Environnement (LSCE-IPSL) UMR 1572 CEA-CNRS-UVSQ Batiment 712 - Pe 119 91191 GIF Sur YVETTE Cedex Tel: (33) 01 69 08 29 02; Fax:01.69.08.77.16 ___ NumPy-Discussion mailing list NumPy-Discussion@scipy.org http://mail.scipy.org/mailman/listinfo/numpy-discussion
Re: [Numpy-discussion] C++ Example
On Sat, Mar 03, 2012 at 04:38:53PM -0800, David Cournapeau wrote: > This is really the kind of code that should be done in cython, as it is > mostly about wrapping C code into the python C API. +1 Gael ___ NumPy-Discussion mailing list NumPy-Discussion@scipy.org http://mail.scipy.org/mailman/listinfo/numpy-discussion
