Re: [Numpy-discussion] Defining version_pattern for fcompiler (pathscale)

answered by the documentation: http://docs.python.org/library/re.html In short, the (?P...) construct defines a named group. -- Pauli Virtanen ___ Numpy-discussion mailing list Numpy-discussion@scipy.org http://mail.scipy.org/mailman/listinfo

Re: [Numpy-discussion] Doc update for 1.3.0?

other doc fixes to 1.3.x tomorrow (if no objections): git://github.com/pv/numpy-work.git work-1.3.x -- Pauli Virtanen ___ Numpy-discussion mailing list Numpy-discussion@scipy.org http://mail.scipy.org/mailman/listinfo/numpy-discussion

Re: [Numpy-discussion] Creating array containing empty lists

].append('foo') a array([['foo'], [], [], [], []], dtype=object) Possibly not any faster or cleaner than the for loop. -- Pauli Virtanen ___ Numpy-discussion mailing list Numpy-discussion@scipy.org http://mail.scipy.org/mailman/listinfo/numpy-discussion

Re: [Numpy-discussion] Using loadtxt() twice on same file freezes python

/numpy/lib/io.py, line 436, in loadtxt raise IOError('End-of-file reached before encountering data.') }}} There haven't been any changes to lib/io.py since branching off 1.3.x, so I believe it should also work OK on 1.3.0. -- Pauli Virtanen ___ Numpy

Re: [Numpy-discussion] Using loadtxt() twice on same file freezes python

already been fixed. -- Pauli Virtanen ___ Numpy-discussion mailing list Numpy-discussion@scipy.org http://mail.scipy.org/mailman/listinfo/numpy-discussion

Re: [Numpy-discussion] Normalization of ifft

: np.fft.ifft([1,0,0,0]) array([ 0.25+0.j, 0.25+0.j, 0.25+0.j, 0.25+0.j]) whereas that of the online reference guide is correct. (To avoid confusion between the different docs, it's probably best to use refer to the ebook by its name.) -- Pauli Virtanen

Re: [Numpy-discussion] Behavior of numpy.random.exponential

Fri, 27 Mar 2009 09:20:09 -0400, josef.pktd wrote: [clip: numpy.random.exponential docstring] I changed this a while ago in the documentation editor, but it hasn't been merged yet to the source docstring It is merged, but I forgot to regenerate the mtrand.c file. -- Pauli Virtanen

Re: [Numpy-discussion] A few more questions about build doc

we'd like docs for newer versions (possibly containing updates etc.) be labelled as compatible with all XX.YY. versions. -- Pauli Virtanen ___ Numpy-discussion mailing list Numpy-discussion@scipy.org http://mail.scipy.org/mailman/listinfo/numpy

Re: [Numpy-discussion] np.savez not multi-processing safe, alternatives?

. The function is fairly small. -- Pauli Virtanen ___ Numpy-discussion mailing list Numpy-discussion@scipy.org http://mail.scipy.org/mailman/listinfo/numpy-discussion

Re: [Numpy-discussion] Numpy 1.3.0 rc1 fails find_duplicates on Solaris

, it might be good not to keep commented-out code such as those np.knownfail decorators in the repository, unless it's explained why it's commented out...) -- Pauli Virtanen ___ Numpy-discussion mailing list Numpy-discussion@scipy.org http

Re: [Numpy-discussion] Numpy 1.3.0 rc1 fails find_duplicates on Solaris

the test is now fixed in trunk: http://projects.scipy.org/numpy/changeset/6827 -- Pauli Virtanen ___ Numpy-discussion mailing list Numpy-discussion@scipy.org http://mail.scipy.org/mailman/listinfo/numpy-discussion

Re: [Numpy-discussion] trouble building docs with sphinx-0.6.1

in Numpy trunk. -- Pauli Virtanen ___ Numpy-discussion mailing list Numpy-discussion@scipy.org http://mail.scipy.org/mailman/listinfo/numpy-discussion

Re: [Numpy-discussion] trouble building docs with sphinx-0.6.1

Wed, 08 Apr 2009 09:59:50 +0200, Gael Varoquaux kirjoitti: On Wed, Apr 01, 2009 at 08:40:15PM +, Pauli Virtanen wrote: It was an incompatibility of Numpy's autosummary extension and Sphinx = 0.6. It should now be fixed in Numpy trunk. autosummary is now in Sphinx (= 0.6). Shouldn't we

Re: [Numpy-discussion] DVCS at PyCon

. -- Pauli Virtanen ___ Numpy-discussion mailing list Numpy-discussion@scipy.org http://mail.scipy.org/mailman/listinfo/numpy-discussion

Re: [Numpy-discussion] documentation suggestion

! *** However, for some reason, I don't see your contribution in the change list: http://docs.scipy.org/numpy/changes/ Can you check if the change you made went through? What page did you edit? -- Pauli Virtanen ___ Numpy-discussion mailing list

[Numpy-discussion] Ill-defined in-place operations (#1085)

it was established that detecting when views really overlap is a problem with no cheap solution. So walking up -base pointers or comparing -data pointers seemed nearly the only feasible way.) -- Pauli Virtanen ___ Numpy-discussion mailing list Numpy

Re: [Numpy-discussion] Compiling for free on Windows32

bdist_egg Does this help? -- Pauli Virtanen ___ Numpy-discussion mailing list Numpy-discussion@scipy.org http://mail.scipy.org/mailman/listinfo/numpy-discussion

Re: [Numpy-discussion] Ill-defined in-place operations (#1085)

Wed, 15 Apr 2009 16:36:09 -0400, josef.pktd wrote: [clip] Is there a list of gotchas for working with views that might produce unexpected results? I don't think there is. Also, the reference manual would probably need a separate section about views. -- Pauli Virtanen

Re: [Numpy-discussion] Ill-defined in-place operations (#1085)

and raise a warning. (The user can silence these, if the behavior is really relied on.) I don't know what is the performance impact of Python warnings, though. The alternative is to have really good documentation on views... -- Pauli Virtanen ___ Numpy

Re: [Numpy-discussion] Question for Pauli or Stefan about doc editor.

Wed, 15 Apr 2009 15:27:21 -0600, Charles R Harris wrote: I'm going to move the docstrings from mtrand.pyx to add_newdocs.py. Will this require any fixes to the doc editor so that the docs don't get readded to mtrand? Go ahead, nothing should break. -- Pauli Virtanen

[Numpy-discussion] Buildbot unavailable

Hi, buildbot.scipy.org says: Service Temporarily Unavailable The server is temporarily unable to service your request due to maintenance downtime or capacity problems. Please try again later. -- Pauli Virtanen ___ Numpy

Re: [Numpy-discussion] svn test failures: linalg with complex

) -- Ran 2034 tests in 41.154s FAILED (KNOWNFAIL=1, failures=2) -- Pauli Virtanen ___ Numpy-discussion mailing list Numpy-discussion@scipy.org http://mail.scipy.org/mailman/listinfo/numpy-discussion

Re: [Numpy-discussion] svn test failures: linalg with complex

Sat, 18 Apr 2009 13:19:39 -1000, Eric Firing wrote: [clip] This is a real pain. What is the simplest work-around? apt-get install libatlas3gf-base export LD_LIBRARY_PATH=/usr/lib/atlas Or, just uninstall libatlas3gf-sse2 in favor of the *-base version. -- Pauli Virtanen

Re: [Numpy-discussion] buggy fortran array reshape ?

these issues in depth. If you want to ensure no-copy, assign to shape: a.shape = (6,) Another remark against reshape: OWNDATA flag is False, even if b is a copy ! Apparently, reshape first copies to a contiguous array and then reshapes. This could be simplified. -- Pauli Virtanen

Re: [Numpy-discussion] buggy fortran array reshape ?

. -- Pauli Virtanen ___ Numpy-discussion mailing list Numpy-discussion@scipy.org http://mail.scipy.org/mailman/listinfo/numpy-discussion

Re: [Numpy-discussion] buggy fortran array reshape ?

Wed, 22 Apr 2009 15:12:20 -0400, josef.pktd wrote: On Wed, Apr 22, 2009 at 2:37 PM, Pauli Virtanen p...@iki.fi wrote: [clip] If you want to ensure no-copy, assign to shape: a.shape = (6,) [clip] Is the difference between assigning to the attribute and using the method call explained

Re: [Numpy-discussion] Porting strategy for py3k

. -- Pauli Virtanen ___ Numpy-discussion mailing list Numpy-discussion@scipy.org http://mail.scipy.org/mailman/listinfo/numpy-discussion

Re: [Numpy-discussion] numpy 1.3.0 test() failures on ubuntu 9.04

shipped with Ubuntu 9.04 are broken: https://bugs.launchpad.net/bugs/363510 -- Pauli Virtanen ___ Numpy-discussion mailing list Numpy-discussion@scipy.org http://mail.scipy.org/mailman/listinfo/numpy-discussion

[Numpy-discussion] Keeping track of backports in Trac

the branches, would help this. -- Pauli Virtanen ___ Numpy-discussion mailing list Numpy-discussion@scipy.org http://mail.scipy.org/mailman/listinfo/numpy-discussion

Re: [Numpy-discussion] Idea: fractional polynomial class

coefficients. -- Pauli Virtanen ___ Numpy-discussion mailing list Numpy-discussion@scipy.org http://mail.scipy.org/mailman/listinfo/numpy-discussion

Re: [Numpy-discussion] Idea: fractional polynomial class

with minor changes, so I see no reason not to make sure we're consistent with duck typing. -- Pauli Virtanen ___ Numpy-discussion mailing list Numpy-discussion@scipy.org http://mail.scipy.org/mailman/listinfo/numpy-discussion

Re: [Numpy-discussion] Idea: fractional polynomial class

Fri, 24 Apr 2009 19:04:50 +, Pauli Virtanen wrote: Well, Numpy's poly1d will work fine with minor changes, so I see no reason not to make sure we're consistent with duck typing. polyint fixed in r6883, there doesn't seem anything else to fix: import numpy as np from fractions import

Re: [Numpy-discussion] Some minor issues with numpy and fractions

constructor, and feed it initializer data. Works for any classes. I'm undecided whether it'd be a good idea to add a specialized routine for doing this... -- Pauli Virtanen ___ Numpy-discussion mailing list Numpy-discussion@scipy.org http

Re: [Numpy-discussion] error building numpy: no file refecount.c

then be merged. I don't think broken trunk has often been a significant problem in Numpy in the past. Anyway, feature branches are good, and we have the buildbot.scipy.org, so there's no reason not to check it after committing. -- Pauli Virtanen

Re: [Numpy-discussion] Installation NumPy v.1.2.1 on Linux

Fri, 08 May 2009 11:45:51 +0400, Ilya A. Kozyreff kirjoitti: $ python setup.py install --prefix=/nethome/ia/usr/ $ python -c 'import numpy; numpy.test()' [clip] ImportError: No module named numpy [clip] What I do wrong?

Re: [Numpy-discussion] Numpy Trac site redirecting in a loop?

://trac-hacks.org/ticket/3233 I applied the patch from the ticket; I think password resets should work now, so you can try using your old accounts again. -- Pauli Virtanen ___ Numpy-discussion mailing list Numpy-discussion@scipy.org http://mail.scipy.org

Re: [Numpy-discussion] FAIL: Test bug in reduceat with structured arrays

. -- [clip] Buildbot can't. I'd suggest removing your build/ directory and rebuilding, to see if it's caused by some file not rebuilding properly. Otherwise, what is the platform you are using? -- Pauli Virtanen

Re: [Numpy-discussion] FAIL: Test bug in reduceat with structured arrays

Mon, 11 May 2009 16:22:37 +0200, Nils Wagner kirjoitti: On Mon, 11 May 2009 14:05:13 + (UTC) Pauli Virtanen p...@iki.fi wrote: Mon, 11 May 2009 14:06:07 +0200, Nils Wagner kirjoitti: Can someone reproduce the following failure ? I am using numpy.__version__ '1.4.0.dev6983

[Numpy-discussion] Indexing with callables (was: Yorick-like functionality)

Wed, 13 May 2009 13:18:45 -0700, David J Strozzi kirjoitti: [clip] Many of you probably know of the interpreter yorick by Dave Munro. As a Livermoron, I use it all the time. There are some built-in functions there, analogous to but above and beyond numpy's sum() and diff(), which are quite

Re: [Numpy-discussion] Question about slicing

think you should re-check that you are doing what you think you are doing. Preparing a self-contained code example could help here, at least this would make pinpointing where the error is more easy. -- Pauli Virtanen ___ Numpy-discussion mailing list

Re: [Numpy-discussion] Indexing with callables (was: Yorick-like functionality)

://yorick.sourceforge.net/manual/yorick_47.php#SEC47 I must say that I don't see many functions missing in Numpy... David (Strozzi): are these the functions you meant? Are there more? -- Pauli Virtanen ___ Numpy-discussion mailing list Numpy-discussion

[Numpy-discussion] Obsolete Endo-generated docs

Hi, Sat, 16 May 2009 16:01:00 +0300, Quilby wrote: [clip] http://www.scipy.org/doc/numpy_api_docs/numpy.linalg.linalg.html#lstsq [clip] Could we take these old Endo-generated docs down, and make the URL redirect to docs.scipy.org? I believe they are more harmful than helpful... -- Pauli

Re: [Numpy-discussion] Obsolete Endo-generated docs

Sat, 16 May 2009 14:02:34 +, Pauli Virtanen wrote: Hi, Sat, 16 May 2009 16:01:00 +0300, Quilby wrote: [clip] http://www.scipy.org/doc/numpy_api_docs/numpy.linalg.linalg.html#lstsq [clip] Could we take these old Endo-generated docs down, and make the URL redirect to docs.scipy.org

Re: [Numpy-discussion] Question about slicing

actually be a bug in matplotlib; perhaps you should ask the people on the matplotlib lists if this is really the intended behavior. -- Pauli Virtanen ___ Numpy-discussion mailing list Numpy-discussion@scipy.org http://mail.scipy.org/mailman/listinfo/numpy

Re: [Numpy-discussion] numpy slices limited to 32 bit values?

, -- Pauli Virtanen ___ Numpy-discussion mailing list Numpy-discussion@scipy.org http://mail.scipy.org/mailman/listinfo/numpy-discussion

Re: [Numpy-discussion] Indexing with callables (was: Yorick-like functionality)

] http://www.scilab.org/platform/index_platform.php?page=history .. [3] http://en.wikipedia.org/wiki/GNU_Octave#History -- Pauli Virtanen ___ Numpy-discussion mailing list Numpy-discussion@scipy.org http://mail.scipy.org/mailman/listinfo/numpy-discussion

Re: [Numpy-discussion] wiki page correction

, it should be x[1,:].copy(). Please feel free to correct it. -- Pauli Virtanen ___ Numpy-discussion mailing list Numpy-discussion@scipy.org http://mail.scipy.org/mailman/listinfo/numpy-discussion

Re: [Numpy-discussion] how to use ldexp?

Thu, 21 May 2009 01:45:54 -0700, dmitrey wrote: I have updated numpy to latest '1.4.0.dev7008', but the bug still remains. I use KUBUNTU 9.04, compilers - gcc (using build-essential), gfortran. Worksforme on Ubuntu 9.04, on python2.6 and python2.5. Should be the same platform. -- Pauli

Re: [Numpy-discussion] how to use ldexp?

Thu, 21 May 2009 09:26:18 +, Pauli Virtanen wrote: Thu, 21 May 2009 01:45:54 -0700, dmitrey wrote: I have updated numpy to latest '1.4.0.dev7008', but the bug still remains. I use KUBUNTU 9.04, compilers - gcc (using build-essential), gfortran. Worksforme on Ubuntu 9.04, on python2.6

Re: [Numpy-discussion] memoryerror with numpy.fromfile

, you should check that you don't have an ulimit set for virtual/RSS memory. -- Pauli Virtanen ___ Numpy-discussion mailing list Numpy-discussion@scipy.org http://mail.scipy.org/mailman/listinfo/numpy-discussion

Re: [Numpy-discussion] memoryerror with numpy.fromfile

://projects.scipy.org/numpy/ticket/1115 which is maybe related. -- Pauli Virtanen ___ Numpy-discussion mailing list Numpy-discussion@scipy.org http://mail.scipy.org/mailman/listinfo/numpy-discussion

Re: [Numpy-discussion] wiki page correction

Thu, 21 May 2009 10:54:21 -0700, Grant Kelly wrote: It's an immutable page. Can someone who already has access make the edit? Umm, are you sure? I don't see any ACL's on the page. (Though you need to register an account on the wiki before editing.) -- Pauli Virtanen

Re: [Numpy-discussion] Home for pyhdf5io?

- array objects so that all their attributes etc. are exposed in the hdf5 file and can be read by non-Python applications. -- Pauli Virtanen ___ Numpy-discussion mailing list Numpy-discussion@scipy.org http://mail.scipy.org/mailman/listinfo/numpy

Re: [Numpy-discussion] Ticket #1113, change title?

the following output for you: np.arctanh(np.array([1e-5 + 1e-5j], np.complex64)) array([ 9.9975e-06 +9.9975e-06j], dtype=complex64) -- Pauli Virtanen ___ Numpy-discussion mailing list Numpy-discussion@scipy.org http://mail.scipy.org/mailman

Re: [Numpy-discussion] documenting index_tricks

(it is a subclass of AxisConcatenator) would make more sense. I'm not sure this change is worth the trouble though. I think the RClass is a private implementation detail, and shouldn't be documented in the reference guide. -- Pauli Virtanen ___ Numpy-discussion

Re: [Numpy-discussion] Generalised Ufunc list

is in place. -- Pauli Virtanen ___ Numpy-discussion mailing list Numpy-discussion@scipy.org http://mail.scipy.org/mailman/listinfo/numpy-discussion

Re: [Numpy-discussion] parsing text strings/files in fromfile, fromstring

? (Let's forget the names of the new keyword arguments for the present, and assume they have perfectly fitting names.) I'd vote for (e) if the slate was clean, but since it's not: +1 for (a) or (b) -- Pauli Virtanen ___ Numpy-discussion mailing list

Re: [Numpy-discussion] [RFR] NpzFile tweaks (Re: Making NpzFiles behave more like dictionaries.)

Wed, 03 Jun 2009 16:05:51 -0400, David Warde-Farley wrote: On 2-Jun-09, at 3:06 PM, Pauli Virtanen wrote: +0 I don't see any drawbacks, and the implementation looks good. Thanks Pauli. I realized I was missing values() and itervalues() (though I can't conceive of a scenario where I'd

Re: [Numpy-discussion] Scipy 0.7.1rc1 released

of printing them to stderr. *** I added this to 0.7.1-notes.rst. -- Pauli Virtanen ___ Numpy-discussion mailing list Numpy-discussion@scipy.org http://mail.scipy.org/mailman/listinfo/numpy-discussion

Re: [Numpy-discussion] Multiplying Python float to numpy.array of objects works but fails with a numpy.float64, numpy Bug?

behavior doesn't seem correct. -- Pauli Virtanen ___ Numpy-discussion mailing list Numpy-discussion@scipy.org http://mail.scipy.org/mailman/listinfo/numpy-discussion

Re: [Numpy-discussion] Question about memmap

representing the binary data. Also, I doubt that this would be very useful: representing large amounts of data as text is not efficient. I also think few people have interest in this feature. -- Pauli Virtanen ___ Numpy-discussion mailing list Numpy

Re: [Numpy-discussion] More on doc-ing new functions

/docs/numpy-docs/reference/routines.set.rst/ in order to be included in the final documentation. -- Pauli Virtanen ___ Numpy-discussion mailing list Numpy-discussion@scipy.org http://mail.scipy.org/mailman/listinfo/numpy-discussion

Re: [Numpy-discussion] Ready for review: PyArrayNeighIterObject, an iterator to iterate over a neighborhood in arbitrary arrays

://docs.scipy.org/numpy/docs/numpy-docs/reference/c-api.array.rst/#array-iterators Probably as a new subsection. -- Pauli Virtanen ___ Numpy-discussion mailing list Numpy-discussion@scipy.org http://mail.scipy.org/mailman/listinfo/numpy-discussion

Re: [Numpy-discussion] More on doc-ing new functions

that should report the status, but it's currently broken. -- Pauli Virtanen ___ Numpy-discussion mailing list Numpy-discussion@scipy.org http://mail.scipy.org/mailman/listinfo/numpy-discussion

Re: [Numpy-discussion] ticket #1096

= x - y; is -inf or not. And if it is, just to return -inf. That's not the correct fix. Anyway, fixed in r7059. -- Pauli Virtanen ___ Numpy-discussion mailing list Numpy-discussion@scipy.org http://mail.scipy.org/mailman/listinfo/numpy-discussion

Re: [Numpy-discussion] Test bug in reduceat with structured arrays copied for speed.

On 2009-06-19, Nils Wagner nwag...@iam.uni-stuttgart.de wrote: Is this a known failure ? I am using 1.4.0.dev7069 Check the tickets: http://projects.scipy.org/numpy/ticket/1108 Cause is not known yet, but that bug most likely has been around for a long time. -- Pauli Virtanen

Re: [Numpy-discussion] Efficient ?axpy operation without copy (B += a*A)

to be fixed by looking at the source.) I don't see many relevant changes in scipy.lib recently, so I'm not sure what change you mean by the above. -- Pauli Virtanen ___ Numpy-discussion mailing list Numpy-discussion@scipy.org http://mail.scipy.org/mailman

Re: [Numpy-discussion] latex equations in docstrings

On 2009-06-24, Robert Kern robert.k...@gmail.com wrote: [clip] Yes. The HOWTO_BUILD_DOCS.txt is unfortunately out of date. So it is. Rewritten. -- Pauli Virtanen ___ Numpy-discussion mailing list Numpy-discussion@scipy.org http://mail.scipy.org

Re: [Numpy-discussion] fromfile and ticket #1152

interface could be added (by keyword) for those who want an exception raised whenever the requested read count could not be completed. +1 -- Pauli Virtanen ___ Numpy-discussion mailing list Numpy-discussion@scipy.org http://mail.scipy.org

Re: [Numpy-discussion] stderr

the program crash on C-level, which is clearly undesirable in a Python program as it cannot be handled. Raising an error here seems to be the proper thing to do. -- Pauli Virtanen ___ Numpy-discussion mailing list Numpy-discussion@scipy.org http

Re: [Numpy-discussion] np.memmap and memory usage

in memory, before writing it to disk. Linux has at least some system-wide parameters available that tune the aggressiveness of data cachine. I suppose there may also be some file-specific settings, but I have no idea what they are. -- Pauli Virtanen

Re: [Numpy-discussion] make html

. -- Pauli Virtanen ___ Numpy-discussion mailing list Numpy-discussion@scipy.org http://mail.scipy.org/mailman/listinfo/numpy-discussion

Re: [Numpy-discussion] Numpy complex types, packing and C99

with GNU Libc 2.9.) -- Pauli Virtanen ___ Numpy-discussion mailing list Numpy-discussion@scipy.org http://mail.scipy.org/mailman/listinfo/numpy-discussion

Re: [Numpy-discussion] Numpy complex types, packing and C99

tests even if buildbots are OK... After repeating this cycle a couple of times, IIRC only some special cases of log survived :) Of course, if you meant to merge the tests first to the new implementations and that to trunk, this sounds better. -- Pauli Virtanen

Re: [Numpy-discussion] roots and high-order polynomial

) A[j, j+1] = 0.5 A[j, j-1] = 0.5 A[-1,:] = -0.5*a[:-1]/a[-1] A[-1,-2] += 0.5 and the zeros are x = linalg.eig(A)[0] See eg. http://dx.doi.org/10.1016/j.apnum.2005.09.007 for more. -- Pauli Virtanen ___ Numpy-discussion

[Numpy-discussion] Adding new functions to Numpy

keep track of which features are supported in which version. -- Pauli Virtanen ___ Numpy-discussion mailing list Numpy-discussion@scipy.org http://mail.scipy.org/mailman/listinfo/numpy-discussion

Re: [Numpy-discussion] Problem with ML subscriptions?

that either this list doesn't want me or there is some other problem. Anyway it seems impossible to reach the right people. I don't think I am able to help you here. Forwarding this to the ML, so the list admins know. -- Pauli Virtanen ___ Numpy-discussion

Re: [Numpy-discussion] The baffling behavior that just won't die

also here: instead of a file random.py, you have a package named 'random' in the working directory. -- Pauli Virtanen ___ Numpy-discussion mailing list Numpy-discussion@scipy.org http://mail.scipy.org/mailman/listinfo/numpy-discussion

Re: [Numpy-discussion] Mathematica vs Matlab vs Python

it as an exercise for the reader to implement the data file parser in Matlab. I doubt it can be easily done in 20 lines :) -- Pauli Virtanen ___ Numpy-discussion mailing list Numpy-discussion@scipy.org http://mail.scipy.org/mailman/listinfo/numpy-discussion

[Numpy-discussion] Optimizing reduction loops (sum(), prod(), et al.)

Hi, Ticket #1143 points out that Numpy's reduction operations are not always cache friendly. I worked a bit on tuning them. Just to tickle some interest, a pathological case before optimization: In [1]: import numpy as np In [2]: x = np.zeros((8, 256)) In [3]: %timeit

Re: [Numpy-discussion] Optimizing reduction loops (sum(), prod(), et al.)

copying the data. If so, then it probably hits similar cache problems as the non-optimized reduction operation. -- Pauli Virtanen ___ NumPy-Discussion mailing list NumPy-Discussion@scipy.org http://mail.scipy.org/mailman/listinfo/numpy-discussion

Re: [Numpy-discussion] Optimizing reduction loops (sum(), prod(), et al.)

, or even have tunable parameters chosen at build or compile time. (Unless, of course, we want to bring a monster into the world -- think about cross-breeding distutils with the ATLAS build system :) -- Pauli Virtanen ___ NumPy-Discussion mailing list

Re: [Numpy-discussion] performing operations in-place in numpy

. Anyway, it seems there is some auditing to do before this change can be safely considered. Also, the speedups obtained were fairly modest, 20%. Are they larger for more complicated expressions? (Ie. is there an expression whose execution time is halved?) -- Pauli Virtanen

Re: [Numpy-discussion] performing operations in-place in numpy

that none of them is problematic. (We know already that at least PyArray_Conjugate is.) -- Pauli Virtanen ___ NumPy-Discussion mailing list NumPy-Discussion@scipy.org http://mail.scipy.org/mailman/listinfo/numpy-discussion

Re: [Numpy-discussion] Optimizing reduction loops (sum(), prod(), et al.)

Thu, 09 Jul 2009 09:54:26 +0200, Matthieu Brucher kirjoitti: 2009/7/9 Pauli Virtanen pav...@iki.fi: [clip] I'm still kind of hoping that it's possible to make some minimal assumptions about CPU caches in general, and have a rule that decides a code path that is good enough, if not optimal

Re: [Numpy-discussion] performing operations in-place in numpy

, and I don't see ways in which one could distinguish between temporary arrays and refcount-1 arrays used in extension modules. -- Pauli Virtanen ___ NumPy-Discussion mailing list NumPy-Discussion@scipy.org http://mail.scipy.org/mailman/listinfo/numpy

Re: [Numpy-discussion] performing operations in-place in numpy

new references of the contained objects. [CPython itself creates a new tuple when doing a = (np.zeros((4,)), np.zeros((5,))) np.add(*a) so that also in this case the refcounts of the two arrays in the tuple are 1.] -- Pauli Virtanen

Re: [Numpy-discussion] speed up np.diag

always traverses the array in virtual C-order, not in the order it's laid out in memory. -- Pauli Virtanen ___ NumPy-Discussion mailing list NumPy-Discussion@scipy.org http://mail.scipy.org/mailman/listinfo/numpy-discussion

Re: [Numpy-discussion] Optimizing reduction loops (sum(), prod(), et al.)

Wed, 08 Jul 2009 22:16:22 +, Pauli Virtanen kirjoitti: [clip] On an older CPU (slower, smaller cache), the situation is slightly different: http://www.iki.fi/pav/tmp/athlon.png http://www.iki.fi/pav/tmp/athlon.txt On average, it's still an improvement in many cases. However

Re: [Numpy-discussion] np.isfinite on structured arrays

expected it to raise a NotImplementedError exception. Can anybody cast some light on this issue ? Thanks a lot in advance Seems like a bug. As I understand, NotImplemented is intended to be returned only from __lt__ etc. comparison methods. -- Pauli Virtanen

Re: [Numpy-discussion] Adding new functions to Numpy

.. rubric:: Notes to make the headings to appear. -- Pauli Virtanen ___ NumPy-Discussion mailing list NumPy-Discussion@scipy.org http://mail.scipy.org/mailman/listinfo/numpy-discussion

Re: [Numpy-discussion] VIGRA, NumPy and Fortran-order (again)

of the reduction operations. Also these would be more efficient if the striding of the output array could be chosen freely. I wonder if it would be OK to make this change... -- Pauli Virtanen ___ NumPy-Discussion mailing list NumPy-Discussion@scipy.org http

Re: [Numpy-discussion] Adding new functions to Numpy

% sure this is a wise route to go, but oh well... -- Pauli Virtanen ___ NumPy-Discussion mailing list NumPy-Discussion@scipy.org http://mail.scipy.org/mailman/listinfo/numpy-discussion

Re: [Numpy-discussion] My identity

On 2009-07-20, Keith Goodman kwgood...@gmail.com wrote: [clip] Oh, sorry, I misunderstood. Yes, a similar change was made to eye but not to identity. Nasty, duplicated code there it seems... -- Pauli Virtanen ___ NumPy-Discussion mailing list NumPy

Re: [Numpy-discussion] Functions to pack/unpack bytes?

to little-endian order. -- Pauli Virtanen ___ NumPy-Discussion mailing list NumPy-Discussion@scipy.org http://mail.scipy.org/mailman/listinfo/numpy-discussion

Re: [Numpy-discussion] Internal Math Library of Numpy

implementations for functions that are missing in it. Are they platform independent? In practice, yes. There are some possible obscure corner cases currently in complex-valued inf/nan handling, though. -- Pauli Virtanen ___ NumPy-Discussion mailing

Re: [Numpy-discussion] itemsize() doesn't work

. It probably doesn't describe all points of Numpy accurately. Of course, the URL is misleading... -- Pauli Virtanen ___ NumPy-Discussion mailing list NumPy-Discussion@scipy.org http://mail.scipy.org/mailman/listinfo/numpy-discussion

Re: [Numpy-discussion] What type should / return in python 3k when applied to two integer types?

, and personally I believe this should be same as numpy's default float. -- Pauli Virtanen ___ NumPy-Discussion mailing list NumPy-Discussion@scipy.org http://mail.scipy.org/mailman/listinfo/numpy-discussion

Re: [Numpy-discussion] Question about np.savez

a list of ndarrays. It didn't complain, but when I loaded the data back, the list had been turned into an ndarray. Is this behaviour expected? It did surprise me. Below there is an example: [clip] It is expected. savez casts its input to arrays before saving. -- Pauli Virtanen

Re: [Numpy-discussion] ticket for O(n) median function?

ahead and create one -- there's little harm done even if it's a duplicate. -- Pauli Virtanen ___ NumPy-Discussion mailing list NumPy-Discussion@scipy.org http://mail.scipy.org/mailman/listinfo/numpy-discussion

<    4   5   6   7   8   9   10   >