[Numpy-discussion] updating the NumPy roadmap

2024-05-24 Thread Ralf Gommers
Hi all, Now that the dust has settled on what we're including in the NumPy 2.0 release, it felt like a good time to update the project roadmap. After a few discussions with other maintainers I opened https://github.com/numpy/numpy/pull/26505. Part of it is a regular maintenance update: remove

[Numpy-discussion] ANN: NumPy 2.0 release date: 16 June 2024

2024-05-23 Thread Ralf Gommers
Hi all, In yesterday's community meeting we discussed the 2.0 release schedule, and concluded that we are far enough along to pick a date for the final 2.0 release. That date will be June 16 (barring any major last-minute blockers appearing of course). A quick timeline: - `maintenance/2.0.x`

[Numpy-discussion] Re: ERROR: Module "features" does not exist

2024-05-16 Thread Ralf Gommers
On Thu, May 16, 2024 at 2:18 PM Thomas Mansencal wrote: > Hello, > > We have a custom and unusual build environment that is making things a bit > difficult to transition from the old Setuptools based build process to > Meson. I'm currently blocked at the CPU feature set detection: > > ``` >

[Numpy-discussion] Re: Build NumPy with Debugging Symbols with Meson

2024-05-16 Thread Ralf Gommers
On Wed, May 15, 2024 at 10:56 PM Robert McLeod wrote: > Hi everyone, > > Is there a gist or similar guide anywhere on the steps required to build > NumPy with debugging symbols on the Windows platform using the new Meson > build system? It seems a bit difficult because NumPy seems to expect a >

[Numpy-discussion] Re: Please consider dropping Python 3.9 support for Numpy 2.0

2024-05-13 Thread Ralf Gommers
On Sun, May 12, 2024 at 8:39 PM Gael Varoquaux < gael.varoqu...@normalesup.org> wrote: > On Fri, May 10, 2024 at 04:42:49PM +0200, Ralf Gommers wrote: > > It gets ever-easier to install new Python versions, with > pyenv/conda/etc. The "my single Python install comes fr

[Numpy-discussion] Re: Please consider dropping Python 3.9 support for Numpy 2.0

2024-05-13 Thread Ralf Gommers
On Fri, May 10, 2024 at 11:28 PM Brigitta Sipőcz < b.sipocz+numpyl...@gmail.com> wrote: > Hi, > > Is there any way to know if other large libraries hasn't set an upper pin > in their last release but since then dropped python version support? > This should be doable with either the PyPI JSON API

[Numpy-discussion] Re: Please consider dropping Python 3.9 support for Numpy 2.0

2024-05-10 Thread Ralf Gommers
On Thu, May 9, 2024 at 12:28 AM Thomas Caswell wrote: > I think the spirit of NEP 29 is to pick your supported Python's when you > pick a target release date and you should then stick to it (to avoid "we > delayed so long we are over a cliff" decisions like this one). > That's true I believe.

[Numpy-discussion] Re: Please consider dropping Python 3.9 support for Numpy 2.0

2024-05-07 Thread Ralf Gommers
On Tue, May 7, 2024 at 11:44 AM Gael Varoquaux < gael.varoqu...@normalesup.org> wrote: > On Tue, May 07, 2024 at 11:31:02AM +0200, Ralf Gommers wrote: > > make `pip install scikit-image==0.22` work if that version of > scikit-image depends on an unconstrained numpy version. &

[Numpy-discussion] Re: Please consider dropping Python 3.9 support for Numpy 2.0

2024-05-07 Thread Ralf Gommers
On Tue, May 7, 2024 at 7:48 AM Juan Nunez-Iglesias wrote: > On Tue, 7 May 2024, at 7:04 AM, Ralf Gommers wrote: > > This problem could have been avoided by proper use of upper bounds. > Scikit-image 0.22 not including a `numpy<2.0` upper bound is a bug in > scikit-image (

[Numpy-discussion] Re: Please consider dropping Python 3.9 support for Numpy 2.0

2024-05-07 Thread Ralf Gommers
On Mon, May 6, 2024 at 11:43 PM Aaron Meurer wrote: > On Mon, May 6, 2024 at 3:05 PM Ralf Gommers > wrote: > > > > > So, I think I'm in favor of dropping Python 3.9 support after all to > prevent problems. It is late in the game, but I do see that we're going to >

[Numpy-discussion] Re: Please consider dropping Python 3.9 support for Numpy 2.0

2024-05-06 Thread Ralf Gommers
On Mon, May 6, 2024 at 10:42 PM Oscar Benjamin wrote: > On Mon, 6 May 2024 at 19:59, Aaron Meurer wrote: > > > > On Mon, May 6, 2024 at 6:34 AM Mark Harfouche > wrote: > > > > > > I'm asking that you let Python 3.9 support disappear with 1.26, and > not "drop a final version" before you decide

[Numpy-discussion] Re: Making show_runtime and show_config enable file output

2024-04-10 Thread Ralf Gommers
On Wed, Apr 10, 2024 at 4:18 PM Ganesh Kathiresan wrote: > Thanks for the input, I have raised a PR: > https://github.com/numpy/numpy/pull/26255. I'll address the UT issues > soon. Let me know if this is what was required. > Thanks Ganesh! ___

[Numpy-discussion] Re: Making show_runtime and show_config enable file output

2024-04-09 Thread Ralf Gommers
On Mon, Apr 8, 2024 at 9:42 PM Matan Addam wrote: > Hello, > > I find the information printed by the above mentioned functions to be > useful for understanding performance context on installed machines, as well > as variability across machines when troubleshooting. How would the > maintainers

[Numpy-discussion] Re: Moving the weekly traige/community meetings

2024-04-08 Thread Ralf Gommers
On Mon, Apr 8, 2024 at 5:37 PM Nathan wrote: > That time work for me, I have a conflict with the old time an hour earlier > than the current time so hopefully that works for everyone. > One hour later works for me too. Cheers, Ralf On Sun, Apr 7, 2024 at 8:34 PM Matti Picus wrote: > >> Could

[Numpy-discussion] Re: numpy 2.0.x has been branched.

2024-03-29 Thread Ralf Gommers
On Fri, Mar 29, 2024 at 2:07 PM Peter Hawkins wrote: > It looks like the pybind11 release is now done ( > https://github.com/pybind/pybind11/releases/tag/v2.12.0)? Any more > blockers? > No more blockers - CI is running on the last backport that we need I believe, so it's very close. Hours to

[Numpy-discussion] Re: numpy 2.0.x has been branched.

2024-03-28 Thread Ralf Gommers
On Tue, Mar 26, 2024 at 1:20 AM Charles R Harris wrote: > > > On Mon, Mar 25, 2024 at 5:54 PM Oscar Benjamin > wrote: > >> On Sat, 9 Mar 2024 at 10:16, Ralf Gommers wrote: >> > >> > On Sat, Mar 9, 2024 at 2:03 AM Oscar Benjamin < >> oscar.j.benj

[Numpy-discussion] Re: Which generation of s390x CPU and how to change it?

2024-03-25 Thread Ralf Gommers
On Mon, Mar 25, 2024 at 2:24 PM Matěj Cepl wrote: > Hello, > > As a maintainer of Python packages for openSUSE/SUSE, > I would like to ask for help with our bug > https://bugzilla.suse.com/1221902. It seems to us that the latest > version of NumPy suddenly requires z15 CPU generation, although >

[Numpy-discussion] Re: Automatic Clipping of array to upper / lower bounds of dtype

2024-03-10 Thread Ralf Gommers
ops each) Ralf > > Regards, > dg > > > On 10 Mar 2024, at 09:59, Ralf Gommers wrote: > > > > On Sat, Mar 9, 2024 at 11:23 PM Dom Grigonis > wrote: > >> Hello, >> >> Can't find answer to this anywhere. >> >> What I would like is t

[Numpy-discussion] Re: Automatic Clipping of array to upper / lower bounds of dtype

2024-03-10 Thread Ralf Gommers
On Sat, Mar 9, 2024 at 11:23 PM Dom Grigonis wrote: > Hello, > > Can't find answer to this anywhere. > > What I would like is to automatically clip the values if they breach the > bounds. > > I have done a simple clipping, and overwritten __iadd__, __isub__, > __setitem__, … > > But I am

[Numpy-discussion] Re: numpy 2.0.x has been branched.

2024-03-09 Thread Ralf Gommers
On Sat, Mar 9, 2024 at 2:03 AM Oscar Benjamin wrote: > On Sat, 9 Mar 2024 at 00:44, Charles R Harris > wrote: > > > > About a month from now. > > What will happen about a month from now? It might seem obvious to you > but I can interpret this in different ways. > > To be clear numpy 2.0 is

[Numpy-discussion] Updating NEP statuses, and accepting NEP 56

2024-03-03 Thread Ralf Gommers
Hi all, Each NEP has a status, which should be indicative of the state that the proposal is in, and that determines in what category it's shown on https://numpy.org/neps/. We have been neglecting to update status on a fair number of NEPs for a long time. I thought I'd fix that - see

[Numpy-discussion] Re: Improved 2DFFT Approach

2024-02-29 Thread Ralf Gommers
On Wed, Feb 28, 2024 at 6:59 AM camrymanjr--- via NumPy-Discussion < numpy-discussion@python.org> wrote: > Good day! > > My name is Alexander Levin. > > My colleague and I did a project on optimisation of two-dimensional > Fourier transform algorithm six months ago. We took your implementation of

[Numpy-discussion] Re: JSON format for multi-dimensional data

2024-02-28 Thread Ralf Gommers
On Tue, Feb 27, 2024 at 3:45 PM wrote: > Thanks Ralf, > > This answers my question about the absence of I/O Numpy format. > > There are three other points related to this format proposal: > > - integration of a semantic level above the number / character formats as > for datetime (e.g. units,

[Numpy-discussion] Re: builing numpy on windows

2024-02-27 Thread Ralf Gommers
On Wed, Feb 28, 2024 at 6:54 AM Ganesh Rajora via NumPy-Discussion < numpy-discussion@python.org> wrote: > Hi Team, > > I am Ganesh working for an MNC here in India and I am working on > customised Python where I build set of python modules with python. > > I do not install them directly from web

[Numpy-discussion] Re: JSON format for multi-dimensional data

2024-02-27 Thread Ralf Gommers
On Sun, Feb 25, 2024 at 12:34 AM wrote: > > > Perhaps, like the Pandas package, it should live outside NumPy for a > > while until some wider consensus could emerge. > > Regarding this initial remark, this is indeed a possible option but it > depends on the answer to the question: > > - does

[Numpy-discussion] Re: Need help in numpy building from source on windows.

2024-02-26 Thread Ralf Gommers
On Mon, Feb 26, 2024 at 3:26 PM rajoraganesh--- via NumPy-Discussion < numpy-discussion@python.org> wrote: > detailed proble can be found at - > https://stackoverflow.com/questions/78059816/issues-in-buildingnumpy-from-source-on-windows Quick answers: 1. Please don't build 1.26.0, but 1.26.4.

[Numpy-discussion] Re: Numpy wheels: who maintains the builds and who pays for it?

2024-02-26 Thread Ralf Gommers
On Thu, Feb 22, 2024 at 7:03 PM wrote: > Hi folks, > > My name is Sean and I'm the author of several GIS packages using Numpy: > Fiona, Rasterio, and Shapely. Hi Sean, thanks for this very good question, and for all your work on GIS packages. > I've followed Numpy's trail when it comes to

[Numpy-discussion] Re: ENH: Introducing a pipe Method for Numpy arrays

2024-02-16 Thread Ralf Gommers
On Fri, Feb 16, 2024 at 12:40 AM Marten van Kerkwijk wrote: > > From my experience, calling methods is generally faster than > > functions. I figure it is due to having less overhead figuring out the > > input. Maybe it is not significant for large data, but it does make a > > difference even

[Numpy-discussion] Re: donation from the Bloomberg FOSS Contributor Fund

2024-01-31 Thread Ralf Gommers
On Wed, Jan 31, 2024 at 1:34 PM Inessa Pawson wrote: > The NumPy Steering Council is excited to announce that we have received a > $10k grant from the Bloomberg FOSS Contributor Fund. We appreciate > Bloomberg’s commitment to sustaining critical digital infrastructure and > thank all the

[Numpy-discussion] welcome Raghuveer, Chris, Mateusz and Matt to the NumPy maintainers team

2024-01-26 Thread Ralf Gommers
Hi all, We've got four new NumPy maintainers! Welcome to the team, and congratulations to: - Raghuveer Devulapalli (https://github.com/r-devulap) - Chris Sidebottom (https://github.com/mousius) - Mateusz Sokół (https://github.com/mtsokol/) - Matt Haberland (https://github.com/mdhaber) Raghuveer

[Numpy-discussion] Re: Proposal to accept NEP 55: Add a UTF-8 variable-width string DType to NumPy

2024-01-24 Thread Ralf Gommers
On Wed, Jan 24, 2024 at 10:43 AM Sebastian Berg wrote: > On Mon, 2024-01-22 at 17:08 -0700, Nathan wrote: > > Hi all, > > > > I propose we accept NEP 55 and merge PR #25347 implementing the NEP > > in time > > for the NumPy 2.0 RC: > > > I really like this work and I think it is a big

[Numpy-discussion] NEP 56: array API standard support in the main numpy namespace

2024-01-07 Thread Ralf Gommers
ual/design comments, please post them on this thread. Cheers, Ralf = NEP 56 — Array API standard support in NumPy's main namespace = :Author: Ralf Gommers :Author: Mateusz Sokó

[Numpy-discussion] Re: incomplete BLAS/CBLAS linking (Telling meson build which CBLAS/LAPACK (LAPACKE?) to use via pkgconfig module)

2023-12-31 Thread Ralf Gommers
On Sat, Dec 30, 2023 at 1:57 PM Dr. Thomas Orgis < thomas.or...@uni-hamburg.de> wrote: > > Am Fri, 29 Dec 2023 11:34:04 +0100 > schrieb Ralf Gommers : > > > If the library name is libcblas.so it will still be found. If it's also a > > nonstandard name, then yes it's

[Numpy-discussion] Re: incomplete BLAS/CBLAS linking (Telling meson build which CBLAS/LAPACK (LAPACKE?) to use via pkgconfig module)

2023-12-31 Thread Ralf Gommers
(re-sending to list) On Fri, Dec 29, 2023 at 11:34 AM Ralf Gommers wrote: > > > On Fri, Dec 29, 2023 at 12:00 AM Dr. Thomas Orgis < > thomas.or...@uni-hamburg.de> wrote: > >> Am Thu, 28 Dec 2023 20:51:27 +0100 >> schrieb Ralf Gommers : >> >>

[Numpy-discussion] Fwd: incomplete BLAS/CBLAS linking (Telling meson build which CBLAS/LAPACK (LAPACKE?) to use via pkgconfig module)

2023-12-31 Thread Ralf Gommers
-- Forwarded message - From: Dr. Thomas Orgis Date: Fri, Dec 29, 2023 at 12:00 AM Subject: Re: incomplete BLAS/CBLAS linking (Telling meson build which CBLAS/LAPACK (LAPACKE?) to use via pkgconfig module) To: Ralf Gommers Am Thu, 28 Dec 2023 20:51:27 +0100 schrieb Ralf Gommers

[Numpy-discussion] Fwd: incomplete BLAS/CBLAS linking (Telling meson build which CBLAS/LAPACK (LAPACKE?) to use via pkgconfig module)

2023-12-31 Thread Ralf Gommers
(I took this off-list unintentionally, so I'm forward each email to the list now) -- Forwarded message - From: Ralf Gommers Date: Thu, Dec 28, 2023 at 8:51 PM Subject: Re: incomplete BLAS/CBLAS linking (Telling meson build which CBLAS/LAPACK (LAPACKE?) to use via pkgconfig

[Numpy-discussion] NEP 54 - SIMD infrastructure evolution to C++ and adopting Google Highway

2023-12-31 Thread Ralf Gommers
of the NEP: === NEP 54 — SIMD infrastructure evolution: adopting Google Highway when moving to C++? === :Author: Sayed Adel, Jan Wassenberg, Matti Picus, Ralf Gommers, Chris Sidebottom :Status: Draft :Type: Standards Trac

[Numpy-discussion] updated 2.0-dev nightlies, including macOS Accelerate wheels

2023-12-22 Thread Ralf Gommers
Hi all, We had some issues with nightlies, the macOS, Linux aarch64 and PyPy ones were about a month out of date. That is fixed now, new nightlies for all supported platforms are up on https://anaconda.org/scientific-python-nightly-wheels/numpy. Note that a lot changed in `main` over the last

[Numpy-discussion] Re: Telling meson build which CBLAS/LAPACK (LAPACKE?) to use via pkgconfig module

2023-12-06 Thread Ralf Gommers
On Wed, Dec 6, 2023 at 1:32 AM Dr. Thomas Orgis wrote: > Am Sun, 3 Dec 2023 19:54:10 +0100 > schrieb "Dr. Thomas Orgis" : > > > > You have to go through a "build frontend" to produce a wheel, which > then > > > gets installed/repackaged for your distro. > > > > This is obviously happening in

[Numpy-discussion] Re: Telling meson build which CBLAS/LAPACK (LAPACKE?) to use via pkgconfig module

2023-11-27 Thread Ralf Gommers
On Mon, Nov 27, 2023 at 6:51 PM Dr. Thomas Orgis < thomas.or...@uni-hamburg.de> wrote: > Am Mon, 27 Nov 2023 14:58:45 +0100 > schrieb Ralf Gommers : > > > The NumPy build does not know anything about this. It will just build, > and > > it will simply call the Open

[Numpy-discussion] Re: Telling meson build which CBLAS/LAPACK (LAPACKE?) to use via pkgconfig module

2023-11-27 Thread Ralf Gommers
On Mon, Nov 27, 2023 at 2:10 PM Dr. Thomas Orgis < thomas.or...@uni-hamburg.de> wrote: > Hi, > > I'm involved in packaging NumPy for http://pkgsrc.org/. We install a > set of possible BLAS/CBLAS/LAPACK/LAPACKE packages side-by-side in the > same prefix. This includes multiple variants of OpenBLAS

[Numpy-discussion] Re: Meson - C extension - Finding numpy includes in virtual env

2023-11-27 Thread Ralf Gommers
On Sun, Nov 26, 2023 at 9:06 PM Nathan wrote: > I want to caution about using `pip install -e .` to get a development > install of numpy. This will work fine working on numpy itself, but won’t be > useful if you need to use the development version of numpy to build another > library. This

[Numpy-discussion] Re: Assessment of the difficulty in porting CPU architecture for numpy

2023-11-17 Thread Ralf Gommers
Hi Xuanbao, On Thu, Nov 16, 2023 at 2:59 PM xuanbao via NumPy-Discussion < numpy-discussion@python.org> wrote: > Hello everyone! I am working on implementing a tool to assess the > complexity of CPU architecture porting. It primarily focuses on RISC-V > architecture porting. In fact, the tool

[Numpy-discussion] Re: NEP 55 - Add a UTF-8 Variable-Width String DType to NumPy

2023-09-20 Thread Ralf Gommers
On Wed, Sep 20, 2023 at 8:26 AM Warren Weckesser wrote: > > > On Fri, Sep 15, 2023 at 3:18 PM Warren Weckesser < > warren.weckes...@gmail.com> wrote: > > > > > > > > On Mon, Sep 11, 2023 at 12:25 PM Nathan > wrote: > >> > >> > >> > >> On Sun, Sep 3, 2023 at 10:54 AM Warren Weckesser < >

[Numpy-discussion] Re: Proposal to accept NEP 52 (Python API cleanup for 2.0)

2023-09-15 Thread Ralf Gommers
k. That is explained in the PR that updates the NEP (https://github.com/numpy/numpy/pull/24620). Cheers, Ralf > On 15 Sep 2023, at 21:12, Ralf Gommers wrote: > > Hi all, > > A lot of work has been happening to implement NEP 52 ( > https://numpy.org/neps/nep-0052-python-api-c

[Numpy-discussion] Proposal to accept NEP 52 (Python API cleanup for 2.0)

2023-09-15 Thread Ralf Gommers
Hi all, A lot of work has been happening to implement NEP 52 ( https://numpy.org/neps/nep-0052-python-api-cleanup.html) over the past 1.5 months - mostly work by Mateusz Sokol, and review effort of Sebastian, Nathan and myself. The majority of API changes have been made. There's more to do of

[Numpy-discussion] Re: [SciPy-Dev] Re: NumPy 1.26.0rc1 released

2023-09-07 Thread Ralf Gommers
is >> release. The changelog doesn't capture the full extent of the work, special >> thanks to Ralf Gommers, Sayed Adel, Stéfan van der Walt, and Matti Picus >> who did much of the work in the main development branch. >> >> > Thanks for doing the release Chuck! >

[Numpy-discussion] Re: reminder: put an upper bound on setuptools if you use numpy.distutils!

2023-08-31 Thread Ralf Gommers
On Thu, Aug 31, 2023 at 6:39 PM Kevin Sheppard wrote: > > > On Sun, Aug 21, 2022 at 6:36 PM Ralf Gommers > wrote: > >> Hi all, >> >> After setuptools 65.0 was released a few days ago, all users of >> numpy.distutils had their builds broken. This is alread

[Numpy-discussion] Re: NEP 55 - Add a UTF-8 Variable-Width String DType to NumPy

2023-08-30 Thread Ralf Gommers
On Tue, Aug 29, 2023 at 4:08 PM Nathan wrote: > The NEP was merged in draft form, see below. > > https://numpy.org/neps/nep-0055-string_dtype.html > This is a really nice NEP, thanks Nathan! I see that questions and constructive feedback is still coming in on GitHub, but for now it seems like

[Numpy-discussion] welcome Andrew Nelson to the NumPy maintainers team

2023-08-21 Thread Ralf Gommers
Hi all, On behalf of the steering council, I am very happy to announce that Andrew is joining the Maintainers team. Andrew has been contributing to our CI setup in particular for the past year, and has contributed for example the Cirrus CI setup and the musllinux builds:

[Numpy-discussion] Re: Add to NumPy a function to compute cumulative sums from 0.

2023-08-18 Thread Ralf Gommers
On Fri, Aug 18, 2023 at 10:59 AM Ronald van Elburg < r.a.j.van.elb...@hetnet.nl> wrote: > I was trying to get a feel for how often the work around occurs. I found > three clear examples in Scipy and one unclear case. One case in holoviews. > Two in numpy. One from soundappraisal's code base. >

[Numpy-discussion] Re: Cirrus testing

2023-08-16 Thread Ralf Gommers
On Wed, Aug 16, 2023 at 5:01 AM Andrew Nelson wrote: > > On Wed, 16 Aug 2023 at 10:51, Andrew Nelson wrote: > >> There's a scipy issue on this that discusses how to reduce usage, >> https://github.com/scipy/scipy/issues/19006. >> >> Main points: >> >> - at the moment CI is run on PR and on

[Numpy-discussion] Re: Cirrus testing

2023-08-15 Thread Ralf Gommers
On Tue, Aug 15, 2023 at 4:19 PM Charles R Harris wrote: > Hi All, > > This is a heads up that we have already exceeded our allotment of free > time on Cirrus CI. They are giving us a pass this month, but next month > they will start enforcing the limits. That will impact both our testing and >

[Numpy-discussion] Re: Test failures m1 OSX with apple clang

2023-08-14 Thread Ralf Gommers
On Mon, Aug 14, 2023 at 1:16 PM Doug Turnbull wrote: > Hey all > > First time trying to build / test numpy main branch, so I'm probably doing > something wrong. > > I brought down main and everything built on the first try. However I'm > getting test failures related to meson. > > Specifically

[Numpy-discussion] update on build system changes in NumPy's main branch

2023-08-11 Thread Ralf Gommers
Hey all, We've landed some major changes in `main` this week, so I thought it's a good idea to keep everyone in the loop. First the good news: we now have full SIMD support in the Meson builds on `main`! This was a huge amount of work by Sayed, so I'd like to say thank you to him for doing all

[Numpy-discussion] Re: xp.asarray semantics

2023-08-07 Thread Ralf Gommers
On Mon, Aug 7, 2023 at 1:40 AM Andrew Nelson wrote: > The array-api documentation ( > https://data-apis.org/array-api/latest/API_specification/generated/array_api.asarray.html#array_api.asarray) > for `asarray` has a copy keyword, the numpy version doesn't. Is there a > plan to add such a

[Numpy-discussion] Re: The 1.26.x maintenance branch has been created.

2023-07-31 Thread Ralf Gommers
On Mon, Jul 31, 2023 at 6:53 PM Charles R Harris wrote: > Hi All, > > The 1.26.x maintenance branch has been created. The 1.26.x branch is a > continuation of the 1.25.x branch and serves to mark the change from our > distutils based builds to the meson builds needed to support the upcoming >

[Numpy-discussion] preparing downstream code for NumPy 2.0 & API deprecations/removals

2023-07-31 Thread Ralf Gommers
Hi all, This email is about two 2.0 release related topics: 1. Advice/guidance for downstream library authors and end users 2. Strategy for development work around public API changes that will be breaking backwards compatibility. I also just created https://github.com/numpy/numpy/issues/24300 as

[Numpy-discussion] Re: Time to start NumPy 1.26 development?

2023-07-15 Thread Ralf Gommers
On Fri, Jul 14, 2023 at 10:59 PM Charles R Harris wrote: > Hi All, > > We plan to release NumPy 1.26 soon after the release of the Python > 3.12.0rc1 release, which is currently scheduled for July 31, just a bit > more than two weeks off. What I'd like to do is > Thanks for getting the ball

[Numpy-discussion] Re: Is there a desire to implement more functions as ufuncs? e.g. round, astype, real

2023-07-13 Thread Ralf Gommers
On Tue, Jul 11, 2023 at 2:38 PM James Webber wrote: > Hello there! First time posting here and I apologize if this discussion is > not new. I couldn't find it in a search. > > I've been contributing a bit to the sparse project ( > https://github.com/pydata/sparse) and I was working on

[Numpy-discussion] Re: Moving busday functionality to numpy-financial

2023-06-28 Thread Ralf Gommers
On Mon, Jun 26, 2023 at 6:57 AM Kai Striega wrote: > Hi Stefan, > > I'm interested in going that direction, or rather, getting the functions > out of NumPy. I'm not sure if it's feasible to rip these functions out of > NumPy itself – or how much work it would require. Last week I spent some >

[Numpy-discussion] Re: mean_std function returning both mean and std

2023-06-02 Thread Ralf Gommers
On Fri, Jun 2, 2023 at 1:51 PM Ronald van Elburg wrote: > Aha, the unnecessary copy mentioned in the > https://dbs.ifi.uni-heidelberg.de/files/Team/eschubert/publications/SSDBM18-covariance-authorcopy.pdf. > paper is a copy of the input. Here it is about discarding a valuable output > (the mean)

[Numpy-discussion] Re: Precision changes to sin/cos in the next release?

2023-05-31 Thread Ralf Gommers
On Wed, May 31, 2023 at 4:19 PM Charles R Harris wrote: > > > On Wed, May 31, 2023 at 8:05 AM Robert Kern wrote: > >> I would much, much rather have the special functions in the `np.*` >> namespace be more accurate than fast on all platforms. These would not >> have been on my list for general

[Numpy-discussion] Re: Precision changes to sin/cos in the next release?

2023-05-31 Thread Ralf Gommers
On Wed, May 31, 2023 at 12:28 PM Chris Sidebottom wrote: > Matthew Brett wrote: > > Hi, > > On Wed, May 31, 2023 at 8:40 AM Matti Picus matti.pi...@gmail.com wrote: > > > On 31/5/23 09:33, Jerome Kieffer wrote: > > > Hi Sebastian, > > > I had a quick look at the PR and it looks like you

[Numpy-discussion] Re: Installing numpy on an "unsupported" platform

2023-05-23 Thread Ralf Gommers
On Tue, May 23, 2023 at 2:26 PM asyropoulos--- via NumPy-Discussion < numpy-discussion@python.org> wrote: > Hello, > > I am using Python 3.10.0 on OpenIndiana and yesterday I tried to install > numpy in my system. The command > > /opt/gnu/python/bin/python3.10 -m pip install --user numpy > >

[Numpy-discussion] NEP 52 - Python API cleanup for NumPy 2.0

2023-05-18 Thread Ralf Gommers
Hi all, Stéfan and I wrote a NEP about cleaning up the Python API for the NumPy 2.0 release. It was first presented at the NumPy 2.0 developer meeting last month, and more review comments came in on https://github.com/numpy/numpy/pull/23537. It seems about ready to propose for wider review here

[Numpy-discussion] Re: Consider linking to Accelerate in Apple Silicon ARM64 wheels

2023-05-09 Thread Ralf Gommers
ers". So you are still using the old version of the library if you did not do that. This is not entirely trivial to do now; I expect we'll see a PR to enable the new libraries quite soon. Cheers, Ralf > > Best, > Jerry > > > On Thu, Mar 23, 2023 at 3:52 AM Ralf Gommers > w

[Numpy-discussion] Re: NumPy 2.0 meeting - Monday, April 3rd, 3 - 7pm UTC

2023-03-30 Thread Ralf Gommers
Hi all, As part of this meeting we have reserved a 30 minute slot for lightning talks. Those can be for topics that are on our tentative roadmap already (see https://github.com/orgs/numpy/projects/9/views/1), or topics that you'd like to add to that roadmap and would like to drive and pitch to

[Numpy-discussion] Re: dropping support for Gitpod and our Docker image builds

2023-03-23 Thread Ralf Gommers
On Mon, Mar 20, 2023 at 9:09 PM Ralf Gommers wrote: > > So my proposal is to drop all the Docker Hub and Gitpod related code and > docs. I have already discussed this with Tania Allard, who did most of the > heavy lifting on the initial creation of the Gitpod machinery (for Sc

[Numpy-discussion] Re: Consider linking to Accelerate in Apple Silicon ARM64 wheels

2023-03-23 Thread Ralf Gommers
On Thu, Mar 23, 2023 at 10:43 AM Clemens Brunner wrote: > Thanks Ralf, this sounds great! Just making sure I understand, this means > that for macOS 13, we have to enable Accelerate by building NumPy from > source. Indeed. Either that, or use a packaging system that's more capable in this

[Numpy-discussion] Re: Consider linking to Accelerate in Apple Silicon ARM64 wheels

2023-03-23 Thread Ralf Gommers
On Thu, Mar 23, 2023 at 1:55 AM Clemens Brunner wrote: > Hello! > > I recently got a new MacBook Pro with an M2 Pro CPU (ARM64). When I ran > some numerical computations (ICA to be precise), I was surprised how slow > it was - way slower than e.g. my almost 10 year old Intel Mac. It turns out >

[Numpy-discussion] Re: dropping support for Gitpod and our Docker image builds

2023-03-21 Thread Ralf Gommers
On Tue, Mar 21, 2023 at 12:20 PM Klaus Zimmermann wrote: > Hi, > > this sounds all reasonable to me, and as mostly a lurker on this list my > input shouldn't carry too much weight anyway. > > I wanted to point out one thing: Docker does continue to offer free > access for Open Source projects,

[Numpy-discussion] dropping support for Gitpod and our Docker image builds

2023-03-20 Thread Ralf Gommers
Hi all, We received a notification from Docker that there Free Team organization no longer exists, and that we have until April 14 to upgrade to a paid tier. We only use Docker to support Gitpod. Gitpod builds have been broken in main for quite a while (see

[Numpy-discussion] Re: `dtype` parameter in `clip` method

2023-03-17 Thread Ralf Gommers
On Thu, Mar 16, 2023 at 7:57 PM Sergio Callegari wrote: > I am trying to use the `clip` method to transform floats to integers with > clipping. I was expecting to be able to do both the clipping and the type > conversion at once, passing the `dtype` parameter to `clip`, together with > a

[Numpy-discussion] Re: removing NUMPY_EXPERIMENTAL_ARRAY_FUNCTION env var

2023-03-12 Thread Ralf Gommers
e as well. > > Von meinem iPhone gesendet > > Am 10.03.2023 um 19:10 schrieb Stephan Hoyer : > >  > +1 for removing this environment variable. It was never intended to stick > around this long. > > On Fri, Mar 10, 2023 at 6:48 AM Ralf Gommers > wrote: > >&

[Numpy-discussion] removing NUMPY_EXPERIMENTAL_ARRAY_FUNCTION env var

2023-03-10 Thread Ralf Gommers
Hi all, In https://github.com/numpy/numpy/pull/23364 we touched on the NUMPY_EXPERIMENTAL_ARRAY_FUNCTION environment variable. This was a temporary feature during the introduction of `__array_function__` (see NEP 18), but we never removed it. I propose we do so now, since it is cumbersome to have

[Numpy-discussion] Re: deprecation of product, cumproduct, alltrue, sometrue functions

2023-03-09 Thread Ralf Gommers
On Tue, Mar 7, 2023 at 1:02 PM Sebastian Berg wrote: > On Tue, 2023-03-07 at 12:17 +0000, Ralf Gommers wrote: > > On Mon, Mar 6, 2023 at 8:12 AM Sebastian Berg < > > sebast...@sipsolutions.net> > > wrote: > > > > > On Thu, 2023-03-02 at 15:20

[Numpy-discussion] Re: deprecation of product, cumproduct, alltrue, sometrue functions

2023-03-07 Thread Ralf Gommers
On Mon, Mar 6, 2023 at 8:12 AM Sebastian Berg wrote: > On Thu, 2023-03-02 at 15:20 +0000, Ralf Gommers wrote: > > Hi all, > > > > In https://github.com/numpy/numpy/pull/23314 I am deprecating four > > functions: `product`, `cumproduct`, `alltrue`, `sometrue`. Th

[Numpy-discussion] deprecation of product, cumproduct, alltrue, sometrue functions

2023-03-02 Thread Ralf Gommers
Hi all, In https://github.com/numpy/numpy/pull/23314 I am deprecating four functions: `product`, `cumproduct`, `alltrue`, `sometrue`. These are all aliases (for `prod`, `cumprod`, `all` and `any`), were already not part of the API docs, and there was an open issue for deprecating them (

[Numpy-discussion] Re: Introducing `np.types`

2023-02-15 Thread Ralf Gommers
On Tue, Feb 14, 2023 at 9:08 PM Stefan van der Walt wrote: > On Tue, Feb 14, 2023, at 12:27, Ralf Gommers wrote: > > Okay, as long as we keep in mind that it should contain all these > not-for-main-namespace functions/classes, it seems fine with me. We can > live with two nam

[Numpy-discussion] Re: Introducing `np.types`

2023-02-14 Thread Ralf Gommers
On Mon, Feb 13, 2023 at 11:33 AM Sebastian Berg wrote: > On Sat, 2023-02-11 at 11:24 +0000, Ralf Gommers wrote: > > On Fri, Feb 10, 2023 at 5:35 PM Nathan > > wrote: > > > > > > > > > > > > > > Small bikeshed: the name np.type

[Numpy-discussion] Re: Introducing `np.types`

2023-02-11 Thread Ralf Gommers
On Fri, Feb 10, 2023 at 5:35 PM Nathan wrote: > > > On Fri, Feb 10, 2023 at 3:31 AM Sebastian Berg > wrote: > >> Hi all, >> >> I was wondering if we should introduce a new `np.types` namespace. The >> main reason is that we have the DType classes, that most users don't >> need to worry about.

[Numpy-discussion] Re: Test suite for duck arrays

2023-01-16 Thread Ralf Gommers
On Mon, Jan 16, 2023 at 3:28 PM Mark Harfouche wrote: > I am trying to create a few different duck arrays that are backed by > different files. > > Is there a standard test suite that we can inspire ourselves from that > helps us assert: > > "Arrays should implement all these different functions

[Numpy-discussion] Re: Road to NumPy 2.0

2023-01-15 Thread Ralf Gommers
but hopefully not most as one needs to use >smaller than default precision types to be affected. > > <#m_-4971028583323681657_A-thorough-cleanup-of-the-Python-API>A thorough > cleanup of the Python API > The NumPy API is quite messy, with many functions an

[Numpy-discussion] Re: Looking for ideas for a Small Development Grant

2022-12-26 Thread Ralf Gommers
On Sun, Dec 25, 2022 at 12:20 AM wrote: > Hello, > > I hope this is the right forum on which to post this, but if not please > let me know. > > I'll be starting a PhD program in mathematics in the fall, and I'm looking > for something to occupy part of my time until then. > > I've been

[Numpy-discussion] Re: CI: testing of musllinux

2022-12-21 Thread Ralf Gommers
On Wed, Dec 21, 2022 at 12:04 PM Andrew Nelson wrote: > On Wed, 21 Dec 2022 at 20:40, Matti Picus wrote: > >> Maybe we should have a scientific-python wide discussion of what >> platforms we wish to support, like NEP 29 for python versions. The NEP >> should include some mechanism for adding

[Numpy-discussion] Re: Addition of useful new functions from the array API specification

2022-12-13 Thread Ralf Gommers
On Mon, Dec 12, 2022 at 4:44 PM Sebastian Berg wrote: > On Wed, 2022-12-07 at 14:21 -0700, Aaron Meurer wrote: > > Hi all. > > > > As discussed in today's community meeting, I plan to start working on > > adding some useful functions to NumPy which are part of the array API > > standard

[Numpy-discussion] Re: Addition of useful new functions from the array API specification

2022-12-08 Thread Ralf Gommers
On Wed, Dec 7, 2022 at 11:51 PM Ilhan Polat wrote: > > On matrix_transpose() : > Every time this discussion brought up, there was a huge resistance to add > more methods to array object or new functions (I have been involved in some > of them on the pro .H side, links you have given and more in

[Numpy-discussion] Re: Adding bit_count ufunc

2022-12-04 Thread Ralf Gommers
beginner/average user, it will have few users right now, and as long as the correspondence is mentioned in the docstring this should be discoverable enough. I'd much prefer no alias, we already have way too many of those and most of them are only noise at this point. Cheers, Ralf > Thanks, > Ganesh

[Numpy-discussion] ANN: NumPy Fellowship Program & Sayed Adel as our first Developer in Residence

2022-12-01 Thread Ralf Gommers
Hi all, I'm excited to be able to share this announcement on behalf of the NumPy Steering Council. We have created a new program, the NumPy Fellowship Program, and offered Sayed Adel the very first Developer in Residence role. Sayed starts his 1 year tenure in that role today, and we are really

[Numpy-discussion] Re: Adding bit_count ufunc

2022-11-30 Thread Ralf Gommers
On Fri, Nov 25, 2022 at 9:55 PM Serge Guelton wrote: > On Fri, Nov 25, 2022 at 08:09:02PM +0100, Sebastian Berg wrote: > > Thanks for bringing this up again. The Python method exists and it > > seems like relatively basic functionality. > > > > Overall, I am slightly in favor of adding the

[Numpy-discussion] Re: Expanding support in testing for external collections.Sequence objects

2022-11-30 Thread Ralf Gommers
On Wed, Nov 30, 2022 at 7:10 PM Marko Pacak wrote: > Hi Ralf, thx for replying to this. > > > I'd prefer to tell users to use `np.asarray()` on their inputs instead. > > How would you do that? Through a warning in the test suite? Or document it > somewhere? > The docstring for array_equal

[Numpy-discussion] Re: Expanding support in testing for external collections.Sequence objects

2022-11-30 Thread Ralf Gommers
On Wed, Nov 30, 2022 at 10:24 AM Matti Picus wrote: > > On 30/11/22 05:47, Stefan van der Walt wrote: > > On Tue, Nov 29, 2022, at 07:21, i...@markopacak.com wrote: > >> The debate is whether np.testing.asset_equal should support > >> collections.Sequence objects. > > assert list(sequence1) ==

[Numpy-discussion] status of long double support and what to do about it

2022-11-17 Thread Ralf Gommers
Hi all, We have to do something about long double support. This is something I wanted to propose a long time ago already, and moving build systems has resurfaced the pain yet again. This is not a full proposal yet, but the start of a discussion and gradual plan of attack. The problem

[Numpy-discussion] Re: Create `np.exceptions` for new exceptions in NumPy?

2022-11-12 Thread Ralf Gommers
On Fri, Nov 11, 2022 at 2:47 PM Sebastian Berg wrote: > Hi all, > > I want to add a new exception or two. It is a longer story, that you > can find at the bottom :). > > Lets create a namespace for custom errors! I don't want to propose new > exceptions that just get dumped in to the main

[Numpy-discussion] Re: plan for moving to Meson

2022-11-11 Thread Ralf Gommers
On Fri, Nov 11, 2022 at 10:07 PM Stefan van der Walt wrote: > On Fri, Nov 11, 2022, at 06:03, Evgeni Burovski wrote: > > before: any thoughts to change it to e.g. tempita templating? > > With the "e.g." maybe being jinja2. tempita works well, but hasn't been > worked on since 2013. > It

[Numpy-discussion] Re: plan for moving to Meson

2022-11-11 Thread Ralf Gommers
On Fri, Nov 11, 2022 at 1:52 PM Sebastian Berg wrote: > On Fri, 2022-11-11 at 12:27 +0100, Ralf Gommers wrote: > > Hi all, > > > > With distutils now removed from the stdlib in the Python 3.12 release > > cycle, the clock is ticking a bit for dealing with our

[Numpy-discussion] plan for moving to Meson

2022-11-11 Thread Ralf Gommers
Hi all, With distutils now removed from the stdlib in the Python 3.12 release cycle, the clock is ticking a bit for dealing with our build system situation. With SciPy's move to Meson now basically complete - there are always loose ends & improvements, but the 1.9 releases have gone well - it's

[Numpy-discussion] Re: How does Numpy build system detect the change of .c source file?

2022-11-02 Thread Ralf Gommers
On Wed, Nov 2, 2022 at 9:30 AM 腾刘 <27rabbi...@gmail.com> wrote: > Hi everyone! I 'm here again. > > Recently I 'm trying to understand the C code with output-debug method, > inserting many print statements. I was doing well with it until one day: I > changed a file called loops_utils.h.src

[Numpy-discussion] Re: NEP 51: Changing the Representation of NumPy Scalars

2022-10-28 Thread Ralf Gommers
On Fri, Oct 28, 2022 at 10:57 AM Sebastian Berg wrote: > Hi all, > > As mentioned earlier, I would like to propose changing the > representation of scalars in NumPy. Discussion and ideas on changes > are much appreciated! > > The main change is to show scalars as: > > * `np.float64(3.0)`

  1   2   3   4   5   6   7   >