Re: [Numpy-discussion] Numpy 1.9 release date

2013-11-10 Thread Ralf Gommers
On Fri, Nov 8, 2013 at 8:22 PM, Charles R Harris
charlesr.har...@gmail.comwrote:

 Hi All,

 The question has come up as to how much effort we should spend backporting
 fixes to 1.8.x. An alternative would be to tag 1.9.0 early next year,
 aiming for a release around April. I think there is almost enough in
 1.9-devel to justify a release. There is Sebastian's index work, Julian's
 continuing work on speedups, the removal of oldnumeric and numarray
 support, and various other deprecations and cleanups that add up to a
 significant number of changes. I've tended to think of 1.9 as a cleanup and
 consolidation release


Makes sense.


 and think that the main thing missing at this point is fixing the datetime
 problems.


Is anyone planning to work on this? If yes, you need a rough estimate of
when this is ready to go. If no, it needs to be decided if this is critical
for the release. From the previous discussion I tend to think so. If it's
critical but no one does it, why plan a release...

A suggestion for backporting strategy: do not backport things that have
just been merged. Because (a) doing it PR by PR gives a lot of overhead,
and (b) if the commit causes issues that have to be fixed or reverted, you
have to fix things twice. Instead, just keep a list of backport candidates
in a github issue, then do it all at once when it's clear that a bugfix
release is needed.

Ralf
___
NumPy-Discussion mailing list
NumPy-Discussion@scipy.org
http://mail.scipy.org/mailman/listinfo/numpy-discussion


Re: [Numpy-discussion] ANN: NumPy 1.7.2rc1 release

2013-11-10 Thread Ralf Gommers
On Wed, Nov 6, 2013 at 6:41 AM, Orion Poplawski or...@cora.nwra.com wrote:

 On 11/3/2013 9:42 AM, Julian Taylor wrote:
  Hi all,
 
  I'm happy to announce the release candidate of Numpy 1.7.2.
  This is a bugfix only release supporting Python 2.4 - 2.7 and 3.1 - 3.3.
 
  More than 37 issues were fixed, the most important issues are listed in
  the release notes:
 
 https://github.com/numpy/numpy/blob/v1.7.2rc1/doc/release/1.7.2-notes.rst
 
  It is supposed to not break any existing code, so please test the
  releases and report any issues you find.

 Builds and tests okay on Fedora 20.


Tested scipy and statsmodels master with Python 2.7 on Ubuntu 13.10, all OK.

Cheers,
Ralf
___
NumPy-Discussion mailing list
NumPy-Discussion@scipy.org
http://mail.scipy.org/mailman/listinfo/numpy-discussion


Re: [Numpy-discussion] Numpy 1.9 release date

2013-11-10 Thread Dave Hirschfeld
Ralf Gommers ralf.gommers at gmail.com writes:

 

 On Fri, Nov 8, 2013 at 8:22 PM, Charles R Harris charlesr.harris at 
gmail.com wrote:
 
 
 and think that the main thing missing at this point is fixing the datetime 
problems.
 
 
 Is anyone planning to work on this? If yes, you need a rough estimate of 
when this is ready to go. If no, it needs to be decided if this is critical 
for the release. From the previous discussion I tend to think so. If it's 
critical but no one does it, why plan a release... 
 
 
 Ralf
 

Just want to pipe up here as to the criticality of datetime bug.

Below is a minimal example from some data analysis code I found in our 
company that was giving incorrect results (fortunately it was caught by 
thorough testing):

In [110]: records = [
 ...:  ('2014-03-29 23:00:00', '2014-03-29 23:00:00'),
 ...:  ('2014-03-30 00:00:00', '2014-03-30 00:00:00'),
 ...:  ('2014-03-30 01:00:00', '2014-03-30 01:00:00'),
 ...:  ('2014-03-30 02:00:00', '2014-03-30 02:00:00'),
 ...:  ('2014-03-30 03:00:00', '2014-03-30 03:00:00'),
 ...:  ('2014-10-25 23:00:00', '2014-10-25 23:00:00'),
 ...:  ('2014-10-26 00:00:00', '2014-10-26 00:00:00'),
 ...:  ('2014-10-26 01:00:00', '2014-10-26 01:00:00'),
 ...:  ('2014-10-26 02:00:00', '2014-10-26 02:00:00'),
 ...:  ('2014-10-26 03:00:00', '2014-10-26 03:00:00')]
 ...: 
 ...: 
 ...: data = np.asarray(records, dtype=[('date obj', 'M8[h]'), ('str 
repr', object)])
 ...: df = pd.DataFrame(data)

In [111]: df
Out[111]: 
 date obj str repr
0 2014-03-29 23:00:00  2014-03-29 23:00:00
1 2014-03-30 00:00:00  2014-03-30 00:00:00
2 2014-03-30 00:00:00  2014-03-30 01:00:00
3 2014-03-30 01:00:00  2014-03-30 02:00:00
4 2014-03-30 02:00:00  2014-03-30 03:00:00
5 2014-10-25 22:00:00  2014-10-25 23:00:00
6 2014-10-25 23:00:00  2014-10-26 00:00:00
7 2014-10-26 01:00:00  2014-10-26 01:00:00
8 2014-10-26 02:00:00  2014-10-26 02:00:00
9 2014-10-26 03:00:00  2014-10-26 03:00:00


Note the local timezone adjusted `date obj` including the duplicate value at 
the clock-change in March and the missing value at the clock-change in 
October. As you can imagine this could very easily lead to incorrect 
analysis.

If running this exact same code in the (Eastern) US you'd see the following 
results:
 date obj str repr
0 2014-03-30 03:00:00  2014-03-29 23:00:00
1 2014-03-30 04:00:00  2014-03-30 00:00:00
2 2014-03-30 05:00:00  2014-03-30 01:00:00
3 2014-03-30 06:00:00  2014-03-30 02:00:00
4 2014-03-30 07:00:00  2014-03-30 03:00:00
5 2014-10-26 03:00:00  2014-10-25 23:00:00
6 2014-10-26 04:00:00  2014-10-26 00:00:00
7 2014-10-26 05:00:00  2014-10-26 01:00:00
8 2014-10-26 06:00:00  2014-10-26 02:00:00
9 2014-10-26 07:00:00  2014-10-26 03:00:00


Unfortunately I don't have the skills to meaningfully contribute in this 
area but it is a very real problem for users of numpy, many of whom are not 
active on the mailing list.

HTH,
Dave


___
NumPy-Discussion mailing list
NumPy-Discussion@scipy.org
http://mail.scipy.org/mailman/listinfo/numpy-discussion


Re: [Numpy-discussion] ANN: NumPy 1.7.2rc1 release

2013-11-10 Thread Christoph Gohlke
On 11/10/2013 8:58 AM, Ralf Gommers wrote:



 On Wed, Nov 6, 2013 at 6:41 AM, Orion Poplawski or...@cora.nwra.com
 mailto:or...@cora.nwra.com wrote:

 On 11/3/2013 9:42 AM, Julian Taylor wrote:
  Hi all,
 
  I'm happy to announce the release candidate of Numpy 1.7.2.
  This is a bugfix only release supporting Python 2.4 - 2.7 and 3.1 - 3.3.
 
  More than 37 issues were fixed, the most important issues are listed in
  the release notes:
 https://github.com/numpy/numpy/blob/v1.7.2rc1/doc/release/1.7.2-notes.rst
 
  It is supposed to not break any existing code, so please test the
  releases and report any issues you find.

 Builds and tests okay on Fedora 20.


 Tested scipy and statsmodels master with Python 2.7 on Ubuntu 13.10, all OK.

 Cheers,
 Ralf


All OK on Windows with msvc9  10, MKL 11.1, Python 2.6-3.3, 32  64 bit.

Christoph
___
NumPy-Discussion mailing list
NumPy-Discussion@scipy.org
http://mail.scipy.org/mailman/listinfo/numpy-discussion


Re: [Numpy-discussion] ANN: NumPy 1.7.2rc1 release

2013-11-10 Thread Christian K.

Am 03.11.13 13:42, schrieb Julian Taylor:

Hi all,

I'm happy to announce the release candidate of Numpy 1.7.2.
This is a bugfix only release supporting Python 2.4 - 2.7 and 3.1 - 3.3.

More than 37 issues were fixed, the most important issues are listed in
the release notes:
https://github.com/numpy/numpy/blob/v1.7.2rc1/doc/release/1.7.2-notes.rst

It is supposed to not break any existing code, so please test the
releases and report any issues you find.

Source tarballs and release notes can be found at
https://sourceforge.net/projects/numpy/files/NumPy/1.7.2rc1/.
Currently only Windows installers are available. OS X installer will
follow soon.


On OSX compilation succeeds (with some errors though) but test() fails.

Attached is the full output.

Christian

Python 2.7.5 |Anaconda 1.6.1 (x86_64)| (default, Jun 28 2013, 22:20:13) 
[GCC 4.0.1 (Apple Inc. build 5493)] on darwin
Type help, copyright, credits or license for more information.
 import numpy
 numpy.__version__
'1.7.2rc1'
 numpy.test()
Running unit tests for numpy
NumPy version 1.7.2rc1
NumPy is installed in /Users/ck/anaconda/lib/python2.7/site-packages/numpy
Python version 2.7.5 |Anaconda 1.6.1 (x86_64)| (default, Jun 28 2013, 22:20:13) 
[GCC 4.0.1 (Apple Inc. build 5493)]
nose version 1.3.0

Re: [Numpy-discussion] ANN: NumPy 1.7.2rc1 release

2013-11-10 Thread Christian K.
Am 10.11.13 21:06, schrieb Christian K.:
 Am 03.11.13 13:42, schrieb Julian Taylor:
 Hi all,

 I'm happy to announce the release candidate of Numpy 1.7.2.
 This is a bugfix only release supporting Python 2.4 - 2.7 and 3.1 - 3.3.

 More than 37 issues were fixed, the most important issues are listed in
 the release notes:
 https://github.com/numpy/numpy/blob/v1.7.2rc1/doc/release/1.7.2-notes.rst

 It is supposed to not break any existing code, so please test the
 releases and report any issues you find.

 Source tarballs and release notes can be found at
 https://sourceforge.net/projects/numpy/files/NumPy/1.7.2rc1/.
 Currently only Windows installers are available. OS X installer will
 follow soon.

 On OSX compilation succeeds (with some errors though) but test() fails.

 Attached is the full output.

I just realised that setup.py picked up gcc 4.0. Anyway, after switching 
to 4.2 the tests still fail.

Christian



___
NumPy-Discussion mailing list
NumPy-Discussion@scipy.org
http://mail.scipy.org/mailman/listinfo/numpy-discussion


Re: [Numpy-discussion] ANN: NumPy 1.7.2rc1 release

2013-11-10 Thread Stéfan van der Walt
Hi Christian

On Sun, 10 Nov 2013 21:06:00 -0300, Christian K. wrote:
 On OSX compilation succeeds (with some errors though) but test() fails.

Do you have the build log available as well?

Thanks
Stéfan
___
NumPy-Discussion mailing list
NumPy-Discussion@scipy.org
http://mail.scipy.org/mailman/listinfo/numpy-discussion


Re: [Numpy-discussion] ANN: NumPy 1.7.2rc1 release

2013-11-10 Thread Charles R Harris
On Sun, Nov 10, 2013 at 5:12 PM, Christian K. ckk...@hoc.net wrote:

 Am 10.11.13 21:06, schrieb Christian K.:
  Am 03.11.13 13:42, schrieb Julian Taylor:
  Hi all,
 
  I'm happy to announce the release candidate of Numpy 1.7.2.
  This is a bugfix only release supporting Python 2.4 - 2.7 and 3.1 - 3.3.
 
  More than 37 issues were fixed, the most important issues are listed in
  the release notes:
 
 https://github.com/numpy/numpy/blob/v1.7.2rc1/doc/release/1.7.2-notes.rst
 
  It is supposed to not break any existing code, so please test the
  releases and report any issues you find.
 
  Source tarballs and release notes can be found at
  https://sourceforge.net/projects/numpy/files/NumPy/1.7.2rc1/.
  Currently only Windows installers are available. OS X installer will
  follow soon.
 
  On OSX compilation succeeds (with some errors though) but test() fails.
 
  Attached is the full output.

 I just realised that setup.py picked up gcc 4.0. Anyway, after switching
 to 4.2 the tests still fail.


Looks like your tests might be left over from 1.8. Try cleaning out the
install and build directories and doing a clean install.

Chuck
___
NumPy-Discussion mailing list
NumPy-Discussion@scipy.org
http://mail.scipy.org/mailman/listinfo/numpy-discussion


Re: [Numpy-discussion] Numpy 1.9 release date

2013-11-10 Thread Stéfan van der Walt
On 9 Nov 2013 03:22, Charles R Harris charlesr.har...@gmail.com wrote:

 that the main thing missing at this point is fixing the datetime problems.

What needs to be done, and what is the plan forward? Is there perhaps an
issue one can follow?

Thanks
Stéfan
___
NumPy-Discussion mailing list
NumPy-Discussion@scipy.org
http://mail.scipy.org/mailman/listinfo/numpy-discussion