Re: [Pytables-users] ANN: numexpr 2.1 RC1 available!

2013-04-27 Thread Antonio Valentino
Hi Francesc,

Il 26/04/2013 14:11, Francesc Alted ha scritto:
 Hi Antonio,

 Al 26/04/13 08:46, En/na Antonio Valentino ha escrit:
 Hi Francesc,

 Il 25/04/2013 23:06, Francesc Alted ha scritto:
 Thanks.  Will do!
 Thanks.
 For the record patches 0002 and 0003 close issue [75] and [77].
 Also numexpr 2.1 closes [91] and [95]


 [75] https://code.google.com/p/numexpr/issues/detail?id=75
 [77] https://code.google.com/p/numexpr/issues/detail?id=77
 [91] https://code.google.com/p/numexpr/issues/detail?id=91
 [95] https://code.google.com/p/numexpr/issues/detail?id=95

 Just released a new version (2.1 RC3) addressing all of this. Please
 check it out and tell me how it goes.

 Thanks,
 Francesc


It seems to be all OK for me and with the patch provided by Anthiny now 
PyTables is 100% compatible with numexpr 2.1rc3.

Ubuntu users can find packages for numexpr 2.1rc3 (both for python 2 and 
pyhton 3) at [1].


[1] https://launchpad.net/~a.valentino/+archive/eotools


thanks again

-- 
Antonio Valentino

--
Try New Relic Now  We'll Send You this Cool Shirt
New Relic is the only SaaS-based application performance monitoring service 
that delivers powerful full stack analytics. Optimize and monitor your
browser, app,  servers with just a few lines of code. Try New Relic
and get this awesome Nerd Life shirt! http://p.sf.net/sfu/newrelic_d2d_apr
___
Pytables-users mailing list
Pytables-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/pytables-users


[Pytables-users] ANN: PyTables 3.0 beta1

2013-04-27 Thread Antonio Valentino
=
  Announcing PyTables 3.0.0b1
=

We are happy to announce PyTables 3.0.0b1.

PyTables 3.0.0b1 comes after about 5 years from the last major release
(2.0) and 7 months since the last stable release (2.4.0).

This is new major release and an important milestone for the PyTables 
project since it provides the long waited support for Python 3.x that is 
being around for already 4 years now.

Almost all the main numeric/scientific packages for python already 
support Python 3 so we are very happy that now also PyTables can provide 
this important feature.


What's new
==

A short summary of main new features:

- Since this release PyTables provides full support to Python 3
- The entire code base is now more compliant with coding style
   guidelines describe in the PEP8.
- Basic support for HDF5 drivers.  Now it is possible to open/create an
   HDF5 file using one of the SEC2, DIRECT, LOG, WINDOWS, STDIO or CORE
   drivers.
- Basic support for in-memory image files.  An HDF5 file can be set
   from or copied into a memory buffer.
- Implemented methods to get/set the user block size in a HDF5 file.
- All read methods now have an optional *out* argument that allows to
   pass a pre-allocated array to store data.
- Added support for the floating point data types with extended
   precision (Float96, Float128, Complex192 and Complex256).

Please refer to the RELEASE_NOTES document for a more detailed list of
changes in this release.

As always, a large amount of bugs have been addressed and squashed as well.

In case you want to know more in detail what has changed in this
version, please refer to:
http://pytables.github.io/release_notes.html

You can download a source package with generated PDF and HTML docs, as
well as binaries for Windows, from:
http://sourceforge.net/projects/pytables/files/pytables/3.0.0b1

For an online version of the manual, visit:
http://pytables.github.io/usersguide/index.html


What it is?
===

PyTables is a library for managing hierarchical datasets and
designed to efficiently cope with extremely large amounts of data with
support for full 64-bit file addressing.  PyTables runs on top of
the HDF5 library and NumPy package for achieving maximum throughput and
convenient use.  PyTables includes OPSI, a new indexing technology,
allowing to perform data lookups in tables exceeding 10 gigarows
(10**10 rows) in less than a tenth of a second.


Resources
=

About PyTables: http://www.pytables.org

About the HDF5 library: http://hdfgroup.org/HDF5/

About NumPy: http://numpy.scipy.org/


Acknowledgments
===

Thanks to many users who provided feature improvements, patches, bug
reports, support and suggestions.  See the ``THANKS`` file in the
distribution package for a (incomplete) list of contributors.  Most
specially, a lot of kudos go to the HDF5 and NumPy makers.
Without them, PyTables simply would not exist.


Share your experience
=

Let us know of any bugs, suggestions, gripes, kudos, etc. you may
have.




   **Enjoy data!**


--
The PyTables Team

--
Try New Relic Now  We'll Send You this Cool Shirt
New Relic is the only SaaS-based application performance monitoring service 
that delivers powerful full stack analytics. Optimize and monitor your
browser, app,  servers with just a few lines of code. Try New Relic
and get this awesome Nerd Life shirt! http://p.sf.net/sfu/newrelic_d2d_apr
___
Pytables-users mailing list
Pytables-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/pytables-users


Re: [Pytables-users] ANN: PyTables 3.0 beta1

2013-04-27 Thread Anthony Scopatz
Whoo hoo!  Thanks for all of your hard work Antonio!

PyTables users, we'd really appreciate it if you could try out this beta
release, run the test suite:

$ python -c import tables as tb; tb.test()

And let us know if there are any issues.  Additionally, if you are feeling
brave, any help you can give closing out the last remaining issues [1]
would be great!

Be Well
Anthony

1. https://github.com/PyTables/PyTables/issues?milestone=4state=open


On Sat, Apr 27, 2013 at 6:51 AM, Antonio Valentino 
antonio.valent...@tiscali.it wrote:

 =
   Announcing PyTables 3.0.0b1
 =

 We are happy to announce PyTables 3.0.0b1.

 PyTables 3.0.0b1 comes after about 5 years from the last major release
 (2.0) and 7 months since the last stable release (2.4.0).

 This is new major release and an important milestone for the PyTables
 project since it provides the long waited support for Python 3.x that is
 being around for already 4 years now.

 Almost all the main numeric/scientific packages for python already
 support Python 3 so we are very happy that now also PyTables can provide
 this important feature.


 What's new
 ==

 A short summary of main new features:

 - Since this release PyTables provides full support to Python 3
 - The entire code base is now more compliant with coding style
guidelines describe in the PEP8.
 - Basic support for HDF5 drivers.  Now it is possible to open/create an
HDF5 file using one of the SEC2, DIRECT, LOG, WINDOWS, STDIO or CORE
drivers.
 - Basic support for in-memory image files.  An HDF5 file can be set
from or copied into a memory buffer.
 - Implemented methods to get/set the user block size in a HDF5 file.
 - All read methods now have an optional *out* argument that allows to
pass a pre-allocated array to store data.
 - Added support for the floating point data types with extended
precision (Float96, Float128, Complex192 and Complex256).

 Please refer to the RELEASE_NOTES document for a more detailed list of
 changes in this release.

 As always, a large amount of bugs have been addressed and squashed as well.

 In case you want to know more in detail what has changed in this
 version, please refer to:
 http://pytables.github.io/release_notes.html

 You can download a source package with generated PDF and HTML docs, as
 well as binaries for Windows, from:
 http://sourceforge.net/projects/pytables/files/pytables/3.0.0b1

 For an online version of the manual, visit:
 http://pytables.github.io/usersguide/index.html


 What it is?
 ===

 PyTables is a library for managing hierarchical datasets and
 designed to efficiently cope with extremely large amounts of data with
 support for full 64-bit file addressing.  PyTables runs on top of
 the HDF5 library and NumPy package for achieving maximum throughput and
 convenient use.  PyTables includes OPSI, a new indexing technology,
 allowing to perform data lookups in tables exceeding 10 gigarows
 (10**10 rows) in less than a tenth of a second.


 Resources
 =

 About PyTables: http://www.pytables.org

 About the HDF5 library: http://hdfgroup.org/HDF5/

 About NumPy: http://numpy.scipy.org/


 Acknowledgments
 ===

 Thanks to many users who provided feature improvements, patches, bug
 reports, support and suggestions.  See the ``THANKS`` file in the
 distribution package for a (incomplete) list of contributors.  Most
 specially, a lot of kudos go to the HDF5 and NumPy makers.
 Without them, PyTables simply would not exist.


 Share your experience
 =

 Let us know of any bugs, suggestions, gripes, kudos, etc. you may
 have.


 

**Enjoy data!**


 --
 The PyTables Team


 --
 Try New Relic Now  We'll Send You this Cool Shirt
 New Relic is the only SaaS-based application performance monitoring service
 that delivers powerful full stack analytics. Optimize and monitor your
 browser, app,  servers with just a few lines of code. Try New Relic
 and get this awesome Nerd Life shirt! http://p.sf.net/sfu/newrelic_d2d_apr
 ___
 Pytables-users mailing list
 Pytables-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/pytables-users

--
Try New Relic Now  We'll Send You this Cool Shirt
New Relic is the only SaaS-based application performance monitoring service 
that delivers powerful full stack analytics. Optimize and monitor your
browser, app,  servers with just a few lines of code. Try New Relic
and get this awesome Nerd Life shirt! http://p.sf.net/sfu/newrelic_d2d_apr___
Pytables-users mailing list
Pytables-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/pytables-users


Re: [Pytables-users] ANN: numexpr 2.1 (Python 3 support is here!)

2013-04-27 Thread Anthony Scopatz
Congrats Francesc!


On Sat, Apr 27, 2013 at 5:07 AM, Francesc Alted fal...@gmail.com wrote:

 
   Announcing Numexpr 2.1
 

 Numexpr is a fast numerical expression evaluator for NumPy.  With it,
 expressions that operate on arrays (like 3*a+4*b) are accelerated
 and use less memory than doing the same calculation in Python.

 It wears multi-threaded capabilities, as well as support for Intel's
 VML library (included in Intel MKL), which allows an extremely fast
 evaluation of transcendental functions (sin, cos, tan, exp, log...)
 while squeezing the last drop of performance out of your multi-core
 processors.

 Its only dependency is NumPy (MKL is optional), so it works well as an
 easy-to-deploy, easy-to-use, computational kernel for projects that
 don't want to adopt other solutions that require more heavy
 dependencies.

 What's new
 ==

 The main feature of this version is that it adds a much needed
 **compatibility for Python 3**

 Many thanks to Antonio Valentino for his fine work on this.
 Also, Christoph Gohlke quickly provided feedback and binaries for
 Windows and Mark Wiebe and Gaƫtan de Menten provided many small
 (but important!) fixes and improvements.  All of you made numexpr 2.1
 the best release ever.  Thanks!

 In case you want to know more in detail what has changed in this
 version, see:

 http://code.google.com/p/numexpr/wiki/ReleaseNotes

 or have a look at RELEASE_NOTES.txt in the tarball.

 Where I can find Numexpr?
 =

 The project is hosted at Google code in:

 http://code.google.com/p/numexpr/

 You can get the packages from PyPI as well:

 http://pypi.python.org/pypi/numexpr

 Share your experience
 =

 Let us know of any bugs, suggestions, gripes, kudos, etc. you may
 have.


 Enjoy data!

 Francesc Alted



 --
 Try New Relic Now  We'll Send You this Cool Shirt
 New Relic is the only SaaS-based application performance monitoring service
 that delivers powerful full stack analytics. Optimize and monitor your
 browser, app,  servers with just a few lines of code. Try New Relic
 and get this awesome Nerd Life shirt! http://p.sf.net/sfu/newrelic_d2d_apr
 ___
 Pytables-users mailing list
 Pytables-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/pytables-users

--
Try New Relic Now  We'll Send You this Cool Shirt
New Relic is the only SaaS-based application performance monitoring service 
that delivers powerful full stack analytics. Optimize and monitor your
browser, app,  servers with just a few lines of code. Try New Relic
and get this awesome Nerd Life shirt! http://p.sf.net/sfu/newrelic_d2d_apr___
Pytables-users mailing list
Pytables-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/pytables-users


Re: [Pytables-users] ANN: PyTables 3.0 beta1

2013-04-27 Thread Andreas Hilboll
Am 27.04.2013 19:42, schrieb Anthony Scopatz:
 On Sat, Apr 27, 2013 at 12:35 PM, Andreas Hilboll li...@hilboll.de
 mailto:li...@hilboll.de wrote:
 
 Am 27.04.2013 19 tel:27.04.2013%2019:17, schrieb Anthony Scopatz:
  Whoo hoo!  Thanks for all of your hard work Antonio!
 
  PyTables users, we'd really appreciate it if you could try out
 this beta
  release, run the test suite:
 
  $ python -c import tables as tb; tb.test()
 
  And let us know if there are any issues.  Additionally, if you are
  feeling brave, any help you can give closing out the last remaining
  issues [1] would be great!
 
 $ virtualenv --system-site-packages .virtualenvs/pytables-test
 (pytables-test) $ python -c import tables; tables.test()
 Traceback (most recent call last):
   File string, line 1, in module
   File tables/__init__.py, line 82, in module
 from tables.utilsextension import (get_pytables_version,
 get_hdf5_version,
 ImportError: No module named utilsextension
 
 
 This seems like you didn't compile and install PyTables first.  So to be
 more clear:
 
 ~ $ cd pytables
 ~/pytables $ python setup.py install 
 ~/pytables $ cd ..
 ~ $ python -c import tables; tables.test()
 
 Be Well
 Anthony 
 
 
 
 -- Andreas.
 
 

Sorry, didn't write down that line. Actually, I did compile and install
pytables using python setup.py install from within the virtualenv.

The problem was that I ran that command from within the installation
directory, so that `import tables` didn't import the installed version.
I keep making that mistake with every project at least twice :-/

When you try to do that in scipy, it gives a warning. Maybe it would be
a good idea to do this in pytables as well?

The tests all ran well:

$ python -c import tables as tb; tb.test()
-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
PyTables version:  3.0.0b1
HDF5 version:  1.8.4-patch1
NumPy version: 1.6.1
Numexpr version:   1.4.2 (not using Intel's VML/MKL)
Zlib version:  1.2.3.4 (in Python interpreter)
BZIP2 version: 1.0.6 (6-Sept-2010)
Blosc version: 1.2.1-rc1 (2013-04-24)
Cython version:0.15.1
Python version:2.7.3 (default, Aug  1 2012, 05:14:39)
[GCC 4.6.3]
Platform:  linux2-x86_64
Byte-ordering: little
Detected cores:2
Default encoding:  ascii
-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
[...]
Ran 5242 tests in 493.636s
OK


and

$ python -c import tables as tb; tb.test()
-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
PyTables version:  3.0.0b1
HDF5 version:  1.8.4-patch1
NumPy version: 1.6.1
Numexpr version:   2.1 (not using Intel's VML/MKL)
Zlib version:  1.2.3.4 (in Python interpreter)
BZIP2 version: 1.0.6 (6-Sept-2010)
Blosc version: 1.2.1-rc1 (2013-04-24)
Cython version:0.19
Python version:3.2.3 (default, Oct 19 2012, 20:10:41)
[GCC 4.6.3]
Platform:  linux2-x86_64
Byte-ordering: little
Detected cores:2
Default encoding:  utf-8
-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
[...]
Ran 5217 tests in 526.794s
OK


-- 
-- Andreas.

--
Try New Relic Now  We'll Send You this Cool Shirt
New Relic is the only SaaS-based application performance monitoring service 
that delivers powerful full stack analytics. Optimize and monitor your
browser, app,  servers with just a few lines of code. Try New Relic
and get this awesome Nerd Life shirt! http://p.sf.net/sfu/newrelic_d2d_apr
___
Pytables-users mailing list
Pytables-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/pytables-users


Re: [Pytables-users] ANN: PyTables 3.0 beta1

2013-04-27 Thread Anthony Scopatz
On Sat, Apr 27, 2013 at 2:26 PM, Andreas Hilboll li...@hilboll.de wrote:

 Am 27.04.2013 19:42, schrieb Anthony Scopatz:
  On Sat, Apr 27, 2013 at 12:35 PM, Andreas Hilboll li...@hilboll.de
  mailto:li...@hilboll.de wrote:
 
  Am 27.04.2013 19 tel:27.04.2013%2019:17, schrieb Anthony Scopatz:
   Whoo hoo!  Thanks for all of your hard work Antonio!
  
   PyTables users, we'd really appreciate it if you could try out
  this beta
   release, run the test suite:
  
   $ python -c import tables as tb; tb.test()
  
   And let us know if there are any issues.  Additionally, if you are
   feeling brave, any help you can give closing out the last remaining
   issues [1] would be great!
 
  $ virtualenv --system-site-packages .virtualenvs/pytables-test
  (pytables-test) $ python -c import tables; tables.test()
  Traceback (most recent call last):
File string, line 1, in module
File tables/__init__.py, line 82, in module
  from tables.utilsextension import (get_pytables_version,
  get_hdf5_version,
  ImportError: No module named utilsextension
 
 
  This seems like you didn't compile and install PyTables first.  So to be
  more clear:
 
  ~ $ cd pytables
  ~/pytables $ python setup.py install
  ~/pytables $ cd ..
  ~ $ python -c import tables; tables.test()
 
  Be Well
  Anthony
 
 
 
  -- Andreas.
 
 

 Sorry, didn't write down that line. Actually, I did compile and install
 pytables using python setup.py install from within the virtualenv.

 The problem was that I ran that command from within the installation
 directory, so that `import tables` didn't import the installed version.
 I keep making that mistake with every project at least twice :-/

 When you try to do that in scipy, it gives a warning. Maybe it would be
 a good idea to do this in pytables as well?


That is a good idea!



 The tests all ran well:


Glad they passed!

Be Well
Anthony



 $ python -c import tables as tb; tb.test()

 -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
 PyTables version:  3.0.0b1
 HDF5 version:  1.8.4-patch1
 NumPy version: 1.6.1
 Numexpr version:   1.4.2 (not using Intel's VML/MKL)
 Zlib version:  1.2.3.4 (in Python interpreter)
 BZIP2 version: 1.0.6 (6-Sept-2010)
 Blosc version: 1.2.1-rc1 (2013-04-24)
 Cython version:0.15.1
 Python version:2.7.3 (default, Aug  1 2012, 05:14:39)
 [GCC 4.6.3]
 Platform:  linux2-x86_64
 Byte-ordering: little
 Detected cores:2
 Default encoding:  ascii

 -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
 [...]
 Ran 5242 tests in 493.636s
 OK


 and

 $ python -c import tables as tb; tb.test()

 -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
 PyTables version:  3.0.0b1
 HDF5 version:  1.8.4-patch1
 NumPy version: 1.6.1
 Numexpr version:   2.1 (not using Intel's VML/MKL)
 Zlib version:  1.2.3.4 (in Python interpreter)
 BZIP2 version: 1.0.6 (6-Sept-2010)
 Blosc version: 1.2.1-rc1 (2013-04-24)
 Cython version:0.19
 Python version:3.2.3 (default, Oct 19 2012, 20:10:41)
 [GCC 4.6.3]
 Platform:  linux2-x86_64
 Byte-ordering: little
 Detected cores:2
 Default encoding:  utf-8

 -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
 [...]
 Ran 5217 tests in 526.794s
 OK


 --
 -- Andreas.

--
Try New Relic Now  We'll Send You this Cool Shirt
New Relic is the only SaaS-based application performance monitoring service 
that delivers powerful full stack analytics. Optimize and monitor your
browser, app,  servers with just a few lines of code. Try New Relic
and get this awesome Nerd Life shirt! http://p.sf.net/sfu/newrelic_d2d_apr___
Pytables-users mailing list
Pytables-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/pytables-users