it as another storage backend.
--
Francesc Alted
--
See everything from the browser to the database with AppDynamics
Get end-to-end visibility with application monitoring from AppDynamics
Isolate bottlenecks
indexed columns.
--
Francesc Alted
--
See everything from the browser to the database with AppDynamics
Get end-to-end visibility with application monitoring from AppDynamics
Isolate bottlenecks and diagnose root cause
.
HTH,
-- Francesc Alted
--
This SF.net email is sponsored by Windows:
Build for Windows Store.
http://p.sf.net/sfu/windows-dev2dev
___
Pytables-users mailing list
Pytables-users
-dev2dev
___
Pytables-users mailing list
Pytables-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/pytables-users
--
Francesc Alted
--
This SF.net email
/windows-dev2dev
___
Pytables-users mailing list
Pytables-users@lists.sourceforge.net
mailto:Pytables-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/pytables-users
--
Francesc Alted
?
--
Francesc Alted
--
How ServiceNow helps IT people transform IT departments:
1. A cloud service to automate IT design, transition and operations
2. Dashboards that offer high-level views of enterprise services
3
, everything
seems to work as expected (but a bit on the slow side ...).
BTW, can you really notice the difference between using 1, 2 or 4
threads? Can you show some figures? Just curious.
--
Francesc Alted
--
How
My congrats for the hard effort too. I am very pleased to see the PyTables
project so healty and well managed. Thanks to all the developers, most
specially Antonio and Anthony. You guys rock!
Francesc
El 02/06/2013 17:54, Anthony Scopatz scop...@gmail.com va escriure:
Congratulations All!
, together with some docs (a small tutorial
would be really great).
For efficiency, the place for this filter would be inside Blosc, but
that's is another story :)
Thanks,
--
Francesc Alted
--
Try New Relic Now We'll Send
://groups.google.es/group/blosc
Francesc Alted
--
Introducing AppDynamics Lite, a free troubleshooting tool for Java/.NET
Get 100% visibility into your production application - at no cost.
Code-level diagnostics for performance
Hi Antonio,
Al 26/04/13 08:46, En/na Antonio Valentino ha escrit:
Hi Francesc,
Il 25/04/2013 23:06, Francesc Alted ha scritto:
Thanks. Will do!
Thanks.
For the record patches 0002 and 0003 close issue [75] and [77].
Also numexpr 2.1 closes [91] and [95]
[75] https://code.google.com/p
Hi,
I'm happy to announce the availability of Blosc 1.2.1 RC1. This is
mainly a fix for a problem with multithreading on Windows platforms.
The fix was important enough for deserving the version bump. Thanks a
lot to Christian Gohlke for proposing the fix: it works really well.
It exists
Thanks. Will do!
El 25/04/2013 21:02, Antonio Valentino antonio.valent...@tiscali.it va
escriure:
Hi Francesc,
Il 14/04/2013 22:19, Francesc Alted ha scritto:
Announcing Numexpr 2.1RC1
Numexpr is a fast numerical
On 4/22/13 8:11 AM, Antonio Valentino wrote:
Hi Francesc,
Il 21/04/2013 21:46, Francesc Alted ha scritto:
Hi,
I'm happy to announce the availability of Blosc 1.2.0 RC1. It exists
currently just as a tag in the github repo
(https://github.com/FrancescAlted/blosc), so you can fetch
, suggestions, gripes, kudos, etc. you may
have.
Enjoy!
--
Francesc Alted
--
Precog is a next-generation analytics platform capable of advanced
analytics on semi-structured data. The platform includes APIs for building
apps
Al 14/04/13 23:12, En/na Christoph Gohlke ha escrit:
Hello,
Looks good. All tests pass here on Python 2.6-3.3, 3264 bit, numpy
1.7.1, VML/MKL 11.0.3, Windows 8. PyTables 2.4 also tests OK against the rc.
Two small issues:
1) numexpr-2.1-rc1.tar.gz is missing the file
___
Pytables-users mailing list
Pytables-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/pytables-users
--
Francesc Alted
--
Everyone hates slow websites. So do we.
Make your web apps
Hi Jon and Anthony,
I can confirm that this is a package error of PyTables in Anaconda CE 64
for Windows. We have filed a ticket in Anaconda for fixing this. Sorry
for the inconveniences.
Francesc Alted
On 2/15/13 4:56 PM, Anthony Scopatz wrote:
Hi Jon,
Unfortunately, I have no way
, Francesc Alted fal...@gmail.com
mailto:fal...@gmail.com wrote:
On 12/6/12 1:42 PM, Alvaro Tejero Cantero wrote:
Thank you for the comprehensive round-up. I have some ideas and
reports below.
What about ctables? The documentation says that it is specificly
column
-á.
On 7 December 2012 17:04, Francesc Alted fal...@gmail.com
mailto:fal...@gmail.com wrote:
Hmm, perhaps cythonizing by hand is your best bet:
$ cython carray/carrayExtension.pyx
If you continue having problems, please write to the carray
mailing list.
Francesc
larger than with PyTables (317ms vs
298ms), which speaks a lot how efficiently is implemented I/O in
HDF5/PyTables stack.
--
Francesc Alted
--
LogMeIn Rescue: Anywhere, Anytime Remote support for IT. Free Trial
Remotely
___
Pytables-users mailing list
Pytables-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/pytables-users
--
Francesc Alted
--
Everyone hates slow websites. So do we.
Make your web apps faster
://pytables.github.com/usersguide/parameter_files.html?#tables.parameters.MAX_BLOSC_THREADS
to 1.
HTH,
--
Francesc Alted
--
LogMeIn Central: Instant, anywhere, Remote PC access and management.
Stay in control, update software
== '__main__':
pool = Pool(processes=2) # start 2 worker processes
items = load_items ()
pool.map (process_items, items)
Hmm, that's strange. Using lzo or zlib works for you?
--
Francesc Alted
On 11/2/12 5:19 PM, Ben Elliston wrote:
On Fri, Nov 02, 2012 at 04:56:55PM -0400, Francesc Alted wrote:
Hmm, that's strange. Using lzo or zlib works for you?
Well, it seems that switching compression algorithms could be a
nightmare (or can I do this with ptrepack?).
Yes, ptrepack can do
tool
called h5repack.
HTH,
--
Francesc Alted
--
LogMeIn Central: Instant, anywhere, Remote PC access and management.
Stay in control, update software, and manage PCs from one command center
Diagnose problems
compression with zlib level 1:
H5 file creation time: 1.900
And using blosc level 5:
H5 file creation time: 0.244
HTH,
--
Francesc Alted
--
Everyone hates slow websites. So do we.
Make your web apps faster with AppDynamics
On 10/31/12 4:02 PM, Francesc Alted wrote:
On 10/31/12 10:12 AM, Andrea Gavana wrote:
Hi Francesc All,
On 31 October 2012 14:13, Francesc Alted wrote:
On 10/31/12 4:30 AM, Andrea Gavana wrote:
Thank you for all your suggestions. I managed to slightly modify the
script you attached and I am
only 45 minutes for the presentation, so I have not
been able to show the PyTables files samples that some of you kindly
send to me (but I'll keep them for the future, one never knows!).
--
Francesc Alted
--
WINDOWS 8
!
I'd also really like to thank Antonio for driving new features into
the code base!
If only we were all on the same continent, we could have a PyTables
birthday
party or something...
Be Well
Anthony
On Sun, Oct 21, 2012 at 10:26 AM, Francesc Alted fal...@pytables.org
mailto:fal
On Sun, Oct 21, 2012 at 1:01 PM, Andy Wilson
wilson.andre...@gmail.com mailto:wilson.andre...@gmail.com wrote:
On Sun, Oct 21, 2012 at 10:41 AM, Francesc Alted
fal...@pytables.org mailto:fal...@pytables.org wrote:
Hi,
I'm going to give a tutorial on PyTables next
. Perhaps in next days.
Feedback welcome.!
--
Francesc Alted PGP KeyID: 0x61C8C11F
Scientific aplications developer
Public PGP key available:http://www.openlc.org/falted_at_openlc.asc
Key fingerprint = 1518 38FE 3A3D 8BE8 24A0 3E5B 1328 32CC 61C8 C11F
--
Francesc Alted
license, see LICENSES/BLOSC.txt for
details.
Mailing list
There is an official mailing list for Blosc at:
bl...@googlegroups.com
http://groups.google.es/group/blosc
--
Francesc Alted
--
Live Security Virtual
list at:
bl...@googlegroups.com
http://groups.google.es/group/blosc
--
Francesc Alted
--
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and
threat landscape has changed
. Now, carray supports both in-memory and on-disk objects,
and they work exactly in the same way.
--
Francesc Alted
--
Got visibility?
Most devs has no idea what their production app looks like.
Find out how fast your
/carray). It supports barely the same
capabilities than the Table object, but the column-order is implemented
properly, so probably a ctable will buy you a nice speed-up.
Thank you for your time,
Hope this helps,
--
Francesc Alted
**Enjoy data!**
--
Francesc Alted
--
Everyone hates slow websites. So do we.
Make your web apps faster with AppDynamics
Download AppDynamics Lite for free today:
http://ad.doubleclick.net/clk
/lists/listinfo/pytables-users
--
Francesc Alted
--
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and
threat landscape has changed and how IT managers can respond
investigation)
* ...
Please let me know if you think there are other point that are
important for python3 support
Ok. That looks good. This is a lot of work though, but I hope you will
manage.
Thanks for the fine work!
--
Francesc Alted
https://lists.sourceforge.net/lists/listinfo/pytables-announce
--
Francesc Alted
--
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and
threat landscape has changed and how
/sfrnl04242012/114/50122263/
___
Pytables-users mailing list
Pytables-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/pytables-users
--
Francesc Alted
that
PyTables only can deal with HDF5 files. For HDF4 I'd rather use pyhdf:
http://pysclint.sourceforge.net/pyhdf/
--
Francesc Alted
--
Live Security Virtual Conference
Exclusive live event will cover all the ways today's
://pytables.github.com/usersguide/file_format.html.
Nope. These attributes are not required, they are optional. PyTables
generally makes a good job at accessing HDF5 without this info. FYI,
these attributes are a superset of the High Level HDF5 library:
http://www.hdfgroup.org/HDF5/hdf5_hl/
--
Francesc
and the latest in malware
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
___
Pytables-users mailing list
Pytables-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/pytables-users
--
Francesc Alted
On 5/14/12 3:12 PM, Anthony Scopatz wrote:
On Mon, May 14, 2012 at 3:05 PM, Francesc Alted fal...@pytables.org
mailto:fal...@pytables.org wrote:
[snip]
However, do not expect to use all your cores at full speed in this
cases, as the reductions in numexpr can only make use of one
and asked a lot of questions, specially on the compression
(Blosc) and query features.
You can find the slides here:
http://www.pytables.org/docs/PUG-Austin-2012-v3.pdf
Cheers,
--
Francesc Alted
--
Live Security
.
In-memory or in-kernel? You probably mean indexed or in-kernel, right?
Yes, that's certainly another nice place for further optimizations.
--
Francesc Alted
--
Live Security Virtual Conference
Exclusive live event
),
(6, 1, 3), (7, 1, 3), (8, 1, 3), (9, 1, 3)],
dtype=[('t20k', 'i4'), ('tetrode', 'u1'), ('unit', 'u1')])
Which versions are you using?
--
Francesc Alted
--
Live Security Virtual Conference
Exclusive live event
confusing.
Yup, agreed. Don't know what to do here. carray was more a
proof-of-concept than anything else, but if development for it continues
in the future, I should ponder about changing the names.
--
Francesc Alted
in wctab02.where('val1')),
dtype=np.int16)
cvals
array([], dtype=int16)
This smells like a bug, but I cannot reproduce it. Could you send an
self-contained example reproducing this behavior?
I am not able to reproduce this either...
--
Francesc Alted
that queries in PyTables are
actually fast --and potentially much faster than NumPy for high
selectivities and indexing.
Hope this helps,
--
Francesc Alted
--
Live Security Virtual Conference
Exclusive live event will cover
?
--
Francesc Alted
--
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and
threat landscape has changed and how IT managers can respond. Discussions
will include endpoint security
On
nodes with data, it may be flushed to disk.
https://github.com/PyTables/PyTables/blob/master/tables/node.py#L512
Yup, it does flush. The message should be more explicit on this.
--
Francesc Alted
--
This SF email
on this.
--
Francesc Alted
--
This SF email is sponsosred by:
Try Windows Azure free for 90 days Click Here
http://p.sf.net/sfu/sfd2d-msazure
___
Pytables-users mailing list
Pytables-users
are best dealt if you
could submit a PR. With github this is easy to do, and it is also very
convenient for maintainers for keeping track of all these requests for
improvement.
Cheers,
--
Francesc Alted
--
Better than sec
On 3/31/12 2:13 AM, Antonio Valentino wrote:
Hi Danid, hi Francesc,
Il 31/03/2012 03:08, Francesc Alted ha scritto:
On 3/30/12 7:57 PM, Daπid wrote:
Hello,
I have several different kinds of data tables, absolutely independent,
defined as in the tutorial
(http://pytables.github.com
-reported sizes.
Just be sure that you experiment with different chunklengths by using
the `chunklen` parameter in carray constructor too.
--
Francesc Alted
--
This SF email is sponsosred by:
Try Windows Azure free for 90
On 3/27/12 6:34 PM, Francesc Alted wrote:
Another option that occurred to me recently is to save all your
columns as unidimensional arrays (Array object, or, if you want
compression, a CArray or EArray), and then use them as components of a
boolean expression using the class `tables.Expr
for this would be more than welcome ;)
--
Francesc Alted
--
This SF email is sponsosred by:
Try Windows Azure free for 90 days Click Here
http://p.sf.net/sfu/sfd2d-msazure
, the only suspicios thing that I have found in your log file is
that HDF5 headers and libraries are in different directories:
* Found HDF5 headers at ``/usr/include``, library at ``/usr/local/lib``.
This is not grave, but do you have an explanation for this?
--
Francesc Alted
://p.sf.net/sfu/sfd2d-msazure
___
Pytables-users mailing list
Pytables-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/pytables-users
--
Francesc Alted
___
Pytables-users mailing list
Pytables-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/pytables-users
--
Francesc Alted
--
This SF email is sponsosred by:
Try
@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/pytables-users
--
Francesc Alted
--
This SF email is sponsosred by:
Try Windows Azure free for 90 days Click Here
http://p.sf.net/sfu/sfd2d-msazure
prevval, gf1[::-1] # reverse sorted
will print the next values:
f0-val0 [decreasing list of f1 values]
f0-val1 [decreasing list of f1 values]
...
f0-valN [decreasing list of f1 values]
Hope this helps,
-- Francesc Alted
to need a lot of insertions or deletions, then
PyTables / HDF5 is probably not what you want.
HTH,
-- Francesc Alted
--
This SF email is sponsosred by:
Try Windows Azure free for 90 days Click Here
http://p.sf.net
we have found a start for providing a structure to your
problem :)
-- Francesc Alted
--
This SF email is sponsosred by:
Try Windows Azure free for 90 days Click Here
http://p.sf.net/sfu/sfd2d-msazure
without a need to load it in-memory. Iterators in
PyTables are one of its most powerful and effective constructions, so be sure
that you master them if you want to get the most out of PyTables.
-- Francesc Alted
traditional technology called indexing:
http://en.wikipedia.org/wiki/Database_index
If it sounds like dumb to you, then let me offer to write an
explanatory note for users in a similar case to mine, once I have
sorted it out.
Hope things are clearer now.
Hasta luego,
-- Francesc Alted
.
Is there a requirement to use the mpi version of the hd5 libraries for blosc
to be multithreaded?
No, only the pthreads library is required. Why are you so sure that PyTables
is not using several threads?
-- Francesc Alted
it...
On Thu, Mar 8, 2012 at 9:31 AM, Francesc Alted fal...@pytables.org wrote:
Excellent! I still have to figure out why your system does not support posix
threads barriers properly, but most probably the patch is a good workaround
for your case. Please feel free to file a bug so
_POSIX_BARRIERS != 200112L)
On Mar 7, 2012, at 8:25 PM, Francesc Alted wrote:
On Mar 7, 2012, at 6:05 PM, Chris Kees wrote:
On Wed, Mar 7, 2012 at 5:18 PM, Francesc Alted fal...@pytables.org wrote:
On Mar 7, 2012, at 3:14 PM, Francesc Alted wrote:
On Mar 7, 2012, at 1:57 PM, Chris Kees wrote
of _POSIX_BARRIERS symbol?
-- Francesc Alted
--
Virtualization Cloud Management Using Capacity Planning
Cloud computing makes use of virtualization - but cloud computing
also focuses on allowing computing to be delivered
On Mar 7, 2012, at 3:14 PM, Francesc Alted wrote:
On Mar 7, 2012, at 1:57 PM, Chris Kees wrote:
Hi Anthony,
I'm using 1.8.7 on ranger. Here is the topmost error:
compile options: '-DNDEBUG=1 -DHAVE_BZ2_LIB=1 -Iblosc
-I/work/01020/cekees/ranger.gnu/build/ranger.gnu/lib/python2.7/site
On Mar 7, 2012, at 6:05 PM, Chris Kees wrote:
On Wed, Mar 7, 2012 at 5:18 PM, Francesc Alted fal...@pytables.org wrote:
On Mar 7, 2012, at 3:14 PM, Francesc Alted wrote:
On Mar 7, 2012, at 1:57 PM, Chris Kees wrote:
Hi Anthony,
I'm using 1.8.7 on ranger. Here is the topmost error
,
-- Francesc Alted
--
Virtualization Cloud Management Using Capacity Planning
Cloud computing makes use of virtualization - but cloud computing
also focuses on allowing computing to be delivered as a service.
http
.
This does not require an additional data copy to obtain the homogeneous array.
-- Francesc Alted
--
Try before you buy = See our experts in action!
The most comprehensive online learning library for Microsoft developers
my system.
Thanks for any input.
J.
-- Francesc Alted
--
Virtualization Cloud Management Using Capacity Planning
Cloud computing makes use of virtualization - but cloud computing
also focuses on allowing
memory usage. Not sure about how much speed you may
gain though.
--
Francesc Alted
--
Keep Your Developer Skills Current with LearnDevNow!
The most comprehensive online learning library for Microsoft developers
is just
2012/1/23 Hector hecto...@gmail.com
On Mon, Jan 23, 2012 at 3:01 AM, Francesc Alted fal...@pytables.org
wrote:
2012/1/23 Hector hecto...@gmail.com
I guess the only reason why I'm thinking of a Table is to be able to
create an index on one of its columns and then be able to do fast
sentences in a VLArray seems like a more sensible approach. Could you tell
us why are you after using a Table?
--
Francesc Alted
--
Try before you buy = See our experts in action!
The most comprehensive online learning library
a lot. Hmm, perhaps it would be
a good thing to reduce this figure to something like 256 or less (some
benchmarks needed).
Thanks for your double check!
--
Francesc Alted
--
Keep Your Developer Skills Current
, Row.append() uses a buffered approach, so I generally recommend
this. Umit, could you assess how much speed-up does Table.append() is
buying you? Just curious.
--
Francesc Alted
--
Keep Your Developer Skills Current
2012/1/2 Gael Varoquaux gael.varoqu...@normalesup.org:
On Mon, Jan 02, 2012 at 06:44:54PM +0100, Francesc Alted wrote:
Perhaps you may get a bit more performance if you use the
`[read,write]_vl_blosc2_hdf` functions that I have sent in my earlier
post, but that adds the python-blosc dependency
for
writing).
And the small gains for fast compressor like Blosc is due to the fact
that heavier compressors like zlib allows to compress more, so the
disk has to work less to deliver the same data.
--
Francesc Alted
--
Write
://ubuntuforums.org/showthread.php?t=589975 ]
But that requires sudo permission indeed.
I am still working on this version, as well as on commenting my
persistence code, but feel free to comment. Hopefully this can be useful
to the pytables community.
Sure, it is. Thanks !
--
Francesc Alted
, it may be useful to use a high performance compressor (e.g.
Blosc) so as to reduce its size.
If your arrays do not share dtypes or shapes at all, then I'm afraid
this the best performance you can expect from PyTables. Is this that
bad compared with other options?
--
Francesc Alted
2011/12/30 Dav Clark d...@alum.mit.edu:
On Dec 30, 2011, at 8:40 AM, Francesc Alted wrote:
2011/12/30 Gael Varoquaux gael.varoqu...@normalesup.org:
Hi list,
I am trying to do a simple comparison of various I/O libraries to save a
bunch of numpy arrays. I don't have time to actually invest
time you write. Thanks.
--
Francesc Alted
--
Cloud Services Checklist: Pricing and Packaging Optimization
This white paper is intended to serve as a reference, checklist and point of
discussion for anyone considering
2011/12/7 Francesc Alted fal...@pytables.org
What you are saying is correct, except that the 'guilty' of dropping the
trailing null characters is NumPy, not HDF5. Look at this:
In [27]: import numpy as np
In [28]: np.array([aaa])
Out[28]:
array(['aaa'],
dtype='|S3')
In [29
2011/12/5 Francesc Alted fal...@pytables.org
Regarding the big error, the HDF5 error stack could be converted into a
Python error so that it can be caught, if needed. Hmm, I'll file a ticket
on this later on.
https://github.com/PyTables/PyTables/issues/120
--
Francesc Alted
/pytables/files/pytables/2.3.1/
that might be useful for Ubuntu too.
--
Francesc Alted
--
Cloud Services Checklist: Pricing and Packaging Optimization
This white paper is intended to serve as a reference, checklist
into a
Python error so that it can be caught, if needed. Hmm, I'll file a ticket
on this later on.
--
Francesc Alted
--
All the data continuously generated in your IT infrastructure
contains a definitive record
.
This is again an artifact introduced by NumPy internally. Force the use
of a tuple:
temptable.append([tuple(sortlist[-1])])
and that should work.
--
Francesc Alted
--
All the data continuously generated in your
[...] parts of it
[the array] easily via indexing. Append() seems to be required before...
Yes. Append is the recommended way for enlarging an EArray. Then you
can use an slice assignment in case you want to modify parts of the
array, i.e.:
steps[:,:,n] = np.arrange(L*K).reshape(L,K)
--
Francesc Alted
declare the final length of the container
(while this is not necessary with EArray). Read the documentation
about EArray/CArray more carefully to explore their rich set of
features.
Hope this helps,
--
Francesc Alted
://pytables.github.com/usersguide/optimization.html#indexed-searches
for more info on how to use this.
--
Francesc Alted
--
All of the data generated in your IT infrastructure is seriously valuable.
Why? It contains a definitive record
--
Francesc Alted
--
Using storage to extend the benefits of virtualization and iSCSI
Virtualization increases hardware utilization and delivers a new level of
agility. Learn what those decisions are and how to modernize your
not really comfortable with a pure english spoken meeting
either. I think the best would be to restrict ourselves to a written chat
meeting. Also, it is easier to keep the logs of a written chat than a
spoken one.
--
Francesc Alted
release
Seems pretty near already :)
Thanks for your effort!
--
Francesc Alted
--
BlackBerryreg; DevCon Americas, Oct. 18-20, San Francisco, CA
The must-attend event for mobile developers. Connect with experts.
Get tools
stage.
OK, PyTables Pro was already well tested so maybe we don't have to worry
too much in this case but it is useful to know for future releases.
Sure. Luck!
--
Francesc Alted
--
BlackBerryreg; DevCon Americas, Oct
1 - 100 of 544 matches
Mail list logo
