Hey Anthony,
I was not there, but judging by the slices, this should have been a very
nice tutorial.
Some remarks:
- In slide 19, you state that, if data comes from datasets with the
'numpy' flavor, they can be accessed in a numpy-like fashion. In fact,
you should be able to access data this way for any flavor.
- In the same slide 19, you mention that data accessed this way is
'memory mapped'. I'm not swure why you are using this expression, but
memory mapped files are normally a way for the operating system to load
data in a lazy way (on-demand). It is very similar to what you are
describing there, but how both systems work is not quite the same. In a
truly 'memory mapped' system, the mapping is done at the operating
system level. In your example, it has been PyTables who has done the
job, without any help from the operating system's 'memory mapping'
capability. But probably you already explained this to the audience.
- In slice 46, you seem to suggest that 'out-of-core' would be a similar
concept to 'in-kernel', but it is not. When I introduced the
'in-kernel' concept in PyTables I meant something like a computation
that is made at C-level (i.e. in the computational kernel, that is,
numexpr). It is true that the way to evaluate out-of-core computations
is via 'in-kernel', but you can also do in-kernel operations with
in-memory data (like in 'in-kernel' selections).
- And finally, I don't see your name anywhere in slide 72. Why is so??
Come on, don't be shy! :)
At any rate, I have found most of the material to be of very high
quality. Thanks for the effort!
Francesc
On 7/17/12 7:46 AM, Anthony Scopatz wrote:
Hello PyTables,
I'd like to present the tutorial I gave at SciPy 2012 this afternoon.
There were 50+ people in attendance! My slides are attached and you
can find the repository with all of my exercises at [1]. This is
released under CC BY-SA, so feel free to poach as needed. I'll be
sure to let you know when the video goes up. I think that we
definitely had some PyTables / HDF5 converts today.
I should also note that Antonio put out the v2.4-rc /during/ my
tutorial ;0.
Enjoy data!
Anthony
1. https://github.com/scopatz/scipy2012/tree/master/hdf5
--
Francesc Alted
------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and
threat landscape has changed and how IT managers can respond. Discussions
will include endpoint security, mobile security and the latest in malware
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
_______________________________________________
Pytables-users mailing list
Pytables-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/pytables-users
