[scikit-image] Image analysis pipeline improvement suggestions

2016-12-28 Thread simone codeluppi
Hi all! I would like to pick your brain for some suggestion on how to modify my image analysis pipeline. I am analyzing terabytes of image stacks generated using a microscope. The current code I generated rely heavily on scikit-image, numpy and scipy. In order to speed up the analysis the code ru

Re: [scikit-image] Image analysis pipeline improvement suggestions

2016-12-28 Thread Nathan Faggian
Hi Simone, I have had a little experience with HDF5 and am interested to see where you go with this. I wonder if you could use "feather": https://github.com/wesm/feather There was a recent post from Wes McKinney about feather, which sparked my interest: http://wesmckinney.com/blog/high-per