Hi Nathan
thanks a lot for the infos!
I looked into it and it seems promising, I just need to understand if it is
possible to save numpy data into feather.
In the pipeline I developed, in the majority of the intermediate steps the
generated numpy arrays are saved as single file (as .lzma using
job
Hi Simone,
unfortunately I can not contribute anything to your questions but would you
mind to share some of your experience with the hdf5 file format and
parallelization?
I am also analysing a lot of big microscopy images and would love to hear
your opinion or get advice for an image pipeline.
B
Hi Simone,
I have had a little experience with HDF5 and am interested to see where you
go with this. I wonder if you could use "feather":
https://github.com/wesm/feather
There was a recent post from Wes McKinney about feather, which sparked my
interest:
http://wesmckinney.com/blog/high-per
Hi all!
I would like to pick your brain for some suggestion on how to modify my
image analysis pipeline.
I am analyzing terabytes of image stacks generated using a microscope. The
current code I generated rely heavily on scikit-image, numpy and scipy. In
order to speed up the analysis the code ru
