Re: [julia-users] ANN: RawArray.jl

2016-10-14 Thread Páll Haraldsson
On Thursday, October 13, 2016 at 6:00:30 PM UTC, Tim Holy wrote: > > If you just want a raw dump of memory, you can get that, and if it's big > it uses `Mmap.mmap` when it reads the data back in. So you can read > terabyte-sized arrays. > [Not clear on mmap.. just a possibility, kind or

Re: [julia-users] ANN: RawArray.jl

2016-10-13 Thread Páll Haraldsson
[Explaining more, and correcting typo..] On Sunday, October 9, 2016 at 12:04:35 AM UTC, Páll Haraldsson wrote: > FLIF is not a replacement for all uses (multidimensional, would be > interesting to know if could to be extended to..), but seem to be the best > option for non-lossy image

Re: [julia-users] ANN: RawArray.jl

2016-10-08 Thread Páll Haraldsson
On Monday, September 26, 2016 at 1:59:15 PM UTC, David Smith wrote: > > Hi, Isaiah. This is a valid question. > > 0. As a preface, I'd like to say I'm not trying to replace anything. I > wrote RawArray to solve a problem we have in magnetic resonance imaging > (quickly saving and loading large

Re: [julia-users] ANN: RawArray.jl

2016-10-01 Thread 'Tobias Knopp' via julia-users
https://github.com/JuliaIO/NRRD.jl thats pure Julia Am Samstag, 1. Oktober 2016 20:48:37 UTC+2 schrieb Steven G. Johnson: > > > > On Monday, September 26, 2016 at 9:59:15 AM UTC-4, David Smith wrote: >> >> I also don't need it to read image formats. Part of the reason behind >> RawArray is to

Re: [julia-users] ANN: RawArray.jl

2016-10-01 Thread Steven G. Johnson
On Monday, September 26, 2016 at 9:59:15 AM UTC-4, David Smith wrote: > > I also don't need it to read image formats. Part of the reason behind > RawArray is to avoid standard image formats because they are not optimized > for large complex-float arrays. I just want to save multi-GB data

Re: [julia-users] ANN: RawArray.jl

2016-09-26 Thread Isaiah Norton
Thanks for the response. 1. I don't think NRRD is as substantially used as you might think. I've > worked in imaging science for years on the data processing/file format end, > and I've never seen anyone use it, and I've never even heard of it. (Pity, > because it looks nice enough. :-\) I

Re: [julia-users] ANN: RawArray.jl

2016-09-26 Thread David Smith
Sorry I forgot to add: JuliaIO/Images.jl relies on having ImageMagick installed, whereas RawArray.jl is a pure Julia solution without any dependencies. On Monday, September 26, 2016 at 8:59:15 AM UTC-5, David Smith wrote: > > Hi, Isaiah. This is a valid question. > > 0. As a preface, I'd

Re: [julia-users] ANN: RawArray.jl

2016-09-26 Thread David Smith
Hi, Isaiah. This is a valid question. 0. As a preface, I'd like to say I'm not trying to replace anything. I wrote RawArray to solve a problem we have in magnetic resonance imaging (quickly saving and loading large complex float arrays), and then I decided to share it so if other people like

Re: [julia-users] ANN: RawArray.jl

2016-09-25 Thread Isaiah Norton
Is there a reason to use this file format over NRRD [1]? To borrow a wise phrasing: I wonder if the world needs another lightweight raw data format ;) For what it's worth, NRRD is already supported by JuliaIO/Images.jl, and I believe addresses the use-cases identified in your readme, but with a

[julia-users] ANN: RawArray.jl

2016-09-25 Thread David Smith
Hi, all: I finally pushed this out, and it might satisfy some of your needs for a simple way to store N-d arrays to disk. Hope you enjoy it. RawArray (.ra) is a simple file format for storing n-dimensional arrays. RawArray was designed to be portable, fast, storage efficient, and future