On Wednesday, 31 August 2016 12:47:37 UTC+8, Lyndon White wrote: > > > So I have one of the models, saved using their custom format ( > https://github.com/sbos/AdaGram.jl/blob/master/src/util.jl#L94) > It is *6Gb*, and takes ages to load and save. > I switch to JLD, *13Gb* even worse. > I used Base.serialize, Its just *13Mb* -- That is a full 3 orders of > magnitude different. > And it is fast to read and write from disk. > > Actually, the figure for Base,Serialize is off there. Turns out there was a ShareArray that did not serialize to disk. As so that 13 MB file can't be deserialised. I thought it was a bit extreme.
But the point stands, that in general there is a large category of types for which Base.Serialise is much much faster than JLD.
