On Sunday, May 17, 2015 at 3:30:49 PM UTC, Páll Haraldsson wrote: > > > I saw an interesting project: > > https://github.com/JuliaLang/julialang.github.com/blob/master/gsoc/2015/index.md#project-simple-persistent-distributed-storage > "This project proposes to implement a very simple persistent storage > mechanism for Julia variables so that data can be saved to and loaded from > disk with a consistent interface that is agnostic of the underlying storage > layer." >
The GSOC project is probably still useful and Prevayler maybe not be for HPC.. I would still like to see it for Julia, but thinking about this more, the CommandPattern would generate very high log activity (if say matrix multiplication would be transaction level, maybe more coarse-grained would be ok). The snapshotting part of it might be better done from outside the application (I think there are tools, and they might work better, not sure about how Prevayler would handle non-deterministic/parallel. The clustering in it is for high-availability). Maybe Prevayler would help for debugging.. you can rerun through your transactions/log but as operations are not always symmetric (matrix multiply), you wouldn't get reversible debugging. And for debugging HPC it would be slow to do this as you would recompute every step.. -- Palli.
