On Sat, Sep 24, 2016 at 3:21 AM, saad khalid <[email protected]> wrote: > I'm running a computation that takes a long time to finish, so I don't want > to do it more than one. I ran it once this morning and it finished and it > was saved in the RAM and I could read it. But, by later in the day, it was > deleted somehow...
Hello, there are many reasons why your processes can stop, and they range from a bug in the code, timeout of the project's idle time, a technical problem, or a general issue with the compute node and it has to reboot. What you have to implement is a way to store the results in a file, and at best when it takes longer, to store intermediate results to be able to resume later one (by reading in the partial results). The topic in general is called "serialization" and "persistent storage". The capabilities of python (I'm assuming you work in Python/Sage) range from range from "pickle" (use the "highest protocol", not the default [1] over using JSON, up to storing data in sqlite3 [2]. [1] https://docs.python.org/2/library/pickle.html#usage [2] https://docs.python.org/2/library/sqlite3.html -- harald -- You received this message because you are subscribed to the Google Groups "sage-cloud" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/sage-cloud/CAGG4CB5cFk2aKX2K%2B3x%2BjEsseG192ag0HtiAA4-m-dFtqGTfUw%40mail.gmail.com. For more options, visit https://groups.google.com/d/optout.
