Benjamin: Is it fairly straining in terms of input/ouput operations per 
second or
because of file sizes ?


If it is about IOPS, the code can be enhanced to group I/O operations.



Allen, Benjamin S a écrit :
> Louis,
>
> That is indeed what these options do.
>
> Ray seems to checkpoint the completion of each step, not at a regular 
> interval. So if you have a step in Ray thats taking longer than your max 
> walltime, you'll still have an issue. Also just an FYI, depending on how big 
> of jobs you're running (number of cores), and what your scratch file space 
> performance is, checkpointing can be fairly straining on the cluster.
>
> Ben
>
> On Jun 12, 2012, at 8:49 AM, Louis Letourneau wrote:
>
>> I saw these options on Ray
>> Checkpointing
>>        -write-checkpoints
>>               Write checkpoint files
>>        -read-checkpoints
>>               Read checkpoint files
>>        -read-write-checkpoints
>>               Read and write checkpoint files
>>
>>
>>
>> I'm hitting walltimes on the cluster I'm using and I'm wondering if by
>> setting:
>> -read-write-checkpoints
>>
>> I can resume where Ray got killed because of walltime?
>>
>> If that's the purpose, what a great feature! :-)
>>
>> Louis
>>
>> ------------------------------------------------------------------------------
>> Live Security Virtual Conference
>> Exclusive live event will cover all the ways today's security and
>> threat landscape has changed and how IT managers can respond. Discussions
>> will include endpoint security, mobile security and the latest in malware
>> threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
>> _______________________________________________
>> Denovoassembler-users mailing list
>> Denovoassembler-users@lists.sourceforge.net
>> https://lists.sourceforge.net/lists/listinfo/denovoassembler-users


------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
_______________________________________________
Denovoassembler-users mailing list
Denovoassembler-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/denovoassembler-users

Reply via email to