[Devel] Re: [RFC][PATCH 2/2] CR: handle a single task with private memory maps

2008-08-12 Thread Joseph Ruscio
On Aug 5, 2008, at 9:23 AM, Dave Hansen wrote: How would you propose making it modular? Dave, What about re-using the madvise() interface for this? Adding a flag along the lines of MADV_DONTCHECKPOINT? I could probably work up a patch to Oren's that removes these from the checkpointed

[Devel] Re: [RFC][PATCH 2/2] CR: handle a single task with private memory maps

2008-08-12 Thread Joseph Ruscio
On Aug 5, 2008, at 9:20 AM, Oren Laadan wrote: Louis Rilling wrote: On Mon, Aug 04, 2008 at 08:51:37PM -0700, Joseph Ruscio wrote: As somewhat of a tangent to this discussion, I've been giving some thought to the general strategy we talked about during the summit. The checkpointing

[Devel] Re: [RFC][PATCH 2/2] CR: handle a single task with private memory maps

2008-08-08 Thread Dave Hansen
On Fri, 2008-08-08 at 10:20 -0700, Joseph Ruscio wrote: On Aug 5, 2008, at 9:23 AM, Dave Hansen wrote: How would you propose making it modular? What about re-using the madvise() interface for this? Adding a flag along the lines of MADV_DONTCHECKPOINT? I could probably work up a patch to

[Devel] Re: [RFC][PATCH 2/2] CR: handle a single task with private memory maps

2008-08-07 Thread Louis Rilling
On Wed, Aug 06, 2008 at 08:41:10AM -0700, Joseph Ruscio wrote: On Aug 5, 2008, at 9:20 AM, Oren Laadan wrote: Eh... and, yes, live migration :) User-space live migration of a batch process e.g. one taking place in an MPI job is quite trivial. User-space live migration of something like a

[Devel] Re: [RFC][PATCH 2/2] CR: handle a single task with private memory maps

2008-08-07 Thread Louis Rilling
On Wed, Aug 06, 2008 at 09:15:46AM -0700, Joseph Ruscio wrote: On Aug 5, 2008, at 9:23 AM, Dave Hansen wrote: On Mon, 2008-08-04 at 20:51 -0700, Joseph Ruscio wrote: It might be desirable for the checkpointing implementation to be modular enough that a userspace application or library could

[Devel] Re: [RFC][PATCH 2/2] CR: handle a single task with private memory maps

2008-08-05 Thread Louis Rilling
On Mon, Aug 04, 2008 at 08:51:37PM -0700, Joseph Ruscio wrote: As somewhat of a tangent to this discussion, I've been giving some thought to the general strategy we talked about during the summit. The checkpointing solution we built at Evergrid sits completely in userspace and is soley

[Devel] Re: [RFC][PATCH 2/2] CR: handle a single task with private memory maps

2008-08-05 Thread Louis Rilling
On Mon, Aug 04, 2008 at 10:37:20PM -0400, Oren Laadan wrote: Louis Rilling wrote: On Fri, Aug 01, 2008 at 02:51:57PM -0400, Oren Laadan wrote: Louis Rilling wrote: On Fri, Aug 01, 2008 at 10:15:26AM -0400, Oren Laadan wrote: I actually wasn't thinking of streaming a series of incremental

[Devel] Re: [RFC][PATCH 2/2] CR: handle a single task with private memory maps

2008-08-05 Thread Oren Laadan
Louis Rilling wrote: On Mon, Aug 04, 2008 at 08:51:37PM -0700, Joseph Ruscio wrote: As somewhat of a tangent to this discussion, I've been giving some thought to the general strategy we talked about during the summit. The checkpointing solution we built at Evergrid sits completely in

[Devel] Re: [RFC][PATCH 2/2] CR: handle a single task with private memory maps

2008-08-05 Thread Dave Hansen
On Mon, 2008-08-04 at 20:51 -0700, Joseph Ruscio wrote: It might be desirable for the checkpointing implementation to be modular enough that a userspace application or library could select to handle certain resources on their own. Memory is the primary one that comes to mind. How would

[Devel] Re: [RFC][PATCH 2/2] CR: handle a single task with private memory maps

2008-08-04 Thread Louis Rilling
On Fri, Aug 01, 2008 at 02:51:57PM -0400, Oren Laadan wrote: Louis Rilling wrote: On Fri, Aug 01, 2008 at 10:15:26AM -0400, Oren Laadan wrote: Louis Rilling wrote: On Thu, Jul 31, 2008 at 03:12:32PM -0400, Oren Laadan wrote: Cut the less interesting (IMHO at least) history to make Dave

[Devel] Re: [RFC][PATCH 2/2] CR: handle a single task with private memory maps

2008-08-04 Thread Oren Laadan
Louis Rilling wrote: On Fri, Aug 01, 2008 at 02:51:57PM -0400, Oren Laadan wrote: Louis Rilling wrote: On Fri, Aug 01, 2008 at 10:15:26AM -0400, Oren Laadan wrote: Louis Rilling wrote: On Thu, Jul 31, 2008 at 03:12:32PM -0400, Oren Laadan wrote: Cut the less interesting (IMHO at least)

[Devel] Re: [RFC][PATCH 2/2] CR: handle a single task with private memory maps

2008-08-01 Thread Oren Laadan
Louis Rilling wrote: On Thu, Jul 31, 2008 at 03:12:32PM -0400, Oren Laadan wrote: Louis Rilling wrote: On Thu, Jul 31, 2008 at 12:28:57PM -0400, Oren Laadan wrote: Louis Rilling wrote: On Thu, Jul 31, 2008 at 11:09:54AM -0400, Oren Laadan wrote: Louis Rilling wrote: On Wed, Jul 30, 2008

[Devel] Re: [RFC][PATCH 2/2] CR: handle a single task with private memory maps

2008-08-01 Thread Louis Rilling
On Thu, Jul 31, 2008 at 03:12:32PM -0400, Oren Laadan wrote: Louis Rilling wrote: On Thu, Jul 31, 2008 at 12:28:57PM -0400, Oren Laadan wrote: Louis Rilling wrote: On Thu, Jul 31, 2008 at 11:09:54AM -0400, Oren Laadan wrote: Louis Rilling wrote: On Wed, Jul 30, 2008 at 06:20:32PM -0400,

[Devel] Re: [RFC][PATCH 2/2] CR: handle a single task with private memory maps

2008-08-01 Thread Louis Rilling
On Wed, Jul 30, 2008 at 02:27:52PM -0400, Oren Laadan wrote: Louis Rilling wrote: +/** + * cr_vma_fill_pgarr - fill a page-array with addr/page tuples for a vma + * @ctx - checkpoint context + * @pgarr - page-array to fill + * @vma - vma to scan + * @start - start address

[Devel] Re: [RFC][PATCH 2/2] CR: handle a single task with private memory maps

2008-08-01 Thread Louis Rilling
On Thu, Jul 31, 2008 at 12:28:57PM -0400, Oren Laadan wrote: Louis Rilling wrote: On Thu, Jul 31, 2008 at 11:09:54AM -0400, Oren Laadan wrote: Louis Rilling wrote: On Wed, Jul 30, 2008 at 06:20:32PM -0400, Oren Laadan wrote: Serge E. Hallyn wrote: Quoting Oren Laadan ([EMAIL PROTECTED]):

[Devel] Re: [RFC][PATCH 2/2] CR: handle a single task with private memory maps

2008-08-01 Thread Oren Laadan
Louis Rilling wrote: On Fri, Aug 01, 2008 at 10:15:26AM -0400, Oren Laadan wrote: Louis Rilling wrote: On Thu, Jul 31, 2008 at 03:12:32PM -0400, Oren Laadan wrote: Louis Rilling wrote: On Thu, Jul 31, 2008 at 12:28:57PM -0400, Oren Laadan wrote: Louis Rilling wrote: On Thu, Jul 31, 2008

[Devel] Re: [RFC][PATCH 2/2] CR: handle a single task with private memory maps

2008-07-31 Thread Serge E. Hallyn
Quoting Louis Rilling ([EMAIL PROTECTED]): On Wed, Jul 30, 2008 at 10:40:35AM -0700, Dave Hansen wrote: On Wed, 2008-07-30 at 11:52 -0500, Serge E. Hallyn wrote: This list is getting on my nerves. Louis, I'm sorry the threading is going to get messed up. I think I just cleared

[Devel] Re: [RFC][PATCH 2/2] CR: handle a single task with private memory maps

2008-07-31 Thread Oren Laadan
Louis Rilling wrote: On Wed, Jul 30, 2008 at 02:27:52PM -0400, Oren Laadan wrote: Louis Rilling wrote: +/** + * cr_vma_fill_pgarr - fill a page-array with addr/page tuples for a vma + * @ctx - checkpoint context + * @pgarr - page-array to fill + * @vma - vma to scan + * @start - start

[Devel] Re: [RFC][PATCH 2/2] CR: handle a single task with private memory maps

2008-07-31 Thread Oren Laadan
Louis Rilling wrote: On Thu, Jul 31, 2008 at 11:09:54AM -0400, Oren Laadan wrote: Louis Rilling wrote: On Wed, Jul 30, 2008 at 06:20:32PM -0400, Oren Laadan wrote: Serge E. Hallyn wrote: Quoting Oren Laadan ([EMAIL PROTECTED]): +int do_checkpoint(struct cr_ctx *ctx) +{ +int ret;

[Devel] Re: [RFC][PATCH 2/2] CR: handle a single task with private memory maps

2008-07-31 Thread Oren Laadan
Louis Rilling wrote: On Thu, Jul 31, 2008 at 12:28:57PM -0400, Oren Laadan wrote: Louis Rilling wrote: On Thu, Jul 31, 2008 at 11:09:54AM -0400, Oren Laadan wrote: Louis Rilling wrote: On Wed, Jul 30, 2008 at 06:20:32PM -0400, Oren Laadan wrote: Serge E. Hallyn wrote: Quoting Oren Laadan

[Devel] Re: [RFC][PATCH 2/2] CR: handle a single task with private memory maps

2008-07-31 Thread Serge E. Hallyn
Quoting Oren Laadan ([EMAIL PROTECTED]): Serge E. Hallyn wrote: Quoting Oren Laadan ([EMAIL PROTECTED]): +int do_checkpoint(struct cr_ctx *ctx) +{ + int ret; + + /* FIX: need to test whether container is checkpointable */ + + ret = cr_write_hdr(ctx); + if (!ret) +

[Devel] Re: [RFC][PATCH 2/2] CR: handle a single task with private memory maps

2008-07-30 Thread Serge E. Hallyn
This list is getting on my nerves. Louis, I'm sorry the threading is going to get messed up. - Forwarded message from [EMAIL PROTECTED] - Subject: Content filtered message notification From: [EMAIL PROTECTED] To: [EMAIL PROTECTED] Date: Wed, 30 Jul 2008 09:16:12 -0700 The attached

[Devel] Re: [RFC][PATCH 2/2] CR: handle a single task with private memory maps

2008-07-30 Thread Dave Hansen
On Wed, 2008-07-30 at 11:52 -0500, Serge E. Hallyn wrote: This list is getting on my nerves. Louis, I'm sorry the threading is going to get messed up. I think I just cleared out the mime type filtering. -- Dave ___ Containers mailing list [EMAIL

[Devel] Re: [RFC][PATCH 2/2] CR: handle a single task with private memory maps

2008-07-30 Thread Oren Laadan
KOSAKI Motohiro wrote: Hi Expand the template sys_checkpoint and sys_restart to be able to dump and restore a single task. The task's address space may consist of only private, simple vma's - anonymous or file-mapped. This big patch adds a mechanism to transfer data between kernel or

[Devel] Re: [RFC][PATCH 2/2] CR: handle a single task with private memory maps

2008-07-30 Thread Oren Laadan
Louis Rilling wrote: Hi Oren, On Tue, Jul 29, 2008 at 11:27:17PM -0400, Oren Laadan wrote: Expand the template sys_checkpoint and sys_restart to be able to dump and restore a single task. The task's address space may consist of only private, simple vma's - anonymous or file-mapped. This

[Devel] Re: [RFC][PATCH 2/2] CR: handle a single task with private memory maps

2008-07-30 Thread Serge E. Hallyn
Quoting Oren Laadan ([EMAIL PROTECTED]): +int do_checkpoint(struct cr_ctx *ctx) +{ + int ret; + + /* FIX: need to test whether container is checkpointable */ + + ret = cr_write_hdr(ctx); + if (!ret) + ret = cr_write_task(ctx, current); + if (!ret) +

[Devel] Re: [RFC][PATCH 2/2] CR: handle a single task with private memory maps

2008-07-30 Thread Oren Laadan
Serge E. Hallyn wrote: Quoting Oren Laadan ([EMAIL PROTECTED]): +int do_checkpoint(struct cr_ctx *ctx) +{ +int ret; + +/* FIX: need to test whether container is checkpointable */ + +ret = cr_write_hdr(ctx); +if (!ret) +ret = cr_write_task(ctx, current); +

[Devel] Re: [RFC][PATCH 2/2] CR: handle a single task with private memory maps

2008-07-30 Thread Dave Hansen
On Tue, 2008-07-29 at 23:27 -0400, Oren Laadan wrote: Expand the template sys_checkpoint and sys_restart to be able to dump and restore a single task. The task's address space may consist of only private, simple vma's - anonymous or file-mapped. So, can we all agree that this is a good

[Devel] Re: [RFC][PATCH 2/2] CR: handle a single task with private memory maps

2008-07-29 Thread KOSAKI Motohiro
Hi Expand the template sys_checkpoint and sys_restart to be able to dump and restore a single task. The task's address space may consist of only private, simple vma's - anonymous or file-mapped. This big patch adds a mechanism to transfer data between kernel or user space to and from the