On Wed, 2008-04-02 at 18:24 -0700, Christoph Lameter wrote:
> Ok lets forget about the single theaded thing to solve the registration 
> races. As Andrea pointed out this still has ssues with other subscribed 
> subsystems (and also try_to_unmap). We could do something like what 
> stop_machine_run does: First disable all running subsystems before 
> registering a new one.
> 
> Maybe this is a possible solution.
> 
> 
> Subject: EMM: disable other notifiers before register and unregister
> 
> As Andrea has pointed out: There are races during registration if other
> subsystem notifiers are active while we register a callback.
> 
> Solve that issue by adding two new notifiers:
> 
> emm_stop
>       Stops the notifier operations. Notifier must block on
>       invalidate_start and emm_referenced from this point on.
>       If an invalidate_start has not been completed by a call
>       to invalidate_end then the driver must wait until the
>       operation is complete before returning.
> 
> emm_start
>       Restart notifier operations.

Please use pause and resume or something like that. stop-start is an
unnatural order; we usually start before we stop, whereas we pause first
and resume later.

> Before registration all other subscribed subsystems are stopped.
> Then the new subsystem is subscribed and things can get running
> without consistency issues.
> 
> Subsystems are restarted after the lists have been updated.
> 
> This also works for unregistering. If we can get all subsystems
> to stop then we can also reliably unregister a subsystem. So
> provide that callback.
> 
> Signed-off-by: Christoph Lameter <[EMAIL PROTECTED]>
> 
> ---
>  include/linux/rmap.h |   10 +++++++---
>  mm/rmap.c            |   30 ++++++++++++++++++++++++++++++
>  2 files changed, 37 insertions(+), 3 deletions(-)
> 
> Index: linux-2.6/include/linux/rmap.h
> ===================================================================
> --- linux-2.6.orig/include/linux/rmap.h       2008-04-02 18:16:07.906032549 
> -0700
> +++ linux-2.6/include/linux/rmap.h    2008-04-02 18:17:10.291070009 -0700
> @@ -94,7 +94,9 @@ enum emm_operation {
>       emm_release,            /* Process exiting, */
>       emm_invalidate_start,   /* Before the VM unmaps pages */
>       emm_invalidate_end,     /* After the VM unmapped pages */
> -     emm_referenced          /* Check if a range was referenced */
> +     emm_referenced,         /* Check if a range was referenced */
> +     emm_stop,               /* Halt all faults/invalidate_starts */
> +     emm_start,              /* Restart operations */
>  };
>  
>  struct emm_notifier {
> @@ -126,13 +128,15 @@ static inline int emm_notify(struct mm_s
>  
>  /*
>   * Register a notifier with an mm struct. Release occurs when the process
> - * terminates by calling the notifier function with emm_release.
> + * terminates by calling the notifier function with emm_release or when
> + * emm_notifier_unregister is called.
>   *
>   * Must hold the mmap_sem for write.
>   */
>  extern void emm_notifier_register(struct emm_notifier *e,
>                                       struct mm_struct *mm);
> -
> +extern void emm_notifier_unregister(struct emm_notifier *e,
> +                                     struct mm_struct *mm);
>  
>  /*
>   * Called from mm/vmscan.c to handle paging out
> Index: linux-2.6/mm/rmap.c
> ===================================================================
> --- linux-2.6.orig/mm/rmap.c  2008-04-02 18:16:09.378057062 -0700
> +++ linux-2.6/mm/rmap.c       2008-04-02 18:16:10.710079201 -0700
> @@ -289,16 +289,46 @@ void emm_notifier_release(struct mm_stru
>  /* Register a notifier */
>  void emm_notifier_register(struct emm_notifier *e, struct mm_struct *mm)
>  {
> +     /* Bring all other notifiers into a quiescent state */
> +     emm_notify(mm, emm_stop, 0, TASK_SIZE);
> +
>       e->next = mm->emm_notifier;
> +
>       /*
>        * The update to emm_notifier (e->next) must be visible
>        * before the pointer becomes visible.
>        * rcu_assign_pointer() does exactly what we need.
>        */
>       rcu_assign_pointer(mm->emm_notifier, e);
> +
> +     /* Continue notifiers */
> +     emm_notify(mm, emm_start, 0, TASK_SIZE);
>  }
>  EXPORT_SYMBOL_GPL(emm_notifier_register);
>  
> +/* Unregister a notifier */
> +void emm_notifier_unregister(struct emm_notifier *e, struct mm_struct *mm)
> +{
> +     struct emm_notifier *p;
> +
> +     emm_notify(mm, emm_stop, 0, TASK_SIZE);
> +
> +     p = mm->emm_notifier;
> +     if (e == p)
> +             mm->emm_notifier = e->next;
> +     else {
> +             while (p->next != e)
> +                     p = p->next;
> +
> +             p->next = e->next;
> +     }
> +     e->next = mm->emm_notifier;
> +
> +     emm_notify(mm, emm_start, 0, TASK_SIZE);
> +     e->callback(e, mm, emm_release, 0, TASK_SIZE);
> +}
> +EXPORT_SYMBOL_GPL(emm_notifier_unregister);
> +
>  /*
>   * Perform a callback
>   *
> 


-------------------------------------------------------------------------
Check out the new SourceForge.net Marketplace.
It's the best place to buy or sell services for
just about anything Open Source.
http://ad.doubleclick.net/clk;164216239;13503038;w?http://sf.net/marketplace
_______________________________________________
kvm-devel mailing list
kvm-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/kvm-devel

Reply via email to