• Viresh Kumar's avatar
    timer: Kick dynticks targets on mod_timer*() calls · 9f6d9baa
    Viresh Kumar authored
    When a timer is enqueued or modified on a dynticks target, that CPU
    must re-evaluate the next tick to service that timer.
    
    The tick re-evaluation is performed by an IPI kick on the target.
    Now while we correctly call wake_up_nohz_cpu() from add_timer_on(), the
    mod_timer*() API family doesn't support so well dynticks targets.
    
    The reason for this is likely that __mod_timer() isn't supposed to
    select an idle target for a timer, unless that target is the current
    CPU, in which case a dynticks idle kick isn't actually needed.
    
    But there is a small race window lurking behind that assumption: the
    elected target has all the time to turn dynticks idle between the call
    to get_nohz_timer_target() and the locking of its base. Hence a risk
    that we enqueue a timer on a dynticks idle destination without kicking
    it. As a result, the timer might be serviced too late in the future.
    
    Also a target elected by __mod_timer() can be in full dynticks mode
    and thus require to be kicked as well. And unlike idle dynticks, this
    concern both local and remote targets.
    
    To fix this whole issue, lets centralize the dynticks kick to
    internal_add_timer() so that it is well handled for all sort of timer
    enqueue. Even timer migration is concerned so that a full dynticks target
    is correctly kicked as needed when timers are migrating to it.
    Signed-off-by: default avatarViresh Kumar <viresh.kumar@linaro.org>
    Signed-off-by: default avatarFrederic Weisbecker <fweisbec@gmail.com>
    Link: http://lkml.kernel.org/r/1403393357-2070-3-git-send-email-fweisbec@gmail.comSigned-off-by: default avatarThomas Gleixner <tglx@linutronix.de>
    9f6d9baa
timer.c 47.3 KB