• Denys Vlasenko's avatar
    x86/asm/entry/64: Do not TRACE_IRQS fast SYSRET64 path · 4416c5a6
    Denys Vlasenko authored
    SYSRET code path has a small irq-off block.
    On this code path, TRACE_IRQS_ON can't be called right before
    interrupts are enabled for real, we can't clobber registers
    there. So current code does it earlier, in a safe place.
    
    But with this, TRACE_IRQS_OFF/ON frames just two fast
    instructions, which is ridiculous: now most of irq-off block is
    _outside_ of the framing.
    
    Do the same thing that we do on SYSCALL entry: do not track this
    irq-off block, it is very small to ever cause noticeable irq
    latency.
    
    Be careful: make sure that "jnz int_ret_from_sys_call_irqs_off"
    now does invoke TRACE_IRQS_OFF - move
    int_ret_from_sys_call_irqs_off label before TRACE_IRQS_OFF.
    Signed-off-by: default avatarDenys Vlasenko <dvlasenk@redhat.com>
    Cc: Alexei Starovoitov <ast@plumgrid.com>
    Cc: Andy Lutomirski <luto@amacapital.net>
    Cc: Borislav Petkov <bp@alien8.de>
    Cc: Frederic Weisbecker <fweisbec@gmail.com>
    Cc: H. Peter Anvin <hpa@zytor.com>
    Cc: Kees Cook <keescook@chromium.org>
    Cc: Linus Torvalds <torvalds@linux-foundation.org>
    Cc: Oleg Nesterov <oleg@redhat.com>
    Cc: Steven Rostedt <rostedt@goodmis.org>
    Cc: Will Drewry <wad@chromium.org>
    Link: http://lkml.kernel.org/r/1427821211-25099-1-git-send-email-dvlasenk@redhat.comSigned-off-by: default avatarIngo Molnar <mingo@kernel.org>
    4416c5a6
entry_64.S 41.2 KB