• Mark Rutland's avatar
    arm64: uaccess: simplify uaccess_mask_ptr() · 2305b809
    Mark Rutland authored
    We introduced uaccess pointer masking for arm64 in commit:
    
      4d8efc2d ("arm64: Use pointer masking to limit uaccess speculation")
    
    Which was intended to prevent speculative uaccesses to kernel memory on
    CPUs where access permissions were not respected under speculation.
    
    At the time, the uaccess primitives were occasionally used to access
    kernel memory, with the maximum permitted address held in
    thread_info::addr_limit. Consequently, the address masking needed to
    take this dynamic limit into account.
    
    Subsequently the uaccess primitives were reworked such that they are
    only used for user memory, and as of commit:
    
      3d2403fd ("arm64: uaccess: remove set_fs()")
    
    ... the address limit was made a compile-time constant, but the logic
    was otherwise unchanged.
    
    Regardless of the configured VA size or whether TBI is in use, the
    address space can be divided into three ranges:
    
    * The TTBR0 VA range, for which any valid pointer has bit 55 *clear*,
      and any non-tag bits [63-56] must match bit 55 (i.e. must be clear).
    
    * The TTBR1 VA range, for which any valid pointer has bit 55 *set*, and
      any non-tag bits [63-56] must match bit 55 (i.e. must be set).
    
    * The gap between the TTBR0 and TTBR1 ranges, where bit 55 may be set or
      clear, but any access will result in a fault.
    
    As the uaccess primitives are now only used for user memory in the TTBR0
    VA range, we can prevent generation of TTBR1 addresses by clearing bit
    55, which will either result in a TTBR0 address or a faulting address
    between the TTBR VA ranges.
    
    This is beneficial for code generation as:
    
    * We no longer clobber the condition codes.
    
    * We no longer burn a register on (TASK_SIZE_MAX - 1).
    
    * We no longer need to consume the untagged pointer.
    
    When building a defconfig v6.0-rc3 with GCC 12.1.0, this change makes
    the resulting Image 64KiB smaller.
    Signed-off-by: default avatarMark Rutland <mark.rutland@arm.com>
    Cc: James Morse <james.morse@arm.com>
    Cc: Robin Murphy <robin.murphy@arm.com>
    Cc: Will Deacon <will@kernel.org>
    Reviewed-by: default avatarRobin Murphy <robin.murphy@arm.com>
    Link: https://lore.kernel.org/r/20220922151053.3520750-1-mark.rutland@arm.com
    [catalin.marinas@arm.com: remove csdb() as the bit clearing is unconditional]
    Signed-off-by: default avatarCatalin Marinas <catalin.marinas@arm.com>
    2305b809
uaccess.h 12.8 KB