• Sandipan Das's avatar
    bpf: support 64-bit offsets for bpf function calls · 2162fed4
    Sandipan Das authored
    The imm field of a bpf instruction is a signed 32-bit integer.
    For JITed bpf-to-bpf function calls, it holds the offset of the
    start address of the callee's JITed image from __bpf_call_base.
    
    For some architectures, such as powerpc64, this offset may be
    as large as 64 bits and cannot be accomodated in the imm field
    without truncation.
    
    We resolve this by:
    
    [1] Additionally using the auxiliary data of each function to
        keep a list of start addresses of the JITed images for all
        functions determined by the verifier.
    
    [2] Retaining the subprog id inside the off field of the call
        instructions and using it to index into the list mentioned
        above and lookup the callee's address.
    
    To make sure that the existing JIT compilers continue to work
    without requiring changes, we keep the imm field as it is.
    Signed-off-by: default avatarSandipan Das <sandipan@linux.vnet.ibm.com>
    Signed-off-by: default avatarDaniel Borkmann <daniel@iogearbox.net>
    2162fed4
verifier.c 170 KB