• Pavel Begunkov's avatar
    sock: optimise UDP sock_wfree() refcounting · 052ada09
    Pavel Begunkov authored
    For non SOCK_USE_WRITE_QUEUE sockets, sock_wfree() (atomically) puts
    ->sk_wmem_alloc twice. It's needed to keep the socket alive while
    calling ->sk_write_space() after the first put.
    
    However, some sockets, such as UDP, are freed by RCU
    (i.e. SOCK_RCU_FREE) and use already RCU-safe sock_def_write_space().
    Carve a fast path for such sockets, put down all refs in one go before
    calling sock_def_write_space() but guard the socket from being freed
    by an RCU read section.
    
    note: because TCP sockets are marked with SOCK_USE_WRITE_QUEUE it
    doesn't add extra checks in its path.
    Signed-off-by: default avatarPavel Begunkov <asml.silence@gmail.com>
    Signed-off-by: default avatarDavid S. Miller <davem@davemloft.net>
    052ada09
sock.c 94.4 KB