• Arseniy Krasnov's avatar
    vsock/virtio: MSG_ZEROCOPY flag support · 581512a6
    Arseniy Krasnov authored
    This adds handling of MSG_ZEROCOPY flag on transmission path:
    
    1) If this flag is set and zerocopy transmission is possible (enabled
       in socket options and transport allows zerocopy), then non-linear
       skb will be created and filled with the pages of user's buffer.
       Pages of user's buffer are locked in memory by 'get_user_pages()'.
    2) Replaces way of skb owning: instead of 'skb_set_owner_sk_safe()' it
       calls 'skb_set_owner_w()'. Reason of this change is that
       '__zerocopy_sg_from_iter()' increments 'sk_wmem_alloc' of socket, so
       to decrease this field correctly, proper skb destructor is needed:
       'sock_wfree()'. This destructor is set by 'skb_set_owner_w()'.
    3) Adds new callback to 'struct virtio_transport': 'can_msgzerocopy'.
       If this callback is set, then transport needs extra check to be able
       to send provided number of buffers in zerocopy mode. Currently, the
       only transport that needs this callback set is virtio, because this
       transport adds new buffers to the virtio queue and we need to check,
       that number of these buffers is less than size of the queue (it is
       required by virtio spec). vhost and loopback transports don't need
       this check.
    Signed-off-by: default avatarArseniy Krasnov <avkrasnov@salutedevices.com>
    Reviewed-by: default avatarStefano Garzarella <sgarzare@redhat.com>
    Acked-by: default avatarMichael S. Tsirkin <mst@redhat.com>
    Signed-off-by: default avatarPaolo Abeni <pabeni@redhat.com>
    581512a6
virtio_transport_common.c 39.5 KB