• Pavel Begunkov's avatar
    io_uring: fix unprotected iopoll overflow · 27122c07
    Pavel Begunkov authored
    [   71.490669] WARNING: CPU: 3 PID: 17070 at io_uring/io_uring.c:769
    io_cqring_event_overflow+0x47b/0x6b0
    [   71.498381] Call Trace:
    [   71.498590]  <TASK>
    [   71.501858]  io_req_cqe_overflow+0x105/0x1e0
    [   71.502194]  __io_submit_flush_completions+0x9f9/0x1090
    [   71.503537]  io_submit_sqes+0xebd/0x1f00
    [   71.503879]  __do_sys_io_uring_enter+0x8c5/0x2380
    [   71.507360]  do_syscall_64+0x39/0x80
    
    We decoupled CQ locking from ->task_complete but haven't fixed up places
    forcing locking for CQ overflows.
    
    Fixes: ec26c225 ("io_uring: merge iopoll and normal completion paths")
    Signed-off-by: default avatarPavel Begunkov <asml.silence@gmail.com>
    Signed-off-by: default avatarJens Axboe <axboe@kernel.dk>
    27122c07
io_uring.c 122 KB