Pavel Begunkov 27122c079f io_uring: fix unprotected iopoll overflow ... [ 71.490669] WARNING: CPU: 3 PID: 17070 at io_uring/io_uring.c:769 io_cqring_event_overflow+0x47b/0x6b0 [ 71.498381] Call Trace: [ 71.498590] <TASK> [ 71.501858] io_req_cqe_overflow+0x105/0x1e0 [ 71.502194] __io_submit_flush_completions+0x9f9/0x1090 [ 71.503537] io_submit_sqes+0xebd/0x1f00 [ 71.503879] __do_sys_io_uring_enter+0x8c5/0x2380 [ 71.507360] do_syscall_64+0x39/0x80 We decoupled CQ locking from ->task_complete but haven't fixed up places forcing locking for CQ overflows. Fixes: ec26c225f0 ("io_uring: merge iopoll and normal completion paths") Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> Signed-off-by: Jens Axboe <axboe@kernel.dk>		2023-09-07 09:02:29 -06:00
..
advise.c
advise.h
alloc_cache.h
cancel.c	io_uring/cancel: wire up IORING_ASYNC_CANCEL_OP for sync cancel	2023-07-17 10:05:48 -06:00
cancel.h	io_uring/cancel: support opcode based lookup and cancelation	2023-07-17 10:05:48 -06:00
epoll.c	io_uring: undeprecate epoll_ctl support	2023-05-26 20:22:41 -06:00
epoll.h
fdinfo.c	io_uring/fdinfo: only print ->sq_array[] if it's there	2023-09-01 15:08:29 -06:00
fdinfo.h
filetable.c	io_uring: add helpers to decode the fixed file file_ptr	2023-06-20 09:36:22 -06:00
filetable.h	io_uring: add helpers to decode the fixed file file_ptr	2023-06-20 09:36:22 -06:00
fs.c
fs.h
io_uring.c	io_uring: fix unprotected iopoll overflow	2023-09-07 09:02:29 -06:00
io_uring.h	io_uring: force inline io_fill_cqe_req	2023-08-24 17:16:19 -06:00
io-wq.c	io_uring: break out of iowq iopoll on teardown	2023-09-07 09:02:27 -06:00
io-wq.h	io_uring: break out of iowq iopoll on teardown	2023-09-07 09:02:27 -06:00
kbuf.c	io_uring: stop calling free_compound_page()	2023-08-21 14:28:42 -07:00
kbuf.h
Makefile
msg_ring.c	io_uring: use io_file_from_index in io_msg_grab_file	2023-06-20 09:36:22 -06:00
msg_ring.h
net.c	io_uring: never overflow io_aux_cqe	2023-08-11 10:42:57 -06:00
net.h
nop.c
nop.h
notif.c	io_uring/notif: add constant for ubuf_info flags	2023-04-15 14:21:04 -06:00
notif.h	io_uring/notif: add constant for ubuf_info flags	2023-04-15 14:21:04 -06:00
opdef.c	io_uring: Pass whole sqe to commands	2023-05-04 08:19:05 -06:00
opdef.h
openclose.c	io_uring: correct check for O_TMPFILE	2023-08-07 12:34:23 -06:00
openclose.h
poll.c	io_uring: never overflow io_aux_cqe	2023-08-11 10:42:57 -06:00
poll.h	io_uring: avoid indirect function calls for the hottest task_work	2023-06-02 08:55:37 -06:00
refs.h
rsrc.c	io_uring/rsrc: keep one global dummy_ubuf	2023-08-11 10:42:57 -06:00
rsrc.h	io_uring/rsrc: Annotate struct io_mapped_ubuf with __counted_by	2023-08-17 19:14:47 -06:00
rw.c	for-6.6/io_uring-2023-08-28	2023-08-29 20:11:33 -07:00
rw.h	io_uring: avoid indirect function calls for the hottest task_work	2023-06-02 08:55:37 -06:00
slist.h
splice.c	io_uring/splice: use fput() directly	2023-08-10 10:24:25 -06:00
splice.h
sqpoll.c	io_uring: Don't set affinity on a dying sqpoll thread	2023-08-30 09:53:44 -06:00
sqpoll.h	io_uring/sqpoll: fix io-wq affinity when IORING_SETUP_SQPOLL is used	2023-08-16 13:40:28 -06:00
statx.c
statx.h
sync.c
sync.h
tctx.c	io_uring: Add io_uring_setup flag to pre-register ring fd and never install it	2023-05-16 08:06:00 -06:00
tctx.h
timeout.c	io_uring: never overflow io_aux_cqe	2023-08-11 10:42:57 -06:00
timeout.h
uring_cmd.c	io_uring: simplify big_cqe handling	2023-08-24 17:16:19 -06:00
uring_cmd.h	io_uring: Remove unnecessary BUILD_BUG_ON	2023-05-04 08:19:05 -06:00
xattr.c
xattr.h