Pavel Begunkov 74a37ce697 io_uring: fix waiters missing wake ups ...

There are reports of mariadb hangs, which is caused by a missing
barrier in the waking code resulting in waiters losing events.

The problem was introduced in a backport
3ab9326f93 ("io_uring: wake up optimisations"),
and the change restores the barrier present in the original commit
3ab9326f93 ("io_uring: wake up optimisations")

Reported by: Xan Charbonnet <xan@charbonnet.com>
Fixes: 3ab9326f93 ("io_uring: wake up optimisations")
Link: https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=1093243#99
Reviewed-by: Li Zetao <lizetao1@huawei.com>
Signed-off-by: Pavel Begunkov <asml.silence@gmail.com>
Signed-off-by: Greg Kroah-Hartman <gregkh@linuxfoundation.org>

2025-02-01 18:30:09 +01:00

..

advise.c

io_uring: make io_kiocb_to_cmd() typesafe

2022-08-12 17:01:00 -06:00

advise.h

…

alloc_cache.h

io_uring: fix poll/netmsg alloc caches

2023-04-06 12:10:52 +02:00

cancel.c

io_uring/cancel: re-grab ctx mutex after finishing wait

2023-01-12 12:02:38 +01:00

cancel.h

…

epoll.c

io_uring: undeprecate epoll_ctl support

2023-06-09 10:34:23 +02:00

epoll.h

…

fdinfo.c

io_uring/fdinfo: lock SQ thread while retrieving thread cpu/pid

2023-11-02 09:35:29 +01:00

fdinfo.h

…

filetable.c

io_uring: drop any code related to SCM_RIGHTS

2024-03-26 18:20:22 -04:00

filetable.h

io_uring: kill hot path fixed file bitmap debug checks

2022-10-16 17:07:53 -06:00

fs.c

io_uring/fs: consider link->flags when getting path for LINKAT

2023-12-03 07:32:11 +01:00

fs.h

…

io_uring.c

io_uring: fix waiters missing wake ups

2025-02-01 18:30:09 +01:00

io_uring.h

io_uring/rw: avoid punting to io-wq directly

2024-12-27 13:53:02 +01:00

io-wq.c

io_uring/io-wq: inherit cpuset of cgroup in io worker

2024-10-17 15:21:14 +02:00

io-wq.h

io_uring/sqpoll: fix io-wq affinity when IORING_SETUP_SQPOLL is used

2023-09-19 12:27:54 +02:00

kbuf.c

io_uring: check for non-NULL file pointer in io_file_can_poll()

2024-06-21 14:35:42 +02:00

kbuf.h

io_uring: allow buffer recycling in READV

2022-09-21 10:30:43 -06:00

Makefile

…

msg_ring.c

io_uring/msg_ring: fix missing lock on overflow for IOPOLL

2023-08-30 16:11:05 +02:00

msg_ring.h

io_uring: get rid of double locking

2023-08-30 16:11:04 +02:00

net.c

io_uring/net: harden multishot termination case for recv

2024-10-17 15:22:05 +02:00

net.h

io_uring/net: zerocopy sendmsg

2022-09-21 13:15:02 -06:00

nop.c

io_uring: fail NOP if non-zero op flags is passed in

2024-06-12 11:02:55 +02:00

nop.h

…

notif.c

io_uring/net: introduce IORING_SEND_ZC_REPORT_USAGE flag

2022-12-31 13:33:11 +01:00

notif.h

io_uring/net: introduce IORING_SEND_ZC_REPORT_USAGE flag

2022-12-31 13:33:11 +01:00

opdef.c

io_uring: get rid of double locking

2023-08-30 16:11:04 +02:00

opdef.h

io_uring: dont remove file from msg_ring reqs

2022-12-31 13:33:12 +01:00

openclose.c

io_uring: correct check for O_TMPFILE

2023-08-16 18:27:24 +02:00

openclose.h

…

poll.c

io_uring: always lock in io_apoll_task_func

2023-09-19 12:27:54 +02:00

poll.h

io_uring/poll: allow some retries for poll triggering spuriously

2023-03-11 13:55:43 +01:00

refs.h

…

rsrc.c

io_uring: drop any code related to SCM_RIGHTS

2024-03-26 18:20:22 -04:00

rsrc.h

io_uring: drop any code related to SCM_RIGHTS

2024-03-26 18:20:22 -04:00

rw.c

io_uring/rw: avoid punting to io-wq directly

2024-12-27 13:53:02 +01:00

rw.h

io_uring/rw: don't lose partial IO result on fail

2022-09-21 13:15:02 -06:00

slist.h

…

splice.c

io_uring: make io_kiocb_to_cmd() typesafe

2022-08-12 17:01:00 -06:00

splice.h

…

sqpoll.c

io_uring/sqpoll: fix sqpoll error handling races

2025-01-02 10:30:54 +01:00

sqpoll.h

io_uring/sqpoll: fix io-wq affinity when IORING_SETUP_SQPOLL is used

2023-09-19 12:27:54 +02:00

statx.c

io_uring: make io_kiocb_to_cmd() typesafe

2022-08-12 17:01:00 -06:00

statx.h

…

sync.c

io_uring: make io_kiocb_to_cmd() typesafe

2022-08-12 17:01:00 -06:00

sync.h

…

tctx.c

io_uring/tctx: work around xa_store() allocation error issue

2024-12-14 19:54:49 +01:00

tctx.h

io_uring: simplify __io_uring_add_tctx_node

2022-10-07 12:25:30 -06:00

timeout.c

io_uring: fix io_match_task must_hold

2024-08-03 08:49:53 +02:00

timeout.h

io_uring: remove unused return from io_disarm_next

2022-09-21 13:15:01 -06:00

uring_cmd.c

block/io_uring: pass in issue_flags for uring_cmd task_work handling

2023-04-06 12:10:51 +02:00

uring_cmd.h

…

xattr.c

__io_setxattr(): constify path

2022-09-01 17:39:05 -04:00

xattr.h

…