kernel/linux.git/io_uring/Makefile, branch v6.6.132

io_uring: add zc notification infrastructure

2022-07-25T00:41:06+00:00

Add internal part of send zerocopy notifications. There are two main structures, the first one is struct io_notif, which carries inside struct ubuf_info and maps 1:1 to it. io_uring will be binding a number of zerocopy send requests to it and ask to complete (aka flush) it. When flushed and all attached requests and skbs complete, it'll generate one and only one CQE. There are intended to be passed into the network layer as struct msghdr::msg_ubuf. The second concept is notification slots. The userspace will be able to register an array of slots and subsequently addressing them by the index in the array. Slots are independent of each other. Each slot can have only one notifier at a time (called active notifier) but many notifiers during the lifetime. When active, a notifier not going to post any completion but the userspace can attach requests to it by specifying the corresponding slot while issueing send zc requests. Eventually, the userspace will want to "flush" the notifier losing any way to attach new requests to it, however it can use the next atomatically added notifier of this slot or of any other slot. When the network layer is done with all enqueued skbs attached to a notifier and doesn't need the specified in them user data, the flushed notifier will post a CQE. Signed-off-by: Pavel Begunkov Link: https://lore.kernel.org/r/3ecf54c31a85762bf679b0a432c9f43ecf7e61cc.1657643355.git.asml.silence@gmail.com Signed-off-by: Jens Axboe

io_uring: move opcode table to opdef.c

2022-07-25T00:39:12+00:00

We already have the declarations in opdef.h, move the rest into its own file rather than in the main io_uring.c file. Signed-off-by: Jens Axboe

io_uring: move read/write related opcodes to its own file

2022-07-25T00:39:12+00:00

Signed-off-by: Jens Axboe

io_uring: move rsrc related data, core, and commands

2022-07-25T00:39:12+00:00

Signed-off-by: Jens Axboe

io_uring: split provided buffers handling into its own file

2022-07-25T00:39:12+00:00

Move both the opcodes related to it, and the internals code dealing with it. Signed-off-by: Jens Axboe

io_uring: move cancelation into its own file

2022-07-25T00:39:12+00:00

This also helps cleanup the io_uring.h cancel parts, as we can make things static in the cancel.c file, mostly. Signed-off-by: Jens Axboe

io_uring: move poll handling into its own file

2022-07-25T00:39:12+00:00

Add a io_poll_issue() rather than export the general task_work locking and io_issue_sqe(), and put the io_op_defs definition and structure into a separate header file so that poll can use it. Signed-off-by: Jens Axboe

io_uring: move io_uring_task (tctx) helpers into its own file

2022-07-25T00:39:12+00:00

Signed-off-by: Jens Axboe

io_uring: move fdinfo helpers to its own file

2022-07-25T00:39:12+00:00

This also means moving a bit more of the fixed file handling to the filetable side, which makes sense separately too. Signed-off-by: Jens Axboe

io_uring: move SQPOLL related handling into its own file

2022-07-25T00:39:12+00:00

Signed-off-by: Jens Axboe