kernel/linux.git/net/core/hotdata.c, branch v6.12.80Linux kernel stable tree (mirror)https://git.radix-linux.su/kernel/linux.git/atom?h=v6.12.802024-05-01T01:46:52+00:00net: move sysctl_mem_pcpu_rsv to net_hotdata2024-05-01T01:46:52+00:00Eric Dumazetedumazet@google.com2024-04-29T13:40:25+00:00urn:sha1:c204fef97ee62ca3310f43d12bbda4eb10266c7c
sysctl_mem_pcpu_rsv is used in TCP fast path,
move it to net_hodata for better cache locality.
Signed-off-by: Eric Dumazet <edumazet@google.com>
Reviewed-by: David Ahern <dsahern@kernel.org>
Link: https://lore.kernel.org/r/20240429134025.1233626-6-edumazet@google.com
Signed-off-by: Jakub Kicinski <kuba@kernel.org>
net: move sysctl_skb_defer_max to net_hotdata2024-05-01T01:46:52+00:00Eric Dumazetedumazet@google.com2024-04-29T13:40:22+00:00urn:sha1:d480dc76d9f8a72671a6f9a7d987d2389c2e2ee4
sysctl_skb_defer_max is used in TCP fast path,
move it to net_hodata.
Signed-off-by: Eric Dumazet <edumazet@google.com>
Reviewed-by: David Ahern <dsahern@kernel.org>
Link: https://lore.kernel.org/r/20240429134025.1233626-3-edumazet@google.com
Signed-off-by: Jakub Kicinski <kuba@kernel.org>
net: move sysctl_max_skb_frags to net_hotdata2024-05-01T01:46:52+00:00Eric Dumazetedumazet@google.com2024-04-29T13:40:21+00:00urn:sha1:a86a0661b86f310c0b73a30c829648864f0b2619
sysctl_max_skb_frags is used in TCP and MPTCP fast paths,
move it to net_hodata for better cache locality.
Signed-off-by: Eric Dumazet <edumazet@google.com>
Reviewed-by: David Ahern <dsahern@kernel.org>
Link: https://lore.kernel.org/r/20240429134025.1233626-2-edumazet@google.com
Signed-off-by: Jakub Kicinski <kuba@kernel.org>
net: move dev_rx_weight to net_hotdata2024-03-08T05:12:42+00:00Eric Dumazetedumazet@google.com2024-03-06T16:00:22+00:00urn:sha1:71c0de9bac9c1dda503322c86be4924f055dc6c9
dev_rx_weight is read from process_backlog().
Move it to net_hotdata for better cache locality.
Signed-off-by: Eric Dumazet <edumazet@google.com>
Acked-by: Soheil Hassas Yeganeh <soheil@google.com>
Reviewed-by: David Ahern <dsahern@kernel.org>
Link: https://lore.kernel.org/r/20240306160031.874438-10-edumazet@google.com
Signed-off-by: Jakub Kicinski <kuba@kernel.org>
net: move dev_tx_weight to net_hotdata2024-03-08T05:12:42+00:00Eric Dumazetedumazet@google.com2024-03-06T16:00:21+00:00urn:sha1:26722dc74bf08fd79564cbcad1e5f3e2aa3bf9cc
dev_tx_weight is used in tx fast path.
Move it to net_hotdata for better cache locality.
Signed-off-by: Eric Dumazet <edumazet@google.com>
Acked-by: Soheil Hassas Yeganeh <soheil@google.com>
Reviewed-by: David Ahern <dsahern@kernel.org>
Link: https://lore.kernel.org/r/20240306160031.874438-9-edumazet@google.com
Signed-off-by: Jakub Kicinski <kuba@kernel.org>
net: move netdev_max_backlog to net_hotdata2024-03-08T05:12:42+00:00Eric Dumazetedumazet@google.com2024-03-06T16:00:18+00:00urn:sha1:edbc666cdcbf4a80ada4311c272a2078af87b880
netdev_max_backlog is used in rx fat path.
Move it to net_hodata for better cache locality.
Signed-off-by: Eric Dumazet <edumazet@google.com>
Acked-by: Soheil Hassas Yeganeh <soheil@google.com>
Reviewed-by: David Ahern <dsahern@kernel.org>
Link: https://lore.kernel.org/r/20240306160031.874438-6-edumazet@google.com
Signed-off-by: Jakub Kicinski <kuba@kernel.org>
net: move ptype_all into net_hotdata2024-03-08T05:12:41+00:00Eric Dumazetedumazet@google.com2024-03-06T16:00:17+00:00urn:sha1:0b91fa4bfb1caedd01cb6eb3b733cbc77c9edb0e
ptype_all is used in rx/tx fast paths.
Move it to net_hotdata for better cache locality.
Signed-off-by: Eric Dumazet <edumazet@google.com>
Acked-by: Soheil Hassas Yeganeh <soheil@google.com>
Reviewed-by: David Ahern <dsahern@kernel.org>
Link: https://lore.kernel.org/r/20240306160031.874438-5-edumazet@google.com
Signed-off-by: Jakub Kicinski <kuba@kernel.org>
net: move netdev_tstamp_prequeue into net_hotdata2024-03-08T05:12:41+00:00Eric Dumazetedumazet@google.com2024-03-06T16:00:16+00:00urn:sha1:f59b5416c396ac4910dd7a0cdf26cbb0e1faf529
netdev_tstamp_prequeue is used in rx path.
Move it to net_hotdata for better cache locality.
Signed-off-by: Eric Dumazet <edumazet@google.com>
Acked-by: Soheil Hassas Yeganeh <soheil@google.com>
Reviewed-by: David Ahern <dsahern@kernel.org>
Link: https://lore.kernel.org/r/20240306160031.874438-4-edumazet@google.com
Signed-off-by: Jakub Kicinski <kuba@kernel.org>
net: move netdev_budget and netdev_budget to net_hotdata2024-03-08T05:12:41+00:00Eric Dumazetedumazet@google.com2024-03-06T16:00:15+00:00urn:sha1:ae6e22f7b7f0702015d86cfa036492b94be92f04
netdev_budget and netdev_budget are used in rx path (net_rx_action())
Move them into net_hotdata for better cache locality.
Signed-off-by: Eric Dumazet <edumazet@google.com>
Acked-by: Soheil Hassas Yeganeh <soheil@google.com>
Reviewed-by: David Ahern <dsahern@kernel.org>
Link: https://lore.kernel.org/r/20240306160031.874438-3-edumazet@google.com
Signed-off-by: Jakub Kicinski <kuba@kernel.org>
net: introduce struct net_hotdata2024-03-08T05:12:41+00:00Eric Dumazetedumazet@google.com2024-03-06T16:00:14+00:00urn:sha1:2658b5a8a4eee5fad378d0bde2f221deacbc58f1
Instead of spreading networking critical fields
all over the places, add a custom net_hotdata
structure so that we can precisely control its layout.
In this first patch, move :
- gro_normal_batch used in rx (GRO stack)
- offload_base used in rx and tx (GRO and TSO stacks)
Signed-off-by: Eric Dumazet <edumazet@google.com>
Acked-by: Soheil Hassas Yeganeh <soheil@google.com>
Reviewed-by: David Ahern <dsahern@kernel.org>
Link: https://lore.kernel.org/r/20240306160031.874438-2-edumazet@google.com
Signed-off-by: Jakub Kicinski <kuba@kernel.org>