kernel/linux.git/include/net/hotdata.h, branch v6.12.80Linux kernel stable tree (mirror)https://git.radix-linux.su/kernel/linux.git/atom?h=v6.12.802024-05-01T01:46:52+00:00net: move sysctl_mem_pcpu_rsv to net_hotdata2024-05-01T01:46:52+00:00Eric Dumazetedumazet@google.com2024-04-29T13:40:25+00:00urn:sha1:c204fef97ee62ca3310f43d12bbda4eb10266c7c
sysctl_mem_pcpu_rsv is used in TCP fast path,
move it to net_hodata for better cache locality.
Signed-off-by: Eric Dumazet <edumazet@google.com>
Reviewed-by: David Ahern <dsahern@kernel.org>
Link: https://lore.kernel.org/r/20240429134025.1233626-6-edumazet@google.com
Signed-off-by: Jakub Kicinski <kuba@kernel.org>
net: move sysctl_skb_defer_max to net_hotdata2024-05-01T01:46:52+00:00Eric Dumazetedumazet@google.com2024-04-29T13:40:22+00:00urn:sha1:d480dc76d9f8a72671a6f9a7d987d2389c2e2ee4
sysctl_skb_defer_max is used in TCP fast path,
move it to net_hodata.
Signed-off-by: Eric Dumazet <edumazet@google.com>
Reviewed-by: David Ahern <dsahern@kernel.org>
Link: https://lore.kernel.org/r/20240429134025.1233626-3-edumazet@google.com
Signed-off-by: Jakub Kicinski <kuba@kernel.org>
net: move sysctl_max_skb_frags to net_hotdata2024-05-01T01:46:52+00:00Eric Dumazetedumazet@google.com2024-04-29T13:40:21+00:00urn:sha1:a86a0661b86f310c0b73a30c829648864f0b2619
sysctl_max_skb_frags is used in TCP and MPTCP fast paths,
move it to net_hodata for better cache locality.
Signed-off-by: Eric Dumazet <edumazet@google.com>
Reviewed-by: David Ahern <dsahern@kernel.org>
Link: https://lore.kernel.org/r/20240429134025.1233626-2-edumazet@google.com
Signed-off-by: Jakub Kicinski <kuba@kernel.org>
net: move rps_sock_flow_table to net_hotdata2024-03-08T05:12:43+00:00Eric Dumazetedumazet@google.com2024-03-06T16:00:31+00:00urn:sha1:ce7f49ab741591d83e33e56948bac2f12de6e14e
rps_sock_flow_table and rps_cpu_mask are used in fast path.
Move them to net_hotdata for better cache locality.
Signed-off-by: Eric Dumazet <edumazet@google.com>
Acked-by: Soheil Hassas Yeganeh <soheil@google.com>
Reviewed-by: David Ahern <dsahern@kernel.org>
Link: https://lore.kernel.org/r/20240306160031.874438-19-edumazet@google.com
Signed-off-by: Jakub Kicinski <kuba@kernel.org>
ipv6: move tcp_ipv6_hash_secret and udp_ipv6_hash_secret to net_hotdata2024-03-08T05:12:43+00:00Eric Dumazetedumazet@google.com2024-03-06T16:00:29+00:00urn:sha1:df51b84564159cdd91a67ee0f9e30b42b3a73cef
Use a 32bit hole in "struct net_offload" to store
the remaining 32bit secrets used by TCPv6 and UDPv6.
Signed-off-by: Eric Dumazet <edumazet@google.com>
Acked-by: Soheil Hassas Yeganeh <soheil@google.com>
Reviewed-by: David Ahern <dsahern@kernel.org>
Link: https://lore.kernel.org/r/20240306160031.874438-17-edumazet@google.com
Signed-off-by: Jakub Kicinski <kuba@kernel.org>
ipv6: move inet6_ehash_secret and udp6_ehash_secret into net_hotdata2024-03-08T05:12:43+00:00Eric Dumazetedumazet@google.com2024-03-06T16:00:28+00:00urn:sha1:5af674bb90a030317a02419e04b66ec0dc892dcd
"struct inet6_protocol" has a 32bit hole in 32bit arches.
Use it to store the 32bit secret used by UDP and TCP,
to increase cache locality in rx path.
Signed-off-by: Eric Dumazet <edumazet@google.com>
Acked-by: Soheil Hassas Yeganeh <soheil@google.com>
Reviewed-by: David Ahern <dsahern@kernel.org>
Link: https://lore.kernel.org/r/20240306160031.874438-16-edumazet@google.com
Signed-off-by: Jakub Kicinski <kuba@kernel.org>
inet: move inet_ehash_secret and udp_ehash_secret into net_hotdata2024-03-08T05:12:43+00:00Eric Dumazetedumazet@google.com2024-03-06T16:00:27+00:00urn:sha1:6e0735723ab437793cfab02d50b3ae3539aeb520
"struct net_protocol" has a 32bit hole in 32bit arches.
Use it to store the 32bit secret used by UDP and TCP,
to increase cache locality in rx path.
Signed-off-by: Eric Dumazet <edumazet@google.com>
Acked-by: Soheil Hassas Yeganeh <soheil@google.com>
Reviewed-by: David Ahern <dsahern@kernel.org>
Link: https://lore.kernel.org/r/20240306160031.874438-15-edumazet@google.com
Signed-off-by: Jakub Kicinski <kuba@kernel.org>
inet: move tcp_protocol and udp_protocol to net_hotdata2024-03-08T05:12:43+00:00Eric Dumazetedumazet@google.com2024-03-06T16:00:26+00:00urn:sha1:571bf020be9c3b135e8b6dd87421919953268c1f
These structures are read in rx path, move them to net_hotdata
for better cache locality.
Signed-off-by: Eric Dumazet <edumazet@google.com>
Acked-by: Soheil Hassas Yeganeh <soheil@google.com>
Reviewed-by: David Ahern <dsahern@kernel.org>
Link: https://lore.kernel.org/r/20240306160031.874438-14-edumazet@google.com
Signed-off-by: Jakub Kicinski <kuba@kernel.org>
ipv6: move tcpv6_protocol and udpv6_protocol to net_hotdata2024-03-08T05:12:43+00:00Eric Dumazetedumazet@google.com2024-03-06T16:00:25+00:00urn:sha1:4ea0875b9d897e3c64cdb486788509f1f062285b
These structures are read in rx path, move them to net_hotdata
for better cache locality.
Signed-off-by: Eric Dumazet <edumazet@google.com>
Acked-by: Soheil Hassas Yeganeh <soheil@google.com>
Reviewed-by: David Ahern <dsahern@kernel.org>
Link: https://lore.kernel.org/r/20240306160031.874438-13-edumazet@google.com
Signed-off-by: Jakub Kicinski <kuba@kernel.org>
udp: move udpv4_offload and udpv6_offload to net_hotdata2024-03-08T05:12:43+00:00Eric Dumazetedumazet@google.com2024-03-06T16:00:24+00:00urn:sha1:6a55ca6b0122d4678e3ab54a8553361aae5082f1
These structures are used in GRO and GSO paths.
Move them to net_hodata for better cache locality.
v2: udpv6_offload definition depends on CONFIG_INET=y
Signed-off-by: Eric Dumazet <edumazet@google.com>
Acked-by: Soheil Hassas Yeganeh <soheil@google.com>
Reviewed-by: David Ahern <dsahern@kernel.org>
Link: https://lore.kernel.org/r/20240306160031.874438-12-edumazet@google.com
Signed-off-by: Jakub Kicinski <kuba@kernel.org>