diff options
| author | Babu Moger <babu.moger@oracle.com> | 2017-08-08 02:52:51 +0300 |
|---|---|---|
| committer | David S. Miller <davem@davemloft.net> | 2017-08-11 00:57:00 +0300 |
| commit | b3a04ed507bf5b85e9eae521f5c6ca1d1bc6a4f2 (patch) | |
| tree | e952ade8ca842529ed89f37061b7b4601f86ff72 /arch/sparc/lib/M7copy_from_user.S | |
| parent | 1ab326934fa1a16f776b014ba482c1be08a205a1 (diff) | |
| download | linux-b3a04ed507bf5b85e9eae521f5c6ca1d1bc6a4f2.tar.xz | |
arch/sparc: Optimized memcpy, memset, copy_to_user, copy_from_user for M7/M8
New algorithm that takes advantage of the M7/M8 block init store
ASI, ie, overlapping pipelines and miss buffer filling.
Full details in code comments.
Signed-off-by: Babu Moger <babu.moger@oracle.com>
Signed-off-by: David S. Miller <davem@davemloft.net>
Diffstat (limited to 'arch/sparc/lib/M7copy_from_user.S')
| -rw-r--r-- | arch/sparc/lib/M7copy_from_user.S | 41 |
1 files changed, 41 insertions, 0 deletions
diff --git a/arch/sparc/lib/M7copy_from_user.S b/arch/sparc/lib/M7copy_from_user.S new file mode 100644 index 000000000000..d0689d762726 --- /dev/null +++ b/arch/sparc/lib/M7copy_from_user.S @@ -0,0 +1,41 @@ +/* + * M7copy_from_user.S: SPARC M7 optimized copy from userspace. + * + * Copyright (c) 2016, Oracle and/or its affiliates. All rights reserved. + */ + + +#define EX_LD(x) \ +98: x; \ + .section __ex_table,"a"; \ + .align 4; \ + .word 98b, __restore_asi; \ + .text; \ + .align 4; + +#define EX_LD_FP(x) \ +98: x; \ + .section __ex_table,"a"; \ + .align 4; \ + .word 98b, __restore_asi_fp; \ + .text; \ + .align 4; + + +#ifndef ASI_AIUS +#define ASI_AIUS 0x11 +#endif + +#define FUNC_NAME M7copy_from_user +#define LOAD(type,addr,dest) type##a [addr] %asi, dest +#define EX_RETVAL(x) 0 + +#ifdef __KERNEL__ +#define PREAMBLE \ + rd %asi, %g1; \ + cmp %g1, ASI_AIUS; \ + bne,pn %icc, raw_copy_in_user; \ + nop +#endif + +#include "M7memcpy.S" |