shinys000114/linux
1
0
Fork 0
mirror of https://github.com/hardkernel/linux.git synced 2026-06-08 03:40:35 +09:00
Code Issues Packages Projects Releases Wiki Activity
Files
cfcf226fdad1be705f5fa028f6af5eb80e5c4d37
linux/mm
History
Jason Gunthorpe f1f505f3b4 UPSTREAM: mm/gup: remove the vma allocation from gup_longterm_locked() 
Long ago there wasn't a FOLL_LONGTERM flag so this DAX check was done by
post-processing the VMA list.

These days it is trivial to just check each VMA to see if it is DAX before
processing it inside __get_user_pages() and return failure if a DAX VMA is
encountered with FOLL_LONGTERM.

Removing the allocation of the VMA list is a significant speed up for many
call sites.

Add an IS_ENABLED to vma_is_fsdax so that code generation is unchanged
when DAX is compiled out.

Remove the dummy version of __gup_longterm_locked() as !CONFIG_CMA already
makes memalloc_nocma_save(), check_and_migrate_cma_pages(), and
memalloc_nocma_restore() into a NOP.

Bug: 209719897
Link: https://lkml.kernel.org/r/0-v1-5551df3ed12e+b8-gup_dax_speedup_jgg@nvidia.com
Signed-off-by: Jason Gunthorpe <jgg@nvidia.com>
Reviewed-by: Ira Weiny <ira.weiny@intel.com>
Cc: Dan Williams <dan.j.williams@intel.com>
Cc: John Hubbard <jhubbard@nvidia.com>
Cc: Pavel Tatashin <pasha.tatashin@soleen.com>
Signed-off-by: Andrew Morton <akpm@linux-foundation.org>
Signed-off-by: Linus Torvalds <torvalds@linux-foundation.org>
Signed-off-by: Minchan Kim <minchan@google.com>
(cherry picked from commit 52650c8b46)
Change-Id: I8be099dc7b617916254c2650ff8a55a6b926a32e
(cherry picked from commit 78ea29e570)
2021-12-09 19:43:20 +00:00
..
kasan
BACKPORT: FROMLIST: kasan: add memzero int for unaligned size at DEBUG
2021-07-15 16:49:20 +00:00
kfence
UPSTREAM: kfence: use TASK_IDLE when awaiting allocation
2021-09-24 15:28:22 -07:00
backing-dev.c
bdi: replace BDI_CAP_NO_{WRITEBACK,ACCT_DIRTY} with a single flag
2020-09-24 13:43:39 -06:00
balloon_compaction.c
…
cleancache.c
…
cma_debug.c
FROMLIST: mm: cma: introduce gfp flag in cma_alloc instead of no_warn
2021-01-25 12:21:02 -08:00
cma_sysfs.c
ANDROID: make cma_sysfs experimental
2021-03-25 19:20:18 +00:00
cma.c
ANDROID: mm: cma do not sleep for __GFP_NORETRY
2021-07-14 11:54:49 -07:00
cma.h
ANDROID: GKI: add OEM data in cma struct
2021-06-04 11:15:16 -07:00
compaction.c
FROMLIST: mm: compaction: fix wakeup logic of proactive compaction
2021-06-17 14:16:29 -07:00
debug_page_ref.c
…
debug_vm_pgtable.c
mm/debug_vm_pgtable: ensure THP availability via has_transparent_hugepage()
2021-07-14 16:56:13 +02:00
debug.c
ANDROID: mm: introduce page_pinner
2021-04-30 09:13:34 -07:00
dmapool.c
mm/dmapool.c: replace hard coded function name with __func__
2020-10-13 18:38:32 -07:00
early_ioremap.c
…
fadvise.c
mm, fadvise: improve the expensive remote LRU cache draining after FADV_DONTNEED
2020-10-13 18:38:29 -07:00
failslab.c
…
filemap.c
ANDROID: mm: Add hooks to filemap_fault for oem's optimization
2021-06-17 14:16:47 -07:00
frame_vector.c
…
frontswap.c
mm/frontswap: mark various intentional data races
2020-08-14 19:56:56 -07:00
gup_benchmark.c
mm/gup_benchmark: take the mmap lock around GUP
2020-10-18 09:27:09 -07:00
gup.c
UPSTREAM: mm/gup: remove the vma allocation from gup_longterm_locked()
2021-12-09 19:43:20 +00:00
highmem.c
mm/highmem.c: clean up endif comments
2020-10-16 11:11:18 -07:00
hmm.c
mm/hmm: bypass devmap pte when all pfn requested flags are fulfilled
2021-09-18 13:40:36 +02:00
huge_memory.c
Merge 5.10.53 into android13-5.10
2021-07-25 15:35:50 +02:00
hugetlb_cgroup.c
hugetlb_cgroup: fix imbalanced css_get and css_put pair for shared mappings
2021-03-30 14:31:54 +02:00
hugetlb.c
Merge 5.10.82 into android13-5.10
2021-11-26 15:31:49 +01:00
hwpoison-inject.c
mm,hwpoison-inject: don't pin for hwpoison_filter
2020-10-16 11:11:16 -07:00
init-mm.c
FROMLIST: mm: protect mm_rb tree with a rwlock
2021-01-22 18:00:57 +00:00
internal.h
Merge 5.10.47 into android13-5.10
2021-06-30 19:29:52 +02:00
interval_tree.c
…
ioremap.c
…
Kconfig
FROMLIST: mm: cma: support sysfs
2021-03-25 19:20:09 +00:00
Kconfig.debug
ANDROID: mm: introduce page_pinner
2021-04-30 09:13:34 -07:00
khugepaged.c
Merge 5.10.78 into android13-5.10
2021-11-06 14:21:25 +01:00
kmemleak.c
UPSTREAM: kfence: make compatible with kmemleak
2021-04-29 08:13:57 +02:00
ksm.c
Merge 5.10.38 into android12-5.10
2021-05-20 15:35:25 +02:00
list_lru.c
mm: list_lru: set shrinker map bit when child nr_items is not zero
2020-12-06 10:19:07 -08:00
maccess.c
uaccess: add force_uaccess_{begin,end} helpers
2020-08-12 10:57:59 -07:00
madvise.c
Merge 5.10.24 into android12-5.10-lts
2021-03-19 09:42:56 +01:00
Makefile
ANDROID: mm: introduce page_pinner
2021-04-30 09:13:34 -07:00
mapping_dirty_helpers.c
…
memblock.c
Merge 5.10.54 into android13-5.10
2021-07-28 15:22:59 +02:00
memcontrol.c
Merge 5.10.80 into android13-5.10
2021-11-19 07:47:18 +01:00
memfd.c
…
memory_hotplug.c
Merge 5.10.68 into android13-5.10
2021-09-23 09:29:33 +02:00
memory-failure.c
mm,hwpoison: return -EBUSY when migration fails
2021-07-19 09:44:56 +02:00
memory.c
Revert "ANDROID: mm: Throttle rss_stat tracepoint"
2021-11-18 20:34:13 +00:00
mempolicy.c
FROMLIST: mm: replace migrate_[prep|finish] with lru_cache_[disable|enable]
2021-03-23 04:05:24 +00:00
mempool.c
FROMGIT: kasan: use separate (un)poison implementation for integrated init
2021-06-17 14:39:37 -07:00
memremap.c
mm: fix memory_failure() handling of dax-namespace metadata
2021-03-04 11:38:21 +01:00
memtest.c
…
migrate.c
Merge 5.10.47 into android13-5.10
2021-06-30 19:29:52 +02:00
mincore.c
mm: factor find_get_incore_page out of mincore_page
2020-10-13 18:38:29 -07:00
mlock.c
ANDROID: mm: page_pinner: unattribute follow_page in munlock_vma_pages_range
2021-04-30 09:13:35 -07:00
mm_init.c
…
mmap.c
ANDROID: android: export kernel function vm_unmapped_area
2021-07-08 22:12:00 +00:00
mmu_gather.c
…
mmu_notifier.c
mm/mmu_notifiers: ensure range_end() is paired with range_start()
2021-03-30 14:32:06 +02:00
mmzone.c
ANDROID: mm: export zone_watermark_ok
2021-02-25 19:36:38 +00:00
mprotect.c
FROMGIT: mm: improve mprotect(R|W) efficiency on pages referenced once
2021-06-15 19:33:15 +00:00
mremap.c
UPSTREAM: mm/mremap: hold the rmap lock in write mode when moving page table entries.
2021-07-15 18:39:14 +00:00
msync.c
…
nommu.c
ANDROID: mm: allow vmas with vm_ops to be speculatively handled
2021-04-23 18:42:39 -07:00
oom_kill.c
Merge 5.10.80 into android13-5.10
2021-11-19 07:47:18 +01:00
OWNERS
ANDROID: Add OWNERS files referring to the respective android-mainline OWNERS
2021-04-03 14:11:30 +00:00
page_alloc.c
Merge 5.10.64 into android13-5.10
2021-09-12 09:16:05 +02:00
page_counter.c
mm/page_counter: correct the obsolete func name in the comment of page_counter_try_charge()
2020-10-13 18:38:30 -07:00
page_ext.c
ANDROID: mm: introduce page_pinner
2021-04-30 09:13:34 -07:00
page_idle.c
…
page_io.c
UPSTREAM: mm/page_io: use pr_alert_ratelimited for swap read/write errors
2021-03-30 18:44:11 +00:00
page_isolation.c
ANDROID: mm: cma: skip problematic pageblock
2021-07-14 11:54:49 -07:00
page_owner.c
ANDROID: mm: Make page_owner_enabled global
2021-04-01 00:09:00 +00:00
page_pinner.c
ANDROID: mm: page_pinner: use EXPORT_SYMBOL_GPL
2021-07-14 03:38:32 +00:00
page_poison.c
UPSTREAM: kasan: fix conflict with page poisoning
2021-07-19 20:39:17 +00:00
page_reporting.c
mm: rename page_order() to buddy_order()
2020-10-16 11:11:19 -07:00
page_reporting.h
…
page_vma_mapped.c
mm/thp: another PVMW_SYNC fix in page_vma_mapped_walk()
2021-06-30 08:47:29 -04:00
page-writeback.c
ANDROID: vendor_hooks: add hook to balance_dirty_pages()
2021-05-20 19:38:42 +00:00
pagewalk.c
…
percpu-internal.h
percpu: make pcpu_nr_empty_pop_pages per chunk type
2021-04-14 08:42:03 +02:00
percpu-km.c
…
percpu-stats.c
percpu: make pcpu_nr_empty_pop_pages per chunk type
2021-04-14 08:42:03 +02:00
percpu-vm.c
…
percpu.c
Merge 5.10.30 into android12-5.10
2021-04-15 14:23:41 +02:00
pgalloc-track.h
…
pgtable-generic.c
mm/thp: fix __split_huge_pmd_locked() on shmem migration entry
2021-06-30 08:47:26 -04:00
process_vm_access.c
mm/process_vm_access.c: include compat.h
2021-01-19 18:27:21 +01:00
ptdump.c
Merge 5.10.32 into android12-5.10
2021-04-22 11:12:08 +02:00
readahead.c
ANDROID: mm: Create vendor hooks to control ZONE_MOVABLE allocations
2020-12-01 18:07:54 +00:00
rmap.c
Merge 5.10.47 into android13-5.10
2021-06-30 19:29:52 +02:00
rodata_test.c
mm/rodata_test.c: fix missing function declaration
2020-08-21 09:52:53 -07:00
shmem.c
Merge 5.10.53 into android13-5.10
2021-07-25 15:35:50 +02:00
shuffle.c
mm: rename page_order() to buddy_order()
2020-10-16 11:11:19 -07:00
shuffle.h
…
slab_common.c
Merge 5.10.46 into android13-5.10
2021-06-24 16:52:23 +02:00
slab.c
Merge 5.10.37 into android12-5.10
2021-05-15 09:28:55 +02:00
slab.h
Merge 5.10.82 into android13-5.10
2021-11-26 15:31:49 +01:00
slob.c
…
slub.c
Merge 5.10.76 into android13-5.10
2021-10-27 10:46:26 +02:00
sparse-vmemmap.c
…
sparse.c
mm/sparse: add the missing sparse_buffer_fini() in error branch
2021-05-14 09:50:45 +02:00
swap_cgroup.c
…
swap_slots.c
mm/swap_slots.c: remove always zero and unused return value of enable_swap_slots_cache()
2020-10-13 18:38:30 -07:00
swap_state.c
FROMLIST: mm: protect VMA modifications using VMA sequence count
2021-01-22 17:59:47 +00:00
swap.c
ANDROID: mm: provision to add shmem pages to inactive file lru head
2021-07-14 20:52:01 -07:00
swapfile.c
Merge branch 'android12-5.10' into 'android13-5.10'
2021-07-21 14:24:16 +02:00
truncate.c
mm/thp: unmap_mapping_page() to fix THP truncate_cleanup_page()
2021-06-30 08:47:27 -04:00
usercopy.c
mm/usercopy.c: delete duplicated word
2020-08-12 10:57:58 -07:00
userfaultfd.c
FROMGIT: userfaultfd/shmem: modify shmem_mfill_atomic_pte to use install_pte()
2021-06-04 19:13:10 +00:00
util.c
Merge 5.10.71 into android13-5.10
2021-10-06 17:32:06 +02:00
vmacache.c
…
vmalloc.c
UPSTREAM: mm: vmalloc: prevent use after free in _vm_unmap_aliases
2021-11-09 17:40:40 +00:00
vmpressure.c
FROMLIST: mm, memcg: add mem_cgroup_disabled checks in vmpressure and swap-related functions
2021-07-12 18:26:15 -07:00
vmscan.c
Merge 5.10.67 into android13-5.10
2021-09-18 13:59:45 +02:00
vmstat.c
ANDROID: mm: allow vmas with vm_ops to be speculatively handled
2021-04-23 18:42:39 -07:00
workingset.c
Merge tag 'xarray-5.9' of git://git.infradead.org/users/willy/xarray
2020-10-20 14:39:37 -07:00
z3fold.c
mm/z3fold: use release_z3fold_page_locked() to release locked z3fold page
2021-07-14 16:56:51 +02:00
zbud.c
mm/zbud: remove redundant initialization
2020-10-13 18:38:34 -07:00
zpool.c
mm/zpool.c: delete duplicated word and fix grammar
2020-08-12 10:57:58 -07:00
zsmalloc.c
Merge 5.10.80 into android13-5.10
2021-11-19 07:47:18 +01:00
zswap.c
…