Peter Zijlstra 2ae5a24749 mm/tlb: Remove tlb_remove_table() non-concurrent condition ...

commit a6f572084f upstream.

Will noted that only checking mm_users is incorrect; we should also
check mm_count in order to cover CPUs that have a lazy reference to
this mm (and could do speculative TLB operations).

If removing this turns out to be a performance issue, we can
re-instate a more complete check, but in tlb_table_flush() eliding the
call_rcu_sched().

Fixes: 2672391169 ("mm, powerpc: move the RCU page-table freeing into generic code")
Reported-by: Will Deacon <will.deacon@arm.com>
Signed-off-by: Peter Zijlstra (Intel) <peterz@infradead.org>
Acked-by: Rik van Riel <riel@surriel.com>
Acked-by: Will Deacon <will.deacon@arm.com>
Cc: Nicholas Piggin <npiggin@gmail.com>
Cc: David Miller <davem@davemloft.net>
Cc: Martin Schwidefsky <schwidefsky@de.ibm.com>
Cc: Michael Ellerman <mpe@ellerman.id.au>
Cc: stable@kernel.org
Signed-off-by: Linus Torvalds <torvalds@linux-foundation.org>
Signed-off-by: Greg Kroah-Hartman <gregkh@linuxfoundation.org>

2023-05-12 17:24:10 +09:00

..

kasan

kasan: fix shadow_size calculation error in kasan_module_alloc

2023-05-12 17:06:05 +09:00

backing-dev.c

block: fix double-free in the failure path of cgwb_bdi_init()

2017-02-26 11:10:52 +01:00

balloon_compaction.c

mm: balloon: use general non-lru movable page feature

2016-07-26 16:19:19 -07:00

bootmem.c

mm: kmemleak: avoid using __va() on addresses that don't have a lowmem mapping

2016-10-11 15:06:33 -07:00

cleancache.c

…

cma_debug.c

…

cma.c

Amlogic: sync the code from mainline. [1/1]

2020-02-04 13:48:58 +09:00

cma.h

codec_mm: add reserved & cma support for 4.9. [1/1]

2018-11-05 05:36:36 -07:00

compaction.c

Amlogic: sync the code from mainline. [1/1]

2020-02-04 13:48:58 +09:00

debug_page_ref.c

…

debug.c

Amlogic: sync the code from mainline. [1/1]

2020-02-04 13:48:58 +09:00

dmapool.c

…

early_ioremap.c

mm/early_ioremap: Fix boot hang with earlyprintk=efi,keep

2018-02-25 11:05:49 +01:00

fadvise.c

mm/fadvise: discard partial page if endbyte is also EOF

2018-05-30 07:50:23 +02:00

failslab.c

…

filemap.c

Merge 4.9.96 into android-4.9

2018-04-24 11:26:46 +02:00

frame_vector.c

mm: fail get_vaddr_frames() for filesystem-dax mappings

2018-02-28 10:18:34 +01:00

frontswap.c

mm, frontswap: convert frontswap_enabled to static key

2016-07-26 16:19:19 -07:00

gup.c

proc: do not access cmdline nor environ from file-backed areas

2018-05-19 10:27:00 +02:00

highmem.c

mm/highmem: make nr_free_highpages() handles all highmem zones by itself

2016-05-19 19:12:14 -07:00

huge_memory.c

mm/huge_memory.c: fix data loss when splitting a file pmd

2023-05-12 16:36:48 +09:00

hugetlb_cgroup.c

mm, hugetlb_cgroup: round limit_in_bytes down to hugepage size

2016-05-20 17:58:30 -07:00

hugetlb.c

mm: hugetlb: yield when prepping struct pages

2018-07-11 16:26:43 +02:00

hwpoison-inject.c

…

init-mm.c

mm: Add a user_ns owner to mm_struct and fix ptrace permission checks

2017-01-06 10:40:13 +01:00

internal.h

mm: use is_migrate_highatomic() to simplify the code

2020-12-17 17:23:23 +09:00

interval_tree.c

…

Kconfig

mm: don't allow deferred pages with NEED_PER_CPU_KM

2018-05-22 16:57:57 +02:00

Kconfig.debug

PM / Hibernate: allow hibernation with PAGE_POISONING_ZERO

2016-09-13 02:35:27 +02:00

khugepaged.c

mm, thp: do not cause memcg oom for thp

2018-05-30 07:50:38 +02:00

kmemcheck.c

…

kmemleak-test.c

…

kmemleak.c

kmemleak: system would panic after enabling kmemleak [1/1]

2020-12-17 17:23:23 +09:00

ksm.c

Amlogic: sync the code from mainline. [1/1]

2020-02-04 13:48:58 +09:00

list_lru.c

mm/list_lru.c: fix list_lru_count_node() to be race free

2017-07-21 07:42:21 +02:00

maccess.c

x86: remove more uaccess_32.h complexity

2016-05-22 17:21:27 -07:00

madvise.c

Merge 4.9.67 into android-4.9

2017-12-05 11:34:59 +01:00

Makefile

Disable the __builtin_return_address() warning globally after all

2016-10-12 10:23:41 -07:00

memblock.c

mm/memblock.c: reversed logic in memblock_discard()

2017-08-30 10:21:47 +02:00

memcontrol.c

memcg: remove memcg_cgroup::id from IDR on mem_cgroup_css_alloc() failure

2023-05-12 17:14:41 +09:00

memory_hotplug.c

mm/memory_hotplug: set magic number to page->freelist instead of page->lru.next

2017-10-21 17:21:36 +02:00

memory-failure.c

mm: hwpoison: call shake_page() after try_to_unmap() for mlocked page

2018-03-24 11:00:21 +01:00

memory.c

mm/tlb: Remove tlb_remove_table() non-concurrent condition

2023-05-12 17:24:10 +09:00

mempolicy.c

Merge 4.9.104 into android-4.9

2018-05-30 13:19:56 +02:00

mempool.c

Revert "mm, mempool: only set __GFP_NOMEMALLOC if there are free elements"

2016-07-28 16:07:41 -07:00

memtest.c

…

migrate.c

Amlogic: sync the code from mainline. [1/1]

2020-02-04 13:48:58 +09:00

mincore.c

mm, swap: use offset of swap entry as key of swap cache

2016-10-07 18:46:28 -07:00

mlock.c

Merge 4.9.31 into android-4.9

2017-06-07 12:37:47 +02:00

mm_init.c

…

mmap.c

Merge 4.9.108 into android-4.9

2018-06-13 16:37:10 +02:00

mmu_context.c

mm/mmu_context, sched/core: Fix mmu_context.h assumption

2016-04-28 11:44:19 +02:00

mmu_notifier.c

…

mmzone.c

mm: optimize for lowmemory killer

2018-04-17 17:58:08 -08:00

mprotect.c

x86/speculation/l1tf: Disallow non privileged high MMIO PROT_NONE mappings

2023-05-12 16:53:04 +09:00

mremap.c

mremap: properly flush TLB before releasing the page (CVE-2018-18281)

2020-12-17 17:23:22 +09:00

msync.c

…

nobootmem.c

mm: discard memblock data later

2017-08-24 17:12:19 -07:00

nommu.c

ptrace: Don't allow accessing an undumpable mm

2017-01-06 10:40:13 +01:00

oom_kill.c

mm, oom_reaper: gather each vma to prevent leaking TLB entry

2017-12-09 22:01:47 +01:00

page_alloc.c

mm, page_alloc: fallback to smallest page when not stealing whole pageblock

2020-12-17 17:23:23 +09:00

page_counter.c

…

page_ext.c

mm/page_ext: support extra space allocation by page_ext user

2016-10-07 18:46:27 -07:00

page_idle.c

mm, vmscan: move lru_lock to the node

2016-07-28 16:07:41 -07:00

page_io.c

mm/page_io.c: replace some BUG_ON()s with VM_BUG_ON_PAGE()

2016-10-07 18:46:29 -07:00

page_isolation.c

mm: optimize for CMA allocate time

2018-03-05 15:34:36 +08:00

page_owner.c

mm/page_owner: don't define fields on struct page_ext by hard-coding

2016-10-07 18:46:27 -07:00

page_poison.c

mm: check the return value of lookup_page_ext for all call sites

2016-06-03 15:06:22 -07:00

page-writeback.c

writeback: safer lock nesting

2018-04-24 09:34:18 +02:00

pagewalk.c

mm/pagewalk.c: report holes in hugetlb ranges

2017-11-24 08:33:42 +01:00

percpu-km.c

…

percpu-vm.c

…

percpu.c

percpu: include linux/sched.h for cond_resched()

2018-05-09 09:50:18 +02:00

pgtable-generic.c

…

process_vm_access.c

mm: remove write/force parameters from __get_user_pages_unlocked()

2016-10-18 14:13:37 -07:00

quicklist.c

…

readahead.c

Merge branch 'android-4.9' into amlogic-4.9-dev

2018-04-24 17:43:19 +08:00

rmap.c

mm, mprotect: flush TLB if potentially racing with a parallel reclaim leaving stale TLB entries

2017-08-11 08:49:29 -07:00

shmem.c

Amlogic: sync the code from mainline. [1/1]

2020-02-04 13:48:58 +09:00

slab_common.c

Amlogic: sync the code from mainline. [1/1]

2020-02-04 13:48:58 +09:00

slab.c

mm, slab: reschedule cache_reap() on the same CPU

2018-04-24 09:34:09 +02:00

slab.h

slub: move synchronize_sched out of slab_mutex on shrink

2017-03-22 12:43:38 +01:00

slob.c

slub: move synchronize_sched out of slab_mutex on shrink

2017-03-22 12:43:38 +01:00

slub.c

mm/slub.c: add __printf verification to slab_err()

2023-05-12 16:39:31 +09:00

sparse-vmemmap.c

treewide: replace obsolete _refok by __ref

2016-08-02 17:31:41 -04:00

sparse.c

mm/memory_hotplug: set magic number to page->freelist instead of page->lru.next

2017-10-21 17:21:36 +02:00

swap_cgroup.c

mm, swap_cgroup: reschedule when neeed in swap_cgroup_swapoff()

2017-07-05 14:40:17 +02:00

swap_state.c

Amlogic: sync the code from mainline. [1/1]

2020-02-04 13:48:58 +09:00

swap.c

mm: optimize for lowmemory killer

2018-04-17 17:58:08 -08:00

swapfile.c

x86/speculation/l1tf: Limit swap file size to MAX_PA/2

2023-05-12 16:53:07 +09:00

truncate.c

fs: add i_blocksize()

2017-06-14 15:06:00 +02:00

usercopy.c

mm: usercopy: Check for module addresses

2016-09-20 16:07:39 -07:00

userfaultfd.c

mm, fs: get rid of PAGE_CACHE_* and page_cache_{get,release} macros

2016-04-04 10:41:08 -07:00

util.c

Provide a function to create a NUL-terminated string from unterminated data

2018-02-25 11:05:41 +01:00

vmacache.c

Amlogic: sync the code from mainline. [1/1]

2020-02-04 13:48:58 +09:00

vmalloc.c

mm: vmalloc: avoid racy handling of debugobjects in vunmap

2023-05-12 16:39:28 +09:00

vmpressure.c

mm: vmpressure: fix sending wrong events on underflow

2017-03-12 06:41:43 +01:00

vmscan.c

Amlogic: sync the code from mainline. [1/1]

2020-02-04 13:48:58 +09:00

vmstat.c

mm: remove total summary of pagetypeinfo

2018-05-21 00:21:18 -07:00

workingset.c

mm: workingset: fix premature shadow node shrinking with cgroups

2017-04-08 09:30:36 +02:00

z3fold.c

mm/z3fold.c: avoid modifying HEADLESS page and minor cleanup

2016-06-03 16:02:55 -07:00

zbud.c

…

zpool.c

…

zsmalloc.c

zsmalloc: calling zs_map_object() from irq is a bug

2017-12-14 09:28:23 +01:00

zswap.c

zswap: re-check zswap_is_full() after do zswap_shrink()

2023-05-12 17:14:18 +09:00