Nadav Amit caa8b9ed84 hugetlbfs: flush TLBs correctly after huge_pmd_unshare ...

commit a4a118f2ee upstream.

When __unmap_hugepage_range() calls to huge_pmd_unshare() succeed, a TLB
flush is missing.  This TLB flush must be performed before releasing the
i_mmap_rwsem, in order to prevent an unshared PMDs page from being
released and reused before the TLB flush took place.

Arguably, a comprehensive solution would use mmu_gather interface to
batch the TLB flushes and the PMDs page release, however it is not an
easy solution: (1) try_to_unmap_one() and try_to_migrate_one() also call
huge_pmd_unshare() and they cannot use the mmu_gather interface; and (2)
deferring the release of the page reference for the PMDs page until
after i_mmap_rwsem is dropeed can confuse huge_pmd_unshare() into
thinking PMDs are shared when they are not.

Fix __unmap_hugepage_range() by adding the missing TLB flush, and
forcing a flush when unshare is successful.

Fixes: 24669e5847 ("hugetlb: use mmu_gather instead of a temporary linked list for accumulating pages)" # 3.6
Signed-off-by: Nadav Amit <namit@vmware.com>
Reviewed-by: Mike Kravetz <mike.kravetz@oracle.com>
Cc: Aneesh Kumar K.V <aneesh.kumar@linux.vnet.ibm.com>
Cc: KAMEZAWA Hiroyuki <kamezawa.hiroyu@jp.fujitsu.com>
Cc: Andrew Morton <akpm@linux-foundation.org>
Signed-off-by: Linus Torvalds <torvalds@linux-foundation.org>
Signed-off-by: Greg Kroah-Hartman <gregkh@linuxfoundation.org>

2023-05-16 12:21:06 +09:00

..

hardware

Merge tag 'armsoc-soc' of git://git.kernel.org/pub/scm/linux/kernel/git/arm/arm-soc

2016-10-07 21:18:42 -07:00

mach

ARM: Make PCI I/O space optional

2016-06-21 10:54:29 -05:00

xen

xen: avoid type warning in xchg_xen_ulong

2018-04-13 19:48:25 +02:00

arch_gicv3.h

Merge tag 'kvm-4.9-1' of git://git.kernel.org/pub/scm/virt/kvm/kvm

2016-10-06 10:49:01 -07:00

arch_timer.h

board: add A32 support for gxl&txlx

2018-08-15 00:47:37 -07:00

arm-cci.h

arm-cci: Get rid of secure transactions for PMU driver

2015-03-27 13:44:35 +00:00

asm-offsets.h

kbuild: move asm-offsets.h to include/generated

2009-12-12 13:08:14 +01:00

assembler.h

ARM: 8796/1: spectre-v1,v1.1: provide helpers for address sanitization

2023-05-15 11:33:55 +09:00

atomic.h

locking/atomic: Remove linux/atomic.h:atomic_fetch_or()

2016-06-16 10:48:32 +02:00

auxvec.h

ARM: 8329/1: miscellaneous vdso infrastructure, preparation

2015-03-27 22:20:45 +00:00

barrier.h

ARM: avoid Cortex-A9 livelock on tight dmb loops

2023-05-15 12:19:00 +09:00

bitops.h

ARM: 8417/1: refactor bitops functions with BIT_MASK() and BIT_WORD()

2015-08-18 14:00:30 +01:00

bitrev.h

ARM: 8287/1: add bitrev.h file to support rbit instruction

2015-01-16 14:06:18 +00:00

bL_switcher.h

ARM: bL_switcher: Add query interface to discover CPU affinities

2013-09-23 18:47:31 -04:00

bug.h

ARM: 8455/1: define __BUG as asm(BUG_INSTR) without CONFIG_BUG

2015-12-03 00:02:29 +00:00

bugs.h

ARM: bugs: hook processor bug checking into SMP and suspend paths

2023-05-15 09:33:00 +09:00

cache.h

ARM: implement support for read-mostly sections

2010-12-05 08:39:36 +00:00

cacheflush.h

ARM: 8601/1: Remove unused secure_flush_area API

2016-08-26 15:11:17 +01:00

cachetype.h

ARM: 8604/1: V7M: Add support for reading the CTR with read_cpuid_cachetype()

2016-09-06 15:51:07 +01:00

checksum.h

ipv6: Pass proto to csum_ipv6_magic as __u8 instead of unsigned short

2016-03-13 23:55:13 -04:00

clocksource.h

arm/arm64: arch_timer: Use archdata to indicate vdso suitability

2016-09-23 17:19:25 +01:00

cmpxchg.h

ARM: 8443/1: Adding support for atomic half word exchange

2015-10-09 16:22:54 +01:00

compiler.h

ARM: 8300/1: teach __asmeq that r11 == fp and r12 == ip

2015-02-10 10:23:11 +00:00

cp15.h

ARM: vdso: Remove dependency with the arch_timer driver internals

2023-05-15 12:59:57 +09:00

cpu.h

ARM: kernel: add MIDR to per-CPU information data

2012-11-19 14:51:11 +00:00

cpuidle.h

ARM: cpuidle: add const qualifier to cpuidle_ops member in structures

2016-04-20 06:59:10 +02:00

cputype.h

ARM: split out processor lookup

2023-05-15 11:34:00 +09:00

cti.h

ARM: coresight: common definition for (OS) Lock Access Register key value

2013-01-10 21:13:05 +00:00

dcc.h

ARM: tty: Move HVC DCC assembly to arch/arm

2014-05-28 13:33:18 -07:00

delay.h

ARM: fix delays

2016-10-06 08:45:40 +01:00

device.h

arm: introduce is_device_dma_coherent

2014-12-04 12:41:50 +00:00

div64.h

ARM: 8504/1: __arch_xprod_64(): small optimization

2016-02-11 15:33:37 +00:00

dma-contiguous.h

drivers: dma-contiguous: clean source code and prepare for device tree

2013-08-27 09:18:29 +02:00

dma-iommu.h

ARM: 8347/1: dma-mapping: fix off-by-one check in arm_setup_iommu_dma_ops

2015-05-03 23:21:55 +01:00

dma-mapping.h

ARM: 8617/1: dma: fix dma_max_pfn()

2016-09-29 16:57:44 +01:00

dma.h

remove <asm/scatterlist.h>

2015-05-05 13:35:39 -06:00

domain.h

ARM: 8573/1: domain: move {set,get}_domain under config guard

2016-05-05 19:03:02 +01:00

ecard.h

ARM: io: ecard: move ioaddr() inside __ecard_address

2011-08-17 08:44:16 +01:00

edac.h

EDAC: Cleanup atomic_scrub mess

2015-05-28 15:31:53 +02:00

efi.h

efi: Convert efi_call_virt() to efi_call_virt_pointer()

2016-06-27 13:06:56 +02:00

elf.h

ANDROID: Revert "arm: move ELF_ET_DYN_BASE to 4MB"

2017-11-02 19:09:28 +00:00

entry-macro-multi.S

ARM: replace BSYM() with badr assembly macro

2015-05-08 17:33:50 +01:00

exception.h

arch, ftrace: for KASAN put hard/soft IRQ entries into separate sections

2016-03-25 16:37:42 -07:00

fb.h

…

fiq_glue.h

ANDROID: ARM: fiq_glue: Add custom fiq return handler api.

2017-01-27 13:51:28 -08:00

fiq.h

ARM: 6940/1: fiq: Briefly document driver responsibilities for suspend/resume

2011-05-26 10:31:06 +01:00

firmware.h

ARM: EXYNOS: add exynos_get_boot_addr() helper

2015-06-06 02:17:56 +09:00

fixmap.h

ARM: add support for generic early_ioremap/early_memremap

2015-12-13 19:18:28 +01:00

flat.h

ARM: 8594/1: enable binfmt_flat on systems with an MMU

2016-08-12 16:47:05 +01:00

floppy.h

ARM: 8584/1: floppy: avoid gcc-6 warning

2016-07-02 11:02:13 +01:00

fncpy.h

ARM: 6640/1: Thumb-2: Symbol manipulation macros for function body copying

2011-01-27 11:48:58 +00:00

fpstate.h

Fix common misspellings

2011-03-31 11:26:23 -03:00

ftrace.h

ARM: 9079/1: ftrace: Add MODULE_PLTS support

2023-05-16 11:54:06 +09:00

futex.h

ARM: futex: Address build warning

2023-05-15 17:28:44 +09:00

glue-cache.h

ARM: 8607/1: V7M: Wire up caches for V7M processors with cache support.

2016-09-06 15:51:08 +01:00

glue-df.h

ARM: 8065/1: remove last use of CONFIG_CPU_ARM710

2014-05-30 01:12:30 +01:00

glue-pf.h

ARM: move cache/processor/fault glue to separate include files

2011-02-12 11:52:21 +00:00

glue-proc.h

ARM: 8103/1: save/restore Cortex-A9 CP15 registers on suspend/resume

2014-07-18 12:29:37 +01:00

glue.h

Fix common misspellings

2011-03-31 11:26:23 -03:00

gpio.h

ARM: delete old reference to ARM_GPIOLIB_COMPLEX

2014-06-30 21:37:39 +02:00

hardirq.h

ARM: prevent tracing IPI_CPU_BACKTRACE

2023-05-15 13:47:08 +09:00

highmem.h

kasan: bring up KASAN for 32bit os [2/2]

2019-05-21 13:45:25 +08:00

hugetlb-3level.h

ARM: mm: HugeTLB support for LPAE systems.

2013-06-04 16:52:37 +01:00

hugetlb.h

mm/hugetlb: remove arch_prepare/release_hugepage from arch headers

2015-06-25 17:00:35 -07:00

hw_breakpoint.h

Amlogic: sync the code from mainline. [1/1]

2020-02-04 13:48:58 +09:00

hw_irq.h

ARM: Remove ununsed set_irq_flags

2015-09-16 16:53:39 +02:00

hwcap.h

ARM: 7981/1: add support for AT_HWCAP2 ELF auxv entry

2014-02-25 11:40:48 +00:00

hypervisor.h

arm: initial Xen support

2012-09-14 13:53:39 +00:00

ide.h

…

idmap.h

ARM: KVM: move to a KVM provided HYP idmap

2013-04-28 22:23:08 -07:00

insn.h

ARM: 9078/1: Add warn suppress parameter to arm_gen_branch_link()

2023-05-16 11:54:04 +09:00

io.h

dts: debug: enable ftrace_ramoops for new tm2 dts [1/1]

2019-06-27 16:37:31 +08:00

irq_work.h

arm: Tell irq work about self IPI support

2014-09-13 18:38:39 +02:00

irq.h

ARM: 8824/1: fix a migrating irq bug when hotplug cpu

2023-05-15 12:05:25 +09:00

irqflags.h

debug: show more debug info when hardlockup happens

2018-09-14 04:59:21 -07:00

jump_label.h

locking/static_keys: Add a new static_key interface

2015-08-03 11:34:15 +02:00

kasan.h

kasan: change address layout [3/3]

2019-05-21 14:13:33 +08:00

Kbuild

ARM: 8715/1: add a private asm/unaligned.h

2017-11-08 10:08:32 +01:00

kexec.h

ARM: kexec: fix kexec for Keystone 2

2016-08-02 19:35:29 -04:00

kgdb.h

ARM: 8764/1: kgdb: fix NUMREGBYTES so that gdb_regs[] is the correct size

2018-07-03 11:23:08 +02:00

kmap_types.h

arm: remove km_type definitions

2012-07-24 15:27:28 +08:00

kprobes.h

ARM: optprobes: execute instruction during restoring if possible.

2015-01-14 12:24:52 +00:00

kvm_arm.h

arm: KVM: Survive unknown traps from guests

2017-12-14 09:28:19 +01:00

kvm_asm.h

ARM: KVM: invalidate BTB on guest exit for Cortex-A12/A17

2023-05-15 09:33:08 +09:00

kvm_coproc.h

KVM: arm: plug potential guest hardware debug leakage

2017-05-25 15:44:44 +02:00

kvm_emulate.h

arm: KVM: Add Virtual Abort injection helper

2016-09-08 12:53:00 +02:00

kvm_host.h

ARM: KVM: report support for SMCCC_ARCH_WORKAROUND_1

2023-05-15 09:33:11 +09:00

kvm_hyp.h

arm/arm64: KVM: Perform local TLB invalidation when multiplexing vcpus on a single CPU

2016-11-04 17:56:28 +00:00

kvm_mmio.h

KVM: arm/arm64: Export mmio_read/write_bus

2016-05-20 15:39:42 +02:00

kvm_mmu.h

ARM: spectre-v2: KVM: invalidate icache on guest exit for Brahma B15

2023-05-15 09:33:09 +09:00

limits.h

…

linkage.h

…

mach-types.h

arm: move mach-types to include/generated

2009-12-12 13:08:14 +01:00

mc146818rtc.h

ARM: mc146818rtc: remove unnecessary include of mach/irqs.h

2012-01-25 20:37:45 -06:00

mcpm.h

ARM: MCPM: remove residency argument from mcpm_cpu_suspend()

2015-05-06 11:47:10 -04:00

mcs_spinlock.h

ARM: 8098/1: mcs lock: implement wfe-based polling for MCS locking

2014-07-18 12:29:35 +01:00

memblock.h

ARM: 8025/1: Get rid of meminfo

2014-06-01 01:17:12 +01:00

memory.h

Amlogic: sync the code from mainline. [1/1]

2020-02-04 13:48:58 +09:00

mmu_context.h

ARM: Hide finish_arch_post_lock_switch() from modules

2016-05-13 16:12:53 +02:00

mmu.h

ARM: 8329/1: miscellaneous vdso infrastructure, preparation

2015-03-27 22:20:45 +00:00

module.h

ARM: 9079/1: ftrace: Add MODULE_PLTS support

2023-05-16 11:54:06 +09:00

mpu.h

ARM: mpu: protect the vectors page with an MPU region

2013-06-17 15:13:18 +01:00

mtd-xip.h

[ARM] move asm/xip.h's mach/hardware.h include to mach/xip.h

2008-12-14 13:22:51 +00:00

mutex.h

ARM: 7495/1: mutex: use generic atomic_dec-based implementation for ARMv6+

2012-08-25 09:22:31 +01:00

neon.h

ARM: add support for kernel mode NEON

2013-07-08 22:08:51 +01:00

nwflash.h

…

opcodes-sec.h

ARM: opcodes: add opcodes definitions for ARM security extensions

2013-01-10 21:10:20 +00:00

opcodes-virt.h

ARM: opcodes: add __ERET/__MSR_ELR_HYP instruction encoding

2012-09-19 08:32:49 +01:00

opcodes.h

ARM: opcodes: add missing include of linux/linkage.h

2013-01-10 21:10:20 +00:00

outercache.h

ARM: move heavy barrier support out of line

2015-07-25 15:28:05 +01:00

page-nommu.h

asm-generic: page.h: Remove useless get_user_page and free_user_page

2016-02-26 15:24:55 +01:00

page.h

ARM: make vectors page inaccessible from userspace

2013-08-01 14:31:58 +01:00

paravirt.h

arm: introduce CONFIG_PARAVIRT, PARAVIRT_TIME_ACCOUNTING and pv_time_ops

2015-12-21 14:40:54 +00:00

patch.h

ARM: probes: move all probe code to dedicate directory

2015-01-09 09:36:50 +00:00

pci.h

PCI: Move pci_dma_* helpers to common code

2016-03-07 10:40:02 -06:00

percpu.h

ARM: percpu.h: fix build error

2023-05-16 08:44:41 +09:00

perf_event.h

perf: arm: enable pmuserenr [1/1]

2019-03-13 20:22:32 +08:00

pgalloc.h

arm: get rid of superfluous __GFP_REPEAT

2016-07-26 16:19:19 -07:00

pgtable-2level-hwdef.h

ARM: 8612/1: LPAE: initialize cache policy correctly

2016-09-12 12:12:30 +01:00

pgtable-2level-types.h

ARM: 7076/1: LPAE: Add (pte|pmd)val_t type definitions as u32

2011-10-06 15:40:05 +01:00

pgtable-2level.h

arch: pgtable: define MAX_POSSIBLE_PHYSMEM_BITS where needed

2023-05-16 12:02:21 +09:00

pgtable-3level-hwdef.h

ARM: 8612/1: LPAE: initialize cache policy correctly

2016-09-12 12:12:30 +01:00

pgtable-3level-types.h

ARM: LPAE: Introduce the 3-level page table format definitions

2011-12-08 10:30:39 +00:00

pgtable-3level.h

arch: pgtable: define MAX_POSSIBLE_PHYSMEM_BITS where needed

2023-05-16 12:02:21 +09:00

pgtable-hwdef.h

ARM: LPAE: Introduce the 3-level page table format definitions

2011-12-08 10:30:39 +00:00

pgtable-nommu.h

mm: make FIRST_USER_ADDRESS unsigned long on all archs

2015-02-11 17:06:03 -08:00

pgtable.h

kasan: bring up KASAN for 32bit os [2/2]

2019-05-21 13:45:25 +08:00

probes.h

ARM: optprobes: execute instruction during restoring if possible.

2015-01-14 12:24:52 +00:00

proc-fns.h

ARM: spectre-v2: per-CPU vtables to work around big.Little systems

2023-05-15 11:34:03 +09:00

processor.h

ARM: avoid Cortex-A9 livelock on tight dmb loops

2023-05-15 12:19:00 +09:00

procinfo.h

…

prom.h

of/fdt: move memreserve and dtb memory reservations into core

2014-04-30 00:59:17 -05:00

psci.h

Merge tag 'armsoc-cleanup' of git://git.kernel.org/pub/scm/linux/kernel/git/arm/arm-soc

2016-01-20 17:55:20 -08:00

ptrace.h

mm: optimize thread stack usage on ARMv7 [1/1]

2019-03-15 12:17:27 +08:00

sections.h

ARM: 8518/1: Use correct symbols for XIP_KERNEL

2016-02-11 15:43:14 +00:00

setup.h

ARM: 8495/1: ATAGS: move save_atags() to arch/arm/include/asm/setup.h

2016-01-04 11:26:00 +00:00

shmparam.h

…

signal.h

arm: switch to generic old sigaction()

2013-02-03 18:15:47 -05:00

smp_plat.h

ARM: 8392/3: smp: Only expose /sys/.../cpuX/online if hotpluggable

2015-07-31 18:58:30 +01:00

smp_scu.h

ARM: make it easier to check the CPU part number correctly

2014-07-18 12:29:02 +01:00

smp_twd.h

ARM: smp_twd: convert to use CLKSRC_OF init

2013-03-11 08:42:08 -05:00

smp.h

ARM: 8423/1: add const qualifier to smp_operations member in structures

2015-09-22 08:13:57 +01:00

sparsemem.h

ARM: 8411/1: Add default SPARSEMEM settings

2016-02-16 16:35:21 +00:00

spinlock_types.h

ARM: locks: prefetch the destination word for write prior to strex

2013-09-30 16:42:55 +01:00

spinlock.h

locking/spinlock, arch: Update and fix spin_unlock_wait() implementations

2016-06-14 11:55:15 +02:00

stackprotector.h

ARM: initial stack protector (-fstack-protector) support

2010-06-14 21:31:00 -04:00

stacktrace.h

ARM: 8070/1: Introduce arm_get_current_stack_frame()

2014-07-18 12:29:11 +01:00

stage2_pgtable.h

kvm-arm: arm32: Introduce stage2 page table helpers

2016-04-21 14:57:26 +02:00

string.h

kasan: bring up KASAN for 32bit os [2/2]

2019-05-21 13:45:25 +08:00

suspend.h

ARM: 8847/1: pm: fix HYP/SVC mode mismatch when MCPM is used

2023-05-15 16:44:17 +09:00

swab.h

UAPI: (Scripted) Disintegrate arch/arm/include/asm

2012-10-12 13:05:52 +01:00

switch_to.h

sched, arm: Remove finish_arch_switch()

2015-08-04 09:37:52 +02:00

sync_bitops.h

ARM: 7989/1: Delete asm/system.h

2014-02-25 11:33:37 +00:00

syscall.h

ARM: 8152/1: Convert pr_warning to pr_warn

2014-09-26 14:39:53 +01:00

system_info.h

ARM: 8355/1: arch: Show the serial number from devicetree in cpuinfo

2015-05-08 10:42:35 +01:00

system_misc.h

ARM: spectre-v2: harden user aborts in kernel space

2023-05-15 09:33:05 +09:00

tcm.h

ARM: 6985/1: export functions to determine the presence of I/DTCM

2011-07-06 20:49:45 +01:00

therm.h

…

thread_info.h

ARM: 8791/1: vfp: use __copy_to_user() when saving VFP state

2023-05-15 11:33:33 +09:00

thread_notify.h

ARM: 6867/1: Introduce THREAD_NOTIFY_COPY for copy_thread() hooks

2011-04-10 21:13:36 +01:00

timex.h

ARM: drop <mach/timex.h> for !ARCH_MULTIPLATFORM, too

2013-12-20 17:17:16 +01:00

tlb.h

hugetlbfs: flush TLBs correctly after huge_pmd_unshare

2023-05-16 12:21:06 +09:00

tlbflush.h

ARM: 7855/1: Add check for Cortex-A15 errata 798181 ECO

2013-10-29 11:06:13 +00:00

tls.h

ARM: 8178/1: fix set_tls for !CONFIG_KUSER_HELPERS

2014-09-30 16:55:23 +01:00

topology.h

arm/topology: link arch_scale_min_freq_capacity to cpufreq

2018-02-01 18:37:19 +00:00

traps.h

BACKPORT: irq: Make the irqentry text section unconditional

2017-12-18 15:21:35 -08:00

trusted_foundations.h

treewide: remove redundant #include <linux/kconfig.h>

2016-10-11 15:06:33 -07:00

types.h

ARM: 7822/1: add workaround for ambiguous C99 stdint.h types

2013-08-25 17:09:46 +01:00

uaccess.h

ARM: 8813/1: Make aligned 2-byte getuser()/putuser() atomic on ARMv6+

2023-05-15 16:09:03 +09:00

ucontext.h

Fix common misspellings

2011-03-31 11:26:23 -03:00

unaligned.h

ARM: 8715/1: add a private asm/unaligned.h

2017-11-08 10:08:32 +01:00

unified.h

ARM: 8723/2: always assume the "unified" syntax for assembly code

2023-05-16 10:51:16 +09:00

unistd.h

ARM: wire up new pkey syscalls

2016-10-19 10:18:47 +01:00

unwind.h

ARM: 7187/1: fix unwinding for XIP kernels

2011-12-06 11:16:13 +00:00

uprobes.h

ARM: add uprobes support

2014-03-18 16:39:40 -04:00

user.h

ARM: 6798/1: aout-core: zero thread debug registers in a.out core dump

2011-03-10 15:16:29 +00:00

v7m.h

ARM: 8603/1: V7M: Add addresses for mem-mapped V7M cache operations

2016-09-06 15:51:06 +01:00

vdso_datapage.h

ARM: 8329/1: miscellaneous vdso infrastructure, preparation

2015-03-27 22:20:45 +00:00

vdso.h

ARM: 8748/1: mm: Define vdso_start, vdso_end as array

2018-05-30 07:50:38 +02:00

vfp.h

ARM: vfp: Add vfp_disable for problematic platforms

2015-05-20 15:07:00 -07:00

vfpmacros.h

ARM: 7566/1: vfp: fix save and restore when running on pre-VFPv3 and CONFIG_VFPv3 set

2012-10-29 10:04:05 +00:00

vga.h

ARM: set vga memory base at run-time

2011-07-12 11:19:29 -05:00

virt.h

arm/arm64: KVM: Export __hyp_text_start/end symbols

2016-07-03 23:41:27 +02:00

word-at-a-time.h

ARM: 8322/1: keep .text and .fixup regions closer together

2015-03-29 23:11:56 +01:00

xor.h

ARM: crypto: add NEON accelerated XOR implementation

2013-07-08 22:09:06 +01:00