Konstantin Khlebnikov e211cb68dd sched/preempt: Fix cond_resched_lock() and cond_resched_softirq() ...

commit fe32d3cd5e upstream.

These functions check should_resched() before unlocking spinlock/bh-enable:
preempt_count always non-zero => should_resched() always returns false.
cond_resched_lock() worked iff spin_needbreak is set.

This patch adds argument "preempt_offset" to should_resched().

preempt_count offset constants for that:

  PREEMPT_DISABLE_OFFSET  - offset after preempt_disable()
  PREEMPT_LOCK_OFFSET     - offset after spin_lock()
  SOFTIRQ_DISABLE_OFFSET  - offset after local_bh_distable()
  SOFTIRQ_LOCK_OFFSET     - offset after spin_lock_bh()

Signed-off-by: Konstantin Khlebnikov <khlebnikov@yandex-team.ru>
Signed-off-by: Peter Zijlstra (Intel) <peterz@infradead.org>
Cc: Alexander Graf <agraf@suse.de>
Cc: Boris Ostrovsky <boris.ostrovsky@oracle.com>
Cc: David Vrabel <david.vrabel@citrix.com>
Cc: Linus Torvalds <torvalds@linux-foundation.org>
Cc: Mike Galbraith <efault@gmx.de>
Cc: Paul Mackerras <paulus@samba.org>
Cc: Peter Zijlstra <peterz@infradead.org>
Cc: Thomas Gleixner <tglx@linutronix.de>
Fixes: bdb4380658 ("sched: Extract the basic add/sub preempt_count modifiers")
Link: http://lkml.kernel.org/r/20150715095204.12246.98268.stgit@buzz
Signed-off-by: Ingo Molnar <mingo@kernel.org>
Signed-off-by: Mike Galbraith <efault@gmx.de>
Signed-off-by: Greg Kroah-Hartman <gregkh@linuxfoundation.org>

2015-10-27 09:45:59 +09:00

..

bitops

bitops/find: clarify and extend documentation

2013-11-13 12:09:22 +09:00

4level-fixup.h

mm: Pass virtual address to [__]p{te,ud,md}_free_tlb()

2009-07-27 12:10:38 -07:00

atomic64.h

lib: Provide generic atomic64_t implementation

2009-06-15 13:27:38 +10:00

atomic-long.h

asm-generic: merge branch 'master' of torvalds/linux-2.6

2009-06-12 11:32:58 +02:00

atomic.h

asm-generic: move cmpxchg*_local defs to cmpxchg.h

2013-03-13 06:11:05 +01:00

audit_change_attr.h

audit: Modify a set of system calls in audit class definitions

2014-01-17 17:01:46 -05:00

audit_dir_write.h

audit: support the "standard" <asm-generic/unistd.h>

2011-05-04 14:41:28 -04:00

audit_read.h

audit: support the "standard" <asm-generic/unistd.h>

2011-05-04 14:41:28 -04:00

audit_signal.h

[PATCH] add SIGNAL syscall class (v3)

2007-05-11 05:38:25 -04:00

audit_write.h

audit: Modify a set of system calls in audit class definitions

2014-01-17 17:01:46 -05:00

barrier.h

arch: Introduce smp_load_acquire(), smp_store_release()

2014-01-12 10:37:17 +01:00

bitops.h

bitops: remove minix bitops from asm/bitops.h

2011-03-23 19:46:22 -07:00

bitsperlong.h

UAPI: (Scripted) Disintegrate include/asm-generic

2012-10-04 18:20:15 +01:00

bug.h

bug.h: Fix up CONFIG_BUG=n implicit function declarations.

2012-06-25 10:32:49 -07:00

bugs.h

asm-generic: add generic versions of common headers

2009-06-11 21:02:37 +02:00

cache.h

asm-generic: add generic NOMMU versions of some headers

2009-06-11 21:02:50 +02:00

cacheflush.h

asm-generic/cacheflush.h: flush icache when copying to user pages

2011-05-25 08:39:37 -07:00

checksum.h

asm-generic headers: Allow yet more arch overrides in checksum.h

2013-02-11 20:00:33 +05:30

clkdev.h

asm-generic: Add default clkdev.h

2012-10-03 21:33:53 +02:00

cmpxchg-local.h

generic: Use raw local irq variant for generic cmpxchg

2013-02-19 08:43:37 +01:00

cmpxchg.h

asm-generic: move cmpxchg*_local defs to cmpxchg.h

2013-03-13 06:11:05 +01:00

cputime_jiffies.h

cputime: Move default nsecs_to_cputime() to jiffies based cputime file

2013-01-27 19:23:25 +01:00

cputime_nsecs.h

cputime_nsecs: use math64.h for nsec resolution conversion helpers

2013-04-26 18:58:12 +02:00

cputime.h

cputime: Generic on-demand virtual cputime accounting

2013-01-27 19:23:27 +01:00

current.h

asm-generic: add generic versions of common headers

2009-06-11 21:02:37 +02:00

delay.h

asm-generic: delay.h fix udelay and ndelay for 8 bit args

2011-07-22 18:45:33 +02:00

device.h

Driver Core: Add platform device arch data V3

2009-07-22 00:28:38 +02:00

div64.h

rename div64_64 to div64_u64

2008-05-01 08:03:58 -07:00

dma-coherent.h

common: dma-mapping: add support for generic dma_mmap_* calls

2012-07-30 12:25:46 +02:00

dma-mapping-broken.h

asm-generic/dma-mapping-broken.h: Provide dma_alloc_attrs()/dma_free_attrs()

2012-12-25 20:14:54 +01:00

dma-mapping-common.h

common: dma-mapping: introduce dma_get_sgtable() function

2012-07-30 12:25:46 +02:00

dma.h

asm-generic: add legacy I/O header files

2009-06-11 21:02:42 +02:00

emergency-restart.h

[PATCH] Add emergency_restart()

2005-07-26 14:35:41 -07:00

exec.h

Split arch_align_stack() out from asm-generic/system.h

2012-03-28 18:30:03 +01:00

fb.h

asm-generic: add generic versions of common headers

2009-06-11 21:02:37 +02:00

fixmap.h

add generic fixmap.h

2014-01-23 16:36:54 -08:00

ftrace.h

asm-generic headers: add ftrace.h

2011-03-17 09:19:04 +08:00

futex.h

futex: Sanitize futex ops argument types

2011-03-11 12:23:31 +01:00

getorder.h

bitops: Add missing parentheses to new get_order macro

2012-02-24 10:39:27 -08:00

gpio.h

Merge tag 'gpio-v3.13-1' of git://git.kernel.org/pub/scm/linux/kernel/git/linusw/linux-gpio

2013-11-12 15:50:46 +09:00

hardirq.h

Fix IRQ flag handling naming

2010-10-07 14:08:55 +01:00

hash.h

lib: hash: follow-up fixups for arch hash

2013-12-19 00:14:53 -05:00

hugetlb.h

mm: Fix generic hugetlb pte check return type.

2013-10-02 20:02:35 -04:00

hw_irq.h

asm-generic: add legacy I/O header files

2009-06-11 21:02:42 +02:00

ide_iops.h

Linux-2.6.12-rc2

2005-04-16 15:20:36 -07:00

int-ll64.h

UAPI: (Scripted) Disintegrate include/asm-generic

2012-10-04 18:20:15 +01:00

io-64-nonatomic-hi-lo.h

asm-generic: architecture independent readq/writeq for 32bit environment

2012-02-21 16:47:28 -08:00

io-64-nonatomic-lo-hi.h

asm-generic: architecture independent readq/writeq for 32bit environment

2012-02-21 16:47:28 -08:00

io.h

kernel: Fix s390 absolute memory access for /dev/mem

2013-05-22 09:45:57 +02:00

ioctl.h

UAPI: (Scripted) Disintegrate include/asm-generic

2012-10-04 18:20:15 +01:00

iomap.h

[PARISC] fix compile break caused by iomap: make IOPORT/PCI mapping functions conditional

2012-02-27 09:43:30 -06:00

irq_regs.h

core: Replace __get_cpu_var with __this_cpu_read if not used for an address.

2010-12-17 15:07:19 +01:00

irq.h

asm-generic: add generic versions of common headers

2009-06-11 21:02:37 +02:00

irqflags.h

Fix IRQ flag handling naming

2010-10-07 14:08:55 +01:00

Kbuild.asm

UAPI: Set up uapi/asm/Kbuild.asm

2012-10-02 18:01:56 +01:00

kdebug.h

asm-generic: kdebug.h: Checkpatch cleanup

2010-10-09 21:51:44 +02:00

kmap_types.h

asm-generic: remove km_type definitions

2012-07-24 15:27:30 +08:00

kvm_para.h

KVM: add kvm_para_available to asm-generic/kvm_para.h

2013-06-05 13:21:29 +03:00

libata-portmap.h

libata-portmap: Remove unused definitions

2007-10-12 14:55:37 -04:00

linkage.h

asm-generic: add generic versions of common headers

2009-06-11 21:02:37 +02:00

local64.h

atomic: use <linux/atomic.h>

2011-07-26 16:49:47 -07:00

local.h

atomic: use <linux/atomic.h>

2011-07-26 16:49:47 -07:00

memory_model.h

__page_to_pfn: Fix typo in comment

2013-10-14 15:28:29 +02:00

mm_hooks.h

[PATCH] x86: PARAVIRT: add hooks to intercept mm creation and destruction

2007-05-02 19:27:14 +02:00

mmu_context.h

asm-generic: add generic NOMMU versions of some headers

2009-06-11 21:02:50 +02:00

mmu.h

asm-generic/mmu.h: Add support for FDPIC

2012-12-09 23:14:14 +01:00

module.h

Make most arch asm/module.h files use asm-generic/module.h

2012-09-28 14:31:03 +09:30

mutex-dec.h

arch: Make __mutex_fastpath_lock_retval return whether fastpath succeeded or not

2013-06-26 12:10:55 +02:00

mutex-null.h

arch: Make __mutex_fastpath_lock_retval return whether fastpath succeeded or not

2013-06-26 12:10:55 +02:00

mutex-xchg.h

arch: Make __mutex_fastpath_lock_retval return whether fastpath succeeded or not

2013-06-26 12:10:55 +02:00

mutex.h

asm-generic: add generic versions of common headers

2009-06-11 21:02:37 +02:00

page.h

Merge tag 'for-linux-3.3-merge-window' of git://linux-c6x.org/git/projects/linux-c6x-upstreaming

2012-01-10 17:39:40 -08:00

param.h

UAPI: (Scripted) Disintegrate include/asm-generic

2012-10-04 18:20:15 +01:00

parport.h

include: remove __dev* attributes.

2013-01-03 15:57:16 -08:00

pci_iomap.h

[PARISC] fix compile break caused by iomap: make IOPORT/PCI mapping functions conditional

2012-02-27 09:43:30 -06:00

pci-bridge.h

PCI: work around Stratus ftServer broken PCIe hierarchy

2012-04-30 15:21:02 -06:00

pci-dma-compat.h

dma-mapping: pci: move pci_set_dma_mask and pci_set_consistent_dma_mask to pci-dma-compat.h

2010-03-12 15:52:42 -08:00

pci.h

PCI: collapse pcibios_resource_to_bus

2012-02-23 20:19:04 -07:00

percpu.h

percpu: Optimize __get_cpu_var()

2010-09-10 10:56:51 +02:00

pgalloc.h

asm-generic: add generic NOMMU versions of some headers

2009-06-11 21:02:50 +02:00

pgtable-nopmd.h

mm: Pass virtual address to [__]p{te,ud,md}_free_tlb()

2009-07-27 12:10:38 -07:00

pgtable-nopud.h

mm: Pass virtual address to [__]p{te,ud,md}_free_tlb()

2009-07-27 12:10:38 -07:00

pgtable.h

mm: use paravirt friendly ops for NUMA hinting ptes

2014-05-31 13:20:30 -07:00

preempt.h

sched/preempt: Fix cond_resched_lock() and cond_resched_softirq()

2015-10-27 09:45:59 +09:00

ptrace.h

asm-generic/ptrace.h: start a common low level ptrace helper

2011-05-26 17:12:36 -07:00

resource.h

UAPI: (Scripted) Disintegrate include/asm-generic

2012-10-04 18:20:15 +01:00

rtc.h

asm-generic: make get_rtc_time overridable

2009-06-11 21:02:18 +02:00

rwsem.h

Hexagon: Add locking types and functions

2011-11-01 07:34:20 -07:00

scatterlist.h

asm-generic: remove ARCH_HAS_SG_CHAIN in scatterlist.h

2010-05-27 09:12:54 -07:00

sections.h

nosave: consolidate __nosave_{begin,end} in <asm/sections.h>

2015-05-06 21:59:21 +02:00

segment.h

asm-generic: add generic NOMMU versions of some headers

2009-06-11 21:02:50 +02:00

serial.h

asm-generic: add legacy I/O header files

2009-06-11 21:02:42 +02:00

siginfo.h

constify copy_siginfo_to_user{,32}()

2013-11-09 00:16:29 -05:00

signal.h

unify default ptrace_signal_deliver

2012-11-29 00:01:23 -05:00

simd.h

crypto: create generic version of ablk_helper

2013-09-24 06:02:24 +10:00

sizes.h

ARM: 7430/1: sizes.h: move from asm-generic to <linux/sizes.h>

2012-06-28 17:14:34 +01:00

spinlock.h

asm-generic: add generic versions of common headers

2009-06-11 21:02:37 +02:00

statfs.h

UAPI: (Scripted) Disintegrate include/asm-generic

2012-10-04 18:20:15 +01:00

string.h

asm-generic: add generic versions of common headers

2009-06-11 21:02:37 +02:00

switch_to.h

Split the switch_to() wrapper out of asm-generic/system.h

2012-03-28 18:30:03 +01:00

syscall.h

asm/syscall.h: add syscall_get_arch

2012-04-14 11:13:19 +10:00

syscalls.h

burying unused conditionals

2013-02-14 09:21:15 -05:00

termios-base.h

asm-generic: rename termios.h, signal.h and mman.h

2009-06-11 21:01:52 +02:00

termios.h

UAPI: (Scripted) Disintegrate include/asm-generic

2012-10-04 18:20:15 +01:00

timex.h

asm-generic: add legacy I/O header files

2009-06-11 21:02:42 +02:00

tlb.h

Fix TLB gather virtual address range invalidation corner cases

2013-08-16 08:52:46 -07:00

tlbflush.h

BUG: headers with BUG/BUG_ON etc. need linux/bug.h

2012-03-04 17:54:34 -05:00

topology.h

topology: alternate fix for ia64 tiger_defconfig build breakage

2010-08-09 20:44:57 -07:00

trace_clock.h

tracing,x86: Add a TSC trace_clock

2012-11-13 15:48:27 -05:00

uaccess-unaligned.h

asm-generic: rename page.h and uaccess.h

2009-06-11 21:02:17 +02:00

uaccess.h

asm-generic: uaccess: Spelling s/a ny/any/

2014-01-02 10:45:23 +01:00

unaligned.h

asm-generic: add generic versions of common headers

2009-06-11 21:02:37 +02:00

unistd.h

Merge tag 'modules-next-for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/rusty/linux

2013-05-05 10:58:06 -07:00

user.h

asm-generic/user.h: Fix spelling in comment

2011-03-01 15:49:39 +01:00

vga.h

asm-generic: add legacy I/O header files

2009-06-11 21:02:42 +02:00

vmlinux.lds.h

kernel: add support for init_array constructors

2013-10-17 15:05:17 +10:30

vtime.h

include/asm-generic/vtime.h: avoid zero-length file

2013-09-30 14:31:02 -07:00

word-at-a-time.h

word-at-a-time: avoid undefined behaviour in zero_bytemask macro

2014-05-06 07:59:29 -07:00

xor.h

asm-generic: xor: mark static functions as __maybe_unused

2012-10-03 21:21:06 +02:00