Subject: [patch 4/4] x86_64: Replace IPI Broadcast when using CPU hotplug.
From: Ashok Raj <[email protected]>
This patch tries to eliminate a race condition with IPI broadcast and
CPU hotplug. Since when we broadcast we dont have control on what cpus
see a spurious intr, or possiblity of receiving an intr when the cpu is
just in process of comming up, we choose to send targetted IPI only to online
cpus.
This same workaround could be done in other places too, like genapic
locations, but this is a simpler change done here.
for the time being: we do the send_IPI_mask() version if CPU hotplug is
selected by default.
Use both CONFIG option if CPU_HOTPLUG is selected, and a cmdline option
to turn it on during startup if necessary.
1. Bringup cpu in complete cli state, and also hold call_lock when we
update online_map. (Not sure if the IPI would be pended and delivered
later causing trouble)
2. SledgeHammer approach to use stop_machine() to achive automicity.
*Very Undesirable*
3. May be setup intr_gate a little later just before setting online_map.
[still ugly bandaid, but may work] online_map should still be updated
under call_lock for safety.
Signed-off-by: Ashok Raj <[email protected]>
--------------------------------------
Kconfig | 4 ++++
kernel/smp.c | 24 +++++++++++++++++++++++-
2 files changed, 27 insertions(+), 1 deletion(-)
Index: linux-2.6.12-rc4-mm2/arch/x86_64/kernel/smp.c
===================================================================
--- linux-2.6.12-rc4-mm2.orig/arch/x86_64/kernel/smp.c
+++ linux-2.6.12-rc4-mm2/arch/x86_64/kernel/smp.c
@@ -43,6 +43,13 @@ static cpumask_t flush_cpumask;
static struct mm_struct * flush_mm;
static unsigned long flush_va;
static DEFINE_SPINLOCK(tlbstate_lock);
+
+#ifdef CONFIG_SAFE_IPI_CALLFUNC
+static int safe_ipi_call = 1;
+#else
+static int safe_ipi_call = 0;
+#endif
+
#define FLUSH_ALL -1ULL
/*
@@ -307,6 +314,15 @@ unlock_ipi_calllock(void)
spin_unlock_irq(&call_lock);
}
+static int __init safe_ipi_setup(char *s)
+{
+ safe_ipi_call = 1;
+ printk ("Turning off broadcast IPI in smp_call_function\n");
+ return 0;
+}
+
+__setup("safe_ipi", safe_ipi_setup);
+
/*
* this function sends a 'generic call function' IPI to all other CPUs
* in the system.
@@ -330,7 +346,13 @@ static void __smp_call_function (void (*
call_data = &data;
wmb();
/* Send a message to all other CPUs and wait for them to respond */
- send_IPI_allbutself(CALL_FUNCTION_VECTOR);
+
+ if (safe_ipi_call) {
+ cpumask_t cpu_mask = cpu_online_map;
+ cpu_clear(smp_processor_id(), cpu_mask);
+ send_IPI_mask(cpu_mask, CALL_FUNCTION_VECTOR);
+ } else
+ send_IPI_allbutself(CALL_FUNCTION_VECTOR);
/* Wait for response */
while (atomic_read(&data.started) != cpus)
Index: linux-2.6.12-rc4-mm2/arch/x86_64/Kconfig
===================================================================
--- linux-2.6.12-rc4-mm2.orig/arch/x86_64/Kconfig
+++ linux-2.6.12-rc4-mm2/arch/x86_64/Kconfig
@@ -302,6 +302,10 @@ config HOTPLUG_CPU
can be controlled through /sys/devices/system/cpu/cpu#.
Say N if you want to disable CPU hotplug.
+config SAFE_IPI_CALLFUNC
+ bool
+ default y
+ depends on HOTPLUG_CPU
config HPET_TIMER
bool
--
-
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to [email protected]
More majordomo info at http://vger.kernel.org/majordomo-info.html
Please read the FAQ at http://www.tux.org/lkml/
[Index of Archives]
[Kernel Newbies]
[Netfilter]
[Bugtraq]
[Photo]
[Stuff]
[Gimp]
[Yosemite News]
[MIPS Linux]
[ARM Linux]
[Linux Security]
[Linux RAID]
[Video 4 Linux]
[Linux for the blind]
[Linux Resources]
