Jeremy Fitzhardinge
2009-May-07 21:14 UTC
[Xen-devel] [GIT PULL] xen: apic support for dom0
Hi Ingo, This branch implements the Xen dom0 hooks into the x86 apic subsystem. These changes are needed so that hardware interrupts are delivered as Xen events via event channels, while allowing the dom0 kernel to control interrupt routing by programming the IO APICs. This code is essentially unchanged from the last time I posted it. The following changes since commit 0c96e43850feb7c7c4a4950f24533491fbd63b5a: Jeremy Fitzhardinge (1): xen: checkpatch cleanups are available in the git repository at: git://git.kernel.org/pub/scm/linux/kernel/git/jeremy/xen.git xen-tip/dom0/apic Gerd Hoffmann (2): xen: set pirq name to something useful. xen: fix legacy irq setup, make ioapic-less machines work. Ian Campbell (1): xen: pre-initialize legacy irqs early Jeremy Fitzhardinge (15): xen/dom0: handle acpi lapic parsing in Xen dom0 xen: hook io_apic read/write operations xen: create dummy ioapic mapping xen: implement pirq type event channels x86/io_apic: add get_nr_irqs_gsi() xen/apic: identity map gsi->irqs xen: direct irq registration to pirq event channels xen: bind pirq to vector and event channel xen: don''t setup acpi interrupt unless there is one xen: use acpi_get_override_irq() to get triggering for legacy irqs xen: initialize irq 0 too xen: dynamically allocate irq & event structures xen: disable MSI xen/apic: checkpatch cleanups xen/apic: add pin argument to setup_ioapic_entry() arch/x86/include/asm/io_apic.h | 7 + arch/x86/include/asm/xen/pci.h | 13 ++ arch/x86/kernel/acpi/boot.c | 18 +++- arch/x86/kernel/apic/io_apic.c | 37 +++++- arch/x86/xen/Kconfig | 11 ++ arch/x86/xen/Makefile | 3 +- arch/x86/xen/apic.c | 60 +++++++++ arch/x86/xen/enlighten.c | 2 + arch/x86/xen/mmu.c | 10 ++ arch/x86/xen/pci.c | 86 +++++++++++++ arch/x86/xen/xen-ops.h | 6 + drivers/pci/pci.h | 2 - drivers/xen/events.c | 274 ++++++++++++++++++++++++++++++++++++++-- include/linux/pci.h | 6 + include/xen/events.h | 19 +++ 15 files changed, 539 insertions(+), 15 deletions(-) create mode 100644 arch/x86/include/asm/xen/pci.h create mode 100644 arch/x86/xen/apic.c create mode 100644 arch/x86/xen/pci.c Thanks, J _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
Jeremy Fitzhardinge
2009-May-07 21:14 UTC
[Xen-devel] [PATCH 01/18] xen/dom0: handle acpi lapic parsing in Xen dom0
Impact: ignore local apics, which are not usable under Xen When running in Xen dom0, we still want to parse the ACPI tables to find out about local and IO apics, but we don''t want to actually use the lapics. Put a couple of tests for Xen to prevent lapics from being mapped or accessed. This is very Xen-specific behaviour, so there didn''t seem to be any point in adding more indirection. Signed-off-by: Jeremy Fitzhardinge <jeremy.fitzhardinge@citrix.com> Reviewed-by: "H. Peter Anvin" <hpa@zytor.com> --- arch/x86/kernel/acpi/boot.c | 10 ++++++++++ 1 files changed, 10 insertions(+), 0 deletions(-) diff --git a/arch/x86/kernel/acpi/boot.c b/arch/x86/kernel/acpi/boot.c index 723989d..4147e0c 100644 --- a/arch/x86/kernel/acpi/boot.c +++ b/arch/x86/kernel/acpi/boot.c @@ -41,6 +41,8 @@ #include <asm/mpspec.h> #include <asm/smp.h> +#include <asm/xen/hypervisor.h> + static int __initdata acpi_force = 0; u32 acpi_rsdt_forced; #ifdef CONFIG_ACPI @@ -218,6 +220,10 @@ static void __cpuinit acpi_register_lapic(int id, u8 enabled) { unsigned int ver = 0; + /* We don''t want to register lapics when in Xen dom0 */ + if (xen_initial_domain()) + return; + if (!enabled) { ++disabled_cpus; return; @@ -802,6 +808,10 @@ static int __init acpi_parse_fadt(struct acpi_table_header *table) static void __init acpi_register_lapic_address(unsigned long address) { + /* Xen dom0 doesn''t have usable lapics */ + if (xen_initial_domain()) + return; + mp_lapic_addr = address; set_fixmap_nocache(FIX_APIC_BASE, address); -- 1.6.0.6 _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
Jeremy Fitzhardinge
2009-May-07 21:14 UTC
[Xen-devel] [PATCH 02/18] xen: hook io_apic read/write operations
Impact: paravirtualize io_apic_read/write In Xen, writes to the IO APIC are paravirtualized via hypercalls, so implement the appropriate operations. This version of the patch just hooks the io_apic read/write functions directly, rather than introducing another layer of indirection. The xen_initial_domain() tests compile to 0 if CONFIG_XEN_DOM0 isn''t set, and are cheap if it is. (An alternative would be to add io_apic_ops, and point them to the Xen implementation as needed. HPA deemed this extra level of indirection to be excessive.) Signed-off-by: Jeremy Fitzhardinge <jeremy.fitzhardinge@citrix.com> Reviewed-by: "H. Peter Anvin" <hpa@zytor.com> --- arch/x86/include/asm/io_apic.h | 6 ++++ arch/x86/kernel/apic/io_apic.c | 32 ++++++++++++++++++++-- arch/x86/xen/Makefile | 2 +- arch/x86/xen/apic.c | 57 ++++++++++++++++++++++++++++++++++++++++ arch/x86/xen/enlighten.c | 2 + arch/x86/xen/xen-ops.h | 6 ++++ 6 files changed, 101 insertions(+), 4 deletions(-) create mode 100644 arch/x86/xen/apic.c diff --git a/arch/x86/include/asm/io_apic.h b/arch/x86/include/asm/io_apic.h index 9d826e4..894ffb8 100644 --- a/arch/x86/include/asm/io_apic.h +++ b/arch/x86/include/asm/io_apic.h @@ -187,4 +187,10 @@ static inline void ioapic_init_mappings(void) { } static inline void probe_nr_irqs_gsi(void) { } #endif +void xen_io_apic_init(void); +unsigned int xen_io_apic_read(unsigned apic, unsigned reg); +void xen_io_apic_write(unsigned int apic, + unsigned int reg, unsigned int value); + + #endif /* _ASM_X86_IO_APIC_H */ diff --git a/arch/x86/kernel/apic/io_apic.c b/arch/x86/kernel/apic/io_apic.c index 767fe7e..c8240f7 100644 --- a/arch/x86/kernel/apic/io_apic.c +++ b/arch/x86/kernel/apic/io_apic.c @@ -62,8 +62,10 @@ #include <asm/uv/uv_hub.h> #include <asm/uv/uv_irq.h> +#include <asm/xen/hypervisor.h> #include <asm/apic.h> + #define __apicdebuginit(type) static type __init /* @@ -407,14 +409,26 @@ static inline void io_apic_eoi(unsigned int apic, unsigned int vector) static inline unsigned int io_apic_read(unsigned int apic, unsigned int reg) { - struct io_apic __iomem *io_apic = io_apic_base(apic); + struct io_apic __iomem *io_apic; + + if (xen_initial_domain()) + return xen_io_apic_read(apic, reg); + + io_apic = io_apic_base(apic); writel(reg, &io_apic->index); return readl(&io_apic->data); } static inline void io_apic_write(unsigned int apic, unsigned int reg, unsigned int value) { - struct io_apic __iomem *io_apic = io_apic_base(apic); + struct io_apic __iomem *io_apic; + + if (xen_initial_domain()) { + xen_io_apic_write(apic, reg, value); + return; + } + + io_apic = io_apic_base(apic); writel(reg, &io_apic->index); writel(value, &io_apic->data); } @@ -427,7 +441,14 @@ static inline void io_apic_write(unsigned int apic, unsigned int reg, unsigned i */ static inline void io_apic_modify(unsigned int apic, unsigned int reg, unsigned int value) { - struct io_apic __iomem *io_apic = io_apic_base(apic); + struct io_apic __iomem *io_apic; + + if (xen_initial_domain()) { + xen_io_apic_write(apic, reg, value); + return; + } + + io_apic = io_apic_base(apic); if (sis_apic_bug) writel(reg, &io_apic->index); @@ -4140,6 +4161,11 @@ void __init ioapic_init_mappings(void) struct resource *ioapic_res; int i; + if (xen_initial_domain()) { + xen_io_apic_init(); + return; + } + ioapic_res = ioapic_setup_resources(); for (i = 0; i < nr_ioapics; i++) { if (smp_found_config) { diff --git a/arch/x86/xen/Makefile b/arch/x86/xen/Makefile index c4cda96..73ecb74 100644 --- a/arch/x86/xen/Makefile +++ b/arch/x86/xen/Makefile @@ -11,4 +11,4 @@ obj-y := enlighten.o setup.o multicalls.o mmu.o irq.o \ obj-$(CONFIG_SMP) += smp.o spinlock.o obj-$(CONFIG_XEN_DEBUG_FS) += debugfs.o -obj-$(CONFIG_XEN_DOM0) += vga.o +obj-$(CONFIG_XEN_DOM0) += vga.o apic.o diff --git a/arch/x86/xen/apic.c b/arch/x86/xen/apic.c new file mode 100644 index 0000000..17736a0 --- /dev/null +++ b/arch/x86/xen/apic.c @@ -0,0 +1,57 @@ +#include <linux/kernel.h> +#include <linux/threads.h> +#include <linux/bitmap.h> + +#include <asm/io_apic.h> +#include <asm/acpi.h> + +#include <asm/xen/hypervisor.h> +#include <asm/xen/hypercall.h> + +#include <xen/interface/xen.h> +#include <xen/interface/physdev.h> + +void __init xen_io_apic_init(void) +{ + printk("xen apic init\n"); + dump_stack(); +} + +unsigned int xen_io_apic_read(unsigned apic, unsigned reg) +{ + struct physdev_apic apic_op; + int ret; + + apic_op.apic_physbase = mp_ioapics[apic].apicaddr; + apic_op.reg = reg; + ret = HYPERVISOR_physdev_op(PHYSDEVOP_apic_read, &apic_op); + if (ret) + BUG(); + return apic_op.value; +} + + +void xen_io_apic_write(unsigned int apic, unsigned int reg, unsigned int value) +{ + struct physdev_apic apic_op; + + apic_op.apic_physbase = mp_ioapics[apic].apicaddr; + apic_op.reg = reg; + apic_op.value = value; + if (HYPERVISOR_physdev_op(PHYSDEVOP_apic_write, &apic_op)) + BUG(); +} + +void xen_init_apic(void) +{ + if (!xen_initial_domain()) + return; + +#ifdef CONFIG_ACPI + /* + * Pretend ACPI found our lapic even though we''ve disabled it, + * to prevent MP tables from setting up lapics. + */ + acpi_lapic = 1; +#endif +} diff --git a/arch/x86/xen/enlighten.c b/arch/x86/xen/enlighten.c index 2d0341f..0ce10ef 100644 --- a/arch/x86/xen/enlighten.c +++ b/arch/x86/xen/enlighten.c @@ -1034,6 +1034,8 @@ asmlinkage void __init xen_start_kernel(void) set_iopl.iopl = 1; if (HYPERVISOR_physdev_op(PHYSDEVOP_set_iopl, &set_iopl) == -1) BUG(); + + xen_init_apic(); } /* set the limit of our address space */ diff --git a/arch/x86/xen/xen-ops.h b/arch/x86/xen/xen-ops.h index 40abcef..82ba25c 100644 --- a/arch/x86/xen/xen-ops.h +++ b/arch/x86/xen/xen-ops.h @@ -83,6 +83,12 @@ static inline void xen_init_vga(const struct dom0_vga_console_info *info, } #endif +#ifdef CONFIG_XEN_DOM0 +void xen_init_apic(void); +#else +static inline void xen_init_apic(void) {} +#endif + /* Declare an asm function, along with symbols needed to make it inlineable */ #define DECL_ASM(ret, name, ...) \ -- 1.6.0.6 _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
Jeremy Fitzhardinge
2009-May-07 21:14 UTC
[Xen-devel] [PATCH 03/18] xen: create dummy ioapic mapping
Impact: debuggability (make failures obvious) We don''t allow direct access to the IO apic, so make sure that any request to map it just "maps" non-present pages. We should see any attempts at direct access explode nicely. Signed-off-by: Jeremy Fitzhardinge <jeremy.fitzhardinge@citrix.com> --- arch/x86/xen/mmu.c | 10 ++++++++++ 1 files changed, 10 insertions(+), 0 deletions(-) diff --git a/arch/x86/xen/mmu.c b/arch/x86/xen/mmu.c index 55da7f9..b105b73 100644 --- a/arch/x86/xen/mmu.c +++ b/arch/x86/xen/mmu.c @@ -1907,6 +1907,16 @@ static void xen_set_fixmap(unsigned idx, unsigned long phys, pgprot_t prot) pte = pfn_pte(phys, prot); break; +#ifdef CONFIG_X86_IO_APIC + case FIX_IO_APIC_BASE_0 ... FIX_IO_APIC_BASE_END: + /* + * We just don''t map the IO APIC - all access is via + * hypercalls. Keep the address in the pte for reference. + */ + pte = pfn_pte(phys, PAGE_NONE); + break; +#endif + case FIX_PARAVIRT_BOOTMAP: /* This is an MFN, but it isn''t an IO mapping from the IO domain */ -- 1.6.0.6 _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
Jeremy Fitzhardinge
2009-May-07 21:14 UTC
[Xen-devel] [PATCH 04/18] xen: implement pirq type event channels
Impact: integrate hardware interrupts into Xen''s event scheme A privileged PV Xen domain can get direct access to hardware. In order for this to be useful, it must be able to get hardware interrupts. Being a PV Xen domain, all interrupts are delivered as event channels. PIRQ event channels are bound to a pirq number and an interrupt vector. When a IO APIC raises a hardware interrupt on that vector, it is delivered as an event channel, which we can deliver to the appropriate device driver(s). This patch simply implements the infrastructure for dealing with pirq event channels. Signed-off-by: Jeremy Fitzhardinge <jeremy.fitzhardinge@citrix.com> --- drivers/xen/events.c | 245 +++++++++++++++++++++++++++++++++++++++++++++++++- include/xen/events.h | 11 +++ 2 files changed, 253 insertions(+), 3 deletions(-) diff --git a/drivers/xen/events.c b/drivers/xen/events.c index 97f4b39..a917ebe 100644 --- a/drivers/xen/events.c +++ b/drivers/xen/events.c @@ -16,7 +16,7 @@ * (typically dom0). * 2. VIRQs, typically used for timers. These are per-cpu events. * 3. IPIs. - * 4. Hardware interrupts. Not supported at present. + * 4. PIRQs - Hardware interrupts. * * Jeremy Fitzhardinge <jeremy@xensource.com>, XenSource Inc, 2007 */ @@ -40,6 +40,9 @@ #include <xen/interface/xen.h> #include <xen/interface/event_channel.h> +/* Leave low irqs free for identity mapping */ +#define LEGACY_IRQS 16 + /* * This lock protects updates to the following mapping and reference-count * arrays. The lock does not need to be acquired to read the mapping tables. @@ -83,10 +86,12 @@ struct irq_info enum ipi_vector ipi; struct { unsigned short gsi; - unsigned short vector; + unsigned char vector; + unsigned char flags; } pirq; } u; }; +#define PIRQ_NEEDS_EOI (1 << 0) static struct irq_info irq_info[NR_IRQS]; @@ -106,6 +111,7 @@ static inline unsigned long *cpu_evtchn_mask(int cpu) #define VALID_EVTCHN(chn) ((chn) != 0) static struct irq_chip xen_dynamic_chip; +static struct irq_chip xen_pirq_chip; /* Constructor for packed IRQ information. */ static struct irq_info mk_unbound_info(void) @@ -218,6 +224,15 @@ static unsigned int cpu_from_evtchn(unsigned int evtchn) return ret; } +static bool pirq_needs_eoi(unsigned irq) +{ + struct irq_info *info = info_for_irq(irq); + + BUG_ON(info->type != IRQT_PIRQ); + + return info->u.pirq.flags & PIRQ_NEEDS_EOI; +} + static inline unsigned long active_evtchns(unsigned int cpu, struct shared_info *sh, unsigned int idx) @@ -334,7 +349,7 @@ static int find_unbound_irq(void) int irq; struct irq_desc *desc; - for (irq = 0; irq < nr_irqs; irq++) + for (irq = LEGACY_IRQS; irq < nr_irqs; irq++) if (irq_info[irq].type == IRQT_UNBOUND) break; @@ -350,6 +365,210 @@ static int find_unbound_irq(void) return irq; } +static bool identity_mapped_irq(unsigned irq) +{ + /* only identity map legacy irqs */ + return irq < LEGACY_IRQS; +} + +static void pirq_unmask_notify(int irq) +{ + struct physdev_eoi eoi = { .irq = irq }; + + if (unlikely(pirq_needs_eoi(irq))) { + int rc = HYPERVISOR_physdev_op(PHYSDEVOP_eoi, &eoi); + WARN_ON(rc); + } +} + +static void pirq_query_unmask(int irq) +{ + struct physdev_irq_status_query irq_status; + struct irq_info *info = info_for_irq(irq); + + BUG_ON(info->type != IRQT_PIRQ); + + irq_status.irq = irq; + if (HYPERVISOR_physdev_op(PHYSDEVOP_irq_status_query, &irq_status)) + irq_status.flags = 0; + + info->u.pirq.flags &= ~PIRQ_NEEDS_EOI; + if (irq_status.flags & XENIRQSTAT_needs_eoi) + info->u.pirq.flags |= PIRQ_NEEDS_EOI; +} + +static bool probing_irq(int irq) +{ + struct irq_desc *desc = irq_to_desc(irq); + + return desc && desc->action == NULL; +} + +static unsigned int startup_pirq(unsigned int irq) +{ + struct evtchn_bind_pirq bind_pirq; + struct irq_info *info = info_for_irq(irq); + int evtchn = evtchn_from_irq(irq); + + BUG_ON(info->type != IRQT_PIRQ); + + if (VALID_EVTCHN(evtchn)) + goto out; + + bind_pirq.pirq = irq; + /* NB. We are happy to share unless we are probing. */ + bind_pirq.flags = probing_irq(irq) ? 0 : BIND_PIRQ__WILL_SHARE; + if (HYPERVISOR_event_channel_op(EVTCHNOP_bind_pirq, &bind_pirq) != 0) { + if (!probing_irq(irq)) + printk(KERN_INFO "Failed to obtain physical IRQ %d\n", + irq); + return 0; + } + evtchn = bind_pirq.port; + + pirq_query_unmask(irq); + + evtchn_to_irq[evtchn] = irq; + bind_evtchn_to_cpu(evtchn, 0); + info->evtchn = evtchn; + + out: + unmask_evtchn(evtchn); + pirq_unmask_notify(irq); + + return 0; +} + +static void shutdown_pirq(unsigned int irq) +{ + struct evtchn_close close; + struct irq_info *info = info_for_irq(irq); + int evtchn = evtchn_from_irq(irq); + + BUG_ON(info->type != IRQT_PIRQ); + + if (!VALID_EVTCHN(evtchn)) + return; + + mask_evtchn(evtchn); + + close.port = evtchn; + if (HYPERVISOR_event_channel_op(EVTCHNOP_close, &close) != 0) + BUG(); + + bind_evtchn_to_cpu(evtchn, 0); + evtchn_to_irq[evtchn] = -1; + info->evtchn = 0; +} + +static void enable_pirq(unsigned int irq) +{ + startup_pirq(irq); +} + +static void disable_pirq(unsigned int irq) +{ +} + +static void ack_pirq(unsigned int irq) +{ + int evtchn = evtchn_from_irq(irq); + + move_native_irq(irq); + + if (VALID_EVTCHN(evtchn)) { + mask_evtchn(evtchn); + clear_evtchn(evtchn); + } +} + +static void end_pirq(unsigned int irq) +{ + int evtchn = evtchn_from_irq(irq); + struct irq_desc *desc = irq_to_desc(irq); + + if (WARN_ON(!desc)) + return; + + if ((desc->status & (IRQ_DISABLED|IRQ_PENDING)) =+ (IRQ_DISABLED|IRQ_PENDING)) { + shutdown_pirq(irq); + } else if (VALID_EVTCHN(evtchn)) { + unmask_evtchn(evtchn); + pirq_unmask_notify(irq); + } +} + +static int find_irq_by_gsi(unsigned gsi) +{ + int irq; + + for(irq = 0; irq < NR_IRQS; irq++) { + struct irq_info *info = info_for_irq(irq); + + if (info == NULL || info->type != IRQT_PIRQ) + continue; + + if (gsi_from_irq(irq) == gsi) + return irq; + } + + return -1; +} + +/* + * Allocate a physical irq, along with a vector. We don''t assign an + * event channel until the irq actually started up. Return an + * existing irq if we''ve already got one for the gsi. + */ +int xen_allocate_pirq(unsigned gsi) +{ + int irq; + struct physdev_irq irq_op; + + spin_lock(&irq_mapping_update_lock); + + irq = find_irq_by_gsi(gsi); + if (irq != -1) { + printk(KERN_INFO "xen_allocate_pirq: returning irq %d for gsi %u\n", + irq, gsi); + goto out; /* XXX need refcount? */ + } + + if (identity_mapped_irq(gsi)) { + irq = gsi; + dynamic_irq_init(irq); + } else + irq = find_unbound_irq(); + + set_irq_chip_and_handler_name(irq, &xen_pirq_chip, + handle_level_irq, "pirq"); + + irq_op.irq = irq; + if (HYPERVISOR_physdev_op(PHYSDEVOP_alloc_irq_vector, &irq_op)) { + dynamic_irq_cleanup(irq); + irq = -ENOSPC; + goto out; + } + + irq_info[irq] = mk_pirq_info(0, gsi, irq_op.vector); + +out: + spin_unlock(&irq_mapping_update_lock); + + return irq; +} + +int xen_vector_from_irq(unsigned irq) +{ + return vector_from_irq(irq); +} + +int xen_gsi_from_irq(unsigned irq) +{ + return gsi_from_irq(irq); +} + int bind_evtchn_to_irq(unsigned int evtchn) { int irq; @@ -922,6 +1141,26 @@ static struct irq_chip xen_dynamic_chip __read_mostly = { .retrigger = retrigger_dynirq, }; +static struct irq_chip xen_pirq_chip __read_mostly = { + .name = "xen-pirq", + + .startup = startup_pirq, + .shutdown = shutdown_pirq, + + .enable = enable_pirq, + .unmask = enable_pirq, + + .disable = disable_pirq, + .mask = disable_pirq, + + .ack = ack_pirq, + .end = end_pirq, + + .set_affinity = set_affinity_irq, + + .retrigger = retrigger_dynirq, +}; + void __init xen_init_IRQ(void) { int i; diff --git a/include/xen/events.h b/include/xen/events.h index 9f24b64..e5b541d 100644 --- a/include/xen/events.h +++ b/include/xen/events.h @@ -58,4 +58,15 @@ void xen_poll_irq(int irq); /* Determine the IRQ which is bound to an event channel */ unsigned irq_from_evtchn(unsigned int evtchn); +/* Allocate an irq for a physical interrupt, given a gsi. "Legacy" + GSIs are identity mapped; others are dynamically allocated as + usual. */ +int xen_allocate_pirq(unsigned gsi); + +/* Return vector allocated to pirq */ +int xen_vector_from_irq(unsigned pirq); + +/* Return gsi allocated to pirq */ +int xen_gsi_from_irq(unsigned pirq); + #endif /* _XEN_EVENTS_H */ -- 1.6.0.6 _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
Jeremy Fitzhardinge
2009-May-07 21:14 UTC
[Xen-devel] [PATCH 05/18] x86/io_apic: add get_nr_irqs_gsi()
From: Jeremy Fitzhardinge <jeremy@f9-builder.(none)> Impact: new interface to get max GSI Add get_nr_irqs_gsi() to return nr_irqs_gsi. Xen will use this to determine how many irqs it needs to reserve for hardware irqs. Signed-off-by: Jeremy Fitzhardinge <jeremy.fitzhardinge@citrix.com> Reviewed-by: "H. Peter Anvin" <hpa@zytor.com> --- arch/x86/include/asm/io_apic.h | 1 + arch/x86/kernel/apic/io_apic.c | 5 +++++ 2 files changed, 6 insertions(+), 0 deletions(-) diff --git a/arch/x86/include/asm/io_apic.h b/arch/x86/include/asm/io_apic.h index 894ffb8..2dbc1e9 100644 --- a/arch/x86/include/asm/io_apic.h +++ b/arch/x86/include/asm/io_apic.h @@ -172,6 +172,7 @@ extern void reinit_intr_remapped_IO_APIC(int intr_remapping, #endif extern void probe_nr_irqs_gsi(void); +extern int get_nr_irqs_gsi(void); extern int setup_ioapic_entry(int apic, int irq, struct IO_APIC_route_entry *entry, diff --git a/arch/x86/kernel/apic/io_apic.c b/arch/x86/kernel/apic/io_apic.c index c8240f7..5a6a29a 100644 --- a/arch/x86/kernel/apic/io_apic.c +++ b/arch/x86/kernel/apic/io_apic.c @@ -3894,6 +3894,11 @@ void __init probe_nr_irqs_gsi(void) printk(KERN_DEBUG "nr_irqs_gsi: %d\n", nr_irqs_gsi); } +int get_nr_irqs_gsi(void) +{ + return nr_irqs_gsi; +} + #ifdef CONFIG_SPARSE_IRQ int __init arch_probe_nr_irqs(void) { -- 1.6.0.6 _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
Jeremy Fitzhardinge
2009-May-07 21:14 UTC
[Xen-devel] [PATCH 06/18] xen/apic: identity map gsi->irqs
From: Jeremy Fitzhardinge <jeremy@f9-builder.(none)> Impact: preserve compat with native Reserve the lower irq range for use for hardware interrupts so we can identity-map them. Signed-off-by: Jeremy Fitzhardinge <jeremy.fitzhardinge@citrix.com> --- drivers/xen/events.c | 23 +++++++++++++++++------ 1 files changed, 17 insertions(+), 6 deletions(-) diff --git a/drivers/xen/events.c b/drivers/xen/events.c index a917ebe..193cee4 100644 --- a/drivers/xen/events.c +++ b/drivers/xen/events.c @@ -31,6 +31,7 @@ #include <asm/ptrace.h> #include <asm/irq.h> #include <asm/idle.h> +#include <asm/io_apic.h> #include <asm/sync_bitops.h> #include <asm/xen/hypercall.h> #include <asm/xen/hypervisor.h> @@ -40,9 +41,6 @@ #include <xen/interface/xen.h> #include <xen/interface/event_channel.h> -/* Leave low irqs free for identity mapping */ -#define LEGACY_IRQS 16 - /* * This lock protects updates to the following mapping and reference-count * arrays. The lock does not need to be acquired to read the mapping tables. @@ -344,12 +342,24 @@ static void unmask_evtchn(int port) put_cpu(); } +static int get_nr_hw_irqs(void) +{ + int ret = 1; + +#ifdef CONFIG_X86_IO_APIC + ret = get_nr_irqs_gsi(); +#endif + + return ret; +} + static int find_unbound_irq(void) { int irq; struct irq_desc *desc; + int start = get_nr_hw_irqs(); - for (irq = LEGACY_IRQS; irq < nr_irqs; irq++) + for (irq = start; irq < nr_irqs; irq++) if (irq_info[irq].type == IRQT_UNBOUND) break; @@ -367,8 +377,8 @@ static int find_unbound_irq(void) static bool identity_mapped_irq(unsigned irq) { - /* only identity map legacy irqs */ - return irq < LEGACY_IRQS; + /* identity map all the hardware irqs */ + return irq < get_nr_hw_irqs(); } static void pirq_unmask_notify(int irq) @@ -537,6 +547,7 @@ int xen_allocate_pirq(unsigned gsi) if (identity_mapped_irq(gsi)) { irq = gsi; + irq_to_desc_alloc_cpu(irq, 0); dynamic_irq_init(irq); } else irq = find_unbound_irq(); -- 1.6.0.6 _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
Jeremy Fitzhardinge
2009-May-07 21:14 UTC
[Xen-devel] [PATCH 07/18] xen: direct irq registration to pirq event channels
Impact: route hardware interrupts via Xen This patch puts the hooks into place so that when the interrupt subsystem registers an irq, it gets routed via Xen (if we''re running under Xen). The first step is to get a gsi for a particular device+pin. We use the normal acpi interrupt routing to do the mapping. We reserve enough irq space to fit the hardware interrupt sources in, so we can allocate the irq == gsi, as we do in the native case; software events will get allocated irqs above that. Having allocated an irq, we ask Xen to allocate a vector, and then bind that pirq/vector to an event channel. When the hardware raises an interrupt on a vector, Xen signals us on the corresponding event channel, which gets routed to the irq and delivered to the appropriate device driver. This patch does everything except set up the IO APIC pin routing to the vector. Signed-off-by: Jeremy Fitzhardinge <jeremy.fitzhardinge@citrix.com> --- arch/x86/include/asm/xen/pci.h | 13 +++++++++++ arch/x86/kernel/acpi/boot.c | 8 ++++++- arch/x86/xen/Kconfig | 11 +++++++++ arch/x86/xen/Makefile | 1 + arch/x86/xen/pci.c | 47 ++++++++++++++++++++++++++++++++++++++++ drivers/xen/events.c | 6 ++++- include/xen/events.h | 8 ++++++ 7 files changed, 92 insertions(+), 2 deletions(-) create mode 100644 arch/x86/include/asm/xen/pci.h create mode 100644 arch/x86/xen/pci.c diff --git a/arch/x86/include/asm/xen/pci.h b/arch/x86/include/asm/xen/pci.h new file mode 100644 index 0000000..0563fc6 --- /dev/null +++ b/arch/x86/include/asm/xen/pci.h @@ -0,0 +1,13 @@ +#ifndef _ASM_X86_XEN_PCI_H +#define _ASM_X86_XEN_PCI_H + +#ifdef CONFIG_XEN_DOM0_PCI +int xen_register_gsi(u32 gsi, int triggering, int polarity); +#else +static inline int xen_register_gsi(u32 gsi, int triggering, int polarity) +{ + return -1; +} +#endif + +#endif /* _ASM_X86_XEN_PCI_H */ diff --git a/arch/x86/kernel/acpi/boot.c b/arch/x86/kernel/acpi/boot.c index 4147e0c..d4de1c2 100644 --- a/arch/x86/kernel/acpi/boot.c +++ b/arch/x86/kernel/acpi/boot.c @@ -41,6 +41,8 @@ #include <asm/mpspec.h> #include <asm/smp.h> +#include <asm/xen/pci.h> + #include <asm/xen/hypervisor.h> static int __initdata acpi_force = 0; @@ -530,9 +532,13 @@ int acpi_gsi_to_irq(u32 gsi, unsigned int *irq) */ int acpi_register_gsi(u32 gsi, int triggering, int polarity) { - unsigned int irq; + int irq; unsigned int plat_gsi = gsi; + irq = xen_register_gsi(gsi, triggering, polarity); + if (irq >= 0) + return irq; + #ifdef CONFIG_PCI /* * Make sure all (legacy) PCI IRQs are set as level-triggered. diff --git a/arch/x86/xen/Kconfig b/arch/x86/xen/Kconfig index fe69286..42e9f0a 100644 --- a/arch/x86/xen/Kconfig +++ b/arch/x86/xen/Kconfig @@ -37,6 +37,17 @@ config XEN_DEBUG_FS Enable statistics output and various tuning options in debugfs. Enabling this option may incur a significant performance overhead. +config XEN_PCI_PASSTHROUGH + bool #"Enable support for Xen PCI passthrough devices" + depends on XEN && PCI + help + Enable support for passing PCI devices through to + unprivileged domains. (COMPLETELY UNTESTED) + +config XEN_DOM0_PCI + def_bool y + depends on XEN_DOM0 && PCI + config XEN_DOM0 bool "Enable Xen privileged domain support" depends on XEN && X86_IO_APIC && ACPI diff --git a/arch/x86/xen/Makefile b/arch/x86/xen/Makefile index 73ecb74..639965a 100644 --- a/arch/x86/xen/Makefile +++ b/arch/x86/xen/Makefile @@ -12,3 +12,4 @@ obj-y := enlighten.o setup.o multicalls.o mmu.o irq.o \ obj-$(CONFIG_SMP) += smp.o spinlock.o obj-$(CONFIG_XEN_DEBUG_FS) += debugfs.o obj-$(CONFIG_XEN_DOM0) += vga.o apic.o +obj-$(CONFIG_XEN_DOM0_PCI) += pci.o \ No newline at end of file diff --git a/arch/x86/xen/pci.c b/arch/x86/xen/pci.c new file mode 100644 index 0000000..f450007 --- /dev/null +++ b/arch/x86/xen/pci.c @@ -0,0 +1,47 @@ +#include <linux/kernel.h> +#include <linux/acpi.h> +#include <linux/pci.h> + +#include <asm/pci_x86.h> + +#include <asm/xen/hypervisor.h> + +#include <xen/interface/xen.h> +#include <xen/events.h> + +#include "xen-ops.h" + +int xen_register_gsi(u32 gsi, int triggering, int polarity) +{ + int irq; + + if (!xen_domain()) + return -1; + + printk(KERN_DEBUG "xen: registering gsi %u triggering %d polarity %d\n", + gsi, triggering, polarity); + + irq = xen_allocate_pirq(gsi); + + printk(KERN_DEBUG "xen: --> irq=%d\n", irq); + + return irq; +} + +void __init xen_setup_pirqs(void) +{ +#ifdef CONFIG_ACPI + int irq; + + /* + * Set up acpi interrupt in acpi_gbl_FADT.sci_interrupt. + */ + irq = xen_allocate_pirq(acpi_gbl_FADT.sci_interrupt); + + printk(KERN_INFO "xen: allocated irq %d for acpi %d\n", + irq, acpi_gbl_FADT.sci_interrupt); + + /* Blerk. */ + acpi_gbl_FADT.sci_interrupt = irq; +#endif +} diff --git a/drivers/xen/events.c b/drivers/xen/events.c index 193cee4..4a15326 100644 --- a/drivers/xen/events.c +++ b/drivers/xen/events.c @@ -419,6 +419,7 @@ static unsigned int startup_pirq(unsigned int irq) struct evtchn_bind_pirq bind_pirq; struct irq_info *info = info_for_irq(irq); int evtchn = evtchn_from_irq(irq); + int rc; BUG_ON(info->type != IRQT_PIRQ); @@ -428,7 +429,8 @@ static unsigned int startup_pirq(unsigned int irq) bind_pirq.pirq = irq; /* NB. We are happy to share unless we are probing. */ bind_pirq.flags = probing_irq(irq) ? 0 : BIND_PIRQ__WILL_SHARE; - if (HYPERVISOR_event_channel_op(EVTCHNOP_bind_pirq, &bind_pirq) != 0) { + rc = HYPERVISOR_event_channel_op(EVTCHNOP_bind_pirq, &bind_pirq); + if (rc != 0) { if (!probing_irq(irq)) printk(KERN_INFO "Failed to obtain physical IRQ %d\n", irq); @@ -1187,4 +1189,6 @@ void __init xen_init_IRQ(void) mask_evtchn(i); irq_ctx_init(smp_processor_id()); + + xen_setup_pirqs(); } diff --git a/include/xen/events.h b/include/xen/events.h index e5b541d..6fe4863 100644 --- a/include/xen/events.h +++ b/include/xen/events.h @@ -69,4 +69,12 @@ int xen_vector_from_irq(unsigned pirq); /* Return gsi allocated to pirq */ int xen_gsi_from_irq(unsigned pirq); +#ifdef CONFIG_XEN_DOM0_PCI +void xen_setup_pirqs(void); +#else +static inline void xen_setup_pirqs(void) +{ +} +#endif + #endif /* _XEN_EVENTS_H */ -- 1.6.0.6 _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
Jeremy Fitzhardinge
2009-May-07 21:14 UTC
[Xen-devel] [PATCH 08/18] xen: bind pirq to vector and event channel
Impact: program IO APICs under Xen Having converting a dev+pin to a gsi, and that gsi to an irq, and allocated a vector for the irq, we must program the IO APIC to deliver an interrupt on a pin to the vector, so Xen can deliver it as an event channel. Given the pirq, we can get the gsi and vector. We map the gsi to a specific IO APIC''s pin, and set the routing entry. (We were passing the ACPI triggering and polarity levels directly into the apic - but they have reversed values. The result was that all the level-triggered interrupts were edge, and vice-versa. It''s surprising that anything worked at all, but now AHCI works for me. Thanks for Gerd Hoffmann for noticing this.) Signed-off-by: Jeremy Fitzhardinge <jeremy.fitzhardinge@citrix.com> --- arch/x86/xen/apic.c | 4 ++-- arch/x86/xen/pci.c | 32 ++++++++++++++++++++++++++++++++ 2 files changed, 34 insertions(+), 2 deletions(-) diff --git a/arch/x86/xen/apic.c b/arch/x86/xen/apic.c index 17736a0..e9d9ea7 100644 --- a/arch/x86/xen/apic.c +++ b/arch/x86/xen/apic.c @@ -4,6 +4,7 @@ #include <asm/io_apic.h> #include <asm/acpi.h> +#include <asm/hw_irq.h> #include <asm/xen/hypervisor.h> #include <asm/xen/hypercall.h> @@ -13,8 +14,7 @@ void __init xen_io_apic_init(void) { - printk("xen apic init\n"); - dump_stack(); + enable_IO_APIC(); } unsigned int xen_io_apic_read(unsigned apic, unsigned reg) diff --git a/arch/x86/xen/pci.c b/arch/x86/xen/pci.c index f450007..0f3663c 100644 --- a/arch/x86/xen/pci.c +++ b/arch/x86/xen/pci.c @@ -2,6 +2,8 @@ #include <linux/acpi.h> #include <linux/pci.h> +#include <asm/mpspec.h> +#include <asm/io_apic.h> #include <asm/pci_x86.h> #include <asm/xen/hypervisor.h> @@ -11,6 +13,31 @@ #include "xen-ops.h" +static void xen_set_io_apic_routing(int irq, int trigger, int polarity) +{ + int ioapic, ioapic_pin; + int vector, gsi; + struct IO_APIC_route_entry entry; + + gsi = xen_gsi_from_irq(irq); + vector = xen_vector_from_irq(irq); + + ioapic = mp_find_ioapic(gsi); + if (ioapic == -1) { + printk(KERN_WARNING "xen_set_ioapic_routing: irq %d gsi %d ioapic %d\n", + irq, gsi, ioapic); + return; + } + + ioapic_pin = mp_find_ioapic_pin(ioapic, gsi); + + printk(KERN_INFO "xen_set_ioapic_routing: irq %d gsi %d vector %d ioapic %d pin %d triggering %d polarity %d\n", + irq, gsi, vector, ioapic, ioapic_pin, trigger, polarity); + + setup_ioapic_entry(ioapic, -1, &entry, ~0, trigger, polarity, vector); + ioapic_write_entry(ioapic, ioapic_pin, entry); +} + int xen_register_gsi(u32 gsi, int triggering, int polarity) { int irq; @@ -25,6 +52,11 @@ int xen_register_gsi(u32 gsi, int triggering, int polarity) printk(KERN_DEBUG "xen: --> irq=%d\n", irq); + if (irq > 0) + xen_set_io_apic_routing(irq, + triggering == ACPI_EDGE_SENSITIVE ? 0 : 1, + polarity == ACPI_ACTIVE_HIGH ? 0 : 1); + return irq; } -- 1.6.0.6 _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
Jeremy Fitzhardinge
2009-May-07 21:14 UTC
[Xen-devel] [PATCH 09/18] xen: pre-initialize legacy irqs early
From: Ian Campbell <ian.campbell@citrix.com> Impact: ISA/legacy device compat Various legacy devices, such as IDE, assume their legacy interrupts are already initialized and are immediately usable. Pre-initialize all the legacy interrupts. Signed-off-by: Ian Campbell <ian.campbell@citrix.com> Signed-off-by: Jeremy Fitzhardinge <jeremy.fitzhardinge@citrix.com> --- arch/x86/xen/pci.c | 6 +++++- 1 files changed, 5 insertions(+), 1 deletions(-) diff --git a/arch/x86/xen/pci.c b/arch/x86/xen/pci.c index 0f3663c..fb408ce 100644 --- a/arch/x86/xen/pci.c +++ b/arch/x86/xen/pci.c @@ -62,9 +62,9 @@ int xen_register_gsi(u32 gsi, int triggering, int polarity) void __init xen_setup_pirqs(void) { -#ifdef CONFIG_ACPI int irq; +#ifdef CONFIG_ACPI /* * Set up acpi interrupt in acpi_gbl_FADT.sci_interrupt. */ @@ -76,4 +76,8 @@ void __init xen_setup_pirqs(void) /* Blerk. */ acpi_gbl_FADT.sci_interrupt = irq; #endif + + /* Pre-allocate legacy irqs */ + for (irq=0; irq < NR_IRQS_LEGACY; irq++) + xen_allocate_pirq(irq); } -- 1.6.0.6 _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
Jeremy Fitzhardinge
2009-May-07 21:14 UTC
[Xen-devel] [PATCH 10/18] xen: don''t setup acpi interrupt unless there is one
From: Jeremy Fitzhardinge <jeremy.fitzhardinge@citrix.com> Impact: compatibility with non-ACPI machines If the SCI hasn''t been set, then presumably we''re not running with acpi, don''t bother setting up the interrupt. Signed-off-by: Jeremy Fitzhardinge <jeremy.fitzhardinge@citrix.com> --- arch/x86/xen/pci.c | 11 +++++------ 1 files changed, 5 insertions(+), 6 deletions(-) diff --git a/arch/x86/xen/pci.c b/arch/x86/xen/pci.c index fb408ce..e88f85e 100644 --- a/arch/x86/xen/pci.c +++ b/arch/x86/xen/pci.c @@ -68,13 +68,12 @@ void __init xen_setup_pirqs(void) /* * Set up acpi interrupt in acpi_gbl_FADT.sci_interrupt. */ - irq = xen_allocate_pirq(acpi_gbl_FADT.sci_interrupt); + if (acpi_gbl_FADT.sci_interrupt > 0) { + irq = xen_allocate_pirq(acpi_gbl_FADT.sci_interrupt); - printk(KERN_INFO "xen: allocated irq %d for acpi %d\n", - irq, acpi_gbl_FADT.sci_interrupt); - - /* Blerk. */ - acpi_gbl_FADT.sci_interrupt = irq; + printk(KERN_INFO "xen: allocated irq %d for acpi %d\n", + irq, acpi_gbl_FADT.sci_interrupt); + } #endif /* Pre-allocate legacy irqs */ -- 1.6.0.6 _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
Jeremy Fitzhardinge
2009-May-07 21:14 UTC
[Xen-devel] [PATCH 11/18] xen: use acpi_get_override_irq() to get triggering for legacy irqs
From: Jeremy Fitzhardinge <jeremy.fitzhardinge@citrix.com> Impact: compatibility with legacy/ISA hardware We need to set up proper IO apic entries for legacy irqs, which are not normally configured by either normal acpi interrupt routing or PNP. This also generalizes the acpi interrupt setup, so we can remove it as a special case. Signed-off-by: Jeremy Fitzhardinge <jeremy.fitzhardinge@citrix.com> --- arch/x86/xen/pci.c | 24 ++++++++++-------------- 1 files changed, 10 insertions(+), 14 deletions(-) diff --git a/arch/x86/xen/pci.c b/arch/x86/xen/pci.c index e88f85e..f55532d 100644 --- a/arch/x86/xen/pci.c +++ b/arch/x86/xen/pci.c @@ -64,19 +64,15 @@ void __init xen_setup_pirqs(void) { int irq; -#ifdef CONFIG_ACPI - /* - * Set up acpi interrupt in acpi_gbl_FADT.sci_interrupt. - */ - if (acpi_gbl_FADT.sci_interrupt > 0) { - irq = xen_allocate_pirq(acpi_gbl_FADT.sci_interrupt); - - printk(KERN_INFO "xen: allocated irq %d for acpi %d\n", - irq, acpi_gbl_FADT.sci_interrupt); - } -#endif - /* Pre-allocate legacy irqs */ - for (irq=0; irq < NR_IRQS_LEGACY; irq++) - xen_allocate_pirq(irq); + for (irq=0; irq < NR_IRQS_LEGACY; irq++) { + int trigger, polarity; + + if (acpi_get_override_irq(irq, &trigger, &polarity) == -1) + continue; + + xen_register_gsi(irq, + trigger ? ACPI_LEVEL_SENSITIVE : ACPI_EDGE_SENSITIVE, + polarity ? ACPI_ACTIVE_LOW : ACPI_ACTIVE_HIGH); + } } -- 1.6.0.6 _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
Jeremy Fitzhardinge
2009-May-07 21:14 UTC
[Xen-devel] [PATCH 12/18] xen: initialize irq 0 too
From: Jeremy Fitzhardinge <jeremy.fitzhardinge@citrix.com> Impact: theoretical bugfix, cleanup IRQ 0 is valid, so make sure it gets initialized properly too. (Though in practice it doesn''t matter, because its the timer interrupt we don''t use.) Signed-off-by: Jeremy Fitzhardinge <jeremy.fitzhardinge@citrix.com> --- arch/x86/xen/pci.c | 2 +- 1 files changed, 1 insertions(+), 1 deletions(-) diff --git a/arch/x86/xen/pci.c b/arch/x86/xen/pci.c index f55532d..502ff5f 100644 --- a/arch/x86/xen/pci.c +++ b/arch/x86/xen/pci.c @@ -52,7 +52,7 @@ int xen_register_gsi(u32 gsi, int triggering, int polarity) printk(KERN_DEBUG "xen: --> irq=%d\n", irq); - if (irq > 0) + if (irq >= 0) xen_set_io_apic_routing(irq, triggering == ACPI_EDGE_SENSITIVE ? 0 : 1, polarity == ACPI_ACTIVE_HIGH ? 0 : 1); -- 1.6.0.6 _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
Jeremy Fitzhardinge
2009-May-07 21:14 UTC
[Xen-devel] [PATCH 13/18] xen: dynamically allocate irq & event structures
From: Jeremy Fitzhardinge <jeremy.fitzhardinge@citrix.com> Impact: reduce memory usage Dynamically allocate the irq_info and evtchn_to_irq arrays, so that 1) the irq_info array scales to the actual number of possible irqs, and 2) we don''t needlessly increase the static size of the kernel when we aren''t running under Xen. Derived on patch from Mike Travis <travis@sgi.com>. Signed-off-by: Jeremy Fitzhardinge <jeremy.fitzhardinge@citrix.com> --- drivers/xen/events.c | 15 +++++++++------ 1 files changed, 9 insertions(+), 6 deletions(-) diff --git a/drivers/xen/events.c b/drivers/xen/events.c index 4a15326..64200a0 100644 --- a/drivers/xen/events.c +++ b/drivers/xen/events.c @@ -27,6 +27,7 @@ #include <linux/module.h> #include <linux/string.h> #include <linux/bootmem.h> +#include <linux/irqnr.h> #include <asm/ptrace.h> #include <asm/irq.h> @@ -91,11 +92,9 @@ struct irq_info }; #define PIRQ_NEEDS_EOI (1 << 0) -static struct irq_info irq_info[NR_IRQS]; +static struct irq_info *irq_info; -static int evtchn_to_irq[NR_EVENT_CHANNELS] = { - [0 ... NR_EVENT_CHANNELS-1] = -1 -}; +static int *evtchn_to_irq; struct cpu_evtchn_s { unsigned long bits[NR_EVENT_CHANNELS/BITS_PER_LONG]; }; @@ -515,7 +514,7 @@ static int find_irq_by_gsi(unsigned gsi) { int irq; - for(irq = 0; irq < NR_IRQS; irq++) { + for(irq = 0; irq < nr_irqs; irq++) { struct irq_info *info = info_for_irq(irq); if (info == NULL || info->type != IRQT_PIRQ) @@ -1180,7 +1179,11 @@ void __init xen_init_IRQ(void) size_t size = nr_cpu_ids * sizeof(struct cpu_evtchn_s); cpu_evtchn_mask_p = alloc_bootmem(size); - BUG_ON(cpu_evtchn_mask_p == NULL); + irq_info = alloc_bootmem(nr_irqs * sizeof(*irq_info)); + + evtchn_to_irq = alloc_bootmem(NR_EVENT_CHANNELS * sizeof(*evtchn_to_irq)); + for(i = 0; i < NR_EVENT_CHANNELS; i++) + evtchn_to_irq[i] = -1; init_evtchn_cpu_bindings(); -- 1.6.0.6 _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
Jeremy Fitzhardinge
2009-May-07 21:14 UTC
[Xen-devel] [PATCH 14/18] xen: set pirq name to something useful.
From: Gerd Hoffmann <kraxel@xeni.home.kraxel.org> Impact: cleanup Make pirq show useful information in /proc/interrupts Signed-off-by: Gerd Hoffmann <kraxel@xeni.home.kraxel.org> Signed-off-by: Jeremy Fitzhardinge <jeremy.fitzhardinge@citrix.com> --- arch/x86/xen/pci.c | 3 ++- drivers/xen/events.c | 4 ++-- include/xen/events.h | 2 +- 3 files changed, 5 insertions(+), 4 deletions(-) diff --git a/arch/x86/xen/pci.c b/arch/x86/xen/pci.c index 502ff5f..fb3ada9 100644 --- a/arch/x86/xen/pci.c +++ b/arch/x86/xen/pci.c @@ -48,7 +48,8 @@ int xen_register_gsi(u32 gsi, int triggering, int polarity) printk(KERN_DEBUG "xen: registering gsi %u triggering %d polarity %d\n", gsi, triggering, polarity); - irq = xen_allocate_pirq(gsi); + irq = xen_allocate_pirq(gsi, (triggering == ACPI_EDGE_SENSITIVE) + ? "ioapic-edge" : "ioapic-level"); printk(KERN_DEBUG "xen: --> irq=%d\n", irq); diff --git a/drivers/xen/events.c b/drivers/xen/events.c index 64200a0..b8fd514 100644 --- a/drivers/xen/events.c +++ b/drivers/xen/events.c @@ -532,7 +532,7 @@ static int find_irq_by_gsi(unsigned gsi) * event channel until the irq actually started up. Return an * existing irq if we''ve already got one for the gsi. */ -int xen_allocate_pirq(unsigned gsi) +int xen_allocate_pirq(unsigned gsi, char *name) { int irq; struct physdev_irq irq_op; @@ -554,7 +554,7 @@ int xen_allocate_pirq(unsigned gsi) irq = find_unbound_irq(); set_irq_chip_and_handler_name(irq, &xen_pirq_chip, - handle_level_irq, "pirq"); + handle_level_irq, name); irq_op.irq = irq; if (HYPERVISOR_physdev_op(PHYSDEVOP_alloc_irq_vector, &irq_op)) { diff --git a/include/xen/events.h b/include/xen/events.h index 6fe4863..4b19b9c 100644 --- a/include/xen/events.h +++ b/include/xen/events.h @@ -61,7 +61,7 @@ unsigned irq_from_evtchn(unsigned int evtchn); /* Allocate an irq for a physical interrupt, given a gsi. "Legacy" GSIs are identity mapped; others are dynamically allocated as usual. */ -int xen_allocate_pirq(unsigned gsi); +int xen_allocate_pirq(unsigned gsi, char *name); /* Return vector allocated to pirq */ int xen_vector_from_irq(unsigned pirq); -- 1.6.0.6 _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
Jeremy Fitzhardinge
2009-May-07 21:14 UTC
[Xen-devel] [PATCH 15/18] xen: fix legacy irq setup, make ioapic-less machines work.
From: Gerd Hoffmann <kraxel@xeni.home.kraxel.org> Impact: compatibility with old machines If the machine has no IO APICs, then just allocate a set of legacy interrupts. Signed-off-by: Gerd Hoffmann <kraxel@xeni.home.kraxel.org> Signed-off-by: Jeremy Fitzhardinge <jeremy.fitzhardinge@citrix.com> --- arch/x86/xen/pci.c | 6 ++++++ 1 files changed, 6 insertions(+), 0 deletions(-) diff --git a/arch/x86/xen/pci.c b/arch/x86/xen/pci.c index fb3ada9..69b475b 100644 --- a/arch/x86/xen/pci.c +++ b/arch/x86/xen/pci.c @@ -65,6 +65,12 @@ void __init xen_setup_pirqs(void) { int irq; + if (0 == nr_ioapics) { + for (irq=0; irq < NR_IRQS_LEGACY; irq++) + xen_allocate_pirq(irq, "xt-pic"); + return; + } + /* Pre-allocate legacy irqs */ for (irq=0; irq < NR_IRQS_LEGACY; irq++) { int trigger, polarity; -- 1.6.0.6 _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
From: Jeremy Fitzhardinge <jeremy.fitzhardinge@citrix.com> Impact: prevent MSI subsystem from crashing Disable MSI until we support it properly. Signed-off-by: Jeremy Fitzhardinge <jeremy.fitzhardinge@citrix.com> --- arch/x86/xen/apic.c | 3 +++ drivers/pci/pci.h | 2 -- include/linux/pci.h | 6 ++++++ 3 files changed, 9 insertions(+), 2 deletions(-) diff --git a/arch/x86/xen/apic.c b/arch/x86/xen/apic.c index e9d9ea7..3f890c4 100644 --- a/arch/x86/xen/apic.c +++ b/arch/x86/xen/apic.c @@ -1,6 +1,7 @@ #include <linux/kernel.h> #include <linux/threads.h> #include <linux/bitmap.h> +#include <linux/pci.h> #include <asm/io_apic.h> #include <asm/acpi.h> @@ -47,6 +48,8 @@ void xen_init_apic(void) if (!xen_initial_domain()) return; + pci_no_msi(); + #ifdef CONFIG_ACPI /* * Pretend ACPI found our lapic even though we''ve disabled it, diff --git a/drivers/pci/pci.h b/drivers/pci/pci.h index d03f6b9..79ada7b 100644 --- a/drivers/pci/pci.h +++ b/drivers/pci/pci.h @@ -111,10 +111,8 @@ extern struct rw_semaphore pci_bus_sem; extern unsigned int pci_pm_d3_delay; #ifdef CONFIG_PCI_MSI -void pci_no_msi(void); extern void pci_msi_init_pci_dev(struct pci_dev *dev); #else -static inline void pci_no_msi(void) { } static inline void pci_msi_init_pci_dev(struct pci_dev *dev) { } #endif diff --git a/include/linux/pci.h b/include/linux/pci.h index 72698d8..724d030 100644 --- a/include/linux/pci.h +++ b/include/linux/pci.h @@ -1253,5 +1253,11 @@ static inline irqreturn_t pci_sriov_migration(struct pci_dev *dev) } #endif +#ifdef CONFIG_PCI_MSI +void pci_no_msi(void); +#else +static inline void pci_no_msi(void) { } +#endif + #endif /* __KERNEL__ */ #endif /* LINUX_PCI_H */ -- 1.6.0.6 _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
Jeremy Fitzhardinge
2009-May-07 21:14 UTC
[Xen-devel] [PATCH 17/18] xen/apic: checkpatch cleanups
From: Jeremy Fitzhardinge <jeremy.fitzhardinge@citrix.com> Clean up mostly whitespace issues. Signed-off-by: Jeremy Fitzhardinge <jeremy.fitzhardinge@citrix.com> --- arch/x86/xen/apic.c | 4 ++-- arch/x86/xen/pci.c | 4 ++-- drivers/xen/events.c | 7 ++++--- 3 files changed, 8 insertions(+), 7 deletions(-) diff --git a/arch/x86/xen/apic.c b/arch/x86/xen/apic.c index 3f890c4..496f07d 100644 --- a/arch/x86/xen/apic.c +++ b/arch/x86/xen/apic.c @@ -53,8 +53,8 @@ void xen_init_apic(void) #ifdef CONFIG_ACPI /* * Pretend ACPI found our lapic even though we''ve disabled it, - * to prevent MP tables from setting up lapics. - */ + * to prevent MP tables from setting up lapics. + */ acpi_lapic = 1; #endif } diff --git a/arch/x86/xen/pci.c b/arch/x86/xen/pci.c index 69b475b..5b9ee11 100644 --- a/arch/x86/xen/pci.c +++ b/arch/x86/xen/pci.c @@ -66,13 +66,13 @@ void __init xen_setup_pirqs(void) int irq; if (0 == nr_ioapics) { - for (irq=0; irq < NR_IRQS_LEGACY; irq++) + for (irq = 0; irq < NR_IRQS_LEGACY; irq++) xen_allocate_pirq(irq, "xt-pic"); return; } /* Pre-allocate legacy irqs */ - for (irq=0; irq < NR_IRQS_LEGACY; irq++) { + for (irq = 0; irq < NR_IRQS_LEGACY; irq++) { int trigger, polarity; if (acpi_get_override_irq(irq, &trigger, &polarity) == -1) diff --git a/drivers/xen/events.c b/drivers/xen/events.c index b8fd514..febab09 100644 --- a/drivers/xen/events.c +++ b/drivers/xen/events.c @@ -514,7 +514,7 @@ static int find_irq_by_gsi(unsigned gsi) { int irq; - for(irq = 0; irq < nr_irqs; irq++) { + for (irq = 0; irq < nr_irqs; irq++) { struct irq_info *info = info_for_irq(irq); if (info == NULL || info->type != IRQT_PIRQ) @@ -1181,8 +1181,9 @@ void __init xen_init_IRQ(void) cpu_evtchn_mask_p = alloc_bootmem(size); irq_info = alloc_bootmem(nr_irqs * sizeof(*irq_info)); - evtchn_to_irq = alloc_bootmem(NR_EVENT_CHANNELS * sizeof(*evtchn_to_irq)); - for(i = 0; i < NR_EVENT_CHANNELS; i++) + evtchn_to_irq = alloc_bootmem(NR_EVENT_CHANNELS * + sizeof(*evtchn_to_irq)); + for (i = 0; i < NR_EVENT_CHANNELS; i++) evtchn_to_irq[i] = -1; init_evtchn_cpu_bindings(); -- 1.6.0.6 _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
Jeremy Fitzhardinge
2009-May-07 21:14 UTC
[Xen-devel] [PATCH 18/18] xen/apic: add pin argument to setup_ioapic_entry()
From: Jeremy Fitzhardinge <jeremy.fitzhardinge@citrix.com> setup_ioapic_entry() grew a ''pin'' argument, so give it one. Signed-off-by: Jeremy Fitzhardinge <jeremy.fitzhardinge@citrix.com> --- arch/x86/xen/pci.c | 3 ++- 1 files changed, 2 insertions(+), 1 deletions(-) diff --git a/arch/x86/xen/pci.c b/arch/x86/xen/pci.c index 5b9ee11..07b59fe 100644 --- a/arch/x86/xen/pci.c +++ b/arch/x86/xen/pci.c @@ -34,7 +34,8 @@ static void xen_set_io_apic_routing(int irq, int trigger, int polarity) printk(KERN_INFO "xen_set_ioapic_routing: irq %d gsi %d vector %d ioapic %d pin %d triggering %d polarity %d\n", irq, gsi, vector, ioapic, ioapic_pin, trigger, polarity); - setup_ioapic_entry(ioapic, -1, &entry, ~0, trigger, polarity, vector); + setup_ioapic_entry(ioapic, -1, &entry, ~0, trigger, polarity, vector, + ioapic_pin); ioapic_write_entry(ioapic, ioapic_pin, entry); } -- 1.6.0.6 _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
Ingo Molnar
2009-May-09 08:42 UTC
[Xen-devel] Re: [PATCH 02/18] xen: hook io_apic read/write operations
* Jeremy Fitzhardinge <jeremy@goop.org> wrote:> --- a/arch/x86/kernel/apic/io_apic.c > +++ b/arch/x86/kernel/apic/io_apic.c > @@ -62,8 +62,10 @@ > #include <asm/uv/uv_hub.h> > #include <asm/uv/uv_irq.h> > > +#include <asm/xen/hypervisor.h> > #include <asm/apic.h> > > + > #define __apicdebuginit(type) static type __init > > /* > @@ -407,14 +409,26 @@ static inline void io_apic_eoi(unsigned int apic, unsigned int vector) > > static inline unsigned int io_apic_read(unsigned int apic, unsigned int reg) > { > - struct io_apic __iomem *io_apic = io_apic_base(apic); > + struct io_apic __iomem *io_apic; > + > + if (xen_initial_domain()) > + return xen_io_apic_read(apic, reg);hm, any reason why we dont want to create a ''struct io_apic'' driver abstraction instead of spreading xen_initial_domain() checks all around the code? Ingo _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
Ingo Molnar
2009-May-09 08:43 UTC
[Xen-devel] Re: [PATCH 02/18] xen: hook io_apic read/write operations
* Ingo Molnar <mingo@elte.hu> wrote:> > * Jeremy Fitzhardinge <jeremy@goop.org> wrote: > > > --- a/arch/x86/kernel/apic/io_apic.c > > +++ b/arch/x86/kernel/apic/io_apic.c > > @@ -62,8 +62,10 @@ > > #include <asm/uv/uv_hub.h> > > #include <asm/uv/uv_irq.h> > > > > +#include <asm/xen/hypervisor.h> > > #include <asm/apic.h> > > > > + > > #define __apicdebuginit(type) static type __init > > > > /* > > @@ -407,14 +409,26 @@ static inline void io_apic_eoi(unsigned int apic, unsigned int vector) > > > > static inline unsigned int io_apic_read(unsigned int apic, unsigned int reg) > > { > > - struct io_apic __iomem *io_apic = io_apic_base(apic); > > + struct io_apic __iomem *io_apic; > > + > > + if (xen_initial_domain()) > > + return xen_io_apic_read(apic, reg); > > hm, any reason why we dont want to create a ''struct io_apic'' > driver abstraction instead of spreading xen_initial_domain() > checks all around the code?And on a higher level, i still dont see why you dont do the whole Xen thing under an irqchip. There should be no extra crappy checks in native code. Ingo _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
Jeremy Fitzhardinge
2009-May-09 15:40 UTC
[Xen-devel] Re: [PATCH 02/18] xen: hook io_apic read/write operations
Ingo Molnar wrote:> * Ingo Molnar <mingo@elte.hu> wrote: > > >> * Jeremy Fitzhardinge <jeremy@goop.org> wrote: >> >> >>> --- a/arch/x86/kernel/apic/io_apic.c >>> +++ b/arch/x86/kernel/apic/io_apic.c >>> @@ -62,8 +62,10 @@ >>> #include <asm/uv/uv_hub.h> >>> #include <asm/uv/uv_irq.h> >>> >>> +#include <asm/xen/hypervisor.h> >>> #include <asm/apic.h> >>> >>> + >>> #define __apicdebuginit(type) static type __init >>> >>> /* >>> @@ -407,14 +409,26 @@ static inline void io_apic_eoi(unsigned int apic, unsigned int vector) >>> >>> static inline unsigned int io_apic_read(unsigned int apic, unsigned int reg) >>> { >>> - struct io_apic __iomem *io_apic = io_apic_base(apic); >>> + struct io_apic __iomem *io_apic; >>> + >>> + if (xen_initial_domain()) >>> + return xen_io_apic_read(apic, reg); >>> >> hm, any reason why we dont want to create a ''struct io_apic'' >> driver abstraction instead of spreading xen_initial_domain() >> checks all around the code? >>My initial patch did that, and I''m happy to revive it. But HPA preferred this approach, arguing against introducing another layer of abstraction for the sake of one user.> And on a higher level, i still dont see why you dont do the whole > Xen thing under an irqchip. There should be no extra crappy checks > in native code. >Hm, every time you see this code, you always have this quasi-Pavlovian response. You say "use an irqchip". I say: * We already use irqchip * but most of the interesting IO apic accesses (routing) are not done via the irqchip interface * so irqchip doesn''t help And then you don''t reply. And then you raise it again. I would *always* prefer to hook into an interface like irqchip rather than gouge into the code, but I really think that irqchip isn''t that interface. If you have a more specific suggestion or proposal I''ll happily follow it up, but repeating "you should use an irqchip" isn''t getting anywhere. To reiterate: * irq_chip is all about interrupt delivery, masking, acking, etc * these Xen dom0 apic changes are all about interrupt routing * irq_chip doesn''t cover routing J _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
Ingo Molnar
2009-May-11 11:19 UTC
[Xen-devel] Re: [PATCH 02/18] xen: hook io_apic read/write operations
* Jeremy Fitzhardinge <jeremy@goop.org> wrote:>> And on a higher level, i still dont see why you dont do the whole >> Xen thing under an irqchip. There should be no extra crappy >> checks in native code. > > Hm, every time you see this code, you always have this > quasi-Pavlovian response.Yep, my reaction to ugly code is pretty predictable, and (hopefully!) repeatable. So calling it Pavlovian is an implicit (albeit, i suspect, unintended ;-) compliment.> You say "use an irqchip". I say: > > * We already use irqchip > * but most of the interesting IO apic accesses (routing) are not > done via the irqchip interface > * so irqchip doesn''t helpI dont see the problem. All APIs within Linux are kept minimalistic and are extended on the fly, on an on-demand basis.> And then you don''t reply. And then you raise it again. > > I would *always* prefer to hook into an interface like irqchip > rather than gouge into the code, but I really think that irqchip > isn''t that interface. If you have a more specific suggestion or > proposal I''ll happily follow it up, but repeating "you should use > an irqchip" isn''t getting anywhere.Well, my main task at this stage is to point out ugly code. I might be able to do research for you and come up with a plan for you, but that''s really a courtesy in general and is not always possible for maintainers. You might argue "of all possible solutions this is the cleanest" but i havent seen you make that point. Ingo _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
Jeremy Fitzhardinge
2009-May-11 18:25 UTC
[Xen-devel] Re: [PATCH 02/18] xen: hook io_apic read/write operations
Ingo Molnar wrote:>> Hm, every time you see this code, you always have this >> quasi-Pavlovian response. >> > > Yep, my reaction to ugly code is pretty predictable, and > (hopefully!) repeatable. So calling it Pavlovian is an implicit > (albeit, i suspect, unintended ;-) compliment. >My frustration is that you''ve generally not replied, and so we haven''t been able to discuss it. Could you be more specific about what''s triggering the reaction? Is it that the change is happening at the io-apic level, or that its some explicit Xen code pasted in here rather than via an io_apic_ops?>> You say "use an irqchip". I say: >> >> * We already use irqchip >> * but most of the interesting IO apic accesses (routing) are not >> done via the irqchip interface >> * so irqchip doesn''t help >> > > I dont see the problem. All APIs within Linux are kept minimalistic > and are extended on the fly, on an on-demand basis. >Sure, where it makes sense. One wouldn''t start extending an API in a completely different direction. irq_chip currently only deals with "irqs"; what those irqs mean and connect to are not its business because that has all been set up elsewhere. If you start adding interrupt routing, then it starts needing to know about devices, busses, etc. I can''t see how that makes much sense at all, particularly for an arch-independent interface.> > Well, my main task at this stage is to point out ugly code. I might > be able to do research for you and come up with a plan for you, but > that''s really a courtesy in general and is not always possible for > maintainers. You might argue "of all possible solutions this is the > cleanest" but i havent seen you make that point.I''d love to, but Plato isn''t taking my calls so I can''t check. But I do think hooking the io-apic operations makes more sense than any other solution because we explicitly want all the other code above it. The *only* difference between a Xen io-apic and a native io-apic is that we need to access the registers with hypercalls rather than mmio. Same registers, same meanings, same settings made at the same time. So the io-apic accessors are at precisely the right level of abstraction for our needs; introducing something higher-level would be an abstraction impedance mismatch, and would be no better for it. An io_apic_ops makes sense to me, if adding it would stop triggering your ugly-code detector. But that''s specifically what HPA objected to in this series... J _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
Ingo Molnar
2009-May-11 21:43 UTC
[Xen-devel] Re: [PATCH 02/18] xen: hook io_apic read/write operations
* Jeremy Fitzhardinge <jeremy@goop.org> wrote:> But I do think hooking the io-apic operations makes more sense > than any other solution because we explicitly want all the other > code above it.That sounds OK-ish at first sight. Ingo _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
Jeremy Fitzhardinge
2009-May-11 22:06 UTC
[Xen-devel] Re: [PATCH 02/18] xen: hook io_apic read/write operations
Ingo Molnar wrote:> * Jeremy Fitzhardinge <jeremy@goop.org> wrote: > > >> But I do think hooking the io-apic operations makes more sense >> than any other solution because we explicitly want all the other >> code above it. >> > > That sounds OK-ish at first sight. >OK. Shall I re-spin with io_apic_ops? J _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel