Magenheimer, Dan (HP Labs Fort Collins)
2006-Apr-04 19:27 UTC
RE: [Xen-devel] Does dom0 see all physical processors? (RE: [Xen-ia64-devel] SAL INFO virtualization)
I understand and sympathize with the need for dom0 to sometimes get and use information from each processor that is only available if dom0 is running on each processor. However, AFAIK, SMP guests are always gang-scheduled, correct? (If not, aren''t there some very knotty research issues related to locking and forward progress?) So on a 16-processor system, every time dom0 needs to run (e.g. to handle backend I/O for any one of perhaps hundreds of domains), *every* domain gets descheduled so that dom0 can be (gang-)scheduled on all 16 processors? If true, this sounds like a _horrible_ performance hit, so I hope I''m misunderstanding something... Dan> -----Original Message----- > From: Keir Fraser [mailto:Keir.Fraser@cl.cam.ac.uk] > Sent: Tuesday, April 04, 2006 1:26 AM > To: Tian, Kevin > Cc: xen-devel; xen-ia64-devel@lists.xensource.com; > Magenheimer, Dan (HP Labs Fort Collins); Tristan Gingold > Subject: Re: [Xen-devel] Does dom0 see all physical > processors? (RE: [Xen-ia64-devel] SAL INFO virtualization) > > > On 4 Apr 2006, at 03:17, Tian, Kevin wrote: > > > > > Then consider your question about a large box with many processors. > > How about the real environment? Is it the case to provide a > 16-way SMP > > box, or a 16-way NUMA box? I prefer to the latter. If it''s > a NUMA box, > > dom0 sees physical ACPI table and can be configured as NUMA aware. > > This is a model we must support if we are to have domain0 > handle other > processor-related ACPI activities (e.g., power management). The power > information and available settings won''t make much sense to the user > unless there''s an equivalence between VCPUs and PCPUs for domain0. > > -- Keir > >_______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
Ryan Harper
2006-Apr-07 15:42 UTC
Re: [Xen-devel] Does dom0 see all physical processors? (RE: [Xen-ia64-devel] SAL INFO virtualization)
* Magenheimer, Dan (HP Labs Fort Collins) <dan.magenheimer@hp.com> [2006-04-07 01:43]:> I understand and sympathize with the need for dom0 to > sometimes get and use information from each processor > that is only available if dom0 is running on each processor. > > However, AFAIK, SMP guests are always gang-scheduled, correct?I don''t believe either the bvt or sedf scheduler in Xen provide any gang scheduling support. Each physical cpu has its own runqueue and it schedules VCPUs independently. The scheduling parameters are set on a per-domain basis but end up being the same for each VCPU. -- Ryan Harper Software Engineer; Linux Technology Center IBM Corp., Austin, Tx (512) 838-9253 T/L: 678-9253 ryanh@us.ibm.com _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel