Hi, I''ve been trying to use E5520 and X5650 together in an heterogeneous pool without success. I know the combination is not on the official XenServer supported list (http://hcl.xensource.com/CPUPoolsList.aspx), but I thought it would be possible to set the mask anyway and see for myself if the combination works… My problem is that the mask doesn''t "stick" after a reboot… "compare-cpu" returns the following output: CPU 1: model name: Intel(R) Xeon(R) CPU E5520 @ 2.27GHz features: 009ce3bd-bfebfbff-00000001-28100800 masking level: full CPU 2: model name: Intel(R) Xeon(R) CPU X5650 @ 2.67GHz features: 029ee3ff-bfebfbff-00000001-2c100800 masking level: full Result: CPU 1 and CPU 2 are compatible for masking Mask type: 2 - CPU 1 has a subset of features to CPU 2 Mask: 009ce3bd-bfebfbff-00000001-28100800 Then, I set the mask on the X5650 as this: # xe host-set-cpu-features features=009ce3bd-bfebfbff-00000001-28100800 When I run "xe host-cpu-info" I see that mask is set in "features_after_reboot" -- however, after the reboot, the mask is simply not applied, and the original "029ee3ff-bfebfbff-00000001-2c100800" is the only mask shown on "host-cpu-info". Is there anything else I should do to ensure the cpu mask is configured at boot? Best regards, Eduardo Bragatto
On Mon, Jun 24, 2013, at 21:10, Eduardo Bragatto wrote:> Is there anything else I should do to ensure the cpu mask is configured > at boot? >Are you doing everything via cli? Have you tried with XenCenter? I don''t know if XenCenter does anything differently when creating Heterogeneous pools
On Tue, 06/25/2013 10:38 AM, Mark Felder <feld@feld.me> wrote:> On Mon, Jun 24, 2013, at 21:10, Eduardo Bragatto wrote: > > Is there anything else I should do to ensure the cpu mask is configured > > at boot? > > >I''ll just share my experiences. I''m running a pool with several hapertown based systems (5410) and a single E5645 based system. [root@xenserver-0003 /]# xe host-cpu-info cpu_count : 12 vendor: GenuineIntel speed: 2400.138 modelname: Intel(R) Xeon(R) CPU E5645 @ 2.40GHz family: 6 model: 44 stepping: 2 flags: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat clflush acpi mmx fxsr sse sse2 ss ht nx constant_tsc nonstop_tsc aperfmperf pni vmx est ssse3 sse4_1 hypervisor ida arat tpr_shadow vnmi flexpriority ept vpid features: 000ce3bd-bfebfbff-00000001-20100800 features_after_reboot: 000ce3bd-bfebfbff-00000001-20100800 physical_features: 029ee3ff-bfebfbff-00000001-2c100800 maskable: full The command I used was xe host-set-cpu-features using values obtained from running the compare-cpu script which I obtained from here: http://www.cl.cam.ac.uk/xen/XenE/host-cpu-info/compare-cpu
Hi Mark, I''m doing it over the CLI, I don''t if it''s possible to have it done through XenCenter. Let me know if you have any information about that. Thanks, Eduardo Bragatto On Tue, Jun 25, 2013 at 11:38 AM, Mark Felder <feld@feld.me> wrote:> On Mon, Jun 24, 2013, at 21:10, Eduardo Bragatto wrote: > > Is there anything else I should do to ensure the cpu mask is configured > > at boot? > > > > Are you doing everything via cli? Have you tried with XenCenter? I don''t > know if XenCenter does anything differently when creating Heterogeneous > pools > > _______________________________________________ > Xen-users mailing list > Xen-users@lists.xen.org > http://lists.xen.org/xen-users >_______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users
Hi Neal, Thanks for sharing your setup. I''m also using the compare-cpu script the same as you, however after I run "host-set-cpu-features" and reboot the server, it does not come back with the mask set -- "features" is still the same as "physical_features". Did you do anything else besides running "host-set-cpu-features" and rebooting? Thanks Eduardo Bragatto On Tue, Jun 25, 2013 at 11:47 AM, Errol Neal <eneal@businessgrade.com>wrote:> On Tue, 06/25/2013 10:38 AM, Mark Felder <feld@feld.me> wrote: > > On Mon, Jun 24, 2013, at 21:10, Eduardo Bragatto wrote: > > > Is there anything else I should do to ensure the cpu mask is configured > > > at boot? > > > > > > > I''ll just share my experiences. > I''m running a pool with several hapertown based systems (5410) and a > single E5645 based system. > > [root@xenserver-0003 /]# xe host-cpu-info > cpu_count : 12 > vendor: GenuineIntel > speed: 2400.138 > modelname: Intel(R) Xeon(R) CPU E5645 @ 2.40GHz > family: 6 > model: 44 > stepping: 2 > flags: fpu de tsc msr pae mce cx8 apic sep mtrr mca > cmov pat clflush acpi mmx fxsr sse sse2 ss ht nx constant_tsc nonstop_tsc > aperfmperf pni vmx est ssse3 sse4_1 hypervisor ida arat tpr_shadow vnmi > flexpriority ept vpid > features: 000ce3bd-bfebfbff-00000001-20100800 > features_after_reboot: 000ce3bd-bfebfbff-00000001-20100800 > physical_features: 029ee3ff-bfebfbff-00000001-2c100800 > maskable: full > > The command I used was xe host-set-cpu-features using values obtained from > running the compare-cpu script which I obtained from here: > http://www.cl.cam.ac.uk/xen/XenE/host-cpu-info/compare-cpu > > _______________________________________________ > Xen-users mailing list > Xen-users@lists.xen.org > http://lists.xen.org/xen-users >_______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users
On Tue, 06/25/2013 12:00 PM, Eduardo Bragatto <eduardo@bragatto.com> wrote:> Hi Neal, > > Thanks for sharing your setup. I''m also using the compare-cpu script the > same as you, however after I run "host-set-cpu-features" and reboot the > server, it does not come back with the mask set -- "features" is still the > same as "physical_features". > > Did you do anything else besides running "host-set-cpu-features" and > rebooting? >Eduardo, The host-set-cpu-features is the only command I run and it sticks. I''m not quite sure why it isn''t sticking for you. Here is my /boot/extlinux.conf: label xe # XCP kernel mboot.c32 append /boot/xen.gz mem=1024G dom0_mem=752M,max:752M watchdog_timeout=300 cpui d_mask_xsave_eax=0 lowmem_emergency_pool=1M crashkernel=64M@32M console=vga vgamode-0x0311 cpuid_mask_ecx=0x000ce3bd cpuid_mask_ext_edx=0x20100800 dom0_max_vcp us=1-4 --- /boot/vmlinuz-2.6-xen root=LABEL=root-odcfwbhu ro xencons=hvc console =hvc0 console=tty0 quiet vga=785 splash --- /boot/initrd-2.6-xen.img Seems like cpuid_mask_ecx and cpuid_mask_edx are key here..
Hi Neal, Thank you very much for sharing extlinux.conf -- the error was really there. I''m using XCP with the MPP driver (Linux Multi-pathing). In that case, the default boot is not "label xe", but "label xe-mpp". Everytime I run "xe host-set-cpu-features" it changes the boot options of "xe" and a few others, but does not touch "xe-mpp". I just copied "cpuid_mask_ecx=0x009ce3bd cpuid_mask_ext_edx=0x28100800" from the other regular "xe" and added it to "xe-mpp" and it worked! :) One caveat, though: I had EDX before ECX on the line above and only the EDX register was masked -- so, it looks like the order matters: EAX, EBX, ECX then EDX. It looks like this behavior should be seen as a bug, although the fix is rather easy to be done manually. Once again, thanks for your help… Best regards, Eduardo Bragatto On Jun 25, 2013, at 1:57 PM, Errol Neal <eneal@businessgrade.com> wrote:> On Tue, 06/25/2013 12:00 PM, Eduardo Bragatto <eduardo@bragatto.com> wrote: >> Hi Neal, >> >> Thanks for sharing your setup. I''m also using the compare-cpu script the >> same as you, however after I run "host-set-cpu-features" and reboot the >> server, it does not come back with the mask set -- "features" is still the >> same as "physical_features". >> >> Did you do anything else besides running "host-set-cpu-features" and >> rebooting? >> > > Eduardo, > > The host-set-cpu-features is the only command I run and it sticks. I''m not quite sure why it isn''t sticking for you. > Here is my /boot/extlinux.conf: > > label xe > # XCP > kernel mboot.c32 > append /boot/xen.gz mem=1024G dom0_mem=752M,max:752M watchdog_timeout=300 cpui > d_mask_xsave_eax=0 lowmem_emergency_pool=1M crashkernel=64M@32M console=vga vga> mode-0x0311 cpuid_mask_ecx=0x000ce3bd cpuid_mask_ext_edx=0x20100800 dom0_max_vcp > us=1-4 --- /boot/vmlinuz-2.6-xen root=LABEL=root-odcfwbhu ro xencons=hvc console > =hvc0 console=tty0 quiet vga=785 splash --- /boot/initrd-2.6-xen.img > > Seems like cpuid_mask_ecx and cpuid_mask_edx are key here..