Carb, Brian A
2007-Sep-14  19:26 UTC
[Xen-devel] Xen Stability Testing - 320 guest domains on ES7000
I''d like to share more of our Stability Testing results. 
We''ve recently
executed 320 guest domains under SLES10 and Xen Unstable on our
ES7000/one platform. Each para-virtualized guest successfully ran
Kernbench, a cpu-intensive benchmark that generates its workload by
compiling a Linux kernel from source files. Throughout the testing, the
ES7000 environment was very stable - we were able to interact with
domain0 via putty sessions, and with the running guests via xm consoles
and networked secure shell commands.
 
In these tests, the ES7000/one was configured with 56 CPUs and 166gb
memory. Xen Unstable was built with NR_DYNIRQS=1024 and
max_phys_cpus=64, and the system was booted with dom0_mem=1024M and
xenheap_megabytes=64. Each guest was configured as a 4x para-virtualized
SLES10 machine with 512mb memory. Guests were each stored on separate
logical volumes on san storage, and booted via physical block device
(phy:).
 
Some features demonstrated by this testing include scalability (320
guests), stability of Xen on the ES7000 platform, and effective Xen
scheduling and handling of over-committed cpus (a total of 1280 virtual
CPUs mapped onto 54 physical CPUs).
 
Host Platform Hardware:
    ES7000/0ne (7-cell configuration) using 56 cpus (28 dual-core
sockets, non-hyperthreaded)
    166gb memory
    SAS internal RAID boot disks
    4 Emulex 2gb Fibre LP1005 HBAs.
 
Host Platform Software:
    SLES10 Release
    Xen Unstable tree (changeset 15445)
    Code deviations from changeset:
      NR_DYNIRQS set to 1024 in
./linux-2.6-xen-sparse/include/asm-x86_64/mach-xen/irq_vectors.h
    Compile Options: max_phys_cpus=64
    Additional Xen Boot Options: dom0_mem=1024M,  xenheap_megabytes=64
 
Storage:
    Hardware: 28 Eurologic 72GB Fibre Channel 10k rpm drives in 2
enclosures, connected via four 2gb fiber paths
    Management: Host-managed via LVM, 4 volume groups of 7 spanned
spindles each, split into 5gb volumes
 
Guest domains:
    Configuration: Para-virtualized SLES10, 512mb memory, 4 vcpu, OS on
external physical storage, fixed IP
    Kernbench test: kernbench -H -M -f -n 1
 
brian carb
unisys corporation - malvern, pa
 
_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xensource.com
http://lists.xensource.com/xen-devel