Hi Everyone, I am trying my hands on xen under Solaris SXCE build 113. The machine has the following configuration: 2 Quad Core Xeon CPUs 16 GB RAM Solaris SXCE b113 4 disks - 2 mirrors x 2 stripes under ZFS The problem is that xen HVM is very slow. I am using the following command to create an Ubuntu 9.0.4 test vm. virt-install -n test1 -r 2048 --vcpus=2 -f /vdatapool/data/test1.img -s 50 --vnc --hvm --os-type=linux --location=/vsafepool/shared/ Installs/Linux/ubuntu-9.04-desktop-amd64.iso Based on some random bits found on google, i did hear it to be slow, but did not expect it to be crawling slow. I am opening the UI through a remote VNC connection. Am I missing something here? Can you guys point me in the right direction? Regards, Dot.yet Following is the output from zpool''s iostat: capacity operations bandwidth pool used avail read write read write ---------- ----- ----- ----- ----- ----- ----- vdatapool 79.8G 848G 0 124 0 15.6M mirror 39.9G 424G 0 62 0 7.80M c3t2d0 - - 0 62 0 7.80M c3t3d0 - - 0 62 0 7.80M mirror 39.9G 424G 0 62 0 7.80M c3t4d0 - - 0 62 0 7.80M c3t5d0 - - 0 62 0 7.80M ---------- ----- ----- ----- ----- ----- ----- capacity operations bandwidth pool used avail read write read write ---------- ----- ----- ----- ----- ----- ----- vdatapool 79.8G 848G 0 135 0 17.0M mirror 39.9G 424G 0 65 0 8.18M c3t2d0 - - 0 65 0 8.18M c3t3d0 - - 0 65 0 8.18M mirror 39.9G 424G 0 70 0 8.79M c3t4d0 - - 0 70 0 8.79M c3t5d0 - - 0 70 0 8.79M ---------- ----- ----- ----- ----- ----- ----- capacity operations bandwidth pool used avail read write read write ---------- ----- ----- ----- ----- ----- ----- vdatapool 79.8G 848G 0 119 0 15.0M mirror 39.9G 424G 0 60 0 7.56M c3t2d0 - - 0 60 0 7.56M c3t3d0 - - 0 60 0 7.56M mirror 39.9G 424G 0 59 0 7.43M c3t4d0 - - 0 59 0 7.43M c3t5d0 - - 0 59 0 7.43M ---------- ----- ----- ----- ----- ----- ----- some data from vmstat as well: kthr memory page disk faults cpu r b w swap free re mf pi po fr de sr cd cd f0 s0 in sy cs us sy id 0 0 0 22436700 13658804 7 2 0 0 0 0 0 0 0 20 1 527 1037 312 0 0 100 0 0 0 13341124 4574844 25 69 0 0 0 0 0 0 0 0 0 1844 149575 2155 4 21 75 0 0 0 13340852 4574568 7 14 0 0 0 0 0 0 0 0 0 2997 142555 3288 4 20 76 1 0 0 13340704 4574420 8 9 0 0 0 0 0 0 0 0 0 1567 150658 1432 3 21 76 1 0 0 13340576 4574292 8 9 0 0 0 0 0 0 0 0 0 1403 148538 1385 3 21 75 0 0 0 13340436 4574152 8 9 0 0 0 0 0 0 0 0 0 1477 150022 1561 4 21 75 0 0 0 13340420 4574136 8 9 0 0 0 0 0 0 0 0 0 1293 152552 1224 3 21 76 0 0 0 13340284 4574000 8 9 0 0 0 0 0 0 0 0 0 1350 144503 1279 4 21 75 1 0 0 13340144 4573860 8 9 0 0 0 0 0 0 0 0 0 1619 151940 1616 3 21 76 3 0 0 13340016 4573732 8 9 0 0 0 0 0 0 0 0 0 1403 136266 1404 3 19 78 1 0 0 13340008 4573724 8 9 0 0 0 0 0 0 0 0 0 1320 147669 1257 4 21 76 0 0 0 13340008 4573724 8 9 0 0 0 0 0 0 0 0 0 1308 148438 1345 4 21 76 0 0 0 13339872 4573588 8 9 0 0 0 0 0 0 0 0 0 1420 147045 1668 3 20 77 Uname -a: SunOS vcade01 5.11 snv_113 i86pc i386 i86xpv /etc/release: Solaris Express Community Edition snv_113 X86 Copyright 2009 Sun Microsystems, Inc. All Rights Reserved. Use is subject to license terms. Assembled 20 April 2009 _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Fajar A. Nugraha
2009-May-19 14:36 UTC
Re: [Xen-users] Ubuntu HVM installation is very slow
On Tue, May 19, 2009 at 7:28 PM, Dot Yet <dot.yet@gmail.com> wrote:> I am trying my hands on xen under Solaris SXCE build 113.You might find more SXCE/opensolaris users, as well as Sun''s developers on xen-discuss@opensolaris.org> The problem is that xen HVM is very slow. I am using the following command > to create an Ubuntu 9.0.4 test vm. > > virt-install -n test1 -r 2048 --vcpus=2 -f /vdatapool/data/test1.img -s 50 > --vnc --hvm --os-type=linux --location=/vsafepool/shared/ > Installs/Linux/ubuntu-9.04-desktop-amd64.isofile-based vbds tend to be slower compared to phy:/. Try using zvol and see if it helps. While we''re at it, why HVM? Why not PV guest, which should provide much better performance?> > Based on some random bits found on google, i did hear it to be slow, but did > not expect it to be crawling slow.Slow is relative :) While it is MUCH slower compared to native or PV guest install, last time I tested it''s comparable to Windows HVM install. This is why IMHO HVM guest is only usable with PV drivers. Meaning Ubuntu HVM install will be almost useless for production purposes since AFAIK there''s no PV driver for its default kernel yet. I actually have an Ubuntu HVM (for testing purposes) and I changed its kernel to RHEL 5.3''s kernel-xen (which has built in PV drivers). The performance improvement was HUGE.> Following is the output from zpool''s iostat: > > vdatapool 79.8G 848G 0 135 0 17.0M17MB/s write with 135 writes/s is a lot (well it can be a lot depending on disk). Try using iostat to see if the disk has maxed out its bandwidth or IOPS.> some data from vmstat as well:Try "xm top". -- Fajar _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Max-Julian Pogner
2009-May-19 15:30 UTC
[Xen-users] Bluescreen after installing gplpv 0.10.0.69
Hi all, I''m setting up Windows 2008 64bit on xen+hvm after windows setup has finished, I installed the drivers with gplpv_fre_wlh_AMD64_0.10.0.69.msi and a) either get an digital signature error, OR when disabling signature checking via Pressing F8 during boot, get b) a Bluescreen with a STOP: 0x00007B error. I have tried - DSEO from http://www.ngohq.com/home.php?page=dseo (gives same bluescreen), - importing james harper''s signature as CA/etc, no change. (windows still does not recognize xenpci.sys as digitally signed) As far as I grasp the idea, the blue screen should be unrelated to the digital-signature issue, since that is temporarily "resolved" by the F8 option to disable signature verification. 0x7B means that windows has some device issues, so the xen drivers do not load despite disabling the digital signature? additionally I have seen, that after installing the drivers, but before reboot, the device manager lists the xenpci.sys driver for the Xen PV PCI device as "not signed" (but the .sys file has Harper''s siganture according to it''s file-properties). Any ideas? regards, Max Pogner _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Max-Julian Pogner
2009-May-19 15:32 UTC
Re: [Xen-users] Bluescreen after installing gplpv 0.10.0.69
PS: I use Xen 3.3.1 built from source, _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Fajar A. Nugraha
2009-May-20 01:09 UTC
Re: [Xen-users] Bluescreen after installing gplpv 0.10.0.69
On Tue, May 19, 2009 at 10:32 PM, Max-Julian Pogner <mjp@netmonic.com> wrote:> PS: I use Xen 3.3.1 built from source,On What dom0 OS? This is a known issue on opensolaris dom0. There''s a workaround though. _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Matthias Reif
2009-May-20 01:33 UTC
Re: [Xen-users] Bluescreen after installing gplpv 0.10.0.69
Max, I had the same bluescreen 0x7b on reboot after installing the GPLPV (0.10.0.69) drivers onto a Windows 2008 64-bit domU. What fixed it for me was a reboot with the NOGPLPV boot option and then reboot again with the GPLPV drivers enabled. The blue screen did not re-occur since. Thanks Matthias Matthias Reif Max-Julian Pogner <mjp@netmonic.com> Sent by: xen-users-bounces@lists.xensource.com 20/05/2009 01:30 AM To xen-users@lists.xensource.com cc Subject [Xen-users] Bluescreen after installing gplpv 0.10.0.69 Hi all, I''m setting up Windows 2008 64bit on xen+hvm after windows setup has finished, I installed the drivers with gplpv_fre_wlh_AMD64_0.10.0.69.msi and a) either get an digital signature error, OR when disabling signature checking via Pressing F8 during boot, get b) a Bluescreen with a STOP: 0x00007B error. I have tried - DSEO from http://www.ngohq.com/home.php?page=dseo (gives same bluescreen), - importing james harper''s signature as CA/etc, no change. (windows still does not recognize xenpci.sys as digitally signed) As far as I grasp the idea, the blue screen should be unrelated to the digital-signature issue, since that is temporarily "resolved" by the F8 option to disable signature verification. 0x7B means that windows has some device issues, so the xen drivers do not load despite disabling the digital signature? additionally I have seen, that after installing the drivers, but before reboot, the device manager lists the xenpci.sys driver for the Xen PV PCI device as "not signed" (but the .sys file has Harper''s siganture according to it''s file-properties). Any ideas? regards, Max Pogner _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users SOUTH PACIFIC SEEDS PO Box 934, GRIFFITH N.S.W. 2680. AUSTRALIA Phone: 02 6962 7333 Fax: 02 6964 1311 CAUTION: The information contained in this e-mail is privileged and confidential. If you are reading this message and you are not the intended recipient, you are hereby notified that any use, dissemination, distribution or reproduction of all or part of the contents is prohibited. If you receive this message in error, please notify the sender immediately. Any opinions or views expressed in this message are those of the individual sender and may not represent those of their employer. _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Max-Julian Pogner
2009-May-20 20:58 UTC
Re: [Xen-users] Bluescreen after installing gplpv 0.10.0.69
Hi Matthias, sadly, nogplpv options does not have any effect in my case (still blue screen) with nogplpv option but without disabling digital signatures with F8: error because of digital signature. (it''s "bcdedit /copy {oldid} /d" name and "bcdedit /set {newid} loadoptions nogplpv" right?) with nogplpv and with disabled digital signatures: blue screen STOP: 0x7B did you use a file, or a real partition (maybe an lvm-volume)? I am using disk = [ ''file:/path/to/hda.img,hda,w'' ] regards, Max Matthias Reif wrote:> > Max, > > I had the same bluescreen 0x7b on reboot after installing the GPLPV > (0.10.0.69) drivers onto a Windows 2008 64-bit domU. > > What fixed it for me was a reboot with the NOGPLPV boot option and then > reboot again with the GPLPV drivers enabled. The blue screen did not > re-occur since. > > Thanks > Matthias > > > > > > *_Matthias Reif_* > *Max-Julian Pogner <mjp@netmonic.com>* > Sent by: xen-users-bounces@lists.xensource.com > > 20/05/2009 01:30 AM > > > To > xen-users@lists.xensource.com > cc > > > > Subject > [Xen-users] Bluescreen after installing gplpv 0.10.0.69 > > > > > > > > > Hi all, > > > I''m setting up Windows 2008 64bit on xen+hvm > > after windows setup has finished, I installed the drivers with > gplpv_fre_wlh_AMD64_0.10.0.69.msi and > a) either get an digital signature error, OR when disabling signature > checking via Pressing F8 during boot, get > b) a Bluescreen with a STOP: 0x00007B error. > > I have tried > - DSEO from http://www.ngohq.com/home.php?page=dseo > (gives same bluescreen), > - importing james harper''s signature as CA/etc, no change. > (windows still does not recognize xenpci.sys as digitally signed) > > > As far as I grasp the idea, the blue screen should be unrelated to the > digital-signature issue, since that is temporarily "resolved" by the F8 > option to disable signature verification. > > 0x7B means that windows has some device issues, so the xen drivers do > not load despite disabling the digital signature? > > > additionally I have seen, that after installing the drivers, but before > reboot, the device manager lists the xenpci.sys driver for the Xen PV > PCI device as "not signed" (but the .sys file has Harper''s siganture > according to it''s file-properties). > > > > Any ideas? > > > regards, > > > Max Pogner > > > _______________________________________________ > Xen-users mailing list > Xen-users@lists.xensource.com > http://lists.xensource.com/xen-users > > > > > *SOUTH PACIFIC SEEDS* > PO Box 934, GRIFFITH N.S.W. 2680. AUSTRALIA/ > Phone:/ 02 6962 7333 /Fax:/ 02 6964 1311 > ------------------------------------------------------------------------ > _CAUTION:_ The information contained in this e-mail is privileged and > confidential. If you are reading this message and you are not the > intended recipient, you are hereby notified that any use, dissemination, > distribution or reproduction of all or part of the contents is > prohibited. If you receive this message in error, please notify the > sender immediately. Any opinions or views expressed in this message are > those of the individual sender and may not represent those of their > employer. >_______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
On Tue, May 19, 2009 at 10:36 AM, Fajar A. Nugraha <fajar@fajar.net> wrote:> On Tue, May 19, 2009 at 7:28 PM, Dot Yet <dot.yet@gmail.com> wrote: > > I am trying my hands on xen under Solaris SXCE build 113. > > You might find more SXCE/opensolaris users, as well as Sun''s > developers on xen-discuss@opensolaris.org > > > The problem is that xen HVM is very slow. I am using the following > command > > to create an Ubuntu 9.0.4 test vm. > > > > virt-install -n test1 -r 2048 --vcpus=2 -f /vdatapool/data/test1.img -s > 50 > > --vnc --hvm --os-type=linux --location=/vsafepool/shared/ > > Installs/Linux/ubuntu-9.04-desktop-amd64.iso > > file-based vbds tend to be slower compared to phy:/. Try using zvol > and see if it helps. > While we''re at it, why HVM? Why not PV guest, which should provide > much better performance? > > > > > Based on some random bits found on google, i did hear it to be slow, but > did > > not expect it to be crawling slow. > > Slow is relative :) > While it is MUCH slower compared to native or PV guest install, last > time I tested it''s comparable to Windows HVM install. This is why IMHO > HVM guest is only usable with PV drivers. Meaning Ubuntu HVM install > will be almost useless for production purposes since AFAIK there''s no > PV driver for its default kernel yet. I actually have an Ubuntu HVM > (for testing purposes) and I changed its kernel to RHEL 5.3''s > kernel-xen (which has built in PV drivers). The performance > improvement was HUGE. > > > > > Following is the output from zpool''s iostat: > > > > vdatapool 79.8G 848G 0 135 0 17.0M > > 17MB/s write with 135 writes/s is a lot (well it can be a lot > depending on disk). > Try using iostat to see if the disk has maxed out its bandwidth or IOPS. > > > some data from vmstat as well: > > Try "xm top". > > -- > Fajar >Hi Fajar, I am using HVM because, I am yet to find clues on how to go directly on a PV if I have an ISO with me. I know I can download an image from jailtime.org, but want to give it a shot on a vanila downloaded iso. I will try on thr zvols tonight. xm top shows this: xentop - 19:43:09 Xen 3.1.4-xvm 2 domains: 2 running, 0 blocked, 0 paused, 0 crashed, 0 dying, 0 shutdown Mem: 16776104k total, 12523148k used, 4252956k free CPUs: 8 @ 2493MHz NAME STATE CPU(sec) CPU(%) MEM(k) MEM(%) MAXMEM(k) MAXMEM(%) VCPUS NETS NETTX(k) NETRX(k) VBDS VBD_OO VBD_RD VBD_WR SSID Domain-0 -----r 37043 95.7 8041472 47.9 no limit n/a 8 0 0 0 0 0 0 0 0 Ubuntu_904 -----r 3200 90.1 4202364 25.0 4210688 25.1 2 1 0 0 2 0 0 0 0 Regards, dot.yet _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Matthias Reif
2009-May-20 23:54 UTC
Re: [Xen-users] Bluescreen after installing gplpv 0.10.0.69
Max-Julian Pogner <mjp@netmonic.com> wrote on 21/05/2009 06:58:55 AM:> with nogplpv option but without disabling digital signatures with F8: > error because of digital signature. > (it''s "bcdedit /copy {oldid} /d" name and > "bcdedit /set {newid} loadoptions nogplpv" right?)Yes, that''s right.> did you use a file, or a real partition (maybe an lvm-volume)? > I am using > disk = [ ''file:/path/to/hda.img,hda,w'' ] >I am using a raw partition (non-LVM) for the domU, ie. disk = [ ''phy:/dev/cciss/c0d0p3,xvda,w'', ''phy:/dev/hda,hdc:cdrom,r'' ] Maybe you should try changing hda to xvda to see if that makes any difference. BTW, my dom0 is CentOS 5.2 with Xen 3.3.0. Cheers Matthias SOUTH PACIFIC SEEDS PO Box 934, GRIFFITH N.S.W. 2680. AUSTRALIA Phone: 02 6962 7333 Fax: 02 6964 1311 CAUTION: The information contained in this e-mail is privileged and confidential. If you are reading this message and you are not the intended recipient, you are hereby notified that any use, dissemination, distribution or reproduction of all or part of the contents is prohibited. If you receive this message in error, please notify the sender immediately. Any opinions or views expressed in this message are those of the individual sender and may not represent those of their employer. _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users