Hello, I have a Win2k8 Server machine running on updated debian lenny, with installed GPLPV drivers. This virtual machine will be my company''s file server, but.... Machine without GPLPV drivers have only 100MBit if''s. This file server needs 1GBit interfaces. I also need ACPI shutdown from hypervisor option for shuting down vm for backups. The wrong thing after installing GPLPV drivers is decreased machine upload. I could download about 40~60MB/s but upload runs at 10~20KB/s. It''s to low for anything ;/ I''ve tested this behaviour with "Checksum Offload" enabled/disabled, "Check checksum on RX packets" enabled/disabled and combination of both options. None of that works. For now I have no idea how to fix this. This is config file of this vm: kernel = "/usr/lib/xen-3.2-1/boot/hvmloader" builder = ''hvm'' memory = 3072 name = ''fileserver'' vif = [ ''bridge=brXX'' ] disk = [ ''phy:/dev/vgsas/dc1-sys,hda,w'', ''file:/xen/ISO/win2k8.iso,hdb:cdrom,r'', ] device_model = ''/usr/lib/xen-3.2-1/bin/qemu-dm'' acpi = 1 apic = 1 #pae = 1 usb = 1 usbdevice = ''tablet'' parallel = ''none'' serial = ''pty'' localtime = 1 cpus = "0,1" vcpus = 2 sdl = 0 vfb = [ ''type=vnc,vnclisten=192.168.x.x,vncdisplay=1'' ] boot=''c'' on_poweroff = ''destroy'' on_reboot = ''restart'' on_crash = ''restart'' keymap = ''pl'' Thanks for any advices. -- Greets, Thomas. _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Can you please try with vcpus=1 and see if that makes any difference. It''s not a solution but it would help me try and find one... Thanks James> -----Original Message----- > From: xen-users-bounces@lists.xensource.com [mailto:xen-users- > bounces@lists.xensource.com] On Behalf Of Tomek > Sent: Monday, 3 August 2009 17:59 > To: xen-users@lists.xensource.com > Subject: [Xen-users] Windows 2008 - slow upload > > Hello, > > I have a Win2k8 Server machine running on updated debian lenny, with > installed GPLPV drivers. This virtual machine will be my company''sfile> server, but.... Machine without GPLPV drivers have only 100MBit if''s. > This file server needs 1GBit interfaces. I also need ACPI shutdownfrom> hypervisor option for shuting down vm for backups. > > The wrong thing after installing GPLPV drivers is decreased machine > upload. I could download about 40~60MB/s but upload runs at 10~20KB/s. > It''s to low for anything ;/ > > I''ve tested this behaviour with "Checksum Offload" enabled/disabled, > "Check checksum on RX packets" enabled/disabled and combination ofboth> options. None of that works. > > For now I have no idea how to fix this. > > This is config file of this vm: > > kernel = "/usr/lib/xen-3.2-1/boot/hvmloader" > builder = ''hvm'' > memory = 3072 > name = ''fileserver'' > vif = [ ''bridge=brXX'' ] > disk = [ > ''phy:/dev/vgsas/dc1-sys,hda,w'', > ''file:/xen/ISO/win2k8.iso,hdb:cdrom,r'', > ] > device_model = ''/usr/lib/xen-3.2-1/bin/qemu-dm'' > acpi = 1 > apic = 1 > #pae = 1 > usb = 1 > usbdevice = ''tablet'' > parallel = ''none'' > serial = ''pty'' > localtime = 1 > cpus = "0,1" > vcpus = 2 > > sdl = 0 > vfb = [ ''type=vnc,vnclisten=192.168.x.x,vncdisplay=1'' ] > > boot=''c'' > > on_poweroff = ''destroy'' > on_reboot = ''restart'' > on_crash = ''restart'' > > keymap = ''pl'' > > > Thanks for any advices. > > -- > Greets, > Thomas. > > _______________________________________________ > Xen-users mailing list > Xen-users@lists.xensource.com > http://lists.xensource.com/xen-users_______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
-------- Original Message -------- Subject: Re: [Xen-users] Windows 2008 - slow upload From: James Harper <james.harper@bendigoit.com.au> To: Tomek <timor@o2.pl>, xen-users@lists.xensource.com Date: 03.08.2009 11:03> Can you please try with vcpus=1 and see if that makes any difference. > It''s not a solution but it would help me try and find one...I''ve changed vcpus to 1, and commented out cpus with no impact on networking. For now I have "Checksum Offload" and "Check checksum on RX packets" both disabled. -- Regards, Thomas. _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Hi Tomek, Where are you uploading to? I have been having very similar issues to you, however I''ve found that my issues are specific to certain hosts on my network. Do other DomU''s on the same host get the same issues? Cheers, Steve 2009/8/3 Tomek <timor@o2.pl>> Hello, > > I have a Win2k8 Server machine running on updated debian lenny, with > installed GPLPV drivers. This virtual machine will be my company''s file > server, but.... Machine without GPLPV drivers have only 100MBit if''s. This > file server needs 1GBit interfaces. I also need ACPI shutdown from > hypervisor option for shuting down vm for backups. > > The wrong thing after installing GPLPV drivers is decreased machine upload. > I could download about 40~60MB/s but upload runs at 10~20KB/s. It''s to low > for anything ;/ > > I''ve tested this behaviour with "Checksum Offload" enabled/disabled, "Check > checksum on RX packets" enabled/disabled and combination of both options. > None of that works. > > For now I have no idea how to fix this. > > This is config file of this vm: > > kernel = "/usr/lib/xen-3.2-1/boot/hvmloader" > builder = ''hvm'' > memory = 3072 > name = ''fileserver'' > vif = [ ''bridge=brXX'' ] > disk = [ > ''phy:/dev/vgsas/dc1-sys,hda,w'', > ''file:/xen/ISO/win2k8.iso,hdb:cdrom,r'', > ] > device_model = ''/usr/lib/xen-3.2-1/bin/qemu-dm'' > acpi = 1 > apic = 1 > #pae = 1 > usb = 1 > usbdevice = ''tablet'' > parallel = ''none'' > serial = ''pty'' > localtime = 1 > cpus = "0,1" > vcpus = 2 > > sdl = 0 > vfb = [ ''type=vnc,vnclisten=192.168.x.x,vncdisplay=1'' ] > > boot=''c'' > > on_poweroff = ''destroy'' > on_reboot = ''restart'' > on_crash = ''restart'' > > keymap = ''pl'' > > > Thanks for any advices. > > -- > Greets, > Thomas. > > _______________________________________________ > Xen-users mailing list > Xen-users@lists.xensource.com > http://lists.xensource.com/xen-users >_______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
> > -------- Original Message -------- > Subject: Re: [Xen-users] Windows 2008 - slow upload > From: James Harper <james.harper@bendigoit.com.au> > To: Tomek <timor@o2.pl>, xen-users@lists.xensource.com > Date: 03.08.2009 11:03 > > > Can you please try with vcpus=1 and see if that makes anydifference.> > It''s not a solution but it would help me try and find one... > > I''ve changed vcpus to 1, and commented out cpus with no impact on > networking. For now I have "Checksum Offload" and "Check checksum onRX> packets" both disabled. >I think I''ll need packet traces to get much further. Can you reproduce using iperf? (it is available for both windows and linux). If you can, then I can send you the details of the wireshark and tcpdump filters I''ll need a capture from. James _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
-------- Original Message -------- Subject: Re: [Xen-users] Windows 2008 - slow upload From: Stephen Ross <stephen.ross1986@googlemail.com> To: Tomek <timor@o2.pl> Date: 03.08.2009 11:32> Hi Tomek, > > Where are you uploading to? I have been having very similar issues to > you, however I''ve found that my issues are specific to certain hosts on > my network. > > Do other DomU''s on the same host get the same issues?Good tip. I could upload to another Win2k8 based VM on the same xen machine with normal speed, but when uploading to different physical server in the same network speed decreased. Tell me more about your problem :) Maybe it''s not optimal VLAN''s configuration. -- Regards, Thomas. _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
xen-users-bounces@lists.xensource.com wrote on 03/08/2009 07:50:09 PM:> -------- Original Message -------- > Subject: Re: [Xen-users] Windows 2008 - slow upload > From: Stephen Ross <stephen.ross1986@googlemail.com> > To: Tomek <timor@o2.pl> > Date: 03.08.2009 11:32 > > > Hi Tomek, > > > > Where are you uploading to? I have been having very similar issues to > > you, however I''ve found that my issues are specific to certain hostson> > my network. > > > > Do other DomU''s on the same host get the same issues? > > Good tip. I could upload to another Win2k8 based VM on the same xen > machine with normal speed, but when uploading to different physical > server in the same network speed decreased. > > Tell me more about your problem :) > > Maybe it''s not optimal VLAN''s configuration. >Hi Tomek, This might be a long shot, but do you have the recently released service pack 2 for Server 2008 installed? I had a Server 2008 domU happily uploading (domU->dom0) at 60-80 MB/s until I started seeing similar symptoms to what your are describing (dom0->domU ok 60-80 MB/s, domU->dom0 poor 2-4 MB/s or even less). The start of these symptoms coincided with the installation of SP2. I haven''t uninstalled SP2 to confirm yet as I wanted to do some troubleshooting first. I found that TCP transmissions from domU to dom0 seem to pause in regular intervals for 0.5 up to 2 seconds, bringing the average transmission speed of large data volumes down to an unacceptable level. dom0: CentOS 5.2, Xen 3.3.1 domU: Windows Server 2008 64-bit SP2, GPLPV 0.10.0.69 Below are the results of a test that I was doing using TTCP and TCPDUMP. Note the timestamps and how the transmission seems to freeze for up to 2 seconds before continuing. 06:39:33.772162 IP 10.230.11.41.commplex-link > 10.230.11.42.51543: . ack 5554177 win 65535 06:39:33.772280 IP 10.230.11.42.51543 > 10.230.11.41.commplex-link: P 5554177:5562369(8192) ack 1 win 64240 06:39:33.772300 IP 10.230.11.41.commplex-link > 10.230.11.42.51543: . ack 5562369 win 65535 06:39:34.126764 IP 10.230.11.42.51543 > 10.230.11.41.commplex-link: P 5562369:5570561(8192) ack 1 win 64240 06:39:34.126793 IP 10.230.11.42.51543 > 10.230.11.41.commplex-link: P 5570561:5578753(8192) ack 1 win 64240 06:39:34.126857 IP 10.230.11.41.commplex-link > 10.230.11.42.51543: . ack 5570561 win 65535 [...] 06:39:34.182774 IP 10.230.11.42.51543 > 10.230.11.41.commplex-link: P 6545409:6553601(8192) ack 1 win 64240 06:39:34.182794 IP 10.230.11.42.51543 > 10.230.11.41.commplex-link: P 6553601:6561793(8192) ack 1 win 64240 06:39:34.182808 IP 10.230.11.41.commplex-link > 10.230.11.42.51543: . ack 6561793 win 65535 06:39:35.477353 IP 10.230.11.42.51543 > 10.230.11.41.commplex-link: P 6561793:6569985(8192) ack 1 win 64240 06:39:35.477375 IP 10.230.11.42.51543 > 10.230.11.41.commplex-link: P 6569985:6578177(8192) ack 1 win 64240 06:39:35.477470 IP 10.230.11.41.commplex-link > 10.230.11.42.51543: . ack 6578177 win 65535 [...] 06:39:35.506777 IP 10.230.11.42.51543 > 10.230.11.41.commplex-link: P 7413761:7421953(8192) ack 1 win 64240 06:39:35.506800 IP 10.230.11.42.51543 > 10.230.11.41.commplex-link: P 7421953:7430145(8192) ack 1 win 64240 06:39:35.506813 IP 10.230.11.41.commplex-link > 10.230.11.42.51543: . ack 7430145 win 65535 06:39:37.477564 IP 10.230.11.42.51543 > 10.230.11.41.commplex-link: P 7430145:7438337(8192) ack 1 win 64240 06:39:37.477601 IP 10.230.11.42.51543 > 10.230.11.41.commplex-link: P 7438337:7446529(8192) ack 1 win 64240 06:39:37.477712 IP 10.230.11.41.commplex-link > 10.230.11.42.51543: . ack 7446529 win 65535 [...] 06:39:37.505504 IP 10.230.11.42.51543 > 10.230.11.41.commplex-link: P 8282113:8290305(8192) ack 1 win 64240 06:39:37.505526 IP 10.230.11.42.51543 > 10.230.11.41.commplex-link: P 8290305:8298497(8192) ack 1 win 64240 06:39:37.505539 IP 10.230.11.41.commplex-link > 10.230.11.42.51543: . ack 8298497 win 65535 06:39:39.463085 IP 10.230.11.42.51543 > 10.230.11.41.commplex-link: P 8298497:8306689(8192) ack 1 win 64240 06:39:39.463117 IP 10.230.11.42.51543 > 10.230.11.41.commplex-link: P 8306689:8314881(8192) ack 1 win 64240 06:39:39.463249 IP 10.230.11.41.commplex-link > 10.230.11.42.51543: . ack 8314881 win 65535 Thanks Matthias SOUTH PACIFIC SEEDS PO Box 934, GRIFFITH N.S.W. 2680. AUSTRALIA Phone: 02 6962 7333 Fax: 02 6964 1311 CAUTION: The information contained in this e-mail is privileged and confidential. If you are reading this message and you are not the intended recipient, you are hereby notified that any use, dissemination, distribution or reproduction of all or part of the contents is prohibited. If you receive this message in error, please notify the sender immediately. Any opinions or views expressed in this message are those of the individual sender and may not represent those of their employer. _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
> > > Hi Tomek, > > > > Where are you uploading to? I have been having very similar issuesto> > you, however I''ve found that my issues are specific to certain hostson> > my network. > > > > Do other DomU''s on the same host get the same issues? > > Good tip. I could upload to another Win2k8 based VM on the same xen > machine with normal speed, but when uploading to different physical > server in the same network speed decreased. > > Tell me more about your problem :) > > Maybe it''s not optimal VLAN''s configuration.It does sound like a failure of one of the offload functions... did you say you disabled them in DomU or just in Dom0? James _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
-------- Original Message -------- Subject: Re: [Xen-users] Windows 2008 - slow upload From: James Harper <james.harper@bendigoit.com.au> To: Tomek <timor@o2.pl>, xen-users@lists.xensource.com Date: 03.08.2009 14:30> to > on > > It does sound like a failure of one of the offload functions... did you > say you disabled them in DomU or just in Dom0?I''ve tested all cases. DomU disabled, Dom0 enabled -> no change DomU enabled, Dom0 disabled -> no change DomU disabled, Dom0 disabled -> no change DomU enabled, Dom0 enabled -> no change -- Regards, Thomas. _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
-------- Original Message -------- Subject: Re: [Xen-users] Windows 2008 - slow upload From: James Harper <james.harper@bendigoit.com.au> To: Tomek <timor@o2.pl>, xen-users@lists.xensource.com Date: 03.08.2009 11:38>> -------- Original Message -------- >> Subject: Re: [Xen-users] Windows 2008 - slow upload >> From: James Harper <james.harper@bendigoit.com.au> >> To: Tomek <timor@o2.pl>, xen-users@lists.xensource.com >> Date: 03.08.2009 11:03 >> >>> Can you please try with vcpus=1 and see if that makes any > difference. >>> It''s not a solution but it would help me try and find one... >> I''ve changed vcpus to 1, and commented out cpus with no impact on >> networking. For now I have "Checksum Offload" and "Check checksum on > RX >> packets" both disabled. >> > > I think I''ll need packet traces to get much further. Can you reproduce > using iperf? (it is available for both windows and linux). If you can, > then I can send you the details of the wireshark and tcpdump filters > I''ll need a capture from.Yes, I can reproduce it with iperf - downloading (works like a charm): iperf -c 192.168.x.1 -P 1 -i 1 -p 5001 -f K -t 10 -T 1 -S 0x04 ------------------------------------------------------------ Client connecting to 192.168.x.1, TCP port 5001 TCP window size: 16.0 KByte (default) ------------------------------------------------------------ [ 3] local 192.168.x.2 port 47419 connected with 192.168.x.1 port 5001 [ ID] Interval Transfer Bandwidth [ 3] 0.0- 1.0 sec 108240 KBytes 108240 KBytes/sec [ 3] 1.0- 2.0 sec 106032 KBytes 106032 KBytes/sec [ 3] 2.0- 3.0 sec 107056 KBytes 107056 KBytes/sec [ 3] 3.0- 4.0 sec 108064 KBytes 108064 KBytes/sec [ 3] 4.0- 5.0 sec 105320 KBytes 105320 KBytes/sec [ 3] 5.0- 6.0 sec 107120 KBytes 107120 KBytes/sec [ 3] 6.0- 7.0 sec 107192 KBytes 107192 KBytes/sec [ 3] 7.0- 8.0 sec 106368 KBytes 106368 KBytes/sec [ 3] 8.0- 9.0 sec 107352 KBytes 107352 KBytes/sec [ 3] 9.0-10.0 sec 106552 KBytes 106552 KBytes/sec [ 3] 0.0-10.0 sec 1069328 KBytes 106932 KBytes/sec And uploading (wtf?): iperf.exe -c 192.168.x.2 -P 1 -i 1 -p 5001 -f k -t 10 ------------------------------------------------------------ Client connecting to 192.168.x.2, TCP port 5001 TCP window size: 8.00 KByte (default) ------------------------------------------------------------ [108] local 192.168.x.1 port 49314 connected with 192.168.x.2 port 5001 [ ID] Interval Transfer Bandwidth [108] 0.0- 1.0 sec 80.0 KBytes 655 Kbits/sec [108] 1.0- 2.0 sec 24.0 KBytes 197 Kbits/sec [108] 2.0- 3.0 sec 24.0 KBytes 197 Kbits/sec [108] 3.0- 4.0 sec 32.0 KBytes 262 Kbits/sec [108] 4.0- 5.0 sec 24.0 KBytes 197 Kbits/sec [108] 5.0- 6.0 sec 24.0 KBytes 197 Kbits/sec [108] 6.0- 7.0 sec 24.0 KBytes 197 Kbits/sec [108] 7.0- 8.0 sec 32.0 KBytes 262 Kbits/sec [108] 8.0- 9.0 sec 24.0 KBytes 197 Kbits/sec [108] 9.0-10.0 sec 24.0 KBytes 197 Kbits/sec [108] 0.0-10.4 sec 320 KBytes 251 Kbits/sec When I''m sniffing on Dom0 when uploading from Win2k8-DomU then packets are "flying" slower when downloading and all runs fluently without any longer brakes. Could you send me details for filters in wireshark/tcpdump? I''ve tested same VLAN configuration from a linux-DomU and it runs normally - so it''s not broken VLAN configuration. For now I''m downloading different versions of GPLPV drivers - maybe there is a regress in newest version... -- Regards, Thomas. _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
> And uploading (wtf?): > iperf.exe -c 192.168.x.2 -P 1 -i 1 -p 5001 -f k -t 10 > ------------------------------------------------------------ > Client connecting to 192.168.x.2, TCP port 5001 > TCP window size: 8.00 KByte (default) > ------------------------------------------------------------ > [108] local 192.168.x.1 port 49314 connected with 192.168.x.2 port5001> [ ID] Interval Transfer Bandwidth > [108] 0.0- 1.0 sec 80.0 KBytes 655 Kbits/sec > [108] 1.0- 2.0 sec 24.0 KBytes 197 Kbits/sec > [108] 2.0- 3.0 sec 24.0 KBytes 197 Kbits/sec > [108] 3.0- 4.0 sec 32.0 KBytes 262 Kbits/sec > [108] 4.0- 5.0 sec 24.0 KBytes 197 Kbits/sec > [108] 5.0- 6.0 sec 24.0 KBytes 197 Kbits/sec > [108] 6.0- 7.0 sec 24.0 KBytes 197 Kbits/sec > [108] 7.0- 8.0 sec 32.0 KBytes 262 Kbits/sec > [108] 8.0- 9.0 sec 24.0 KBytes 197 Kbits/sec > [108] 9.0-10.0 sec 24.0 KBytes 197 Kbits/sec > [108] 0.0-10.4 sec 320 KBytes 251 Kbits/secInteresting. It actually seems pretty consistent. I was expecting something a bit more up and down.> > When I''m sniffing on Dom0 when uploading from Win2k8-DomU then packets > are "flying" slower when downloading and all runs fluently without any > longer brakes. > > Could you send me details for filters in wireshark/tcpdump?Basically just ''port 5001'' and make sure you capture the whole packet (-s0 under tcpdump). If you can start wireshark on DomU (or tshark or whatever you are comfortable with), then tcpdump on Dom0 on the interface that has the IP address (eg not the bridge) and then send me the output. Maybe use ''-t3'' (3 second run) on iperf too as I don''t think 10 seconds will tell me any more than 3 seconds does.> I''ve tested same VLAN configuration from a linux-DomU and it runs > normally - so it''s not broken VLAN configuration.Okay. I could imagine some vlan problems if large send or checksum offloading was involved but with those off it''s unlikely. You aren''t using jumbo frames are you?> > For now I''m downloading different versions of GPLPV drivers - maybe > there is a regress in newest version...That would be useful to know too. Thanks James _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
"Robert Zöhrer | pronet.at"
2009-Aug-04 10:58 UTC
Re: [Xen-users] Windows 2008 - slow upload
Tomek schrieb:> The wrong thing after installing GPLPV drivers is decreased machine > upload. I could download about 40~60MB/s but upload runs at 10~20KB/s. > It''s to low for anything ;/I''ve similar behavior with Win2003 SBS SP2 and installed GPLPV 0.10.0.86. Uninstalling this GPLV version definitely "solves" the issue, but I can''t say if it arrived after installing SP2 or maybe I installed GPLPV after SP2 .. didn''t remember anymore. regards, Robert My HVM-config: --------------------------------- import os, re arch = os.uname()[4] if re.search(''64'', arch): arch_libdir = ''lib64'' else: arch_libdir = ''lib'' kernel = "/usr/lib/xen/boot/hvmloader" builder=''hvm'' # use 3 virt. cpus vcpus = 3 # Use phys. CPU 1-3, reserving CPU0 for dom0 cpus = "1-3" # max RAM used memory = 2048 # Should be at least 2KB per MB of domain memory, plus a few MB per vcpu. shadow_memory = 8 name = ''infra-win2003sbs'' # behavior on_poweroff = ''destroy'' on_reboot = ''restart'' on_crash = ''restart'' ## When using GPLPV driver instead of qemu vif = [ ''bridge=eth2'' ] # Use acpi acpi = 1 disk = [ ''phy:/dev/drbd0,hda,w'' ] device_model = ''/usr/'' + arch_libdir + ''/xen/bin/qemu-dm'' #----------------------------------------------------------------------------- # boot on floppy (a), hard disk (c) or CD-ROM (d) # default: hard disk, cd-rom, floppy boot="c" sdl=0 # VNC access vnc=1 vnclisten = "0.0.0.0" vncpasswd=''XXXXXXXXX'' # USB usb = 1 usbdevice=''tablet'' serial=''pty'' #set time localtime=1 # set keymap keymap=''de'' _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Hi, I have the same problem with Win2003 SBS SP2 and installed GPLPV 0.10.0.86. GPLPV 0.9xx before hasn''t this problem, with "Checksum Offload" enabled. My config: CentOS 5.3, XEN 3.4 (http://www.gitco.de/linux/x86_64/centos/) ------------------------ import os, re arch = os.uname()[4] if re.search(''64'', arch): arch_libdir = ''lib64'' else: arch_libdir = ''lib'' kernel = "/usr/lib/xen/boot/hvmloader" builder=''hvm'' memory = 1536 vcpus=2 name = "xenhvm" vif = [ ''mac=00:16:3E:0F:65:74, bridge=intern, vifname=xenhvm01'' ] #disk [''phy:/dev/disk/by-path/ip-192.168.99.12:3260-iscsi-iqn.2008-11.de.123648ght:storage.vg02-xenhvm01,hda,w''] disk = [''phy:/dev/drbd2,hda,w''] #device_model = ''/usr/'' + arch_libdir + ''/xen/bin/qemu-dm'' device_model = ''/usr/'' + arch_libdir + ''/xen/bin/qemu-dm.drbd2'' boot="c" sdl=0 vnc=1 vncviewer=0 vncdisplay=1 vncconsole=0 vncpasswd='''' stdvga=0 serial=''pty'' localtime=1 usb=1 usbdevice=''tablet'' keymap=''de'' regards, Tiemo "Robert Zöhrer | pronet.at" wrote:> > Tomek schrieb: > >> The wrong thing after installing GPLPV drivers is decreased machine >> upload. I could download about 40~60MB/s but upload runs at 10~20KB/s. >> It''s to low for anything ;/ > > I''ve similar behavior with Win2003 SBS SP2 and installed GPLPV 0.10.0.86. > > Uninstalling this GPLV version definitely "solves" the issue, but I > can''t say if it arrived after installing SP2 or maybe I installed GPLPV > after SP2 .. didn''t remember anymore. > > regards, > Robert > > > My HVM-config: > --------------------------------- > import os, re > arch = os.uname()[4] > if re.search(''64'', arch): > arch_libdir = ''lib64'' > else: > arch_libdir = ''lib'' > > kernel = "/usr/lib/xen/boot/hvmloader" > builder=''hvm'' > > # use 3 virt. cpus > vcpus = 3 > > # Use phys. CPU 1-3, reserving CPU0 for dom0 > cpus = "1-3" > > # max RAM used > memory = 2048 > > # Should be at least 2KB per MB of domain memory, plus a few MB per vcpu. > shadow_memory = 8 > name = ''infra-win2003sbs'' > > # behavior > on_poweroff = ''destroy'' > on_reboot = ''restart'' > on_crash = ''restart'' > > ## When using GPLPV driver instead of qemu > vif = [ ''bridge=eth2'' ] > > > # Use acpi > acpi = 1 > > disk = [ ''phy:/dev/drbd0,hda,w'' ] > > device_model = ''/usr/'' + arch_libdir + ''/xen/bin/qemu-dm'' > > #----------------------------------------------------------------------------- > # boot on floppy (a), hard disk (c) or CD-ROM (d) > # default: hard disk, cd-rom, floppy > > boot="c" > > sdl=0 > > # VNC access > vnc=1 > vnclisten = "0.0.0.0" > vncpasswd=''XXXXXXXXX'' > > # USB > usb = 1 > usbdevice=''tablet'' > > serial=''pty'' > > #set time > localtime=1 > > # set keymap > keymap=''de'' > > > _______________________________________________ > Xen-users mailing list > Xen-users@lists.xensource.com > http://lists.xensource.com/xen-users > >-- View this message in context: http://www.nabble.com/Windows-2008---slow-upload-tp24786754p24807027.html Sent from the Xen - User mailing list archive at Nabble.com. _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
-------- Original Message -------- Subject: Re: [Xen-users] Windows 2008 - slow upload From: Robert Zöhrer | pronet.at <robert.zoehrer@pronet.at> To: xen-users@lists.xensource.com Date: 04.08.2009 12:58> Tomek schrieb: > > > I''ve similar behavior with Win2003 SBS SP2 and installed GPLPV 0.10.0.86. > > Uninstalling this GPLV version definitely "solves" the issue, but I > can''t say if it arrived after installing SP2 or maybe I installed GPLPV > after SP2 .. didn''t remember anymore.Yes it solves problem... but without GPLPV you have only 100Mbit interface under DomU. Because I want to use this DomU as a file server (for about 100 users) I need 1Gbit if. -- Regards, Thomas. _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
> > Tomek schrieb: > > > > > > I''ve similar behavior with Win2003 SBS SP2 and installed GPLPV0.10.0.86.> > > > Uninstalling this GPLV version definitely "solves" the issue, but I > > can''t say if it arrived after installing SP2 or maybe I installedGPLPV> > after SP2 .. didn''t remember anymore. > > Yes it solves problem... but without GPLPV you have only 100Mbit > interface under DomU. Because I want to use this DomU as a file server > (for about 100 users) I need 1Gbit if.Don''t let the ''reported speed'' worry you too much. GPLPV report 1Gbit because that seemed like a reasonable thing to do. I could report 10Mbit or 10Gbit to Windows and it wouldn''t change the actual speed of the interface. I can get well over 2gbits/second between DomU and Dom0. I might make the reported speed configurable just in case something does use it for performance tuning somewhere... That said, all other things being equal the PV drivers should be heaps faster than the qemu emulated device. We need to work out what is different between our setups because I just can''t reproduce any of the problems you guys are reporting. Just to get this info in one spot (sorry if I''m asking you to repeat yourselves), please tell me the versions of: GPLPV Xen (hypervisor) Dom0 Kernel Dom0 kernel patch source if you aren''t running the standard 2.6.18 kernel that ships with Xen, eg a distro kernel perhaps? Dom0 network module (eg e1000e) Dom0 network card (just the make and chipset should be fine) TX speed from DomU to Dom0 as measured with ''iperf -w1m'' (approx will be fine) TX speed from DomU to a physical machine on the other side of a 1GBit interface from Dom0 Thanks James _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
"Robert Zöhrer | pronet.at"
2009-Aug-04 13:00 UTC
Re: [Xen-users] Windows 2008 - slow upload
Tomek schrieb:> Yes it solves problem... but without GPLPV you have only 100Mbit > interface under DomU. Because I want to use this DomU as a file server > (for about 100 users) I need 1Gbit if.yes, "solve" is the wrong expression .. I want to use GPLPV too. Still tried older driver versions (e.g. 0.10.0.69)? Same issue? Robert _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
-------- Original Message -------- Subject: Re: [Xen-users] Windows 2008 - slow upload From: James Harper <james.harper@bendigoit.com.au> To: Tomek <timor@o2.pl>, xen-users@lists.xensource.com Date: 04.08.2009 01:50> Okay. I could imagine some vlan problems if large send or checksum > offloading was involved but with those off it''s unlikely. You aren''t > using jumbo frames are you?And that''s the point. After GPLPV installation large send data offload was enabled by default. I didn''t check it earlier or ignored it. Ehhh dump thing. Disabling it solves the problem. Thanks for your time and tips which was most useful for me. -- Regards, Thomas. _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
> > -------- Original Message -------- > Subject: Re: [Xen-users] Windows 2008 - slow upload > From: James Harper <james.harper@bendigoit.com.au> > To: Tomek <timor@o2.pl>, xen-users@lists.xensource.com > Date: 04.08.2009 01:50 > > > Okay. I could imagine some vlan problems if large send or checksum > > offloading was involved but with those off it''s unlikely. You aren''t > > using jumbo frames are you? > > And that''s the point. After GPLPV installation large send data offload > was enabled by default. I didn''t check it earlier or ignored it. > Ehhh dump thing. > > Disabling it solves the problem. > > Thanks for your time and tips which was most useful for me. >So you aren''t using Jumbo frames though? (I''ve never tested with Jumbo frames) But Large Send was enabled in the DomU which was affecting DomU->external traffic, but not DomU->DomX traffic right? I''d still like to find what the root cause is (netback bug? GPLPV bug? Physical Ethernet device driver bug?) but I''m glad it''s working for you now. James _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
"Robert Zöhrer | pronet.at"
2009-Aug-04 13:54 UTC
Re: [Xen-users] Windows 2008 - slow upload
James Harper schrieb:> Just to get this info in one spot (sorry if I''m asking you to repeat > yourselves), please tell me the versions of: > GPLPV0.10.0.86> Xen (hypervisor) > Dom0 Kernel----------------- host : greatmama-n2 release : 2.6.26-2-xen-amd64 version : #1 SMP Sun Jul 26 22:39:03 UTC 2009 machine : x86_64 nr_cpus : 4 nr_nodes : 1 cores_per_socket : 4 threads_per_core : 1 cpu_mhz : 2333 hw_caps : bfebfbff:20000800:00000000:00000140:000ce3bd:00000000:00000001 total_memory : 4093 free_memory : 2083 node_to_cpu : node0:0-3 xen_major : 3 xen_minor : 2 xen_extra : -1 xen_caps : xen-3.0-x86_64 xen-3.0-x86_32p hvm-3.0-x86_32 hvm-3.0-x86_32p hvm-3.0-x86_64 xen_scheduler : credit xen_pagesize : 4096 platform_params : virt_start=0xffff800000000000 xen_changeset : unavailable cc_compiler : gcc version 4.3.1 (Debian 4.3.1-2) cc_compile_by : waldi cc_compile_domain : debian.org cc_compile_date : Sat Jun 28 09:32:18 UTC 2008 xend_config_format : 4 -----------------> Dom0 kernel patch source if you aren''t running the standard 2.6.18 > kernel that ships with Xen, eg a distro kernel perhaps?all plain debian lenny> Dom0 network module (eg e1000e)e1000e on eth0 bnx2 on eth2> Dom0 network card (just the make and chipset should be fine)eth0: 0e:00.0 Ethernet controller: Intel Corporation 82571EB Gigabit Ethernet Controller (rev 06) Subsystem: Hewlett-Packard Company NC360T PCI Express Dual Port Gigabit Server Adapter Flags: bus master, fast devsel, latency 0, IRQ 17 Memory at fdfe0000 (32-bit, non-prefetchable) [size=128K] Memory at fdfc0000 (32-bit, non-prefetchable) [size=128K] I/O ports at 6000 [size=32] [virtual] Expansion ROM at d1100000 [disabled] [size=128K] Capabilities: [c8] Power Management version 2 Capabilities: [d0] Message Signalled Interrupts: Mask- 64bit+ Queue=0/0 Enable- Capabilities: [e0] Express Endpoint, MSI 00 Capabilities: [100] Advanced Error Reporting <?> Capabilities: [140] Device Serial Number 5c-f0-55-ff-ff-29-1f-00 Kernel driver in use: e1000e Kernel modules: e1000e eth2: 03:00.0 Ethernet controller: Broadcom Corporation NetXtreme II BCM5708 Gigabit Ethernet (rev 12) Subsystem: Hewlett-Packard Company NC373i Integrated Multifunction Gigabit Server Adapter Flags: bus master, 66MHz, medium devsel, latency 64, IRQ 16 Memory at f8000000 (64-bit, non-prefetchable) [size=32M] [virtual] Expansion ROM at d1300000 [disabled] [size=2K] Capabilities: [40] PCI-X non-bridge device Capabilities: [48] Power Management version 2 Capabilities: [50] Vital Product Data <?> Capabilities: [58] Message Signalled Interrupts: Mask- 64bit+ Queue=0/0 Enable- Kernel driver in use: bnx2 Kernel modules: bnx2> TX speed from DomU to Dom0 as measured with ''iperf -w1m'' (approx will be > fine)For now I only have output/speed of some (bacula) backup runs. Receiving bacula storage daemon resides in Dom0, the sending file-daemon in domU. I get a rate about 1.3 MB/s. Whithout GPLPV now I get rates about 6-7 MB/s.> TX speed from DomU to a physical machine on the other side of a 1GBit > interface from Dom0At the moment I don''t have any phy machine in the same subnet. But I''ve measured filetransfer (smb) speed between the GPLPV server (TX) and another WinHVM on the same subnet: About poorly 65 kB/s. In the other direction I get rates about 2.5-3 MB/s (smb traffic). But the other HVM didn''t have GPLPV installed so the bottleneck here was quemu on the peer. Maybe I also should play around with offloading. regards, Robert _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
-------- Original Message -------- Subject: Re: [Xen-users] Windows 2008 - slow upload From: James Harper <james.harper@bendigoit.com.au> To: Tomek <timor@o2.pl> Date: 04.08.2009 15:25> So you aren''t using Jumbo frames though? (I''ve never tested with Jumbo > frames)No, I don''t use jambo frames.> But Large Send was enabled in the DomU which was affecting > DomU->external traffic, but not DomU->DomX traffic right?Exactly. But I don''t test DomU->Dom0 or Dom0->DomU. Dom0 is in different network on different interface: - eth0 - Dom0 management, etc., - eth1 - DomU''s interface with VLAN''s. I used this HOWTO for VLAN''s configuration: http://renial.net/weblog/2007/02/27/xen-vlan/> I''d still like to find what the root cause is (netback bug? GPLPV bug? > Physical Ethernet device driver bug?) but I''m glad it''s working for you > now.Tell me what you need and I will give it to you. You had time for me so I''m obliged to find some for you.> Just to get this info in one spot (sorry if I''m asking you to repeat > yourselves), please tell me the versions of: > GPLPVgplpv_fre_wlh_x86_0.10.0.69, gplpv_fre_wlh_x86_0.10.0.83 and gplpv_fre_wlh_x86_0.10.0.86 (I''ve tested on these three).> Xen (hypervisor)# xm info host : xxx release : 2.6.26-2-xen-amd64 version : #1 SMP Sun Jul 26 22:39:03 UTC 2009 machine : x86_64 nr_cpus : 4 nr_nodes : 1 cores_per_socket : 4 threads_per_core : 1 cpu_mhz : 2833 hw_caps : bfebfbff:20100800:00000000:00000140:040ce3bd:00000000:00000001 total_memory : 10237 free_memory : 252 node_to_cpu : node0:0-3 xen_major : 3 xen_minor : 2 xen_extra : -1 xen_caps : xen-3.0-x86_64 xen-3.0-x86_32p hvm-3.0-x86_32 hvm-3.0-x86_32p hvm-3.0-x86_64 xen_scheduler : credit xen_pagesize : 4096 platform_params : virt_start=0xffff800000000000 xen_changeset : unavailable cc_compiler : gcc version 4.3.1 (Debian 4.3.1-2) cc_compile_by : waldi cc_compile_domain : debian.org cc_compile_date : Sat Jun 28 09:32:18 UTC 2008 xend_config_format : 4> Dom0 Kernel > Dom0 kernel patch source if you aren''t running the standard 2.6.18 > kernel that ships with Xen, eg a distro kernel perhaps?# uname -a Linux xxx 2.6.26-2-xen-amd64 #1 SMP Sun Jul 26 22:39:03 UTC 2009 x86_64 GNU/Linux> Dom0 network module (eg e1000e)bnx2> Dom0 network card (just the make and chipset should be fine)Ethernet controller: Broadcom Corporation NetXtreme II BCM5708 Gigabit Ethernet (rev 12)> TX speed from DomU to Dom0 as measured with ''iperf -w1m'' (approx will be > fine)It could be quite hard in my current configuration.> TX speed from DomU to a physical machine on the other side of a 1GBit > interface from Dom0With large data offload enabled/disabled or both? -- Regards, Thomas. _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
"Robert Zöhrer | pronet.at"
2009-Aug-04 14:22 UTC
Re: [Xen-users] Windows 2008 - slow upload
Robert Zöhrer | pronet.at schrieb:> bnx2 on eth2Forgotten: DomUs are connected to eth2 _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
> > I''d still like to find what the root cause is (netback bug? GPLPV bug? > Physical Ethernet device driver bug?) but I''m glad it''s working for you > now. > > James > > _______________________________________________ > Xen-users mailing list > Xen-users@lists.xensource.com > http://lists.xensource.com/xen-users >James, On my test system I also have to disable large send offload otherwise uploads are very slow, but on my main Xen system it is enabled in all domU''s and seems to cause no problems. I suspect there are some bugs which are triggered by interactions between different kernel/nic driver/gplpv versions, the problems we discussed with 2.6.30 do not go away completely after toggling receive offload, but the errors are much less frequent and throughput is much better. Quite why toggling receive offload off and on again would help I don''t know, but it does. A similar system using e1000e driver does not suffer from the same problem, but I''ve tried different versions of the igb driver and they all seem to be affected. opensuse have selected 2.6.31 as their next official distro kernel, I plan to rebase the patches as soon as it is available and dedicate some time to testing and working out the networking bugs. Andy _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
> release : 2.6.26-2-xen-amd64Hmmm... same version as some other reports> > Maybe I also should play around with offloading. >For a start, disable checksum and large send offload in domU (properties of xen network adapter) James _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Please try disabling "large send offload" in the adapter properties under windows. Please let me know if that does or doesn't work. Thanks James> -----Original Message----- > From: xen-users-bounces@lists.xensource.com [mailto:xen-users- > bounces@lists.xensource.com] On Behalf Of td1964 > Sent: Tuesday, 4 August 2009 21:54 > To: xen-users@lists.xensource.com > Subject: Re: [Xen-users] Windows 2008 - slow upload > > > Hi, > > I have the same problem with Win2003 SBS SP2 and installed GPLPV 0.10.0.86. > GPLPV 0.9xx before hasn't this problem, with "Checksum Offload" enabled. > My config: > CentOS 5.3, XEN 3.4 (http://www.gitco.de/linux/x86_64/centos/) > ------------------------ > import os, re > arch = os.uname()[4] > if re.search('64', arch): > arch_libdir = 'lib64' > else: > arch_libdir = 'lib' > kernel = "/usr/lib/xen/boot/hvmloader" > builder='hvm' > memory = 1536 > vcpus=2 > name = "xenhvm" > vif = [ 'mac=00:16:3E:0F:65:74, bridge=intern, vifname=xenhvm01' ] > #disk > ['phy:/dev/disk/by-path/ip-192.168.99.12:3260-iscsi-iqn.2008- > 11.de.123648ght:storage.vg02-xenhvm01,hda,w'] > disk = ['phy:/dev/drbd2,hda,w'] > #device_model = '/usr/' + arch_libdir + '/xen/bin/qemu-dm' > device_model = '/usr/' + arch_libdir + '/xen/bin/qemu-dm.drbd2' > boot="c" > sdl=0 > vnc=1 > vncviewer=0 > vncdisplay=1 > vncconsole=0 > vncpasswd='' > stdvga=0 > serial='pty' > localtime=1 > usb=1 > usbdevice='tablet' > keymap='de' > > regards, > Tiemo > > > > > > "Robert Zöhrer | pronet.at" wrote: > > > > Tomek schrieb: > > > >> The wrong thing after installing GPLPV drivers is decreased machine > >> upload. I could download about 40~60MB/s but upload runs at 10~20KB/s. > >> It's to low for anything ;/ > > > > I've similar behavior with Win2003 SBS SP2 and installed GPLPV 0.10.0.86. > > > > Uninstalling this GPLV version definitely "solves" the issue, but I > > can't say if it arrived after installing SP2 or maybe I installed GPLPV > > after SP2 .. didn't remember anymore. > > > > regards, > > Robert > > > > > > My HVM-config: > > --------------------------------- > > import os, re > > arch = os.uname()[4] > > if re.search('64', arch): > > arch_libdir = 'lib64' > > else: > > arch_libdir = 'lib' > > > > kernel = "/usr/lib/xen/boot/hvmloader" > > builder='hvm' > > > > # use 3 virt. cpus > > vcpus = 3 > > > > # Use phys. CPU 1-3, reserving CPU0 for dom0 > > cpus = "1-3" > > > > # max RAM used > > memory = 2048 > > > > # Should be at least 2KB per MB of domain memory, plus a few MB per vcpu. > > shadow_memory = 8 > > name = 'infra-win2003sbs' > > > > # behavior > > on_poweroff = 'destroy' > > on_reboot = 'restart' > > on_crash = 'restart' > > > > ## When using GPLPV driver instead of qemu > > vif = [ 'bridge=eth2' ] > > > > > > # Use acpi > > acpi = 1 > > > > disk = [ 'phy:/dev/drbd0,hda,w' ] > > > > device_model = '/usr/' + arch_libdir + '/xen/bin/qemu-dm' > > > > #--------------------------------------------------------------------------- > -- > > # boot on floppy (a), hard disk (c) or CD-ROM (d) > > # default: hard disk, cd-rom, floppy > > > > boot="c" > > > > sdl=0 > > > > # VNC access > > vnc=1 > > vnclisten = "0.0.0.0" > > vncpasswd='XXXXXXXXX' > > > > # USB > > usb = 1 > > usbdevice='tablet' > > > > serial='pty' > > > > #set time > > localtime=1 > > > > # set keymap > > keymap='de' > > > > > > _______________________________________________ > > Xen-users mailing list > > Xen-users@lists.xensource.com > > http://lists.xensource.com/xen-users > > > > > > -- > View this message in context: http://www.nabble.com/Windows-2008---slow- > upload-tp24786754p24807027.html > Sent from the Xen - User mailing list archive at Nabble.com. > > > _______________________________________________ > Xen-users mailing list > Xen-users@lists.xensource.com > http://lists.xensource.com/xen-users_______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users