James Harper
2008-Jun-23 10:46 UTC
[Xen-users] RE: Problems with GPLPV 0.9.10 on XP Pro, STOP 0x0000007B
I''ve just put up some instructions on running the windows debugger in Xen to be able to get some output from the GPLPV drivers if they won''t boot. Have a look at http://wiki.xensource.com/xenwiki/XenWindowsGplPv If it doesn''t make sense or if I''ve made a mistake then let me know, or go ahead and correct it yourself. James> -----Original Message----- > From: Mark Bryars [mailto:mark@darkskiez.co.uk] > Sent: Monday, 23 June 2008 19:53 > To: James Harper > Subject: Re: Problems with GPLPV 0.9.10 on XP Pro, STOP 0x0000007B > > > Ok, so, I removed the drivers and downloaded the 0.9.11-pre4 release, > booted with gplpv switch, ran debugview and installed the drivers > > > During the installation process windows picked up a D: drive andstarted> autorun scanning it. It had initialised the device successfully, UGH! > > Managed to recover the log file created by mounting the image, because > windows wont boot anymore, still with the 7B error with GPLPV switch,and> because of some corrupt files otherwise, tho because it starts up I > doubt it will be of much use :( > > > Regards, > Mark Bryars >_______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Sandro Sigala
2008-Jun-25 05:10 UTC
[Xen-devel] GPLPV Drivers 0.9.11-pre4 hang during boot - Windows XP Pro SP2
Hello James, thanks for the new instructions on operating the debugger. I tested the latest version of the PV driver on a Ubuntu server (dom0) with kernel: ----------------------------------- Linux version 2.6.24-16-xen (buildd@yellow) (gcc version 4.2.3 (Ubuntu 4.2.3-2ubuntu7)) #1 SMP Thu Apr 10 14:35:03 UTC 2008 (Ubuntu 2.6.24-4.6-generic) ----------------------------------- and hypervisor: ----------------------------------- (XEN) Xen version 3.2.1-rc1-pre (buildd@buildd) (gcc version 4.2.3 (Ubuntu 4.2.3-2ubuntu7)) Fri Apr 11 01:13:51 UTC 2008 ----------------------------------- the machine is an AMD Dual-Core AMD Opteron Processor 1220 stepping 03 The DomU is a fresh install of Windows XP Professional (English), SP2, with the .net 2.0 framework and 0.9.11-pre4 drivers installed. Graphically, the DomU hangs during the booting process (the progress bar is running forever). Under WinDbg, the latest messages printed every 5 seconds are: ----------------------------------- XenVbd no_free_grant_requests = 0 XenVbd aligned requests = 0, aligned bytes = 0 XenVbd unaligned requests = 0, unaligned bytes = 0 XenVbd interrupts = 1 XenVbd no_free_grant_requests = 0 XenVbd aligned requests = 1, aligned bytes = 512 XenVbd unaligned requests = 0, unaligned bytes = 0 XenVbd interrupts = 1 ----------------------------------- Full debug log messages attached. Machine configuration is: http://www.sigala.it/gplpv/WINXPPRO_ENG2.cfg dmesg output from dom0: http://www.sigala.it/gplpv/dmesg.txt xm dmesg output from dom0: http://www.sigala.it/gplpv/xm-dmesg.txt Best Regards, Sandro _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
Sandro Sigala
2008-Jul-03 07:02 UTC
Re: [Xen-devel] GPLPV Drivers 0.9.11-pre4 hang during boot - Windows XP Pro SP2
Hello James, was the information I sent one week ago enough to spot the problem? Thanks, Sandro Sandro Sigala wrote:> Graphically, the DomU hangs during the booting process (the progress > bar is running forever). > > Under WinDbg, the latest messages printed every 5 seconds are: > ----------------------------------- > XenVbd no_free_grant_requests = 0 > XenVbd aligned requests = 0, aligned bytes = 0 > XenVbd unaligned requests = 0, unaligned bytes = 0 > XenVbd interrupts = 1 > XenVbd no_free_grant_requests = 0 > XenVbd aligned requests = 1, aligned bytes = 512 > XenVbd unaligned requests = 0, unaligned bytes = 0 > XenVbd interrupts = 1 > ----------------------------------- > > Full debug log messages attached. > > Machine configuration is: > http://www.sigala.it/gplpv/WINXPPRO_ENG2.cfg > dmesg output from dom0: > http://www.sigala.it/gplpv/dmesg.txt > xm dmesg output from dom0: > http://www.sigala.it/gplpv/xm-dmesg.txt >_______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
James Harper
2008-Jul-03 11:13 UTC
RE: [Xen-devel] GPLPV Drivers 0.9.11-pre4 hang during boot - WindowsXP Pro SP2
I''ve only just gotten back to it - I tried upgrading my test machine to 3.3-unstable (Debian package) and it was breaking badly. Two things I noticed: 1. you are using tap:aio - as a test, can you try using file: instead? I have never gotten tap:aio working. If you''ve already tried this and mentioned it to me then I apologise in advance :) 2. I''m wondering if there might be a race in the code that figures out if the backend is 32 or 64 bits... I''ll do some testing on that. James> -----Original Message----- > From: xen-devel-bounces@lists.xensource.com [mailto:xen-devel- > bounces@lists.xensource.com] On Behalf Of Sandro Sigala > Sent: Thursday, 3 July 2008 17:03 > To: xen-devel@lists.xensource.com > Subject: Re: [Xen-devel] GPLPV Drivers 0.9.11-pre4 hang during boot - > WindowsXP Pro SP2 > > Hello James, > > was the information I sent one week ago enough to spot the problem? > > Thanks, > Sandro > > Sandro Sigala wrote: > > Graphically, the DomU hangs during the booting process (the progress > > bar is running forever). > > > > Under WinDbg, the latest messages printed every 5 seconds are: > > ----------------------------------- > > XenVbd no_free_grant_requests = 0 > > XenVbd aligned requests = 0, aligned bytes = 0 > > XenVbd unaligned requests = 0, unaligned bytes = 0 > > XenVbd interrupts = 1 > > XenVbd no_free_grant_requests = 0 > > XenVbd aligned requests = 1, aligned bytes = 512 > > XenVbd unaligned requests = 0, unaligned bytes = 0 > > XenVbd interrupts = 1 > > ----------------------------------- > > > > Full debug log messages attached. > > > > Machine configuration is: > > http://www.sigala.it/gplpv/WINXPPRO_ENG2.cfg > > dmesg output from dom0: > > http://www.sigala.it/gplpv/dmesg.txt > > xm dmesg output from dom0: > > http://www.sigala.it/gplpv/xm-dmesg.txt > > > > _______________________________________________ > Xen-devel mailing list > Xen-devel@lists.xensource.com > http://lists.xensource.com/xen-devel_______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
James Harper
2008-Jul-03 12:16 UTC
RE: [Xen-devel] GPLPV Drivers 0.9.11-pre4 hang during boot - WindowsXP Pro SP2
Could you please try 0.9.11-pre5? That would be 0.9.11 proper except that suddenly ''restore'' isn''t working anymore, but if you could tell me if you problem is fixed or not then that would be great! James> -----Original Message----- > From: xen-devel-bounces@lists.xensource.com [mailto:xen-devel- > bounces@lists.xensource.com] On Behalf Of Sandro Sigala > Sent: Thursday, 3 July 2008 17:03 > To: xen-devel@lists.xensource.com > Subject: Re: [Xen-devel] GPLPV Drivers 0.9.11-pre4 hang during boot - > WindowsXP Pro SP2 > > Hello James, > > was the information I sent one week ago enough to spot the problem? > > Thanks, > Sandro > > Sandro Sigala wrote: > > Graphically, the DomU hangs during the booting process (the progress > > bar is running forever). > > > > Under WinDbg, the latest messages printed every 5 seconds are: > > ----------------------------------- > > XenVbd no_free_grant_requests = 0 > > XenVbd aligned requests = 0, aligned bytes = 0 > > XenVbd unaligned requests = 0, unaligned bytes = 0 > > XenVbd interrupts = 1 > > XenVbd no_free_grant_requests = 0 > > XenVbd aligned requests = 1, aligned bytes = 512 > > XenVbd unaligned requests = 0, unaligned bytes = 0 > > XenVbd interrupts = 1 > > ----------------------------------- > > > > Full debug log messages attached. > > > > Machine configuration is: > > http://www.sigala.it/gplpv/WINXPPRO_ENG2.cfg > > dmesg output from dom0: > > http://www.sigala.it/gplpv/dmesg.txt > > xm dmesg output from dom0: > > http://www.sigala.it/gplpv/xm-dmesg.txt > > > > _______________________________________________ > Xen-devel mailing list > Xen-devel@lists.xensource.com > http://lists.xensource.com/xen-devel_______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
Sandro Sigala
2008-Jul-03 14:19 UTC
Re: [Xen-devel] GPLPV Drivers 0.9.11-pre4 hang during boot - WindowsXP Pro SP2
Hello, James Harper wrote: > I''ve only just gotten back to it - I tried upgrading my test machine to > 3.3-unstable (Debian package) and it was breaking badly. > > Two things I noticed: > > 1. you are using tap:aio - as a test, can you try using file: instead? I > have never gotten tap:aio working. If you''ve already tried this and > mentioned it to me then I apologise in advance :) Unfortunately I can''t make a test: the "file:" access is broken in Ubuntu Hardy, while it was working IIRC in Ubuntu Gutsy. On the other hand, the "tap:aio" access is working perfectly in Hardy while was broken in Gutsy :)> Could you please try 0.9.11-pre5? > > That would be 0.9.11 proper except that suddenly ''restore'' isn''t working > anymore, but if you could tell me if you problem is fixed or not then > that would be great! >I tried on the same hardware/software configuration with a new fresh install of WinXPPro (to be sure that no older PV driver was present). Unfortunately seems like to loop forever on a different part of the code: --------------------------------------------------------------------------- XenPCI IRP_MN_QUERY_CAPABILITIES (status = c00000bb) XenPCI IRP_MN_QUERY_PNP_DEVICE_STATE (status = 00000000) XenVbd --- HwScsiStartIo (Still figuring out ring) XenVbd ring_detect_state = 0, operation = ff, id = 0, status = 0 XenVbd ring_detect_state = 1, operation = 0, id = ff, status = 0 XenVbd --> HwScsiResetBus XenVbd IRQL = 22 XenVbd <-- HwScsiResetBus XenVbd Command = INQUIRY XenVbd (LUN = 0, EVPD = 0, Page Code = 00) XenVbd (Length = 36) XenVbd (Srb->Databuffer = 817abbc8) XenVbd Command = INQUIRY XenVbd (LUN = 0, EVPD = 1, Page Code = 00) XenVbd (Length = 255) XenVbd (Srb->Databuffer = 817abbc8) XenVbd Command = INQUIRY XenVbd (LUN = 0, EVPD = 1, Page Code = 80) XenVbd (Length = 255) XenVbd (Srb->Databuffer = 817abbc8) XenPCI IRP_MN_QUERY_DEVICE_RELATIONS (status = 00000000) XenVbd --> HwScsiResetBus XenVbd IRQL = 22 XenVbd <-- HwScsiResetBus --------------------------------------------------------------------------- After the last message no more messages are printed on the windbg console while the progress bar is still running (so it''s not a hang). Please find attached the full debug log. Thanks, Sandro _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
James Harper
2008-Jul-04 01:32 UTC
RE: [Xen-devel] GPLPV Drivers 0.9.11-pre4 hang during boot - WindowsXP Pro SP2
> Hello, > > James Harper wrote: > > I''ve only just gotten back to it - I tried upgrading my testmachine to> > 3.3-unstable (Debian package) and it was breaking badly. > > > > Two things I noticed: > > > > 1. you are using tap:aio - as a test, can you try using file:instead?> I > > have never gotten tap:aio working. If you''ve already tried this and > > mentioned it to me then I apologise in advance :) > > Unfortunately I can''t make a test: the "file:" access is broken inUbuntu> Hardy, while it was working IIRC in Ubuntu Gutsy. On the other hand,the> "tap:aio" access is working perfectly in Hardy while was broken inGutsy> :)Hmmm... well according to the logs the fact that it is tap:aio doesn''t seem to be a problem - it''s past where it crashes on my system when I try with tap:aio. I have uploaded a version of xenvbd.sys with a whole load of debug statements in it which should give me more of an idea about what is going on. I have uploaded xenvbd-xp-debug.zip to http://www.meadowcourt.org/downloads, please put the xenvbd.sys file in c:\windows\system32\drivers and reboot and send me the debug output from that. Thanks James> > > Could you please try 0.9.11-pre5? > > > > That would be 0.9.11 proper except that suddenly ''restore'' isn''tworking> > anymore, but if you could tell me if you problem is fixed or notthen> > that would be great! > > > > I tried on the same hardware/software configuration with a new fresh > install > of WinXPPro (to be sure that no older PV driver was present). > > Unfortunately seems like to loop forever on a different part of thecode:>------------------------------------------------------------------------ --> - > XenPCI IRP_MN_QUERY_CAPABILITIES (status = c00000bb) > XenPCI IRP_MN_QUERY_PNP_DEVICE_STATE (status = 00000000) > XenVbd --- HwScsiStartIo (Still figuring out ring) > XenVbd ring_detect_state = 0, operation = ff, id = 0, status = 0 > XenVbd ring_detect_state = 1, operation = 0, id = ff, status = 0 > XenVbd --> HwScsiResetBus > XenVbd IRQL = 22 > XenVbd <-- HwScsiResetBus > XenVbd Command = INQUIRY > XenVbd (LUN = 0, EVPD = 0, Page Code = 00) > XenVbd (Length = 36) > XenVbd (Srb->Databuffer = 817abbc8) > XenVbd Command = INQUIRY > XenVbd (LUN = 0, EVPD = 1, Page Code = 00) > XenVbd (Length = 255) > XenVbd (Srb->Databuffer = 817abbc8) > XenVbd Command = INQUIRY > XenVbd (LUN = 0, EVPD = 1, Page Code = 80) > XenVbd (Length = 255) > XenVbd (Srb->Databuffer = 817abbc8) > XenPCI IRP_MN_QUERY_DEVICE_RELATIONS (status = 00000000) > XenVbd --> HwScsiResetBus > XenVbd IRQL = 22 > XenVbd <-- HwScsiResetBus >------------------------------------------------------------------------ --> - > > After the last message no more messages are printed on the windbgconsole> while the progress bar is still running (so it''s not a hang). > > Please find attached the full debug log. > > Thanks, > Sandro_______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
Sandro Sigala
2008-Jul-04 07:39 UTC
Re: [Xen-devel] GPLPV Drivers 0.9.11-pre4 hang during boot - WindowsXP Pro SP2
Hi, I did like you suggested but the debug output in not changing much, apart of a few lines different... unless I made a mistake but it''s unlikely, I just replaced the xenvbd.sys file as you suggested after installing the drivers and before rebooting. Interesting enough, without the /GPLPV parameter Windoze is hanging at a certain point. I noticed this behavior also in the previous -pre4 version of the drivers. I attached a debug log also in that situation. Thanks, Sandro James Harper wrote:> I have uploaded a version of xenvbd.sys with a whole load of debug > statements in it which should give me more of an idea about what is > going on. > > I have uploaded xenvbd-xp-debug.zip to > http://www.meadowcourt.org/downloads, please put the xenvbd.sys file in > c:\windows\system32\drivers and reboot and send me the debug output from > that._______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
Wayne Gong
2008-Jul-04 08:29 UTC
Re: [Xen-devel] GPLPV Drivers 0.9.11-pre4 hang during boot - WindowsXP Pro SP2
Hi James, I meet this problem before but not in the same scenario. I use WinPv driver WDF version and attach a lot of vbd and vif device, such as 4 disks and 8 NICs. After WinPv driver install correctly, reboot the vm. Vm cannot reboot correctly every times. And the debug log is very similar as Sandro provided. I change the backend bit width detect code as follow. In my test box, WinPv driver works ok till now. Please have a try if you are interested in it. +XenVbd_TestBitWidth(PXENVBD_DEVICE_DATA DeviceData, PXENVBD_TARGET_DATA TargetData) +{ + blkif_request_t *req; + ULONG i; + int notify; + + KdPrint((__DRIVER_NAME " --> XenVbd_TestBitWidth\n")); + req = RING_GET_REQUEST(&TargetData->Ring, TargetData->Ring.req_prod_pvt); + req->id = 0; + KdPrint((__DRIVER_NAME " req id : %d\n",req->id)); + req->operation = 0xff; + req->nr_segments = 0; + for (i = 0; i < req->nr_segments; i++) + { + req->seg[i].gref = 0xffffffff; + req->seg[i].first_sect = 0xff; + req->seg[i].last_sect = 0xff; + } + TargetData->Ring.req_prod_pvt++; + + RING_PUSH_REQUESTS_AND_CHECK_NOTIFY(&TargetData->Ring, notify); + KdPrint((__DRIVER_NAME " 1st notify: %d\n", notify)); + if (notify) + DeviceData->XenDeviceData->XenInterface.EvtChn_Notify( + DeviceData->XenDeviceData->XenInterface.InterfaceHeader.Context, + TargetData->EventChannel); + KeMemoryBarrier(); + + req = RING_GET_REQUEST(&TargetData->Ring, TargetData->Ring.req_prod_pvt); + req->id = 1; + KdPrint((__DRIVER_NAME " req id : %d\n",req->id)); + req->operation = 0xff; + req->nr_segments = 0; + for (i = 0; i < req->nr_segments; i++) + { + req->seg[i].gref = 0xffffffff; + req->seg[i].first_sect = 0xff; + req->seg[i].last_sect = 0xff; + } + TargetData->Ring.req_prod_pvt++; + + RING_PUSH_REQUESTS_AND_CHECK_NOTIFY(&TargetData->Ring, notify); + KdPrint((__DRIVER_NAME " 2nd notify: %d\n", notify)); + if (notify) + DeviceData->XenDeviceData->XenInterface.EvtChn_Notify( + DeviceData->XenDeviceData->XenInterface.InterfaceHeader.Context, + TargetData->EventChannel); + KeMemoryBarrier(); + KdPrint((__DRIVER_NAME " <-- XenVbd_TestBitWidth\n")); + return; +} _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
Sandro Sigala
2008-Jul-04 08:56 UTC
Re: [Xen-devel] GPLPV Drivers 0.9.11-pre4 hang during boot - WindowsXP Pro SP2
Wayne Gong wrote: I change the backend bit width detect > code as follow. In my test box, WinPv driver works ok till now. Please > have a try if you are interested in it. Thank you very much! If James will not able to reproduce the very same situation, I will try to install the DDK toolkit and compile myself the drivers and do some experiments. Regards, Sandro _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
James Harper
2008-Jul-04 10:44 UTC
RE: [Xen-devel] GPLPV Drivers 0.9.11-pre4 hang during boot - WindowsXP Pro SP2
> Hi, > > I did like you suggested but the debug output in not changing > much, apart of a few lines different... unless I made a mistake > but it''s unlikely, I just replaced the xenvbd.sys file as you > suggested after installing the drivers and before rebooting. > > Interesting enough, without the /GPLPV parameter Windoze is hanging > at a certain point. I noticed this behavior also in the previous > -pre4 version of the drivers. I attached a debug log also > in that situation.My bad... I just looked at the winxp\i386 directory and the xenvbd.sys in there is too old... I probably recompiled it for 2k3 by mistake. I have just recompiled and uploaded the correct version. Sorry for giving you the run around. Hopefully we''ll get to the bottom of this yet! James _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
James Harper
2008-Jul-04 11:19 UTC
RE: [Xen-devel] GPLPV Drivers 0.9.11-pre4 hang during boot - WindowsXP Pro SP2
> Hi James, > > I meet this problem before but not in the same scenario. > I use WinPv driver WDF version and attach a lot of vbd and vif device, > such as 4 disks and 8 NICs. After WinPv driver install correctly,reboot> the vm. Vm cannot reboot correctly every times. And the debug log is > very similar as Sandro provided. I change the backend bit width detect > code as follow. In my test box, WinPv driver works ok till now. Please > have a try if you are interested in it.That patch appears to be to your wdf version of the code... can you give me a summary of what the change you made is? At a guess, the difference to the original code is that you are doing two separate notify''s, and a KeMemoryBarrier after each. Can you tell my why the barrier is required? I just noticed that the for() loop will never actually do anything as req->nr_segments is initialised to zero... that''s the same in my current code too! I wonder how long that has been a problem for? I''ll change my code to initialise nr_segments to the maximum. James> > > +XenVbd_TestBitWidth(PXENVBD_DEVICE_DATA DeviceData,PXENVBD_TARGET_DATA> TargetData) > +{ > + blkif_request_t *req; > + ULONG i; > + int notify; > + > + KdPrint((__DRIVER_NAME " --> XenVbd_TestBitWidth\n")); > + req = RING_GET_REQUEST(&TargetData->Ring, TargetData- > >Ring.req_prod_pvt); > + req->id = 0; > + KdPrint((__DRIVER_NAME " req id : %d\n",req->id)); > + req->operation = 0xff; > + req->nr_segments = 0; > + for (i = 0; i < req->nr_segments; i++) > + { > + req->seg[i].gref = 0xffffffff; > + req->seg[i].first_sect = 0xff; > + req->seg[i].last_sect = 0xff; > + } > + TargetData->Ring.req_prod_pvt++; > + > + RING_PUSH_REQUESTS_AND_CHECK_NOTIFY(&TargetData->Ring, notify); > + KdPrint((__DRIVER_NAME " 1st notify: %d\n", notify)); > + if (notify) > + DeviceData->XenDeviceData->XenInterface.EvtChn_Notify( > +DeviceData->XenDeviceData->XenInterface.InterfaceHeader.Context,> + TargetData->EventChannel); > + KeMemoryBarrier(); > + > + req = RING_GET_REQUEST(&TargetData->Ring, TargetData- > >Ring.req_prod_pvt); > + req->id = 1; > + KdPrint((__DRIVER_NAME " req id : %d\n",req->id)); > + req->operation = 0xff; > + req->nr_segments = 0; > + for (i = 0; i < req->nr_segments; i++) > + { > + req->seg[i].gref = 0xffffffff; > + req->seg[i].first_sect = 0xff; > + req->seg[i].last_sect = 0xff; > + } > + TargetData->Ring.req_prod_pvt++; > + > + RING_PUSH_REQUESTS_AND_CHECK_NOTIFY(&TargetData->Ring, notify); > + KdPrint((__DRIVER_NAME " 2nd notify: %d\n", notify)); > + if (notify) > + DeviceData->XenDeviceData->XenInterface.EvtChn_Notify( > +DeviceData->XenDeviceData->XenInterface.InterfaceHeader.Context,> + TargetData->EventChannel); > + KeMemoryBarrier(); > + KdPrint((__DRIVER_NAME " <-- XenVbd_TestBitWidth\n")); > + return; > +} >_______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
Sandro Sigala
2008-Jul-04 11:45 UTC
Re: [Xen-devel] GPLPV Drivers 0.9.11-pre4 hang during boot - WindowsXP Pro SP2
James Harper wrote:> I have just recompiled and uploaded the correct version. Sorry for > giving you the run around. Hopefully we''ll get to the bottom of this > yet!Happens! :-) Attached there are the new logs with /GPLPV and without. Regards, Sandro _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
James Harper
2008-Jul-04 12:39 UTC
RE: [Xen-devel] GPLPV Drivers 0.9.11-pre4 hang during boot - WindowsXP Pro SP2
> James Harper wrote: > > I have just recompiled and uploaded the correct version. Sorry for > > giving you the run around. Hopefully we''ll get to the bottom of this > > yet! > > Happens! :-) > > Attached there are the new logs with /GPLPV and without.Do you have any timestamps to go with your logs? Don''t worry about resubmitting these ones but on any future ones it would be useful. It looks like requests being put on the ring are not being actioned... maybe we are corrupting something somewhere. Looking at this bit of the logs: " XenVbd --- HwScsiStartIo (Still figuring out ring) " That ''Still figuring out ring'' bit means that we got a request before we had detected whether we were talking to a 32 or 64 bit ring, so we told windows to give us the request back again later when we were ready. I haven''t seen that before in my logs, so something about your system means that windows is giving you a request at an earlier point than my test systems... Then we see this: " XenVbd ring_detect_state = 0, operation = ff, id = 0, status = 0 XenVbd ring_detect_state = 1, operation = 0, id = ff, status = 0 " Which means that the first response we got back had operation ff which is what we expect, but the second one had operaton = 0 and id = ff which means that the ring is out of alignment and we must be using the opposite ring size (64 bits in this case). Originally I thought that maybe Windows wasn''t re-issuing the original request, but obviously it is: " XenVbd --> HwScsiStartIo PathId = 0, TargetId = 0, Lun = 0 XenVbd SRB_FUNCTION_EXECUTE_SCSI XenVbd Command = READ/WRITE XenVbd --> XenVbd_PutSrbOnRing XenVbd <-- XenVbd_PutSrbOnRing " But then it is never getting a response so it resets the bus: " XenVbd --> HwScsiResetBus XenVbd IRQL = 22 XenVbd <-- HwScsiResetBus " I wonder if it is a problem under XP... I''ll see what I can do about setting up a new XP test environment (my old one broke :) Otherwise, I''m out of ideas for the moment. James _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
Wayne Gong
2008-Jul-04 15:15 UTC
Re: [Xen-devel] GPLPV Drivers 0.9.11-pre4 hang during boot - WindowsXP Pro SP2
> That patch appears to be to your wdf version of the code... can you give > me a summary of what the change you made is? > > At a guess, the difference to the original code is that you are doing > two separate notify''s, and a KeMemoryBarrier after each. Can you tell my > why the barrier is required? > > I just noticed that the for() loop will never actually do anything as > req->nr_segments is initialised to zero... that''s the same in my current > code too! I wonder how long that has been a problem for? I''ll change my > code to initialise nr_segments to the maximum. > > James > >Yes, as you mentioned, there are only two difference. When I meet the bug, I have no idea to deal with it. So I try several method and times to fix it. After I changed the code up to the patch as I send to you, it works fine. And till now I am not very such whether this bug has been fixed. So I this patch just a try and I cannot explain it exactly even today. Best regards -- Wayne _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
James Harper
2008-Jul-05 09:58 UTC
RE: [Xen-devel] GPLPV Drivers 0.9.11-pre4 hang during boot - WindowsXP Pro SP2
I''ve re-installed XP on my test machine and it works fine, so it''s obviously related more to your server than XP. Did you get the DDK downloaded? I''d just enabled a heap of the debug statements in there and add more and see what you can come up with. James _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
Sandro Sigala
2008-Jul-05 10:11 UTC
Re: [Xen-devel] GPLPV Drivers 0.9.11-pre4 hang during boot - WindowsXP Pro SP2
James Harper wrote:> I''ve re-installed XP on my test machine and it works fine, so it''s > obviously related more to your server than XP. >[sarcasm]I love these situations[/sarcasm] :)> Did you get the DDK downloaded? I''d just enabled a heap of the debug > statements in there and add more and see what you can come up with.I will do it ASAP, just 2 questions: 1) I will try to recompile the code using also the patch suggested by Wayne. What is the HG revision of the code that matches with the 0.9.11-pre5 release? Are there any tags? (I''m used to SVN but not to the HG VCS, so maybe I overlooked something...) 2) I tried in the past to put under stress the VMs with some benchmarks, but unfortunately most of them are more Graphics-focused than disk, net, cpu, memory focused. Do you have suggestions for some other software? Thanks, Sandro _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
James Harper
2008-Jul-05 10:17 UTC
RE: [Xen-devel] GPLPV Drivers 0.9.11-pre4 hang during boot - WindowsXP Pro SP2
> > Did you get the DDK downloaded? I''d just enabled a heap of the debug > > statements in there and add more and see what you can come up with. > > I will do it ASAP, just 2 questions: > > 1) I will try to recompile the code using also the patch suggested by > Wayne. > What is the HG revision of the code that matches with the 0.9.11-pre5 > release? Are there any tags? (I''m used to SVN but not to the HG VCS,so> maybe > I overlooked something...)Quite a while back I moved from using the newer WDF to using WDM. The reasons for this were: . I wanted to be able to use the drivers in textmode setup (eg ''Press F6 to load OEM drivers'') . Andy Grover wanted to be able to use mingw32 to compile rather than the DDK compiler, which would mean building under Linux would be a possibility. . Nobody was really sure about the compatibility of GPL and WDF. Wayne''s patch relates to the WDF stream, but if you look in scsiport.c you should recognise the part where the patch would apply, his changes are fairly small.> 2) I tried in the past to put under stress the VMs with somebenchmarks,> but unfortunately most of them are more Graphics-focused than > disk, net, cpu, memory focused. Do you have suggestions for someother> software? >Someone has reported crashes under (I think) one of the network benchmark tools, but I''ve not been able to reproduce it. Have a look through the mailing list at what others are using for benchmarking... I''ve suddenly got a mental blank trying to remember what they are called! James _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
James Harper
2008-Jul-05 11:53 UTC
RE: [Xen-devel] GPLPV Drivers 0.9.11-pre4 hang during boot - WindowsXP Pro SP2
I just had a thought... do you have any physical block devices you could use, eg an lvm partition? That way we can remove any doubt about it being the tap:aio thing. If you don''t have a physical device, then please try using losetup to create a block device from your file and then use that as the phy: device. Thanks James _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
Sandro Sigala
2008-Jul-05 12:00 UTC
Re: [Xen-devel] GPLPV Drivers 0.9.11-pre4 hang during boot - WindowsXP Pro SP2
Hi, I''m downloading the WDK monster + XPSP2 symbols and is taking ages :-( James Harper wrote:> If you don''t have a physical device, then please try using losetup to > create a block device from your file and then use that as the phy: > device.I had the same idea yesterday and I tried "just in case", unfortunately the behavior is the same... Sandro _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
James Harper
2008-Jul-05 12:02 UTC
RE: [Xen-devel] GPLPV Drivers 0.9.11-pre4 hang during boot - WindowsXP Pro SP2
> > Hi, > > I''m downloading the WDK monster + XPSP2 symbols and is taking ages :-( >I''ll build another xenvbd.sys with some more debug stuff in it. James _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
James Harper
2008-Jul-05 12:07 UTC
RE: [Xen-devel] GPLPV Drivers 0.9.11-pre4 hang during boot -WindowsXP Pro SP2
> > > > Hi, > > > > I''m downloading the WDK monster + XPSP2 symbols and is taking ages:-(> > > > I''ll build another xenvbd.sys with some more debug stuff in it. >Okay, as before, please try the xenvbd-xp-debug.zip from the download site. That one should give some more output about the responses that have been received from dom0. Thanks James _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
Sandro Sigala
2008-Jul-05 12:30 UTC
Re: [Xen-devel] GPLPV Drivers 0.9.11-pre4 hang during boot -Windows XP Pro SP2
James Harper wrote:> Okay, as before, please try the xenvbd-xp-debug.zip from the download > site. > > That one should give some more output about the responses that have been > received from dom0. >Thanks, new log attached. > > Probably a stupid question, but how do you enable the timestamps in > > windbg? > In the ''View'' menu there is an item ''Event Timestamps'' which is ticked > on mine, but I don''t recall ever having to tick it... My version of > WinDbg is 6.8.0004.0 if that makes any difference. I was blind... :-( Sandro _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
James Harper
2008-Jul-05 12:38 UTC
RE: [Xen-devel] GPLPV Drivers 0.9.11-pre4 hang during boot -Windows XP Pro SP2
> James Harper wrote: > > Okay, as before, please try the xenvbd-xp-debug.zip from thedownload> > site. > > > > That one should give some more output about the responses that havebeen> > received from dom0. > > > > Thanks, new log attached. >Okay... well I can see that there are definitely no interrupts occurring after the call to ''PutSrbOnRing''. I''ve just made another change, this time the ring state will be forced to 64 bit without doing the detection side of things. Please download and try again. That will tell us if the ring detection code is crashing the backend in some way. I''ll wait up a bit for your response, but it''s 22:37 over here, so if you don''t hear from me after this then I''ve gone to bed :) James _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
Sandro Sigala
2008-Jul-05 12:52 UTC
Re: [Xen-devel] GPLPV Drivers 0.9.11-pre4 hang during boot - Windows XP Pro SP2
James Harper wrote:> Okay... well I can see that there are definitely no interrupts occurring > after the call to ''PutSrbOnRing''. > > I''ve just made another change, this time the ring state will be forced > to 64 bit without doing the detection side of things. Please download > and try again. That will tell us if the ring detection code is crashing > the backend in some way.Ok, done!> I''ll wait up a bit for your response, but it''s 22:37 over here, so if > you don''t hear from me after this then I''ve gone to bed :)Well, have a nice rest then ;-) Thanks, Sandro _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
James Harper
2008-Jul-05 12:59 UTC
RE: [Xen-devel] GPLPV Drivers 0.9.11-pre4 hang during boot - Windows XP Pro SP2
> James Harper wrote: > > Okay... well I can see that there are definitely no interruptsoccurring> > after the call to ''PutSrbOnRing''. > > > > I''ve just made another change, this time the ring state will beforced> > to 64 bit without doing the detection side of things. Pleasedownload> > and try again. That will tell us if the ring detection code iscrashing> > the backend in some way. > > Ok, done! >Well... that''s just strange. The two dummy requests get processed just fine, but the real ones don''t, even when I remove the dummy requests completely... At least that tells me where not to look :) I''ll look at it further tomorrow. Thanks James _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
James Harper
2008-Jul-06 11:45 UTC
RE: [Xen-devel] GPLPV Drivers 0.9.11-pre4 hang during boot - Windows XP Pro SP2
> > I''ve just made another change, this time the ring state will beforced> > to 64 bit without doing the detection side of things. Pleasedownload> > and try again. That will tell us if the ring detection code iscrashing> > the backend in some way. > > Ok, done! >I''ve just put another one up to try. Give it a go when you can and send me the results. I''m running out of ideas though... James _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
Sandro Sigala
2008-Jul-06 12:04 UTC
Re: [Xen-devel] GPLPV Drivers 0.9.11-pre4 hang during boot - Windows XP Pro SP2
James Harper wrote: > I''ve just put another one up to try. Give it a go when you can and send> me the results. I''m running out of ideas though...Thanks. Log attached as usual. Later (tomorrow for you I guess) I will install the DDK stuff, do some experiments and post the results. Regards, Sandro _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
James Harper
2008-Jul-07 10:51 UTC
RE: [Xen-devel] GPLPV Drivers 0.9.11-pre4 hang during boot - Windows XP Pro SP2
Are you getting anywhere with this, or may latest xenvbd.sys? I''d like to do another release soon, but would really like to find out what is causing the hang you are seeing as you aren''t the only one who has reported it. Thanks James> -----Original Message----- > From: Sandro Sigala [mailto:sandro@sigala.it] > Sent: Sunday, 6 July 2008 22:04 > To: James Harper > Cc: xen-devel@lists.xensource.com > Subject: Re: [Xen-devel] GPLPV Drivers 0.9.11-pre4 hang during boot - > Windows XP Pro SP2 > > James Harper wrote: > > I''ve just put another one up to try. Give it a go when you can and > send > > me the results. I''m running out of ideas though... > > Thanks. Log attached as usual. > > Later (tomorrow for you I guess) I will install the DDK stuff, do some > experiments and post the results. > > Regards, > Sandro_______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
Sandro Sigala
2008-Jul-07 11:28 UTC
Re: [Xen-devel] GPLPV Drivers 0.9.11-pre4 hang during boot - Windows XP Pro SP2
James Harper wrote:> Are you getting anywhere with this, or may latest xenvbd.sys? > > I''d like to do another release soon, but would really like to find out > what is causing the hang you are seeing as you aren''t the only one who > has reported it. >Sorry, I had to do some other unexpected work, and I moved forward the DDK experimentation. Please find attached the new log. Thanks, Sandro _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
James Harper
2008-Jul-07 11:36 UTC
RE: [Xen-devel] GPLPV Drivers 0.9.11-pre4 hang during boot - Windows XP Pro SP2
> James Harper wrote: > > Are you getting anywhere with this, or may latest xenvbd.sys? > > > > I''d like to do another release soon, but would really like to findout> > what is causing the hang you are seeing as you aren''t the only onewho> > has reported it. > > > > Sorry, I had to do some other unexpected work, and I moved forward theDDK> experimentation. > > Please find attached the new log. >Everything seems okay in that one too. If you can spare the time, please now try replacing your xenpci.sys with the file in xenpci-xp-debug.zip, and try it again. This will tell me if dom0 is sending the request at all and we are dropping it for some reason. Thanks James _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
Sandro Sigala
2008-Jul-07 11:57 UTC
Re: [Xen-devel] GPLPV Drivers 0.9.11-pre4 hang during boot - Windows XP Pro SP2
James Harper wrote:> Everything seems okay in that one too. > > If you can spare the time, please now try replacing your xenpci.sys with > the file in xenpci-xp-debug.zip, and try it again. This will tell me if > dom0 is sending the request at all and we are dropping it for some > reason.Done. Thanks for the "off-line" debugging. Regards, Sandro _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
James Harper
2008-Jul-07 12:05 UTC
RE: [Xen-devel] GPLPV Drivers 0.9.11-pre4 hang during boot - Windows XP Pro SP2
> > James Harper wrote: > > Everything seems okay in that one too. > > > > If you can spare the time, please now try replacing your xenpci.syswith> > the file in xenpci-xp-debug.zip, and try it again. This will tell meif> > dom0 is sending the request at all and we are dropping it for some > > reason. > > Done. Thanks for the "off-line" debugging. >Hmmm... I think I can see the problem - XenPCI is getting IRQ 5, and IRQ 5 is being assigned to all the subsequent devices that XenPCI enumerates, and due to the slightly dodgy way I dish out interrupts to other devices this maybe isn''t working. I should probably have spotted that earlier but I wasn''t looking for it! I''ll see if I can come up with a fix of some sort, hopefully I''ll have something in a few minutes. Btw, on my test machines, XenPCI always seems to get IRQ 28 and the other devices all get IRQ 11. Any idea why yours would all be getting IRQ 5? My guess would be that you don''t have APIC enabled, or that you didn''t have it enabled when you first installed. Either way, it''s a bug for the GPLPV drivers to behave this way so I''ll fix it. I just hope there are enough interrupts to go around! Thanks James _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
Sandro Sigala
2008-Jul-07 12:17 UTC
Re: [Xen-devel] GPLPV Drivers 0.9.11-pre4 hang during boot - Windows XP Pro SP2
James Harper wrote:> Hmmm... I think I can see the problem - XenPCI is getting IRQ 5, and IRQ > 5 is being assigned to all the subsequent devices that XenPCI > enumerates, and due to the slightly dodgy way I dish out interrupts to > other devices this maybe isn''t working. I should probably have spotted > that earlier but I wasn''t looking for it!Great!> > Btw, on my test machines, XenPCI always seems to get IRQ 28 and the > other devices all get IRQ 11. Any idea why yours would all be getting > IRQ 5? My guess would be that you don''t have APIC enabled, or that you > didn''t have it enabled when you first installed.Confirmed, I have APIC disabled in the VM (also while installing), because in the past this caused strange problems with the older Xen versions. Since then I always left it disabled for safety, but I guess it''s now safe... Thanks, Sandro _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
James Harper
2008-Jul-07 12:19 UTC
RE: [Xen-devel] GPLPV Drivers 0.9.11-pre4 hang during boot - WindowsXP Pro SP2
> > > > James Harper wrote: > > > Everything seems okay in that one too. > > > > > > If you can spare the time, please now try replacing yourxenpci.sys> with > > > the file in xenpci-xp-debug.zip, and try it again. This will tellme> if > > > dom0 is sending the request at all and we are dropping it for some > > > reason. > > > > Done. Thanks for the "off-line" debugging. > > > > Hmmm... I think I can see the problem - XenPCI is getting IRQ 5, andIRQ> 5 is being assigned to all the subsequent devices that XenPCI > enumerates, and due to the slightly dodgy way I dish out interrupts to > other devices this maybe isn''t working. I should probably have spotted > that earlier but I wasn''t looking for it! > > I''ll see if I can come up with a fix of some sort, hopefully I''ll have > something in a few minutes. >Okay I''ve changed xenpci to not assign out the same irq to it''s devices as it gets from pci. Please get the xenpci-xp-debug.zip and give it another go. I''ve given it a quick test and it doesn''t seem to break anything... James _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
Sandro Sigala
2008-Jul-07 12:42 UTC
Re: [Xen-devel] GPLPV Drivers 0.9.11-pre4 hang during boot - WindowsXP Pro SP2
James Harper wrote: > Okay I''ve changed xenpci to not assign out the same irq to it''s devices > as it gets from pci. Please get the xenpci-xp-debug.zip and give it > another go. I''ve given it a quick test and it doesn''t seem to break > anything... > > James Congratulations, it works! ;-) (Both with apic=0 and apic=1). I''m logging all the messages but it''s quite slow, a lot of: --- Mon Jul 7 12:29:51.305 2008 (GMT+2): Mon Jul 7 12:29:51.505 2008 (GMT+2): XenPCI <-- EvtChn_Interrupt Mon Jul 7 12:29:51.505 2008 (GMT+2): Mon Jul 7 12:29:51.806 2008 (GMT+2): XenPCI --> EvtChn_DpcBounce Mon Jul 7 12:29:51.806 2008 (GMT+2): Mon Jul 7 12:29:52.036 2008 (GMT+2): XenPCI Calling interrupt vector 33 Mon Jul 7 12:29:52.036 2008 (GMT+2): Mon Jul 7 12:29:52.236 2008 (GMT+2): XenPCI <-- EvtChn_DpcBounce --- I will send it when the debugging output is completed. Sandro _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
James Harper
2008-Jul-07 12:43 UTC
RE: [Xen-devel] GPLPV Drivers 0.9.11-pre4 hang during boot - WindowsXP Pro SP2
> > James Harper wrote: > > Okay I''ve changed xenpci to not assign out the same irq to it''sdevices> > as it gets from pci. Please get the xenpci-xp-debug.zip and give it > > another go. I''ve given it a quick test and it doesn''t seem to break > > anything... > > > > James > > Congratulations, it works! ;-) (Both with apic=0 and apic=1). > > I''m logging all the messages but it''s quite slow, a lot of: > --- > Mon Jul 7 12:29:51.305 2008 (GMT+2): > Mon Jul 7 12:29:51.505 2008 (GMT+2): XenPCI <-- EvtChn_Interrupt > Mon Jul 7 12:29:51.505 2008 (GMT+2): > Mon Jul 7 12:29:51.806 2008 (GMT+2): XenPCI --> EvtChn_DpcBounce > Mon Jul 7 12:29:51.806 2008 (GMT+2): > Mon Jul 7 12:29:52.036 2008 (GMT+2): XenPCI Calling interruptvector> 33 > Mon Jul 7 12:29:52.036 2008 (GMT+2): > Mon Jul 7 12:29:52.236 2008 (GMT+2): XenPCI <-- EvtChn_DpcBounce > --- > > I will send it when the debugging output is completed. >No need, if it''s working then that''s fine, the debug output will just tell me what I already know. I''ll do another pre-release, probably tomorrow. Thanks for your patience! James _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
Sandro Sigala
2008-Jul-07 12:47 UTC
Re: [Xen-devel] GPLPV Drivers 0.9.11-pre4 hang during boot - WindowsXP Pro SP2
James Harper wrote:> No need, if it''s working then that''s fine, the debug output will just > tell me what I already know.Ok.> I''ll do another pre-release, probably tomorrow. > > Thanks for your patience!Well, thanks for YOUR patience ;-) Thanks, Sandro _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel