xen discuss - Nov 2008 - domain 0 on new built xvm system can''t do disk io when Intel vt-d enabled

Hi David,

As you know, I have built a system with the developing xvm source and
onnv in matrix-unstable gate, and managed to create HVM guests for
Fedora 7, Nevada snv_89 and Windows XP sp2. I did all these with vt-d
disabled in BIOS setting. When I turned on vt-d, domain 0 can''t do
disk io during boot up time. After several failures on reading data
from disk, domain 0 panic''ed and rebooted.

Is this a known issue that somebody has got it fixed or mine is the
first try on a vt-d enabled system?

Thanks,
Allen

On Thu, Nov 06, 2008 at 11:16:17PM +0800, Lu Baolu
wrote:
> As you know, I have built a system with the developing xvm source and
> onnv in matrix-unstable gate, and managed to create HVM guests for
> Fedora 7, Nevada snv_89 and Windows XP sp2. I did all these with vt-d
> disabled in BIOS setting. When I turned on vt-d, domain 0 can''t do
> disk io during boot up time. After several failures on reading data
> from disk, domain 0 panic''ed and rebooted.
> 
> Is this a known issue that somebody has got it fixed or mine is the
> first try on a vt-d enabled system?
It''s possible that you are the first to run our dom0 on VT-d, as
I''ve
not tried that myself.

What was the panic?

David - I am in vaccation. I will post the debug information the next Monday.

Thanks, Allen

On Thu, Nov 6, 2008 at 11:40 PM, David Edmondson <dme@sun.com>
wrote:
> On Thu, Nov 06, 2008 at 11:16:17PM +0800, Lu Baolu wrote:
>> As you know, I have built a system with the developing xvm source and
>> onnv in matrix-unstable gate, and managed to create HVM guests for
>> Fedora 7, Nevada snv_89 and Windows XP sp2. I did all these with vt-d
>> disabled in BIOS setting. When I turned on vt-d, domain 0
can''t do
>> disk io during boot up time. After several failures on reading data
>> from disk, domain 0 panic''ed and rebooted.
>>
>> Is this a known issue that somebody has got it fixed or mine is the
>> first try on a vt-d enabled system?
>
> It''s possible that you are the first to run our dom0 on VT-d, as
I''ve
> not tried that myself.
>
> What was the panic?
>

Hi David,

This xen-unstable snapshot (changeset #17779) doesn''t support vt-d2
features. After disabling vt-d2 in BIOS setting (vt-d1 still remaining
enabled), the domain 0 boots well. Hope the coming 3.3 will fix this
problem.

vt-d1 is just ok for my current phase 2 work.

Thanks,
Allen


On Fri, Nov 7, 2008 at 10:57 AM, Lu Baolu <allen.virt@gmail.com>
wrote:
> David - I am in vaccation. I will post the debug information the next
Monday.
>
> Thanks, Allen
>
> On Thu, Nov 6, 2008 at 11:40 PM, David Edmondson <dme@sun.com> wrote:
>> On Thu, Nov 06, 2008 at 11:16:17PM +0800, Lu Baolu wrote:
>>> As you know, I have built a system with the developing xvm source
and
>>> onnv in matrix-unstable gate, and managed to create HVM guests for
>>> Fedora 7, Nevada snv_89 and Windows XP sp2. I did all these with
vt-d
>>> disabled in BIOS setting. When I turned on vt-d, domain 0
can''t do
>>> disk io during boot up time. After several failures on reading data
>>> from disk, domain 0 panic''ed and rebooted.
>>>
>>> Is this a known issue that somebody has got it fixed or mine is the
>>> first try on a vt-d enabled system?
>>
>> It''s possible that you are the first to run our dom0 on VT-d,
as I''ve
>> not tried that myself.
>>
>> What was the panic?
>>
>

Hi,

Domain 0 boots successfully, but when use xvm tools to start the HVM
guests, the system hangs. The input and output don''t work. And the CPU
fans spin in highest speed.

I am a newbie to xVM debugging. Can anybody give me some hints about
how to get debugging information in this case? One thing is that I
can''t enter kmdb through press "F1+A", although it works
before the
system hangs.

Thanks,
Allen

On Tue, Nov 11, 2008 at 2:02 PM, Lu Baolu <allen.virt@gmail.com>
wrote:
> Hi David,
>
> This xen-unstable snapshot (changeset #17779) doesn''t support
vt-d2
> features. After disabling vt-d2 in BIOS setting (vt-d1 still remaining
> enabled), the domain 0 boots well. Hope the coming 3.3 will fix this
> problem.
>
> vt-d1 is just ok for my current phase 2 work.
>
> Thanks,
> Allen
>
>
> On Fri, Nov 7, 2008 at 10:57 AM, Lu Baolu <allen.virt@gmail.com>
wrote:
>> David - I am in vaccation. I will post the debug information the next
Monday.
>>
>> Thanks, Allen
>>
>> On Thu, Nov 6, 2008 at 11:40 PM, David Edmondson <dme@sun.com>
wrote:
>>> On Thu, Nov 06, 2008 at 11:16:17PM +0800, Lu Baolu wrote:
>>>> As you know, I have built a system with the developing xvm
source and
>>>> onnv in matrix-unstable gate, and managed to create HVM guests
for
>>>> Fedora 7, Nevada snv_89 and Windows XP sp2. I did all these
with vt-d
>>>> disabled in BIOS setting. When I turned on vt-d, domain 0
can''t do
>>>> disk io during boot up time. After several failures on reading
data
>>>> from disk, domain 0 panic''ed and rebooted.
>>>>
>>>> Is this a known issue that somebody has got it fixed or mine is
the
>>>> first try on a vt-d enabled system?
>>>
>>> It''s possible that you are the first to run our dom0 on
VT-d, as I''ve
>>> not tried that myself.
>>>
>>> What was the panic?
>>>
>>
>

So I have to wait for xvm 3.3 release?

On Tue, Nov 11, 2008 at 2:41 PM, Lu Baolu <allen.virt@gmail.com>
wrote:
> Hi,
>
> Domain 0 boots successfully, but when use xvm tools to start the HVM
> guests, the system hangs. The input and output don''t work. And the
CPU
> fans spin in highest speed.
>
> I am a newbie to xVM debugging. Can anybody give me some hints about
> how to get debugging information in this case? One thing is that I
> can''t enter kmdb through press "F1+A", although it works
before the
> system hangs.
>
> Thanks,
> Allen
>
> On Tue, Nov 11, 2008 at 2:02 PM, Lu Baolu <allen.virt@gmail.com>
wrote:
>> Hi David,
>>
>> This xen-unstable snapshot (changeset #17779) doesn''t support
vt-d2
>> features. After disabling vt-d2 in BIOS setting (vt-d1 still remaining
>> enabled), the domain 0 boots well. Hope the coming 3.3 will fix this
>> problem.
>>
>> vt-d1 is just ok for my current phase 2 work.
>>
>> Thanks,
>> Allen
>>
>>
>> On Fri, Nov 7, 2008 at 10:57 AM, Lu Baolu <allen.virt@gmail.com>
wrote:
>>> David - I am in vaccation. I will post the debug information the
next Monday.
>>>
>>> Thanks, Allen
>>>
>>> On Thu, Nov 6, 2008 at 11:40 PM, David Edmondson
<dme@sun.com> wrote:
>>>> On Thu, Nov 06, 2008 at 11:16:17PM +0800, Lu Baolu wrote:
>>>>> As you know, I have built a system with the developing xvm
source and
>>>>> onnv in matrix-unstable gate, and managed to create HVM
guests for
>>>>> Fedora 7, Nevada snv_89 and Windows XP sp2. I did all these
with vt-d
>>>>> disabled in BIOS setting. When I turned on vt-d, domain 0
can''t do
>>>>> disk io during boot up time. After several failures on
reading data
>>>>> from disk, domain 0 panic''ed and rebooted.
>>>>>
>>>>> Is this a known issue that somebody has got it fixed or
mine is the
>>>>> first try on a vt-d enabled system?
>>>>
>>>> It''s possible that you are the first to run our dom0
on VT-d, as I''ve
>>>> not tried that myself.
>>>>
>>>> What was the panic?
>>>>
>>>
>>
>

Allen, sorry for the long delay, I was travelling.

On Tue, Nov 11, 2008 at 02:41:26PM +0800, Lu Baolu
wrote:
> Domain 0 boots successfully, but when use xvm tools to start the HVM
> guests, the system hangs. The input and output don''t work. And the
CPU
> fans spin in highest speed.
> 
> I am a newbie to xVM debugging. Can anybody give me some hints about
> how to get debugging information in this case? One thing is that I
> can''t enter kmdb through press "F1+A", although it works
before the
> system hangs.
It''s very difficult to debug without a serial console. Can you set
that up?

Hi David,

It is easy to me if the machine has a serial port. But that I am
working at has no serial port on board.

Somebody has told me about using a usb-serial adapter. But I don''t
think it will work at the very beginning of kernel boot.

Thanks,
Allen

On Mon, Nov 17, 2008 at 7:44 PM, David Edmondson <dme@sun.com>
wrote:
> Allen, sorry for the long delay, I was travelling.
>
> On Tue, Nov 11, 2008 at 02:41:26PM +0800, Lu Baolu wrote:
>> Domain 0 boots successfully, but when use xvm tools to start the HVM
>> guests, the system hangs. The input and output don''t work. And
the CPU
>> fans spin in highest speed.
>>
>> I am a newbie to xVM debugging. Can anybody give me some hints about
>> how to get debugging information in this case? One thing is that I
>> can''t enter kmdb through press "F1+A", although it
works before the
>> system hangs.
>
> It''s very difficult to debug without a serial console. Can you set
> that up?
>

On Wed, Nov 19, 2008 at 02:28:54PM +0800, Lu Baolu
wrote:
> It is easy to me if the machine has a serial port. But that I am
> working at has no serial port on board.
Do you have an appropriate machine with a serial console? It will help
a lot during development.
> Somebody has told me about using a usb-serial adapter. But I don''t
> think it will work at the very beginning of kernel boot.
In general it won''t.

On Wed, Nov 19, 2008 at 2:44 PM, David Edmondson <dme@sun.com>
wrote:
> On Wed, Nov 19, 2008 at 02:28:54PM +0800, Lu Baolu wrote:
>> It is easy to me if the machine has a serial port. But that I am
>> working at has no serial port on board.
>
> Do you have an appropriate machine with a serial console? It will help
> a lot during development.
No such machine in my lab. Let me try to figure out.
>
>> Somebody has told me about using a usb-serial adapter. But I
don''t
>> think it will work at the very beginning of kernel boot.
>
> In general it won''t.
>