rabbtux rabbtux
2008-Jan-22 20:31 UTC
[Xen-users] AoE server & client on same physical xen box?
A while back, I did some testing with Aoe on my xen boxes. I found that I could not get an Aoe partition from Dom0 served to a DomU on the same box. My conclusion is that you can''t get an Aoe server and Aoe client to work on the same box, even between Dom0 and DomU, or a pair of DomUs. Is there something I might be missing? Anyone else successful? Thanks, Marshall _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Tom Mornini
2008-Jan-22 21:08 UTC
Re: [Xen-users] AoE server & client on same physical xen box?
Assuming you''re running bridged network mode, I''d be highly surprised if this didn''t work. -- -- Tom Mornini On Jan 22, 2008, at 12:31 PM, rabbtux rabbtux wrote:> A while back, I did some testing with Aoe on my xen boxes. I found > that I could not get an Aoe partition from Dom0 served to a DomU on > the same box. My conclusion is that you can''t get an Aoe server and > Aoe client to work on the same box, even between Dom0 and DomU, or a > pair of DomUs. Is there something I might be missing? Anyone else > successful? > > Thanks, > Marshall > > _______________________________________________ > Xen-users mailing list > Xen-users@lists.xensource.com > http://lists.xensource.com/xen-users_______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Marcelo Messa
2008-Jan-22 21:08 UTC
Re: [Xen-users] AoE server & client on same physical xen box?
Your problem refers to ethernet padding. Xen do not implement this
part of ethernet protocol and this causes some issues with this
layer2 protocol. Take a look at:
http://article.gmane.org/
gmane.network.aoe.aoetools.general/606
Apply the patch to vblade server.
If your "pair" of DomUs have some Full Virtual machine as vblade
server, everything should work.
I posted a mail here and opend a bug in Xen bugzilla, but I had no
answers here. Maybe , someday, someone, answer.
http://bugzilla.xensource.com/bugzilla/show_bug.cgi?
id=1140
Cheers
Marcelo Messa
Em 22/01/2008, às 18:31, rabbtux rabbtux escreveu:
> A while back, I did some testing with Aoe on my xen boxes. I found
> that I could not get an Aoe partition from Dom0 served to a DomU on
> the same box. My conclusion is that you can''t get an Aoe server
and
> Aoe client to work on the same box, even between Dom0 and DomU, or a
> pair of DomUs. Is there something I might be missing? Anyone else
> successful?
>
> Thanks,
> Marshall
>
> _______________________________________________
> Xen-users mailing list
> Xen-users@lists.xensource.com
> http://lists.xensource.com/xen-users
_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users
Tom Brown
2008-Jan-22 21:21 UTC
Re: [Xen-users] AoE server & client on same physical xen box?
On Tue, 22 Jan 2008, Tom Mornini wrote:> Assuming you''re running bridged network mode, I''d be highly surprised if this > didn''t work. > > -- > -- Tom Mornini > > On Jan 22, 2008, at 12:31 PM, rabbtux rabbtux wrote: > >> A while back, I did some testing with Aoe on my xen boxes. I found >> that I could not get an Aoe partition from Dom0 served to a DomU on >> the same box. My conclusion is that you can''t get an Aoe server and >> Aoe client to work on the same box, even between Dom0 and DomU, or a >> pair of DomUs. Is there something I might be missing? Anyone else >> successful?I had to make a change to the vblade.c code... there''s a packet size check that seems to fail... I have no idea why it is only an issue in XEN configurations, but it seems that it is... Here''s the change: --- vblade-14/aoe.c 2006-11-20 09:48:05.000000000 -0800 +++ vblade-14.tom/aoe.c 2007-04-17 19:07:35.000000000 -0700 @@ -202,7 +202,7 @@ perror("read network"); exit(1); } - if (n < 60) + if (n < 20) continue; p = (Aoehdr *) buf; if (ntohs(p->type) != 0x88a2) that seems to be sufficient to make vblade work "on the same box" -Tom _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Tom Brown
2008-Jan-22 21:56 UTC
Re: [Xen-users] AoE server & client on same physical xen box?
>> > A while back, I did some testing with Aoe on my xen boxes. I found >> > that I could not get an Aoe partition from Dom0 served to a DomU on >> > the same box. My conclusion is that you can''t get an Aoe server and >> > Aoe client to work on the same box, even between Dom0 and DomU, or a >> > pair of DomUs. Is there something I might be missing? Anyone else >> > successful? > > I had to make a change to the vblade.c code... there''s a packet size check > that seems to fail... I have no idea why it is only an issue in XEN > configurations, but it seems that it is... Here''s the change: > > --- vblade-14/aoe.c 2006-11-20 09:48:05.000000000 -0800 > +++ vblade-14.tom/aoe.c 2007-04-17 19:07:35.000000000 -0700 > @@ -202,7 +202,7 @@ > perror("read network"); > exit(1); > } > - if (n < 60) > + if (n < 20) > continue; > p = (Aoehdr *) buf; > if (ntohs(p->type) != 0x88a2) > > that seems to be sufficient to make vblade work "on the same box" > > -TomInteresting... One of the other posts referred to http://article.gmane.org/gmane.network.aoe.aoetools.general/606 ... which is doing it "the other way", making the requester (kernel aoe driver) pad the request to 60 bytes. There of course is a kernel vblade as well, that would probably need a similar patch if you were going to fix it on the vblade side... of course, there''s nothing wrong with fixing it on both sides... but if you are using the user space vblade program, that is by far the simplest place to fix it. -Tom _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
rabbtux rabbtux
2008-Jan-22 22:29 UTC
Re: [Xen-users] AoE server & client on same physical xen box?
Thanks for all the replies! This is a known issue. Correct me if I am wrong, but I should be able to have a fully virtualized(HVM) DomU act as the AoE server and then the clients can be either Dom0 or other DomUs. This will work without code modification since the problem is in the vbladed code, right?? On Jan 22, 2008 1:56 PM, Tom Brown <xensource.com@vmail.baremetal.com> wrote:> >> > A while back, I did some testing with Aoe on my xen boxes. I found > >> > that I could not get an Aoe partition from Dom0 served to a DomU on > >> > the same box. My conclusion is that you can''t get an Aoe server and > >> > Aoe client to work on the same box, even between Dom0 and DomU, or a > >> > pair of DomUs. Is there something I might be missing? Anyone else > >> > successful? > > > > I had to make a change to the vblade.c code... there''s a packet size check > > that seems to fail... I have no idea why it is only an issue in XEN > > configurations, but it seems that it is... Here''s the change: > > > > --- vblade-14/aoe.c 2006-11-20 09:48:05.000000000 -0800 > > +++ vblade-14.tom/aoe.c 2007-04-17 19:07:35.000000000 -0700 > > @@ -202,7 +202,7 @@ > > perror("read network"); > > exit(1); > > } > > - if (n < 60) > > + if (n < 20) > > continue; > > p = (Aoehdr *) buf; > > if (ntohs(p->type) != 0x88a2) > > > > that seems to be sufficient to make vblade work "on the same box" > > > > -Tom > > Interesting... One of the other posts referred to > > http://article.gmane.org/gmane.network.aoe.aoetools.general/606 > > ... which is doing it "the other way", making the requester (kernel aoe > driver) pad the request to 60 bytes. There of course is a kernel vblade as > well, that would probably need a similar patch if you were going to fix it > on the vblade side... of course, there''s nothing wrong with fixing it on > both sides... but if you are using the user space vblade program, that is > by far the simplest place to fix it. > > > -Tom > > > > > _______________________________________________ > Xen-users mailing list > Xen-users@lists.xensource.com > http://lists.xensource.com/xen-users >_______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Tom Brown
2008-Jan-22 22:41 UTC
Re: [Xen-users] AoE server & client on same physical xen box?
On Tue, 22 Jan 2008, rabbtux rabbtux wrote:> Thanks for all the replies! This is a known issue. Correct me if I > am wrong, but I should be able to have a fully virtualized(HVM) DomU > act as the AoE server and then the clients can be either Dom0 or other > DomUs. This will work without code modification since the problem is > in the vbladed code, right??The problem is in the XEN virtual NICs not padding ethernet packets to the minimum required size (60 bytes) for ethernet packets. The work around is to either change the check in the vblade server, or force the AOE requester to pad its requests (either remove the 60 byte check, or pad the packets to pass the check, same effect :)>From a performance perspective it would seem rather strange to use an HVMdomain to host the AOE storage service... (too much virtualization). According to Marcello''s bug report, what you describe is the _only_ way it would work without making the trivial change... http://bugzilla.xensource.com/bugzilla/show_bug.cgi?id=1140 "The results shows that only FullVirtualization do padding, and only when receives a packet (not when send it)." -Tom _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Mark Williamson
2008-Jan-24 23:27 UTC
Re: [Xen-users] AoE server & client on same physical xen box?
> I posted a mail here and opend a bug in Xen bugzilla, but I had no > answers here. Maybe , someday, someone, answer. > > http://bugzilla.xensource.com/bugzilla/show_bug.cgi? > id=1140Hi Marcelo, Do you fancy posting your report (probably just copy & paste the report from bugzilla and include the URL) to xen-devel? This ought to be fixed, because AoE servers are likely to be a common configuration. Bugs generally get more attention when reported to xen-devel (yes, that does mean that the bugzilla is a bit misleading and redundant). Cheers, Mark -- Push Me Pull You - Distributed SCM tool (http://www.cl.cam.ac.uk/~maw48/pmpu/) _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Marcelo Messa
2008-Jan-25 02:49 UTC
Re: [Xen-users] AoE server & client on same physical xen box?
tks Mark.
I will send an e-mail to xen-devel. If that thread have addons, I
reply here.
Cheers
Marcelo Messa
Em 24/01/2008, às 21:27, Mark Williamson escreveu:
>> I posted a mail here and opend a bug in Xen bugzilla, but I had no
>> answers here. Maybe , someday, someone, answer.
>>
>> http://bugzilla.xensource.com/bugzilla/show_bug.cgi?
>> id=1140
>
> Hi Marcelo,
>
> Do you fancy posting your report (probably just copy & paste the
> report from
> bugzilla and include the URL) to xen-devel? This ought to be
> fixed, because
> AoE servers are likely to be a common configuration.
>
> Bugs generally get more attention when reported to xen-devel (yes,
> that does
> mean that the bugzilla is a bit misleading and redundant).
>
> Cheers,
> Mark
>
> --
> Push Me Pull You - Distributed SCM tool (http://www.cl.cam.ac.uk/
> ~maw48/pmpu/)
_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users