So I have been scheming for many months now to get myself what seems to me to be the Uber Server setup: Some high powered compute nodes (Opteron CPU''s with oodles of RAM) attached to a ton of storage using AoE. I now have the money to buy the equipment and will place an order for 8 machines in the next day or two. I had heard about UDP packet corruption and drivers which hang when an AoE node goes down and other such things causing problems. Are these issues resolved? Is anyone running AoE on Xen? In production or just experimenting? I have been running 4 Xen domains on a machine (all off of local disk) for the last 6+ months and I am satisfied that Xen is solid and I am comfortable with it. Now I need to bring AoE into the equation to get my company the high availability and SAN capabilities that we have always wanted. -- Tracy R Reed http://copilotconsulting.com 1-877-MY-COPILOT _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
So I have been scheming for many months now to get myself what seems to me to be the Uber Server setup: Some high powered compute nodes (Opteron CPU''s with oodles of RAM) attached to a ton of storage using AoE. I now have the money to buy the equipment and will place an order for 8 machines in the next day or two. I had heard about UDP packet/checksum corruption and drivers which hang when an AoE node goes down and other such things causing problems. Are these issues resolved? Is anyone running AoE on Xen? In production or just experimenting? I have read about people booting off of AoE but it required a patch last I saw. Has this been integrated? I have been running 4 Xen domains on a machine (all off of local disk) for the last 6+ months and I am satisfied that Xen is solid and I am comfortable with it. Now I need to bring AoE into the equation to get my company the high availability and SAN capabilities that we have always wanted. -- Tracy R Reed http://ultraviolet.org _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Tracy R Reed <treed@ultraviolet.org> writes:>I had heard about UDP packet/checksum corruption and drivers which hang >when an AoE node goes down and other such things causing problems. Are >these issues resolved?I don''t know but I did hear from Coraid about packet corruption and they convinced me (for now) that the Ethernet level of error detection should be sufficient.>Is anyone running AoE on Xen?I am.>In production or >just experimenting?Yes. I have two machines running against two Coraid SATA/RAID units. One machine is all production. The other is experimentation and does data backup to the second Coraid box.>I have read about people booting off of AoE but it >required a patch last I saw. Has this been integrated?I don''t know. It seems odd to me to talk about *booting* from AoE. What BIOS supports that? OTOH, booting from the network and then using AoE for root seems simple enough.>I have been running 4 Xen domains on a machine (all off of local disk) >for the last 6+ months and I am satisfied that Xen is solid and I am >comfortable with it. Now I need to bring AoE into the equation to get my >company the high availability and SAN capabilities that we have always >wanted.I''ve only used Xen with AoE. It''s an integral part of the way I want to use Xen. Moving domains between machines should be trivial and setup is incredibly easy (especially compared to iSCSI, etc.). And, of course, it''s handy to be able to pick up 7TB+ chunks for cheap. --kyler _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Which filesystem do you use ?> > I''ve only used Xen with AoE. It''s an integral part of the way I want > to use Xen. Moving domains between machines should be trivial and > setup is incredibly easy (especially compared to iSCSI, etc.). And, > of course, it''s handy to be able to pick up 7TB+ chunks for cheap. > > --kyler > > > _______________________________________________ > Xen-users mailing list > Xen-users@lists.xensource.com > http://lists.xensource.com/xen-users >_______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
On Fri, May 12, 2006 at 10:21:09AM -0400, Michael Lessard wrote:> Which filesystem do you use ?I''m almost all ext3 but I have at least one ReiserFS partition that I just copied from an old machine. (I migrated a few physical machines to Xen.) --kyler _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
When you do live migration between 2 physical server, both server mount the partition who are on SAN ? On 5/12/06, Kyler Laird <Kyler@lairds.com> wrote:> > On Fri, May 12, 2006 at 10:21:09AM -0400, Michael Lessard wrote: > > > Which filesystem do you use ? > > I''m almost all ext3 but I have at least one ReiserFS partition that I > just copied from an old machine. (I migrated a few physical machines to > Xen.) > > --kyler > >_______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
On Fri, May 12, 2006 at 10:28:12AM -0400, Michael Lessard wrote:> >I''m almost all ext3 but I have at least one ReiserFS partition that I > >just copied from an old machine. (I migrated a few physical machines to > >Xen.)> When you do live migration between 2 physical server, both server mount the > partition who are on SAN ?When I said "migrated a few physical machines" I was referring to replacing a few physical machines with a single Xen host (one-time migration...if I do it right) but I do have two Xen hosts both mounting the same Etherdrives. I haven''t done live migration with them yet but in theory it should work easily. I''ve (successfully) experimented with using OCFS2 to mount the same partition on multiple machines simultaneously but I find that it''s easier for me to get my head around having separate partitions for each domain. That means only having one machine mount a partition at a time. I use GFS partitioning (parted) and "#define AOE_PARTITIONS (256)" in linux-2.6.16-xen0/drivers/block/aoe/aoe.h so that I can have plenty of partitions. (GFS lets me name them too. That''s handy.) BTW, I mentioned earlier that I use ext3. I''ve been toying with XFS but I ran into some problems using it on a non-AoE Xen machine at home. I like that it''s faster at creating partitions. Making multi TB partitions with ext3 takes awhile. --kyler _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users