Dear List, I''m thinking about using xen productive in our datacenter, i''m still testing around with it. Now I got some questions, just for basic understanding, we got for example this environment: 2 Nodes 1 SCSI Pool server (Connected via scsi to both nodes) Now I want to build a "cluster" so i would like to make this: Node 1 -> Primary -| | --> domU 1 (LV/OCFS2) |-> SCSI POOL 1.5TB (VG) | --> domU 2 (LV/OCFS2) Node 2 -> Secondary -| | --> domU 3 (LV/OCFS2) So the reason, why I use ocfs2 is, because I access the same Disk with 2 Nodes via scsi. It would destroy the fs, if I use ext3 (normaly). but.... I can''t boot the domU''s form a ocfs2 filesystem... So I tried to setup a domU and installed ocfs2 into it, after that I cloned the system into a ocfs2 lv, but if I start it, it can''t find the root filesystem. what else do I have to attend to get a system startet from a ocfs2 filesystem? Or is this the wrong way? Regards, D. Vogt _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Hello Dominik What you doubt about ocfs2 implementation (all doubt or at specific point) ?!, and what the Operating System ?! Cheers Waldirio 2008/6/27 Dominik Vogt <dominik.vogt@iml.unibe.ch>:> Dear List, > > I''m thinking about using xen productive in our datacenter, i''m still > testing around with it. Now I got some questions, just for basic > understanding, we got for example this environment: > > 2 Nodes > 1 SCSI Pool server (Connected via scsi to both nodes) > > Now I want to build a "cluster" so i would like to make this: > > Node 1 -> Primary -| | --> domU 1 (LV/OCFS2) > |-> SCSI POOL 1.5TB (VG) | --> domU 2 (LV/OCFS2) > Node 2 -> Secondary -| | --> domU 3 (LV/OCFS2) > > So the reason, why I use ocfs2 is, because I access the same Disk with 2 > Nodes via scsi. It would destroy the fs, if I use ext3 (normaly). > but.... I can''t boot the domU''s form a ocfs2 filesystem... So I tried to > setup a domU and installed ocfs2 into it, after that I cloned the system > into a ocfs2 lv, but if I start it, it can''t find the root filesystem. > what else do I have to attend to get a system startet from a ocfs2 > filesystem? Or is this the wrong way? > > Regards, D. Vogt > > > > _______________________________________________ > Xen-users mailing list > Xen-users@lists.xensource.com > http://lists.xensource.com/xen-users >-- ______________ Atenciosamente Waldirio msn: wmp@sinope.com.br Site: www.waldirio.com.br Blog: blog.waldirio.com.br PGP: www.waldirio.com.br/public.html _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Good Morning Dominik
Let''s try explain the implementation of ocfs2 in guest machine (in my
case
RedHat).
I have created the Oracle RAC summary and one point of the procedure is
the implementation of ocfs2. Because of size, I removed all another points,
keep only ocfs (later I''ll put in my web site the full document).
When you configure using ocfs2console (graphical environment), you''ll
inform the IP address of machines which will access the shared file system,
at the finish, will be created one ocfs config file
(/etc/ocfs2/cluster.conf) with this content (in my case)
###
node:
ip_port = 7777
ip_address = 164.85.216.107
number = 0
name = cambeba.mydomain.com
cluster = ocfs2
node:
ip_port = 7777
ip_address = 164.85.216.105
number = 1
name = cangua.mydomain.com
cluster = ocfs2
cluster:
node_count = 2
name = ocfs2
###
At the finish of configuration, the tool ocfs2console have the option
"Propagate Configuration" which will share this configuration with all
another nodes configured.
The next step is create a partition (can be using lv for example) and format
using ocfs2
1. Create using lvm (pvcreate/vgcreate/lvcreate)
2. Formatting using ocfs2 (mkfs.ocfs2 <path created before for lvcreate>)
3. Mount automatically the partition by fstab (include in fstab like below)
and later "# mount -a"
/dev/ocfs2/ocfs_01 /ocfs_01 ocfs2 _netdev,
datavolume,nointr 0 0
PS: Create a lvm and format just on one node, at another nodes only include
on fstab and enjoy
PS2: The attached document was written in Portuguese, so if you have any
problem or doubt to understand, reply.
Any doubt or "append" for this procedure, reply :)
Good luck
Waldirio
2008/7/3, Dominik Vogt
<dominik.vogt@iml.unibe.ch>:>
> Hello Waldirio,
>
> No doubt''s, it''s just a fact that I cant boot from ocfs2.
My systems are
> all debian etch. So just for understanding what I did (Maybe I
> understood all wrong about ocfs2)
>
> So I create a Volume Group, in this case it is about 1.5TB. Then I
> create vor every domu a Logical Volume, and format it with ocfs2
> filesystem. After that i install a system on that Logical Volume,
it''s
> working until this. but if I want to start the domu, xen starts the
> system but on boot it can''t find the root partition! so it seems
like
> the kernel can''t initalize the ocfs2 fs during startup.
>
> Do I have to do some special things to get it running?
>
> Thanks and A nice day,
> Dominik
>
> Am Mittwoch, den 02.07.2008, 14:01 -0300 schrieb Waldirio Manhães
> Pinheiro:
> > Hello Dominik
> >
> > What you doubt about ocfs2 implementation (all doubt or at specific
> > point) ?!, and what the Operating System ?!
> >
> > Cheers
> > Waldirio
> >
> > 2008/6/27 Dominik Vogt <dominik.vogt@iml.unibe.ch>:
> > Dear List,
> >
> > I''m thinking about using xen productive in our
datacenter, i''m
> > still
> > testing around with it. Now I got some questions, just for
> > basic
> > understanding, we got for example this environment:
> >
> > 2 Nodes
> > 1 SCSI Pool server (Connected via scsi to both nodes)
> >
> > Now I want to build a "cluster" so i would like to
make this:
> >
> > Node 1 -> Primary -| | -->
domU 1
> > (LV/OCFS2)
> > |-> SCSI POOL 1.5TB (VG) | -->
domU 2
> > (LV/OCFS2)
> > Node 2 -> Secondary -| | -->
domU 3
> > (LV/OCFS2)
> >
> > So the reason, why I use ocfs2 is, because I access the same
> > Disk with 2
> > Nodes via scsi. It would destroy the fs, if I use ext3
> > (normaly).
> > but.... I can''t boot the domU''s form a ocfs2
filesystem... So
> > I tried to
> > setup a domU and installed ocfs2 into it, after that I cloned
> > the system
> > into a ocfs2 lv, but if I start it, it can''t find the
root
> > filesystem.
> > what else do I have to attend to get a system startet from a
> > ocfs2
> > filesystem? Or is this the wrong way?
> >
> > Regards, D. Vogt
> >
> >
> >
> > _______________________________________________
> > Xen-users mailing list
> > Xen-users@lists.xensource.com
> > http://lists.xensource.com/xen-users
> >
> >
> >
> > --
> > ______________
> > Atenciosamente
> > Waldirio
> > msn: wmp@sinope.com.br
> > Site: www.waldirio.com.br
> > Blog: blog.waldirio.com.br
> > PGP: www.waldirio.com.br/public.html
> --
> Dominik Vogt
> Informatikbetreuer
> Universität Bern
> Institut für medizinische Lehre (IML)
> Abteilung für Assessment und Evaluation (AAE)
> Inselspital 37a
> CH-3010 Bern
>
> Phone: 031 632 3584
> Mail: dominik.vogt@iml.unibe.ch
>
>
--
______________
Atenciosamente
Waldirio
msn: wmp@sinope.com.br
Site: www.waldirio.com.br
Blog: blog.waldirio.com.br
PGP: www.waldirio.com.br/public.html
_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users
Dear Waldirio, Thank you for your description! (hell yea I can''t portuguese but I understood it ;-)) I think you didn''t get the point what I would do exactly... I try to boot from a ocfs2 fs. so the whole system is on a LV which is formated with ocfs2. I don''t know if this possible... but I need a clustring filesystem because I dont have isci or something else... just 2 boxes which access the same scsi device... Greetings Dominik Am Donnerstag, den 03.07.2008, 08:05 -0300 schrieb Waldirio Manhães Pinheiro:> Good Morning Dominik > > Let''s try explain the implementation of ocfs2 in guest machine (in > my case RedHat). > > I have created the Oracle RAC summary and one point of the procedure > is the implementation of ocfs2. Because of size, I removed all another > points, keep only ocfs (later I''ll put in my web site the full > document). > > When you configure using ocfs2console (graphical environment), > you''ll inform the IP address of machines which will access the shared > file system, at the finish, will be created one ocfs config file > (/etc/ocfs2/cluster.conf) with this content (in my case) > > ### > node: > ip_port = 7777 > ip_address = 164.85.216.107 > number = 0 > name = cambeba.mydomain.com > cluster = ocfs2 > node: > ip_port = 7777 > ip_address = 164.85.216.105 > number = 1 > name = cangua.mydomain.com > cluster = ocfs2 > > cluster: > node_count = 2 > name = ocfs2 > ### > > At the finish of configuration, the tool ocfs2console have the option > "Propagate Configuration" which will share this configuration with all > another nodes configured. > > The next step is create a partition (can be using lv for example) and > format using ocfs2 > 1. Create using lvm (pvcreate/vgcreate/lvcreate) > 2. Formatting using ocfs2 (mkfs.ocfs2 <path created before for > lvcreate>) > 3. Mount automatically the partition by fstab (include in fstab like > below) and later "# mount -a" > > /dev/ocfs2/ocfs_01 /ocfs_01 ocfs2 _netdev, > datavolume,nointr 0 0 > > > > PS: Create a lvm and format just on one node, at another nodes only > include on fstab and enjoy > > > > PS2: The attached document was written in Portuguese, so if you have > any problem or doubt to understand, reply. > > > > Any doubt or "append" for this procedure, reply :) > > > > Good luck > > Waldirio > > > > > 2008/7/3, Dominik Vogt <dominik.vogt@iml.unibe.ch>: > Hello Waldirio, > > No doubt''s, it''s just a fact that I cant boot from ocfs2. My > systems are > all debian etch. So just for understanding what I did (Maybe I > understood all wrong about ocfs2) > > So I create a Volume Group, in this case it is about 1.5TB. > Then I > create vor every domu a Logical Volume, and format it with > ocfs2 > filesystem. After that i install a system on that Logical > Volume, it''s > working until this. but if I want to start the domu, xen > starts the > system but on boot it can''t find the root partition! so it > seems like > the kernel can''t initalize the ocfs2 fs during startup. > > Do I have to do some special things to get it running? > > Thanks and A nice day, > Dominik > > Am Mittwoch, den 02.07.2008, 14:01 -0300 schrieb Waldirio > Manhães > Pinheiro: > > Hello Dominik > > > > What you doubt about ocfs2 implementation (all doubt or at > specific > > point) ?!, and what the Operating System ?! > > > > Cheers > > Waldirio > > > > 2008/6/27 Dominik Vogt <dominik.vogt@iml.unibe.ch>: > > Dear List, > > > > I''m thinking about using xen productive in our > datacenter, i''m > > still > > testing around with it. Now I got some questions, > just for > > basic > > understanding, we got for example this environment: > > > > 2 Nodes > > 1 SCSI Pool server (Connected via scsi to both > nodes) > > > > Now I want to build a "cluster" so i would like to > make this: > > > > Node 1 -> Primary -| | > --> domU 1 > > (LV/OCFS2) > > |-> SCSI POOL 1.5TB (VG) | --> > domU 2 > > (LV/OCFS2) > > Node 2 -> Secondary -| | > --> domU 3 > > (LV/OCFS2) > > > > So the reason, why I use ocfs2 is, because I access > the same > > Disk with 2 > > Nodes via scsi. It would destroy the fs, if I use > ext3 > > (normaly). > > but.... I can''t boot the domU''s form a ocfs2 > filesystem... So > > I tried to > > setup a domU and installed ocfs2 into it, after that > I cloned > > the system > > into a ocfs2 lv, but if I start it, it can''t find > the root > > filesystem. > > what else do I have to attend to get a system > startet from a > > ocfs2 > > filesystem? Or is this the wrong way? > > > > Regards, D. Vogt > > > > > > > > _______________________________________________ > > Xen-users mailing list > > Xen-users@lists.xensource.com > > http://lists.xensource.com/xen-users > > > > > > > > -- > > ______________ > > Atenciosamente > > Waldirio > > msn: wmp@sinope.com.br > > Site: www.waldirio.com.br > > Blog: blog.waldirio.com.br > > PGP: www.waldirio.com.br/public.html > -- > Dominik Vogt > Informatikbetreuer > Universität Bern > Institut für medizinische Lehre (IML) > Abteilung für Assessment und Evaluation (AAE) > Inselspital 37a > CH-3010 Bern > > Phone: 031 632 3584 > Mail: dominik.vogt@iml.unibe.ch > > > > > -- > ______________ > Atenciosamente > Waldirio > msn: wmp@sinope.com.br > Site: www.waldirio.com.br > Blog: blog.waldirio.com.br > PGP: www.waldirio.com.br/public.html > _______________________________________________ > Xen-users mailing list > Xen-users@lists.xensource.com > http://lists.xensource.com/xen-users-- Dominik Vogt Informatikbetreuer Universität Bern Institut für medizinische Lehre (IML) Abteilung für Assessment und Evaluation (AAE) Inselspital 37a CH-3010 Bern Phone: 031 632 3584 Mail: dominik.vogt@iml.unibe.ch _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
On Thu, Jul 3, 2008 at 9:21 AM, Dominik Vogt <dominik.vogt@iml.unibe.ch> wrote:> I try to boot from a ocfs2 fs. so the whole system is on a LV which is > formated with ocfs2. I don''t know if this possible... but I need a > clustring filesystem because I dont have isci or something else... just > 2 boxes which access the same scsi device...i don''t know if there''s any limitation in OCFS2 for booting, but i think GRUB, (and maybe PyGRUB) would have problems with that. it may be easier to use host your kernel and initrd in Dom0, and make sure that initrd has all needed modules to correctly mount the root filesystem. of course, it would be FAR easier to use anything else (small ext3, big initrd, network booting, etc) as the root partition, and later mount the shared OCFS storage. also, keep in mind that two machines sharing the same root tree would interfere in lots of ways, no matter what filesystem you use, so be very sure that each machine has it''s own root tree. (you wouldn''t want to share /var/log, or /var/run, eh?) -- Javier _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Yes of course, the thing is, If the fs isn''t clustering on that scsi raid sys. it will destroy the fs if I connect with both servers. So my try was, to format it with ocfs2! The second server is just a "backup" server. So if the first one crashes, I can migrate the domu''s easyli to the second one. I could work with images, which are on the ocfs2 partition this would work, but images are not as felxible as lv''s... But I think i''m definitly on the wrong way now... cheers Am Donnerstag, den 03.07.2008, 09:42 -0500 schrieb Javier Guerra:> On Thu, Jul 3, 2008 at 9:21 AM, Dominik Vogt <dominik.vogt@iml.unibe.ch> wrote: > > I try to boot from a ocfs2 fs. so the whole system is on a LV which is > > formated with ocfs2. I don''t know if this possible... but I need a > > clustring filesystem because I dont have isci or something else... just > > 2 boxes which access the same scsi device... > > i don''t know if there''s any limitation in OCFS2 for booting, but i > think GRUB, (and maybe PyGRUB) would have problems with that. it may > be easier to use host your kernel and initrd in Dom0, and make sure > that initrd has all needed modules to correctly mount the root > filesystem. > > of course, it would be FAR easier to use anything else (small ext3, > big initrd, network booting, etc) as the root partition, and later > mount the shared OCFS storage. > > also, keep in mind that two machines sharing the same root tree would > interfere in lots of ways, no matter what filesystem you use, so be > very sure that each machine has it''s own root tree. (you wouldn''t > want to share /var/log, or /var/run, eh?) >-- Dominik Vogt Informatikbetreuer Universität Bern Institut für medizinische Lehre (IML) Abteilung für Assessment und Evaluation (AAE) Inselspital 37a CH-3010 Bern Phone: 031 632 3584 Mail: dominik.vogt@iml.unibe.ch _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
On Thu, Jul 3, 2008 at 9:51 AM, Dominik Vogt <dominik.vogt@iml.unibe.ch> wrote:> Yes of course, the thing is, If the fs isn''t clustering on that scsi > raid sys. it will destroy the fs if I connect with both servers. So mywhen i mentioned ext3 (or any non-cluster fs) i meant _different_ ext3 partitions, one for each box.> try was, to format it with ocfs2! The second server is just a "backup" > server. So if the first one crashes, I can migrate the domu''s easyli to > the second one. I could work with images, which are on the ocfs2 > partition this would work, but images are not as felxible as lv''s... > But I think i''m definitly on the wrong way now...again, much easier is to have the root filesystem non-shared, and just share the storage. -- Javier _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Hello friends I''m read only now and yes, it''s better each node with it structure and what you think necessary, you share with ocfs file system. Maybe you can check RedHat cluster suite for you environment http://www.redhat.com/cluster_suite/ or http://www.centos.org/docs/4/html/rh-cs-en-4/ Good Luck Waldirio 2008/7/3, Javier Guerra <javier@guerrag.com>:> > On Thu, Jul 3, 2008 at 9:51 AM, Dominik Vogt <dominik.vogt@iml.unibe.ch> > wrote: > > Yes of course, the thing is, If the fs isn''t clustering on that scsi > > raid sys. it will destroy the fs if I connect with both servers. So my > > when i mentioned ext3 (or any non-cluster fs) i meant _different_ ext3 > partitions, one for each box. > > > try was, to format it with ocfs2! The second server is just a "backup" > > server. So if the first one crashes, I can migrate the domu''s easyli to > > the second one. I could work with images, which are on the ocfs2 > > partition this would work, but images are not as felxible as lv''s... > > But I think i''m definitly on the wrong way now... > > again, much easier is to have the root filesystem non-shared, and just > share the storage. > > -- > Javier >-- ______________ Atenciosamente Waldirio msn: wmp@sinope.com.br Site: www.waldirio.com.br Blog: blog.waldirio.com.br PGP: www.waldirio.com.br/public.html _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
On Thu, 2008-07-03 at 16:21 +0200, Dominik Vogt wrote:> I think you didn''t get the point what I would do exactly... > I try to boot from a ocfs2 fs. so the whole system is on a LV which is > formated with ocfs2. I don''t know if this possible... but I need a > clustring filesystem because I dont have isci or something else... just > 2 boxes which access the same scsi device...You can create a single system image (what you describe is a single system image) however you will have to do a lot of additional configuration. For instance, each node that shares a single root file system will need to have its own view of the /etc directory, its own /var/run and many other things if introducing Xen. This is possible with contextually dependent symbolic links (CDSLs), but not so easy to implement. You''ll also have to have to hack together an initrd that starts networking, gets a cluster config, loads the FS module and starts the cluster service before pivot_root can be called. Most would just use PXE for this. I would really recommend booting from a local disk then mounting the cluster FS, unless you _really_ need to implement a single system image. Regards, --Tim _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users