Vanaclocha Llorens, Jose Lorenzo
2006-Mar-10 12:00 UTC
[Ocfs2-users] Add a new node to ocfs cluster
Hi everybody, My problem is that I want to add a new node to an existing RAC with ocfs2, without stop the database. If I add a new node to an existing ocfs cluster, do I need to stop the ocfs in the others nodes of the cluster? I've tried to do it without stop the ocfs in the others nodes but I get the following error: ------------------------------------------------------------------------------------------------------------------------------------------------------------------ [root at raclab3 ~]# mount.ocfs2 /dev/mapper/eva_d1 /u01/app/oracle mount.ocfs2: Transport endpoint is not connected while mounting /dev/mapper/eva_d1 on /u01/app/oracle ------------------------------------------------------------------------------------------------------------------------------------------------------------------ I've three nodes: raclab3, raclab4 and raclab5. I'm trying to add raclab3 to the existing cluster formed by raclab4 and raclab5. In the raclab3 I have the following folder: ------------------------------------------------------------------------------------------------------------------------------------------------------------------ [root at raclab3 ~]# ls -l /config/cluster/ocfs2/node/ total 0 drwxr-xr-x 2 root root 0 Mar 10 11:53 raclab3 drwxr-xr-x 2 root root 0 Mar 10 11:47 raclab4 drwxr-xr-x 2 root root 0 Mar 10 11:47 raclab5 ------------------------------------------------------------------------------------------------------------------------------------------------------------------ But in the raclab4 and raclab5 I have: ------------------------------------------------------------------------------------------------------------------------------------------------------------------ [root at raclab5 ~]# ls -l /config/cluster/ocfs2/node/ total 0 drwxr-xr-x 2 root root 0 Mar 10 12:47 raclab4 drwxr-xr-x 2 root root 0 Mar 10 12:47 raclab5 ------------------------------------------------------------------------------------------------------------------------------------------------------------------ If I execute in both nodes: ------------------------------------------------------------------------------------------------------------------------------------------------------------------ [root at raclab5 ~]# /etc/init.d/o2cb disable Writing O2CB configuration: OK [root at raclab5 ~]# /etc/init.d/o2cb enable Writing O2CB configuration: OK Loading module "configfs": OK Mounting configfs filesystem at /config: OK Loading module "ocfs2_nodemanager": OK Loading module "ocfs2_dlm": OK Loading module "ocfs2_dlmfs": OK Mounting ocfs2_dlmfs filesystem at /dlm: OK Starting cluster ocfs2: OK ------------------------------------------------------------------------------------------------------------------------------------------------------------------ I get information of raclab3: ------------------------------------------------------------------------------------------------------------------------------------------------------------------ [root at raclab5 ~]# ls -l /config/cluster/ocfs2/node/ total 0 drwxr-xr-x 2 root root 0 Mar 10 12:51 raclab3 drwxr-xr-x 2 root root 0 Mar 10 12:51 raclab4 drwxr-xr-x 2 root root 0 Mar 10 12:51 raclab5 ------------------------------------------------------------------------------------------------------------------------------------------------------------------ And finally I can mount my file system in the raclab3 node. Summarizing, is it possible to add a new node without stop the ocfs in all the cluster nodes? Any help or comment will be welcome. Best regards, Lloren? -------------- next part -------------- An HTML attachment was scrubbed... URL: http://oss.oracle.com/pipermail/ocfs2-users/attachments/20060310/6bf65e67/attachment.html
One can add nodes dynamically. Run ocfs2console on all existing nodes to add the new node. Note adding on one and propagating to others will not work. One needs to add on each active node via ocfs2console. Once added, the new node should show up in /config/cluster/<clustername>/nodes. Ensure you see the new node on all active nodes. Then copy the updated cluster.conf to the new node and start the cluster and mount. Vanaclocha Llorens, Jose Lorenzo wrote:> > Hi everybody, > > My problem is that I want to add a new node to an existing RAC with > ocfs2, without stop the database. > > If I add a new node to an existing ocfs cluster, do I need to stop the > ocfs in the others nodes of the cluster? > > I?ve tried to do it without stop the ocfs in the others nodes but I > get the following error: > > ------------------------------------------------------------------------------------------------------------------------------------------------------------------ > > [root at raclab3 ~]# mount.ocfs2 /dev/mapper/eva_d1 /u01/app/oracle > > mount.ocfs2: Transport endpoint is not connected while mounting > /dev/mapper/eva_d1 on /u01/app/oracle > > ------------------------------------------------------------------------------------------------------------------------------------------------------------------ > > I?ve three nodes: raclab3, raclab4 and raclab5. I?m trying to add > raclab3 to the existing cluster formed by raclab4 and raclab5. > > In the raclab3 I have the following folder: > > ------------------------------------------------------------------------------------------------------------------------------------------------------------------ > > [root at raclab3 ~]# ls -l /config/cluster/ocfs2/node/ > > total 0 > > drwxr-xr-x 2 root root 0 Mar 10 11:53 raclab3 > > drwxr-xr-x 2 root root 0 Mar 10 11:47 raclab4 > > drwxr-xr-x 2 root root 0 Mar 10 11:47 raclab5 > > ------------------------------------------------------------------------------------------------------------------------------------------------------------------ > > But in the raclab4 and raclab5 I have: > > ------------------------------------------------------------------------------------------------------------------------------------------------------------------ > > [root at raclab5 ~]# ls -l /config/cluster/ocfs2/node/ > > total 0 > > drwxr-xr-x 2 root root 0 Mar 10 12:47 raclab4 > > drwxr-xr-x 2 root root 0 Mar 10 12:47 raclab5 > > ------------------------------------------------------------------------------------------------------------------------------------------------------------------ > > If I execute in both nodes: > > ------------------------------------------------------------------------------------------------------------------------------------------------------------------ > > [root at raclab5 ~]# /etc/init.d/o2cb disable > > Writing O2CB configuration: OK > > [root at raclab5 ~]# /etc/init.d/o2cb enable > > Writing O2CB configuration: OK > > Loading module "configfs": OK > > Mounting configfs filesystem at /config: OK > > Loading module "ocfs2_nodemanager": OK > > Loading module "ocfs2_dlm": OK > > Loading module "ocfs2_dlmfs": OK > > Mounting ocfs2_dlmfs filesystem at /dlm: OK > > Starting cluster ocfs2: OK > > ------------------------------------------------------------------------------------------------------------------------------------------------------------------ > > I get information of raclab3: > > ------------------------------------------------------------------------------------------------------------------------------------------------------------------ > > [root at raclab5 ~]# ls -l /config/cluster/ocfs2/node/ > > total 0 > > drwxr-xr-x 2 root root 0 Mar 10 12:51 raclab3 > > drwxr-xr-x 2 root root 0 Mar 10 12:51 raclab4 > > drwxr-xr-x 2 root root 0 Mar 10 12:51 raclab5 > > ------------------------------------------------------------------------------------------------------------------------------------------------------------------ > > And finally I can mount my file system in the raclab3 node. > > Summarizing, is it possible to add a new node without stop the ocfs in > all the cluster nodes? > > Any help or comment will be welcome. > > Best regards, > > Lloren? > > ------------------------------------------------------------------------ > > _______________________________________________ > Ocfs2-users mailing list > Ocfs2-users at oss.oracle.com > http://oss.oracle.com/mailman/listinfo/ocfs2-users >
I saw this error recently when I tried to use two IP addresses on each machine on the private interconnect. I got past it by using only one NIC card/address on the P-I on each node. -------------- next part -------------- An HTML attachment was scrubbed... URL: http://oss.oracle.com/pipermail/ocfs2-users/attachments/20060312/ab0e3cce/attachment.html
Vanaclocha Llorens, Jose Lorenzo
2006-Mar-13 10:53 UTC
[Ocfs2-users] Add a new node to ocfs cluster
Many thanks for your help Sunil. One more question my final intention is to do it in a silent mode. Can the ocfs2console step be replaced with a sequence of commands? I mean, my final goal is add a node to an existing Oracle RAC automatically. Do you think that it is possible from the ocfs perspective? Best regards, Lloren? Vanaclocha -----Mensaje original----- De: Sunil Mushran [mailto:Sunil.Mushran at oracle.com] Enviado el: s?bado, 11 de marzo de 2006 0:29 Para: Vanaclocha Llorens, Jose Lorenzo CC: ocfs2-users at oss.oracle.com Asunto: Re: [Ocfs2-users] Add a new node to ocfs cluster One can add nodes dynamically. Run ocfs2console on all existing nodes to add the new node. Note adding on one and propagating to others will not work. One needs to add on each active node via ocfs2console. Once added, the new node should show up in /config/cluster/<clustername>/nodes. Ensure you see the new node on all active nodes. Then copy the updated cluster.conf to the new node and start the cluster and mount. Vanaclocha Llorens, Jose Lorenzo wrote:> > Hi everybody, > > My problem is that I want to add a new node to an existing RAC with > ocfs2, without stop the database. > > If I add a new node to an existing ocfs cluster, do I need to stop the > ocfs in the others nodes of the cluster? > > I've tried to do it without stop the ocfs in the others nodes but I > get the following error: > > ------------------------------------------------------------------------------------------------------------------------------------------------------------------ > > [root at raclab3 ~]# mount.ocfs2 /dev/mapper/eva_d1 /u01/app/oracle > > mount.ocfs2: Transport endpoint is not connected while mounting > /dev/mapper/eva_d1 on /u01/app/oracle > > ------------------------------------------------------------------------------------------------------------------------------------------------------------------ > > I've three nodes: raclab3, raclab4 and raclab5. I'm trying to add > raclab3 to the existing cluster formed by raclab4 and raclab5. > > In the raclab3 I have the following folder: > > ------------------------------------------------------------------------------------------------------------------------------------------------------------------ > > [root at raclab3 ~]# ls -l /config/cluster/ocfs2/node/ > > total 0 > > drwxr-xr-x 2 root root 0 Mar 10 11:53 raclab3 > > drwxr-xr-x 2 root root 0 Mar 10 11:47 raclab4 > > drwxr-xr-x 2 root root 0 Mar 10 11:47 raclab5 > > ------------------------------------------------------------------------------------------------------------------------------------------------------------------ > > But in the raclab4 and raclab5 I have: > > ------------------------------------------------------------------------------------------------------------------------------------------------------------------ > > [root at raclab5 ~]# ls -l /config/cluster/ocfs2/node/ > > total 0 > > drwxr-xr-x 2 root root 0 Mar 10 12:47 raclab4 > > drwxr-xr-x 2 root root 0 Mar 10 12:47 raclab5 > > ------------------------------------------------------------------------------------------------------------------------------------------------------------------ > > If I execute in both nodes: > > ------------------------------------------------------------------------------------------------------------------------------------------------------------------ > > [root at raclab5 ~]# /etc/init.d/o2cb disable > > Writing O2CB configuration: OK > > [root at raclab5 ~]# /etc/init.d/o2cb enable > > Writing O2CB configuration: OK > > Loading module "configfs": OK > > Mounting configfs filesystem at /config: OK > > Loading module "ocfs2_nodemanager": OK > > Loading module "ocfs2_dlm": OK > > Loading module "ocfs2_dlmfs": OK > > Mounting ocfs2_dlmfs filesystem at /dlm: OK > > Starting cluster ocfs2: OK > > ------------------------------------------------------------------------------------------------------------------------------------------------------------------ > > I get information of raclab3: > > ------------------------------------------------------------------------------------------------------------------------------------------------------------------ > > [root at raclab5 ~]# ls -l /config/cluster/ocfs2/node/ > > total 0 > > drwxr-xr-x 2 root root 0 Mar 10 12:51 raclab3 > > drwxr-xr-x 2 root root 0 Mar 10 12:51 raclab4 > > drwxr-xr-x 2 root root 0 Mar 10 12:51 raclab5 > > ------------------------------------------------------------------------------------------------------------------------------------------------------------------ > > And finally I can mount my file system in the raclab3 node. > > Summarizing, is it possible to add a new node without stop the ocfs in > all the cluster nodes? > > Any help or comment will be welcome. > > Best regards, > > Lloren? > > ------------------------------------------------------------------------ > > _______________________________________________ > Ocfs2-users mailing list > Ocfs2-users at oss.oracle.com > http://oss.oracle.com/mailman/listinfo/ocfs2-users >
Vanaclocha Llorens, Jose Lorenzo
2006-Mar-14 19:17 UTC
[Ocfs2-users] Add a new node to ocfs cluster
I'm sorry Sunil, but does it work only for add nodes? When we try to remove we get: ------------------------------------------------------------ [root at raclab5 ~]# o2cb_ctl -D -n raclab3 -u o2cb_ctl: Not yet supported ------------------------------------------------------------ Best regards, Lloren? Vanaclocha -----Mensaje original----- De: Sunil Mushran [mailto:Sunil.Mushran at oracle.com] Enviado el: lunes, 13 de marzo de 2006 19:20 Para: Vanaclocha Llorens, Jose Lorenzo CC: ocfs2-users at oss.oracle.com Asunto: Re: [Ocfs2-users] Add a new node to ocfs cluster o2cb_ctl -C -n <hostname> -t node -a cluster=<clustername> -a ip_address=<ip> -a ip_port=<port> -a number=<nodenum> -i For e.g. # o2cb_ctl -C -n node99 -t node -a cluster=clus5 -a ip_address=192.168.0.99 -a ip_port=7777 -a number=99 -i Refer "man o2cb_ctl" for more details. Vanaclocha Llorens, Jose Lorenzo wrote:> Many thanks for your help Sunil. One more question my final intention is to do it in a silent mode. Can the ocfs2console step be replaced with a sequence of commands? > > I mean, my final goal is add a node to an existing Oracle RAC automatically. Do you think that it is possible from the ocfs perspective? > > Best regards, > > > Lloren? Vanaclocha > > > -----Mensaje original----- > De: Sunil Mushran [mailto:Sunil.Mushran at oracle.com] > Enviado el: s?bado, 11 de marzo de 2006 0:29 > Para: Vanaclocha Llorens, Jose Lorenzo > CC: ocfs2-users at oss.oracle.com > Asunto: Re: [Ocfs2-users] Add a new node to ocfs cluster > > One can add nodes dynamically. Run ocfs2console on > all existing nodes to add the new node. Note adding on > one and propagating to others will not work. One needs > to add on each active node via ocfs2console. > > Once added, the new node should show up in > /config/cluster/<clustername>/nodes. Ensure you see the > new node on all active nodes. > > Then copy the updated cluster.conf to the new node and > start the cluster and mount. > > Vanaclocha Llorens, Jose Lorenzo wrote: > >> Hi everybody, >> >> My problem is that I want to add a new node to an existing RAC with >> ocfs2, without stop the database. >> >> If I add a new node to an existing ocfs cluster, do I need to stop the >> ocfs in the others nodes of the cluster? >> >> I've tried to do it without stop the ocfs in the others nodes but I >> get the following error: >> >> ------------------------------------------------------------------------------------------------------------------------------------------------------------------ >> >> [root at raclab3 ~]# mount.ocfs2 /dev/mapper/eva_d1 /u01/app/oracle >> >> mount.ocfs2: Transport endpoint is not connected while mounting >> /dev/mapper/eva_d1 on /u01/app/oracle >> >> ------------------------------------------------------------------------------------------------------------------------------------------------------------------ >> >> I've three nodes: raclab3, raclab4 and raclab5. I'm trying to add >> raclab3 to the existing cluster formed by raclab4 and raclab5. >> >> In the raclab3 I have the following folder: >> >> ------------------------------------------------------------------------------------------------------------------------------------------------------------------ >> >> [root at raclab3 ~]# ls -l /config/cluster/ocfs2/node/ >> >> total 0 >> >> drwxr-xr-x 2 root root 0 Mar 10 11:53 raclab3 >> >> drwxr-xr-x 2 root root 0 Mar 10 11:47 raclab4 >> >> drwxr-xr-x 2 root root 0 Mar 10 11:47 raclab5 >> >> ------------------------------------------------------------------------------------------------------------------------------------------------------------------ >> >> But in the raclab4 and raclab5 I have: >> >> ------------------------------------------------------------------------------------------------------------------------------------------------------------------ >> >> [root at raclab5 ~]# ls -l /config/cluster/ocfs2/node/ >> >> total 0 >> >> drwxr-xr-x 2 root root 0 Mar 10 12:47 raclab4 >> >> drwxr-xr-x 2 root root 0 Mar 10 12:47 raclab5 >> >> ------------------------------------------------------------------------------------------------------------------------------------------------------------------ >> >> If I execute in both nodes: >> >> ------------------------------------------------------------------------------------------------------------------------------------------------------------------ >> >> [root at raclab5 ~]# /etc/init.d/o2cb disable >> >> Writing O2CB configuration: OK >> >> [root at raclab5 ~]# /etc/init.d/o2cb enable >> >> Writing O2CB configuration: OK >> >> Loading module "configfs": OK >> >> Mounting configfs filesystem at /config: OK >> >> Loading module "ocfs2_nodemanager": OK >> >> Loading module "ocfs2_dlm": OK >> >> Loading module "ocfs2_dlmfs": OK >> >> Mounting ocfs2_dlmfs filesystem at /dlm: OK >> >> Starting cluster ocfs2: OK >> >> ------------------------------------------------------------------------------------------------------------------------------------------------------------------ >> >> I get information of raclab3: >> >> ------------------------------------------------------------------------------------------------------------------------------------------------------------------ >> >> [root at raclab5 ~]# ls -l /config/cluster/ocfs2/node/ >> >> total 0 >> >> drwxr-xr-x 2 root root 0 Mar 10 12:51 raclab3 >> >> drwxr-xr-x 2 root root 0 Mar 10 12:51 raclab4 >> >> drwxr-xr-x 2 root root 0 Mar 10 12:51 raclab5 >> >> ------------------------------------------------------------------------------------------------------------------------------------------------------------------ >> >> And finally I can mount my file system in the raclab3 node. >> >> Summarizing, is it possible to add a new node without stop the ocfs in >> all the cluster nodes? >> >> Any help or comment will be welcome. >> >> Best regards, >> >> Lloren? >> >> ------------------------------------------------------------------------ >> >> _______________________________________________ >> Ocfs2-users mailing list >> Ocfs2-users at oss.oracle.com >> http://oss.oracle.com/mailman/listinfo/ocfs2-users >> >>
File a feature request via bugzilla... http://oss.oracle.com/bugzilla Priority for any feature depends largely on user interest. http://www.unicom.com/pw/reply-to-harmful.html :) Brian Long wrote:> On Tue, 2006-03-14 at 11:28 -0800, Sunil Mushran wrote: > >> The o2cb cluster stack currently only allows adding new nodes >> dynamically. All other ops, modify/del, require the cluster to be down. >> > > Is there a list of feature requests being serviced by Oracle OCFS > developers? Is this on the list? Is there a time frame where we can > expect this to be released? > > Also, is there a reason this list does not set the "reply-to" field back > to the list? :) > > /Brian/ > >