RHEL 4 (CENT OS) Am I waisting my time trying to get the 10G Clusterware installer to use OCFS2 volumes for the voting and OCR disks ? The ocfs2 setup seems happy on both nodes but the 10G installer says the location entered for the oracle cluster registry (OCR) is not shared across all the nodes in the cluster Do the volumes need to mounted ? I did with no change . [root@green rc5.d]# ./S50o2cb status Module "configfs": Loaded Filesystem "configfs": Mounted Module "ocfs2_nodemanager": Loaded Module "ocfs2_dlm": Loaded Module "ocfs2_dlmfs": Loaded Filesystem "ocfs2_dlmfs": Mounted Checking cluster ocfs2: Online Checking heartbeat: Not active [root@pink rc5.d]# ./S50o2cb status Module "configfs": Loaded Filesystem "configfs": Mounted Module "ocfs2_nodemanager": Loaded Module "ocfs2_dlm": Loaded Module "ocfs2_dlmfs": Loaded Filesystem "ocfs2_dlmfs": Mounted Checking cluster ocfs2: Online Checking heartbeat: Not active any thoughts ?
Marcos E. Matsunaga
2005-Sep-23 08:11 UTC
[Ocfs2-users] ocfs2 <-> 10G (10.2.01) Clusterware
Did you format and mount the OCFS2 partitions? What you have is the Cluster Service up (o2cb) only, but no volumes mounted (Checking heartbeat: Not active ). OUI is only detecting a local FS where Oracle will create the OCR/VOTING files. Make sure to mount the filesystem on all nodes and test to see if they are consistently mounted at the same mountpoints by creating a file under the mountpoint and verifying from the other nodes. For example: On Node1: # mount -t ocfs2 /dev/sdxx /ocfs2 # touch /ocfs2/Node1 On Node2: # mount -t ocfs2 /dev/sdxx /ocfs2 # ls -la /ocfs2 << THIS SHOULD SHOW THE "Node1" FILE. IF NOT, CHECK YOUR CONFIGURATION. Regards, Marcos Eduardo Matsunaga Oracle Corporate Architecture - Linux 5955 TG Lee Blvd Email : Marcos.Matsunaga@oracle.com Orlando, FL 32822 Phone : (407)458-1710 Fax : (407)851-9093 A crisis is when you can't say "Let's forget the whole thing." --------------------------------------------------------------------------------------- The statements and opinions expressed here are my own and do not necessarily represent those of Oracle Corporation. John Minson wrote:>RHEL 4 (CENT OS) > >Am I waisting my time trying to get the 10G Clusterware installer to use OCFS2 volumes for the voting and OCR disks ? >The ocfs2 setup seems happy on both nodes but the 10G installer says > >the location entered for the oracle cluster registry (OCR) is not shared across all the nodes in the cluster > >Do the volumes need to mounted ? I did with no change . > >[root@green rc5.d]# ./S50o2cb status >Module "configfs": Loaded >Filesystem "configfs": Mounted >Module "ocfs2_nodemanager": Loaded >Module "ocfs2_dlm": Loaded >Module "ocfs2_dlmfs": Loaded >Filesystem "ocfs2_dlmfs": Mounted >Checking cluster ocfs2: Online >Checking heartbeat: Not active > >[root@pink rc5.d]# ./S50o2cb status >Module "configfs": Loaded >Filesystem "configfs": Mounted >Module "ocfs2_nodemanager": Loaded >Module "ocfs2_dlm": Loaded >Module "ocfs2_dlmfs": Loaded >Filesystem "ocfs2_dlmfs": Mounted >Checking cluster ocfs2: Online >Checking heartbeat: Not active > >any thoughts ? > >_______________________________________________ >Ocfs2-users mailing list >Ocfs2-users@oss.oracle.com >http://oss.oracle.com/mailman/listinfo/ocfs2-users > >-------------- next part -------------- An HTML attachment was scrubbed... URL: http://oss.oracle.com/pipermail/ocfs2-users/attachments/20050923/008150d9/attachment.html
this looks ok to me [root@pink rc5.d]# ./S50o2cb status Module "configfs": Loaded Filesystem "configfs": Mounted Module "ocfs2_nodemanager": Loaded Module "ocfs2_dlm": Loaded Module "ocfs2_dlmfs": Loaded Filesystem "ocfs2_dlmfs": Mounted Checking cluster ocfs2: Online Checking heartbeat: Active [root@pink rc5.d]# mounted.ocfs2 -f Device FS Nodes /dev/sda1 ocfs2 green, pink /dev/sdb1 ocfs2 green, pink /dev/sdc1 ocfs2 Not mounted yet I continue to get the same reply from the installer when I tell it to use /dev/sdb1 as the OCR location .>>> "Marcos E. Matsunaga" <Marcos.Matsunaga@oracle.com> 9/23/2005 9:11:26 AM >>>Did you format and mount the OCFS2 partitions? What you have is the Cluster Service up (o2cb) only, but no volumes mounted (Checking heartbeat: Not active ). OUI is only detecting a local FS where Oracle will create the OCR/VOTING files. Make sure to mount the filesystem on all nodes and test to see if they are consistently mounted at the same mountpoints by creating a file under the mountpoint and verifying from the other nodes. For example: On Node1: # mount -t ocfs2 /dev/sdxx /ocfs2 # touch /ocfs2/Node1 On Node2: # mount -t ocfs2 /dev/sdxx /ocfs2 # ls -la /ocfs2 << THIS SHOULD SHOW THE "Node1" FILE. IF NOT, CHECK YOUR CONFIGURATION. Regards, Marcos Eduardo Matsunaga Oracle Corporate Architecture - Linux 5955 TG Lee Blvd Email : Marcos.Matsunaga@oracle.com Orlando, FL 32822 Phone : (407)458-1710 Fax : (407)851-9093 A crisis is when you can't say "Let's forget the whole thing." --------------------------------------------------------------------------------------- The statements and opinions expressed here are my own and do not necessarily represent those of Oracle Corporation. John Minson wrote:>RHEL 4 (CENT OS) > >Am I waisting my time trying to get the 10G Clusterware installer to use OCFS2 volumes for the voting and OCR disks ? >The ocfs2 setup seems happy on both nodes but the 10G installer says > >the location entered for the oracle cluster registry (OCR) is not shared across all the nodes in the cluster > >Do the volumes need to mounted ? I did with no change . > >[root@green rc5.d]# ./S50o2cb status >Module "configfs": Loaded >Filesystem "configfs": Mounted >Module "ocfs2_nodemanager": Loaded >Module "ocfs2_dlm": Loaded >Module "ocfs2_dlmfs": Loaded >Filesystem "ocfs2_dlmfs": Mounted >Checking cluster ocfs2: Online >Checking heartbeat: Not active > >[root@pink rc5.d]# ./S50o2cb status >Module "configfs": Loaded >Filesystem "configfs": Mounted >Module "ocfs2_nodemanager": Loaded >Module "ocfs2_dlm": Loaded >Module "ocfs2_dlmfs": Loaded >Filesystem "ocfs2_dlmfs": Mounted >Checking cluster ocfs2: Online >Checking heartbeat: Not active > >any thoughts ? > >_______________________________________________ >Ocfs2-users mailing list >Ocfs2-users@oss.oracle.com >http://oss.oracle.com/mailman/listinfo/ocfs2-users > >
the file create worked fine . I'm confused about '/etc/oracle/ocr.loc' . This is a cold install . There are no oracle files on the system .>>> "Marcos E. Matsunaga" <Marcos.Matsunaga@oracle.com> 9/23/2005 9:46:13 AM >>>Can you check if you have the file /etc/oracle/ocr.loc? If so, check if the parameter ocrconfig_loc points to the correct mountpoint. Did you test the file creation on the mountpoint of /dev/sdb1? Regards, Marcos Eduardo Matsunaga Oracle Corporate Architecture - Linux 5955 TG Lee Blvd Email : Marcos.Matsunaga@oracle.com Orlando, FL 32822 Phone : (407)458-1710 Fax : (407)851-9093 A crisis is when you can't say "Let's forget the whole thing." --------------------------------------------------------------------------------------- The statements and opinions expressed here are my own and do not necessarily represent those of Oracle Corporation. John Minson wrote:>this looks ok to me > >[root@pink rc5.d]# ./S50o2cb status >Module "configfs": Loaded >Filesystem "configfs": Mounted >Module "ocfs2_nodemanager": Loaded >Module "ocfs2_dlm": Loaded >Module "ocfs2_dlmfs": Loaded >Filesystem "ocfs2_dlmfs": Mounted >Checking cluster ocfs2: Online >Checking heartbeat: Active > >[root@pink rc5.d]# mounted.ocfs2 -f >Device FS Nodes >/dev/sda1 ocfs2 green, pink >/dev/sdb1 ocfs2 green, pink >/dev/sdc1 ocfs2 Not mounted > >yet I continue to get the same reply from the installer when I tell it to use /dev/sdb1 as the OCR location . > > > > >>>>"Marcos E. Matsunaga" <Marcos.Matsunaga@oracle.com> 9/23/2005 9:11:26 AM >>> >>>> >>>> >Did you format and mount the OCFS2 partitions? > >What you have is the Cluster Service up (o2cb) only, but no volumes >mounted (Checking heartbeat: Not active ). > >OUI is only detecting a local FS where Oracle will create the OCR/VOTING >files. > >Make sure to mount the filesystem on all nodes and test to see if they >are consistently mounted at the same mountpoints by creating a file >under the mountpoint and verifying from the other nodes. > >For example: > >On Node1: > ># mount -t ocfs2 /dev/sdxx /ocfs2 ># touch /ocfs2/Node1 > >On Node2: ># mount -t ocfs2 /dev/sdxx /ocfs2 ># ls -la /ocfs2 << THIS SHOULD SHOW THE "Node1" FILE. IF >NOT, CHECK YOUR CONFIGURATION. > > >Regards, > >Marcos Eduardo Matsunaga > >Oracle >Corporate Architecture - Linux > >5955 TG Lee Blvd Email : Marcos.Matsunaga@oracle.com >Orlando, FL 32822 Phone : (407)458-1710 >Fax : (407)851-9093 > >A crisis is when you can't say "Let's forget the whole thing." >--------------------------------------------------------------------------------------- >The statements and opinions expressed here are my own >and do not necessarily represent those of Oracle Corporation. > > > > >John Minson wrote: > > > >>RHEL 4 (CENT OS) >> >>Am I waisting my time trying to get the 10G Clusterware installer to use OCFS2 volumes for the voting and OCR disks ? >>The ocfs2 setup seems happy on both nodes but the 10G installer says >> >>the location entered for the oracle cluster registry (OCR) is not shared across all the nodes in the cluster >> >>Do the volumes need to mounted ? I did with no change . >> >>[root@green rc5.d]# ./S50o2cb status >>Module "configfs": Loaded >>Filesystem "configfs": Mounted >>Module "ocfs2_nodemanager": Loaded >>Module "ocfs2_dlm": Loaded >>Module "ocfs2_dlmfs": Loaded >>Filesystem "ocfs2_dlmfs": Mounted >>Checking cluster ocfs2: Online >>Checking heartbeat: Not active >> >>[root@pink rc5.d]# ./S50o2cb status >>Module "configfs": Loaded >>Filesystem "configfs": Mounted >>Module "ocfs2_nodemanager": Loaded >>Module "ocfs2_dlm": Loaded >>Module "ocfs2_dlmfs": Loaded >>Filesystem "ocfs2_dlmfs": Mounted >>Checking cluster ocfs2: Online >>Checking heartbeat: Not active >> >>any thoughts ? >> >>_______________________________________________ >>Ocfs2-users mailing list >>Ocfs2-users@oss.oracle.com >>http://oss.oracle.com/mailman/listinfo/ocfs2-users >> >> >> >> > >_______________________________________________ >Ocfs2-users mailing list >Ocfs2-users@oss.oracle.com >http://oss.oracle.com/mailman/listinfo/ocfs2-users > >
Marcos E. Matsunaga
2005-Sep-23 09:17 UTC
[Ocfs2-users] ocfs2 <-> 10G (10.2.01) Clusterware
Ok.. I thought it wasn't a cold install, that's why I asked you to check the /etc/oracle/ocr.loc file. Since it is a cold install, the file should not be there. Here is how it should work. During install, the Oracle Installer will look for the file /etc/oracle/ocr.loc. If it does exist, then it will use it. If it doesn't, you will ask you to inform the location of the OCR and VOTING files during the installation. In this case, if you choose to create the files at /ocfs2 (/dev/sdb1), it will look for the files at the same location on the remote node. If it can't get the results, it will return the error you are getting. One thing that must be working in order for it to work, is ssh. You should be able to ssh to your node and to the remote node without password. If it prompts you for password or it is unable to connect to the remote node, then it may also return the error. Can you send the output of "mount -t ocfs2" from both nodes? Regards, Marcos Eduardo Matsunaga Oracle Corporate Architecture - Linux 5955 TG Lee Blvd Email : Marcos.Matsunaga@oracle.com Orlando, FL 32822 Phone : (407)458-1710 Fax : (407)851-9093 A crisis is when you can't say "Let's forget the whole thing." --------------------------------------------------------------------------------------- The statements and opinions expressed here are my own and do not necessarily represent those of Oracle Corporation. John Minson wrote:>the file create worked fine . >I'm confused about '/etc/oracle/ocr.loc' . This is a cold install . There are no oracle files on the system . > > > >>>>"Marcos E. Matsunaga" <Marcos.Matsunaga@oracle.com> 9/23/2005 9:46:13 AM >>> >>>> >>>> >Can you check if you have the file /etc/oracle/ocr.loc? If so, check if >the parameter ocrconfig_loc points to the correct mountpoint. > >Did you test the file creation on the mountpoint of /dev/sdb1? > >Regards, > >Marcos Eduardo Matsunaga > >Oracle >Corporate Architecture - Linux > >5955 TG Lee Blvd Email : Marcos.Matsunaga@oracle.com >Orlando, FL 32822 Phone : (407)458-1710 >Fax : (407)851-9093 > >A crisis is when you can't say "Let's forget the whole thing." >--------------------------------------------------------------------------------------- >The statements and opinions expressed here are my own >and do not necessarily represent those of Oracle Corporation. > > > > >John Minson wrote: > > > >>this looks ok to me >> >>[root@pink rc5.d]# ./S50o2cb status >>Module "configfs": Loaded >>Filesystem "configfs": Mounted >>Module "ocfs2_nodemanager": Loaded >>Module "ocfs2_dlm": Loaded >>Module "ocfs2_dlmfs": Loaded >>Filesystem "ocfs2_dlmfs": Mounted >>Checking cluster ocfs2: Online >>Checking heartbeat: Active >> >>[root@pink rc5.d]# mounted.ocfs2 -f >>Device FS Nodes >>/dev/sda1 ocfs2 green, pink >>/dev/sdb1 ocfs2 green, pink >>/dev/sdc1 ocfs2 Not mounted >> >>yet I continue to get the same reply from the installer when I tell it to use /dev/sdb1 as the OCR location . >> >> >> >> >> >> >>>>>"Marcos E. Matsunaga" <Marcos.Matsunaga@oracle.com> 9/23/2005 9:11:26 AM >>> >>>>> >>>>> >>>>> >>>>> >>Did you format and mount the OCFS2 partitions? >> >>What you have is the Cluster Service up (o2cb) only, but no volumes >>mounted (Checking heartbeat: Not active ). >> >>OUI is only detecting a local FS where Oracle will create the OCR/VOTING >>files. >> >>Make sure to mount the filesystem on all nodes and test to see if they >>are consistently mounted at the same mountpoints by creating a file >>under the mountpoint and verifying from the other nodes. >> >>For example: >> >>On Node1: >> >># mount -t ocfs2 /dev/sdxx /ocfs2 >># touch /ocfs2/Node1 >> >>On Node2: >># mount -t ocfs2 /dev/sdxx /ocfs2 >># ls -la /ocfs2 << THIS SHOULD SHOW THE "Node1" FILE. IF >>NOT, CHECK YOUR CONFIGURATION. >> >> >>Regards, >> >>Marcos Eduardo Matsunaga >> >>Oracle >>Corporate Architecture - Linux >> >>5955 TG Lee Blvd Email : Marcos.Matsunaga@oracle.com >>Orlando, FL 32822 Phone : (407)458-1710 >>Fax : (407)851-9093 >> >>A crisis is when you can't say "Let's forget the whole thing." >>--------------------------------------------------------------------------------------- >>The statements and opinions expressed here are my own >>and do not necessarily represent those of Oracle Corporation. >> >> >> >> >>John Minson wrote: >> >> >> >> >> >>>RHEL 4 (CENT OS) >>> >>>Am I waisting my time trying to get the 10G Clusterware installer to use OCFS2 volumes for the voting and OCR disks ? >>>The ocfs2 setup seems happy on both nodes but the 10G installer says >>> >>>the location entered for the oracle cluster registry (OCR) is not shared across all the nodes in the cluster >>> >>>Do the volumes need to mounted ? I did with no change . >>> >>>[root@green rc5.d]# ./S50o2cb status >>>Module "configfs": Loaded >>>Filesystem "configfs": Mounted >>>Module "ocfs2_nodemanager": Loaded >>>Module "ocfs2_dlm": Loaded >>>Module "ocfs2_dlmfs": Loaded >>>Filesystem "ocfs2_dlmfs": Mounted >>>Checking cluster ocfs2: Online >>>Checking heartbeat: Not active >>> >>>[root@pink rc5.d]# ./S50o2cb status >>>Module "configfs": Loaded >>>Filesystem "configfs": Mounted >>>Module "ocfs2_nodemanager": Loaded >>>Module "ocfs2_dlm": Loaded >>>Module "ocfs2_dlmfs": Loaded >>>Filesystem "ocfs2_dlmfs": Mounted >>>Checking cluster ocfs2: Online >>>Checking heartbeat: Not active >>> >>>any thoughts ? >>> >>>_______________________________________________ >>>Ocfs2-users mailing list >>>Ocfs2-users@oss.oracle.com >>>http://oss.oracle.com/mailman/listinfo/ocfs2-users >>> >>> >>> >>> >>> >>> >>_______________________________________________ >>Ocfs2-users mailing list >>Ocfs2-users@oss.oracle.com >>http://oss.oracle.com/mailman/listinfo/ocfs2-users >> >> >> >>-------------- next part -------------- An HTML attachment was scrubbed... URL: http://oss.oracle.com/pipermail/ocfs2-users/attachments/20050923/f09939c6/attachment.html
It works now . I tried every thing but . I even 'touched' a file and tried that . I never thought to give the name of a non-existent file. thanks for your help . I have been attempting to get this cw/rac/asm/linux setup to work since Monday and I'm getting a little burned out . John>>> Joel Becker <Joel.Becker@oracle.com> 9/23/2005 10:08:55 AM >>>On Fri, Sep 23, 2005 at 09:37:25AM -0400, John Minson wrote:> [root@pink rc5.d]# mounted.ocfs2 -f > Device FS Nodes > /dev/sda1 ocfs2 green, pink > /dev/sdb1 ocfs2 green, pink > /dev/sdc1 ocfs2 Not mounted > > yet I continue to get the same reply from the installer when I tell it to use /dev/sdb1 as the OCR location .Did you specify "/dev/sdb1" as the OCR location? You cannot specify the physical partition when it is a filesystem! You need to specify a filename inside the mount. That is, if /dev/sdb1 is mounted on /oracle/mount2, you specify the OCR location as /oracle/mount2/ocr. Something like that. Joel -- Life's Little Instruction Book #157 "Take time to smell the roses." Joel Becker Principal Software Developer Oracle E-mail: joel.becker@oracle.com Phone: (650) 506-8127