I used this command to create volume label on OCFS: mkfs.ocfs -F -b 128 -L data13 -m /oradata/data13 -u oracle -g dba -p 0775 /dev/emcpowerp1 emcpowerp is composed of /dev/sdad and /dev/sdk. It seems the above command created the same labels for /dev/emcpowerp1, /dev/sdad1 and /dev/sdk1. But when I tried to mount this ocfs filesystem by label, it gave me the following error. # mount -L data13 /oradata/data13 mount: the label data13 occurs on both /dev/emcpowerp1 and /dev/sdad1 - not mounted Is this a bug? Or does it mean OCFS label would not work for EMC PowerPath devices? Thanks, Hai # powermt display dev=emcpowerp Pseudo name=emcpowerp CLARiiON ID=APM00035004439 [WPProd] Logical device ID=60060160F1D91200FC9395794415DA11 [LUN 619] state=alive; policy=CLAROpt; priority=0; queued-IOs=0 Owner: default=SP A, current=SP A =============================================================================---------------- Host --------------- - Stor - -- I/O Path - -- Stats --- ### HW Path I/O Paths Interf. Mode State Q-IOs Errors ============================================================================= 3 lpfc sdad SP B0 active alive 0 0 1 lpfc sdk SP A0 active alive 0 0
I got the same error also for the following: # mount -t ocfs -L data13 /oradata/data13 mount: the label data13 occurs on both /dev/emcpowerp1 and /dev/sdad1 - not mounted Please help, Hai> -----Original Message----- > From: Wu, Hai > Sent: Wednesday, August 31, 2005 6:42 PM > To: 'ocfs-users@oss.oracle.com' > Subject: problem with OCFS label > > I used this command to create volume label on OCFS: > mkfs.ocfs -F -b 128 -L data13 -m /oradata/data13 -u oracle -g dba -p 0775 /dev/emcpowerp1 > > emcpowerp is composed of /dev/sdad and /dev/sdk. It seems the above command created the same labels for /dev/emcpowerp1, /dev/sdad1 and /dev/sdk1. > > But when I tried to mount this ocfs filesystem by label, it gave me the following error. > # mount -L data13 /oradata/data13 > mount: the label data13 occurs on both /dev/emcpowerp1 and /dev/sdad1 - not mounted > > Is this a bug? Or does it mean OCFS label would not work for EMC PowerPath devices? > Thanks, > Hai > > # powermt display dev=emcpowerp > Pseudo name=emcpowerp > CLARiiON ID=APM00035004439 [WPProd] > Logical device ID=60060160F1D91200FC9395794415DA11 [LUN 619] > state=alive; policy=CLAROpt; priority=0; queued-IOs=0 > Owner: default=SP A, current=SP A > =============================================================================> ---------------- Host --------------- - Stor - -- I/O Path - -- Stats --- > ### HW Path I/O Paths Interf. Mode State Q-IOs Errors > =============================================================================> 3 lpfc sdad SP B0 active alive 0 0 > 1 lpfc sdk SP A0 active alive 0 0 >
On Wed, Aug 31, 2005 at 06:42:20PM -0500, Wu, Hai wrote:> But when I tried to mount this ocfs filesystem by label, it gave me the following error. > # mount -L data13 /oradata/data13 > mount: the label data13 occurs on both /dev/emcpowerp1 and /dev/sdad1 - not mountedThis isn't a bug, this is a common problem with multipath. mount(8) does not know that /dev/emcpowerp1 and /dev/sdad1 are the same drive. So it cannot decide which to use. You must mount by device name in this case. Joel -- "Gone to plant a weeping willow On the bank's green edge it will roll, roll, roll. Sing a lulaby beside the waters. Lovers come and go, the river roll, roll, rolls." Joel Becker Senior Member of Technical Staff Oracle E-mail: joel.becker@oracle.com Phone: (650) 506-8127
Thanks Joel. If I can't use OCFS label, then how can I make sure I am still mounting the same emcpower device if we need to add/remove powerpath LUNs? I know that devlabel would not work in this case. (And IBM this its own way of dealing with this problem, not sure about EMC in this case). Thanks, Hai -----Original Message----- From: Joel Becker [mailto:Joel.Becker@oracle.com] Sent: Wed 8/31/2005 8:28 PM To: Wu, Hai Cc: ocfs-users@oss.oracle.com Subject: Re: [Ocfs-users] problem with OCFS label On Wed, Aug 31, 2005 at 06:42:20PM -0500, Wu, Hai wrote:> But when I tried to mount this ocfs filesystem by label, it gave me the following error. > # mount -L data13 /oradata/data13 > mount: the label data13 occurs on both /dev/emcpowerp1 and /dev/sdad1 - not mountedThis isn't a bug, this is a common problem with multipath. mount(8) does not know that /dev/emcpowerp1 and /dev/sdad1 are the same drive. So it cannot decide which to use. You must mount by device name in this case. Joel -- "Gone to plant a weeping willow On the bank's green edge it will roll, roll, roll. Sing a lulaby beside the waters. Lovers come and go, the river roll, roll, rolls." Joel Becker Senior Member of Technical Staff Oracle E-mail: joel.becker@oracle.com Phone: (650) 506-8127
Raj, I am using PowerPath 4.3.2/RHEL ES3U4/OCFSv1/CX700. For the same node, are you saying I don't need to worry about adding/removing LUNs? I thought the device number would change, say from emcpowerd to emcpowerc, if we were to remove emcpowera. Thanks, Hai -----Original Message----- From: Raj [mailto:sanstorage@gmail.com] Sent: Wed 8/31/2005 10:48 PM To: Wu, Hai Cc: Joel Becker; ocfs-users@oss.oracle.com Subject: Re: [Ocfs-users] problem with OCFS label Wu, OCFS label does not work with EMC powerdevices. EMC powerdevices uses a logical ID number which knows the path to the correct LUNs on the backend. Compare those on each nodes and they will be the same. Do a powermt display dev=all and you find that long number which will be the same across nodes. If you need a consistent look and feel across all the nodes you will need to copy the Powerpath config file across nodes and then reboot. What version of PowerPath are you using? Hope that helps. Raj On 8/31/05, Wu, Hai < hxwu@tribune.com> wrote: Thanks Joel. If I can't use OCFS label, then how can I make sure I am still mounting the same emcpower device if we need to add/remove powerpath LUNs? I know that devlabel would not work in this case. (And IBM this its own way of dealing with this problem, not sure about EMC in this case). Thanks, Hai -----Original Message----- From: Joel Becker [mailto: Joel.Becker@oracle.com] Sent: Wed 8/31/2005 8:28 PM To: Wu, Hai Cc: ocfs-users@oss.oracle.com Subject: Re: [Ocfs-users] problem with OCFS label On Wed, Aug 31, 2005 at 06:42:20PM -0500, Wu, Hai wrote:> But when I tried to mount this ocfs filesystem by label, it gave me the following error. > # mount -L data13 /oradata/data13 > mount: the label data13 occurs on both /dev/emcpowerp1 and /dev/sdad1 - not mountedThis isn't a bug, this is a common problem with multipath. mount(8) does not know that /dev/emcpowerp1 and /dev/sdad1 are the same drive. So it cannot decide which to use. You must mount by device name in this case. Joel -- "Gone to plant a weeping willow On the bank's green edge it will roll, roll, roll. Sing a lulaby beside the waters. Lovers come and go, the river roll, roll, rolls." Joel Becker Senior Member of Technical Staff Oracle E-mail: joel.becker@oracle.com Phone: (650) 506-8127 _______________________________________________ Ocfs-users mailing list Ocfs-users@oss.oracle.com <http://oss.oracle.com/mailman/listinfo/ocfs-users> http://oss.oracle.com/mailman/listinfo/ocfs-users
Can u mount via # mount -t ocfs /dev/emcpowerp1 /oradata/data13 ? Just to see if it will mount w/o spec'ing the label. -----Original Message----- From: ocfs-users-bounces@oss.oracle.com [mailto:ocfs-users-bounces@oss.oracle.com] On Behalf Of Wu, Hai Sent: Wednesday, 31 August, 2005 19.44 To: ocfs-users@oss.oracle.com Subject: [Ocfs-users] RE: problem with OCFS label I got the same error also for the following: # mount -t ocfs -L data13 /oradata/data13 mount: the label data13 occurs on both /dev/emcpowerp1 and /dev/sdad1 - not mounted Please help, Hai> -----Original Message----- > From: Wu, Hai > Sent: Wednesday, August 31, 2005 6:42 PM > To: 'ocfs-users@oss.oracle.com' > Subject: problem with OCFS label > > I used this command to create volume label on OCFS: > mkfs.ocfs -F -b 128 -L data13 -m /oradata/data13 -u oracle -g dba -p0775 /dev/emcpowerp1> > emcpowerp is composed of /dev/sdad and /dev/sdk. It seems the abovecommand created the same labels for /dev/emcpowerp1, /dev/sdad1 and /dev/sdk1.> > But when I tried to mount this ocfs filesystem by label, it gave methe following error.> # mount -L data13 /oradata/data13 > mount: the label data13 occurs on both /dev/emcpowerp1 and /dev/sdad1- not mounted> > Is this a bug? Or does it mean OCFS label would not work for EMCPowerPath devices?> Thanks, > Hai > > # powermt display dev=emcpowerp > Pseudo name=emcpowerp > CLARiiON ID=APM00035004439 [WPProd] > Logical device ID=60060160F1D91200FC9395794415DA11 [LUN 619] > state=alive; policy=CLAROpt; priority=0; queued-IOs=0 > Owner: default=SP A, current=SP A >============================================================================> ---------------- Host --------------- - Stor - -- I/O Path - -- Stats ---> ### HW Path I/O Paths Interf. Mode StateQ-IOs Errors>============================================================================> 3 lpfc sdad SP B0 active alive 0 0> 1 lpfc sdk SP A0 active alive0 0>_______________________________________________ Ocfs-users mailing list Ocfs-users@oss.oracle.com http://oss.oracle.com/mailman/listinfo/ocfs-users
Raj, Thanks. My worry is about the entries in /etc/fstab file. The configuration would be the same across all nodes in the RAC. Say: /dev/emcpowerd /oradata/data3 _netdev, ... If emcpowerd was changed to emcpowerc, then this mounting would fail. We have to manually modify that file then. I want to use LABEL to work around that problem, and I know that won't work now. It seems it has to be done manually. Please let me know if I got it wrong. Your suggestion of copying powerpath config file across nodes is a good one. To do 'powermt save', then copy the file. I am still not sure where that file is at this point. Thanks, Hai -----Original Message----- From: Raj [mailto:sanstorage@gmail.com] Sent: Thu 9/1/2005 7:12 AM To: Wu, Hai Cc: Joel Becker; ocfs-users@oss.oracle.com Subject: Re: [Ocfs-users] problem with OCFS label You would not need to worry about that even if you add/remove LUNs. Powerpath maintains a consistent "Logical device ID" across nodes. Even if your nodes scans the same LUN as say for example empowerc on node1 and emcpowerd on node2, thier Logical device ID will be the same. Hope that helps. Raj On 8/31/05, Wu, Hai < hxwu@tribune.com> wrote: Raj, I am using PowerPath 4.3.2/RHEL ES3U4/OCFSv1/CX700. For the same node, are you saying I don't need to worry about adding/removing LUNs? I thought the device number would change, say from emcpowerd to emcpowerc, if we were to remove emcpowera. Thanks, Hai -----Original Message----- From: Raj [mailto: sanstorage@gmail.com] Sent: Wed 8/31/2005 10:48 PM To: Wu, Hai Cc: Joel Becker; ocfs-users@oss.oracle.com Subject: Re: [Ocfs-users] problem with OCFS label Wu, OCFS label does not work with EMC powerdevices. EMC powerdevices uses a logical ID number which knows the path to the correct LUNs on the backend. Compare those on each nodes and they will be the same. Do a powermt display dev=all and you find that long number which will be the same across nodes. If you need a consistent look and feel across all the nodes you will need to copy the Powerpath config file across nodes and then reboot. What version of PowerPath are you using? Hope that helps. Raj On 8/31/05, Wu, Hai < hxwu@tribune.com> wrote: Thanks Joel. If I can't use OCFS label, then how can I make sure I am still mounting the same emcpower device if we need to add/remove powerpath LUNs? I know that devlabel would not work in this case. (And IBM this its own way of dealing with this problem, not sure about EMC in this case). Thanks, Hai -----Original Message----- From: Joel Becker [mailto: Joel.Becker@oracle.com] Sent: Wed 8/31/2005 8:28 PM To: Wu, Hai Cc: ocfs-users@oss.oracle.com Subject: Re: [Ocfs-users] problem with OCFS label On Wed, Aug 31, 2005 at 06:42:20PM -0500, Wu, Hai wrote:> But when I tried to mount this ocfs filesystem by label, it gave me the following error. > # mount -L data13 /oradata/data13 > mount: the label data13 occurs on both /dev/emcpowerp1 and /dev/sdad1 - not mountedThis isn't a bug, this is a common problem with multipath. mount(8) does not know that /dev/emcpowerp1 and /dev/sdad1 are the same drive. So it cannot decide which to use. You must mount by device name in this case. Joel -- "Gone to plant a weeping willow On the bank's green edge it will roll, roll, roll. Sing a lulaby beside the waters. Lovers come and go, the river roll, roll, rolls." Joel Becker Senior Member of Technical Staff Oracle E-mail: joel.becker@oracle.com Phone: (650) 506-8127 _______________________________________________ Ocfs-users mailing list Ocfs-users@oss.oracle.com < <http://oss.oracle.com/mailman/listinfo/ocfs-users> http://oss.oracle.com/mailman/listinfo/ocfs-users> http://oss.oracle.com/mailman/listinfo/ocfs-users
It will work w/o specifying the label. I just want to try to use LABEL as a workaround for device name/number changes if adding/removing LUNs. Thanks, Hai -----Original Message----- From: Clarke Thomas [mailto:Clarke@houghtonintl.com] Sent: Thu 9/1/2005 7:50 AM To: ocfs-users@oss.oracle.com Cc: Subject: RE: [Ocfs-users] RE: problem with OCFS label Can u mount via # mount -t ocfs /dev/emcpowerp1 /oradata/data13 ? Just to see if it will mount w/o spec'ing the label. -----Original Message----- From: ocfs-users-bounces@oss.oracle.com [mailto:ocfs-users-bounces@oss.oracle.com] On Behalf Of Wu, Hai Sent: Wednesday, 31 August, 2005 19.44 To: ocfs-users@oss.oracle.com Subject: [Ocfs-users] RE: problem with OCFS label I got the same error also for the following: # mount -t ocfs -L data13 /oradata/data13 mount: the label data13 occurs on both /dev/emcpowerp1 and /dev/sdad1 - not mounted Please help, Hai> -----Original Message----- > From: Wu, Hai > Sent: Wednesday, August 31, 2005 6:42 PM > To: 'ocfs-users@oss.oracle.com' > Subject: problem with OCFS label > > I used this command to create volume label on OCFS: > mkfs.ocfs -F -b 128 -L data13 -m /oradata/data13 -u oracle -g dba -p0775 /dev/emcpowerp1> > emcpowerp is composed of /dev/sdad and /dev/sdk. It seems the abovecommand created the same labels for /dev/emcpowerp1, /dev/sdad1 and /dev/sdk1.> > But when I tried to mount this ocfs filesystem by label, it gave methe following error.> # mount -L data13 /oradata/data13 > mount: the label data13 occurs on both /dev/emcpowerp1 and /dev/sdad1- not mounted> > Is this a bug? Or does it mean OCFS label would not work for EMCPowerPath devices?> Thanks, > Hai > > # powermt display dev=emcpowerp > Pseudo name=emcpowerp > CLARiiON ID=APM00035004439 [WPProd] > Logical device ID=60060160F1D91200FC9395794415DA11 [LUN 619] > state=alive; policy=CLAROpt; priority=0; queued-IOs=0 > Owner: default=SP A, current=SP A >============================================================================> ---------------- Host --------------- - Stor - -- I/O Path - -- Stats ---> ### HW Path I/O Paths Interf. Mode StateQ-IOs Errors>============================================================================> 3 lpfc sdad SP B0 active alive 0 0> 1 lpfc sdk SP A0 active alive0 0>_______________________________________________ Ocfs-users mailing list Ocfs-users@oss.oracle.com http://oss.oracle.com/mailman/listinfo/ocfs-users _______________________________________________ Ocfs-users mailing list Ocfs-users@oss.oracle.com http://oss.oracle.com/mailman/listinfo/ocfs-users
That's a good one. I will do that. Thanks! Hai -----Original Message----- From: Raj [mailto:sanstorage@gmail.com] Sent: Thursday, September 01, 2005 6:25 PM To: Wu, Hai Cc: Clarke Thomas; ocfs-users@oss.oracle.com Subject: Re: [Ocfs-users] RE: problem with OCFS label Wu, Before you do this make a BACKUP and save the Powerpath config files!!! IIMPORTANT! If you are using EMC PowerPath 4.3.2 you can try to copy the following files across nodes in /etc/ -rw-r--r-- 1 root root 16384 Sep 1 18:59 /etc/emcp_devicesDB.dat -rw-r--r-- 1 root root 4096 Sep 1 18:59 /etc/emcp_devicesDB.idx Hope that helps. Raj On 9/1/05, Wu, Hai < hxwu@tribune.com> wrote: It will work w/o specifying the label. I just want to try to use LABEL as a workaround for device name/number changes if adding/removing LUNs. Thanks, Hai -----Original Message----- From: Clarke Thomas [mailto: Clarke@houghtonintl.com <mailto:Clarke@houghtonintl.com> ] Sent: Thu 9/1/2005 7:50 AM To: ocfs-users@oss.oracle.com Cc: Subject: RE: [Ocfs-users] RE: problem with OCFS label Can u mount via # mount -t ocfs /dev/emcpowerp1 /oradata/data13 ? Just to see if it will mount w/o spec'ing the label. -----Original Message----- From: ocfs-users-bounces@oss.oracle.com [mailto: <mailto:ocfs-users-bounces@oss.oracle.com> ocfs-users-bounces@oss.oracle.com] On Behalf Of Wu, Hai Sent: Wednesday, 31 August, 2005 19.44 To: ocfs-users@oss.oracle.com Subject: [Ocfs-users] RE: problem with OCFS label I got the same error also for the following: # mount -t ocfs -L data13 /oradata/data13 mount: the label data13 occurs on both /dev/emcpowerp1 and /dev/sdad1 - not mounted Please help, Hai> -----Original Message----- > From: Wu, Hai > Sent: Wednesday, August 31, 2005 6:42 PM > To: ' ocfs-users@oss.oracle.com' > Subject: problem with OCFS label > > I used this command to create volume label on OCFS: > mkfs.ocfs -F -b 128 -L data13 -m /oradata/data13 -u oracle -g dba -p0775 /dev/emcpowerp1> > emcpowerp is composed of /dev/sdad and /dev/sdk. It seems the abovecommand created the same labels for /dev/emcpowerp1, /dev/sdad1 and /dev/sdk1.> > But when I tried to mount this ocfs filesystem by label, it gave methe following error.> # mount -L data13 /oradata/data13 > mount: the label data13 occurs on both /dev/emcpowerp1 and /dev/sdad1- not mounted> > Is this a bug? Or does it mean OCFS label would not work for EMCPowerPath devices?> Thanks, > Hai > > # powermt display dev=emcpowerp > Pseudo name=emcpowerp > CLARiiON ID=APM00035004439 [WPProd] > Logical device ID=60060160F1D91200FC9395794415DA11 [LUN 619] > state=alive; policy=CLAROpt; priority=0; queued-IOs=0 > Owner: default=SP A, current=SP A >============================================================================> ---------------- Host --------------- - Stor - -- I/O Path - -- Stats ---> ### HW Path I/O Paths Interf. Mode StateQ-IOs Errors>============================================================================> 3 lpfc sdad SP B0 active alive 0 0> 1 lpfc sdk SP A0 active alive0 0>_______________________________________________ Ocfs-users mailing list Ocfs-users@oss.oracle.com http://oss.oracle.com/mailman/listinfo/ocfs-users _______________________________________________ Ocfs-users mailing list Ocfs-users@oss.oracle.com http://oss.oracle.com/mailman/listinfo/ocfs-users _______________________________________________ Ocfs-users mailing list Ocfs-users@oss.oracle.com http://oss.oracle.com/mailman/listinfo/ocfs-users -------------- next part -------------- An HTML attachment was scrubbed... URL: http://oss.oracle.com/pipermail/ocfs-users/attachments/20050901/d8891f89/attachment.html