Ocfs2 users - May 2009 - another node is heartbeating in our slot

Hi members,
Newbie. Help pls.

My setup:
system 1: opensuse 11.1 with iscsitarget (secondary hard drive with
logical volume) + ocfs2
system 2: opensuse 11.1 with open-iscsi (detects the logical volume on
system 1) + ocfs2

1) mount -t ocfs /dev/sdb /u01/oradata/orcl  (on system 2) i have this
entry made to /etc/fstab as well as /etc/init.d/boot.local but the
detection of logical volume /dev/sdb during bootup takes place after
the mount commands have surpassed and hence the mount fails. Are there
any other options other than for manual mount after logon ?

2) once i manually mount /dev/sdb on system 2 with mount -t ocfs
/dev/sdb /u01/oradata/orcl i receive the following error on system 1:
another node is heartbeating in our slot error.

Any help is greatly appreicated.

Additional info:
On my earlier attempts with other Linux OS namely ubuntu 8.10, the
configuration was:

system 1: Ubuntu 8.10 with iscsitarget (secondary hard drive with
logical volume) + open-iscsi (initiator) + ocfs2
system 2: Ubuntu 8.10 with open-iscsi (initiator detects the logical
volume on system 1) + ocfs2

But with Opensuse 11.1(on system 1) , as soon as i create a logical
volume, it is automatically detected as /dev/dm-0 on system 1 (no need
to install open-iscsi initiator)

It looks like i have a similar situation as the link below:

http://oss.oracle.com/pipermail/ocfs2-users/2008-January/002328.html

On this post to the mailing list, Sunil Mushran states "You cannot
mount it simultaneously on a iscsi target (host) and a iscsi
node"

Could someone enlighten me if this is true with my case as well.
Thanks in advance.

On Tue, May 5, 2009 at 3:53 PM, sundar mahadevan
<sundarmahadevan82 at gmail.com> wrote:
> Hi members,
> Newbie. Help pls.
>
> My setup:
> system 1: opensuse 11.1 with iscsitarget (secondary hard drive with
> logical volume) + ocfs2
> system 2: opensuse 11.1 with open-iscsi (detects the logical volume on
> system 1) + ocfs2
>
> 1) mount -t ocfs /dev/sdb /u01/oradata/orcl ?(on system 2) i have this
> entry made to /etc/fstab as well as /etc/init.d/boot.local but the
> detection of logical volume /dev/sdb during bootup takes place after
> the mount commands have surpassed and hence the mount fails. Are there
> any other options other than for manual mount after logon ?
>
> 2) once i manually mount /dev/sdb on system 2 with mount -t ocfs
> /dev/sdb /u01/oradata/orcl i receive the following error on system 1:
> another node is heartbeating in our slot error.
>
> Any help is greatly appreicated.
>

Hi sundar,

sundar mahadevan wrote:
> Hi members,
> Newbie. Help pls.
> 
> My setup:
> system 1: opensuse 11.1 with iscsitarget (secondary hard drive with
> logical volume) + ocfs2
> system 2: opensuse 11.1 with open-iscsi (detects the logical volume on
> system 1) + ocfs2
> 
> 1) mount -t ocfs /dev/sdb /u01/oradata/orcl  (on system 2) i have this
> entry made to /etc/fstab as well as /etc/init.d/boot.local but the
> detection of logical volume /dev/sdb during bootup takes place after
> the mount commands have surpassed and hence the mount fails. Are there
> any other options other than for manual mount after logon ?
> 
> 2) once i manually mount /dev/sdb on system 2 with mount -t ocfs
> /dev/sdb /u01/oradata/orcl i receive the following error on system 1:
> another node is heartbeating in our slot error.
I would guess that the volume was already mounted in system 1, right? So
What is your cluster.conf looks like? Does the 2 nodes knows each other?

Regards,
Tao

Hi.

I too had the same problem.

But through a random google searching one day I discovered that Mark Fasesh
had pointed out the following:
> Yes. The node you export the iscsi drive (your iscsi target, or
'san' in
> this example) can not run ocfs2 on that drive alongside other nodes who
have
> it mounted via the iscsi client. This is a limitation in that the iscsi
> target does not share the same pages against the iscsi device and the
block
> device.
http://oss.oracle.com/pipermail/ocfs2-users/2006-December/001146.html

A reply suggested that you could mount the iscsi disk by using an initiator
and target on the same machine. Then mount it from the 2nd also.
I have found this to work.
And have been able to have drbd on 2 machines, and iscsi export the disk to
a third machine. The 3 nodes work seemingly fine.


But am having other iscsi issues preventing me from using it in a production
environment.
I have found that if the iscsi target goes missing during the initiator's
mid write, the initiator experiences soft lockups and never recovers. Even
in a multipath environment.
Does anyone here have any ideas to solving this?

I was about 5mins away from posting on the open-iscsi forum to see what
anyone says, when I saw your email in this thread.


> Subject: [Ocfs2-users] another node is heartbeating in our slot
> 
> Hi members,
> Newbie. Help pls.
> 
> My setup:
> system 1: opensuse 11.1 with iscsitarget (secondary hard drive with
> logical volume) + ocfs2
> system 2: opensuse 11.1 with open-iscsi (detects the logical volume on
> system 1) + ocfs2
> 
> 1) mount -t ocfs /dev/sdb /u01/oradata/orcl  (on system 2) i have this
> entry made to /etc/fstab as well as /etc/init.d/boot.local but the
> detection of logical volume /dev/sdb during bootup takes place after
> the mount commands have surpassed and hence the mount fails. Are there
> any other options other than for manual mount after logon ?
> 
> 2) once i manually mount /dev/sdb on system 2 with mount -t ocfs
> /dev/sdb /u01/oradata/orcl i receive the following error on system 1:
> another node is heartbeating in our slot error.
> 
> Any help is greatly appreicated.
> 
Andy..