Ocfs2 users - Oct 2010 - OCFS2 + iscsi: another node is heartbeating in our slot (over scst)

Hi,

I'm building a cluster containing two nodes with seperate common storage 
server.
On storage server i have volume with ocfs2 fs which is sharing this 
volume via iscsi target.

When node connected to the target i can local mount volume on node and 
using it.

Unfortunately. on storage server ocfs2 logged to dmesg:

Oct 19 22:21:02 storage kernel: [ 1510.424144] 
(o2hb-2283B3335E,4427,0):o2hb_do_disk_heartbeat:770 ERROR: Device 
"sda1": another node is heartbeating in our slot!
Oct 19 22:21:02 storage kernel: [ 1510.428600] o2net: connection to node 
node-2 (num 0) at 192.168.1.69:7777 shutdown, state 7
.
.
Oct 19 22:21:32 storage kernel: [ 1540.448016] 
(o2net,4404,0):o2net_connect_expired:1659 ERROR: no connection 
established with node 0 after 30.0 seconds, giving up and returning errors.
Oct 19 22:21:38 storage kernel: [ 1546.496143] 
(o2hb-2283B3335E,4427,0):o2hb_do_disk_heartbeat:770 ERROR: Device 
"sda1": another node is heartbeating in our slot!

Fianlly, storage server and node are restarting.

Coule You hel me?

-- 
Pozdrawiam
Adam Skowronek

On Wed, Oct 20, 2010 at 10:17:49AM +0200, Adam Skowronek
wrote:
> I'm building a cluster containing two nodes with seperate common
storage
> server.
> On storage server i have volume with ocfs2 fs which is sharing this 
> volume via iscsi target.
> 
> When node connected to the target i can local mount volume on node and 
> using it.
	I'm not sure what you mean here.  I think you are saying:

- The host storage_machine has a disk exported via scst.
- The hosts node1 and node2 see that disk via iscsi.
- The host nod1 can mount the ocfs2 volume and use it just fine.
> Unfortunately. on storage server ocfs2 logged to dmesg:
> 
> Oct 19 22:21:02 storage kernel: [ 1510.424144] 
> (o2hb-2283B3335E,4427,0):o2hb_do_disk_heartbeat:770 ERROR: Device 
> "sda1": another node is heartbeating in our slot!
> Oct 19 22:21:02 storage kernel: [ 1510.428600] o2net: connection to node 
> node-2 (num 0) at 192.168.1.69:7777 shutdown, state 7
	It looks like you have also mounted the ocfs2 volume on the
storage_machine host via its regular disk.  You cannot do this, because
the iscsi software caches data that the ocfs2 driver won't see in
/dev/sda1.
	If you want to mount the volume on storage_machine as well, you
will have to export the disk back to itself via iscsi.

Joel

-- 

"Not everything that can be counted counts, and not everything
 that counts can be counted."
        - Albert Einstein 

Joel Becker
Senior Development Manager
Oracle
E-mail: joel.becker at oracle.com
Phone: (650) 506-8127