gluster volume create volume01 replica 2 transport tcp server01:/brick01 server02:/brick01 gluster volume start volume01 Then server1 and server2 each mount the volume from themselves via /etc/fstab entry: localhost:/volume01 /glusterfs/vol01 glusterfs defaults,_netdev,acl 0 0 This works, modifications inside /glusterfs/vol01 are seen by the other host. However when I reboot either server01 or server02, the client mount point on the surviving node (/glusterfs/vol01) hangs until the node reboots. If the node never boots, the client mount point on the surviving node hangs for 30 minutes. I have tried reducing frame-timeout to 10 seconds to no avail. Also; once the rebooted server comes back online it fails to mount /glusterfs/vol01, hanging, again for 30 minutes. A subsequent remount succeeds. Cancelling the hung mount with umount -f /glusterfs/vol01 and then re-mounting succeeds. Any ideas what I am doing wrong? Here is the volfile from /var/log/glusterfs/glusterfs-vol01.log 1: volume volume01-client-0 2: type protocol/client 3: option remote-host server01 4: option remote-subvolume /brick01 5: option transport-type tcp 6: option frame-timeout 10 7: end-volume 8: 9: volume volume01-client-1 10: type protocol/client 11: option remote-host server02 12: option remote-subvolume /brick01 13: option transport-type tcp 14: option frame-timeout 10 15: end-volume 16: 17: volume volume01-replicate-0 18: type cluster/replicate 19: subvolumes volume01-client-0 volume01-client-1 20: end-volume 21: 22: volume volume01-write-behind 23: type performance/write-behind 24: subvolumes volume01-replicate-0 25: end-volume 26: 27: volume volume01-read-ahead 28: type performance/read-ahead 29: subvolumes volume01-write-behind 30: end-volume 31: 32: volume volume01-io-cache 33: type performance/io-cache 34: subvolumes volume01-read-ahead 35: end-volume 36: 37: volume volume01-quick-read 38: type performance/quick-read 39: subvolumes volume01-io-cache 40: end-volume 41: 42: volume volume01-stat-prefetch 43: type performance/stat-prefetch 44: subvolumes volume01-quick-read 45: end-volume 46: 47: volume volume01 48: type debug/io-stats 49: option latency-measurement off 50: option count-fop-hits off 51: subvolumes volume01-stat-prefetch 52: end-volume --00151773e296a198f904b0efa7db Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable =09 =09 =09 <style type=3D"text/css"> <!-- @page { margin: 0.79in } P { margin-bottom: 0.08in } --> </style> <p style=3D"margin-bottom: 0in">Hello;<br><br>I have installed glusterfs 3.2.4 to a pair of Red Hat Enterprise Linux 6.1 x86_64 machines with 2GB memory. I am attempting to mirror a directory full of content between the two servers, which also serve and update the content through a webapp via Apache. My issue is that the client mount points hang for 30 minutes or so if either node is brought down.<br><br>The volfile will be at the end of this e-mail.<br><br>I setup two bricks, one each on nodes server01 and server02, using ext4 and acl mount options. The vfstab entries on each server look like this<br><br><font face=3D"courier new, monospace">/dev/mapper/sysvg-brick01 /brick01=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 ext4=A0=A0=A0 defaults,nosuid,acl=A0=A0=A0=A0=A0=A0=A0 1 2</font><br><br>From one host, I configure them as a mirror and start the volume:<br><br><font face=3D"courier new, monospace">gluster volume create volume01 replica 2 transport tcp server01:/brick01 server02:/brick01</font><br><font face=3D"courier new, monospace">gluster volume start volume01</font><br><br>Then server1 and server2 each mount the volume from themselves via /etc/fstab entry:<br><br><font face=3D"courier new, monospace">localhost:/volume01=A0=A0=A0=A0 /glusterfs/vol01=A0=A0=A0=A0=A0=A0=A0 glusterfs defaults,_netdev,acl=A0=A0=A0=A0 0 0</font><br><br>This works, modifications inside /glusterfs/vol01 are seen by the other host. However when I reboot either server01 or server02, the client mount point on the surviving node (/glusterfs/vol01) hangs until the node reboots. If the node never boots, the client mount point on the surviving node hangs for 30 minutes. I have tried reducing frame-timeout to 10 seconds to no avail.<br><br>Also; once the rebooted server comes back online it fails to mount /glusterfs/vol01, hanging, again for 30 minutes. A subsequent remount succeeds. Cancelling the hung mount with umount -f /glusterfs/vol01 and then re-mounting succeeds.<br><br>Any ideas what I am doing wrong?<br><br>Here is the volfile from /var/log/glusterfs/glusterfs-vol01.log<br><br>=A0 <font face=3D"courier new, monospace">1: volume volume01-client-0</font><br>=A0 <font face=3D"courier new, monospace">2:=A0=A0=A0=A0 type protocol/client</font><br>=A0 <font face=3D"courier new, monospace">3:=A0=A0=A0=A0 option remote-host server01</font><br>=A0 <font face=3D"courier new, monospace">4:=A0=A0=A0=A0 option remote-subvolume /brick01</font><br>=A0 <font face=3D"courier new, monospace">5:=A0=A0=A0=A0 option transport-type tcp</font><br>=A0 <font face=3D"courier new, monospace">6:=A0=A0=A0=A0 option frame-timeout 10</font><br>=A0 <font face=3D"courier new, monospace">7: end-volume</font><br>=A0 <font face=3D"courier new, monospace">8: </font><br>=A0 <font face=3D"courier new, monospace">9: volume volume01-client-1</font><br>=A0<font face=3D"courier new, monospace">10:=A0=A0=A0=A0 type protocol/client</font><br>=A0<font face=3D"courier new, monospace">11:=A0=A0=A0=A0 option remote-host server02</font><br>=A0<font face=3D"courier new, monospace">12:=A0=A0=A0=A0 option remote-subvolume /brick01</font><br>=A0<font face=3D"courier new, monospace">13:=A0=A0=A0=A0 option transport-type tcp</font><br>=A0<font face=3D"courier new, monospace">14:=A0=A0=A0=A0 option frame-timeout 10</font><br>=A0<font face=3D"courier new, monospace">15: end-volume</font><br>=A0<font face=3D"courier new, monospace">16: </font><br>=A0<font face=3D"courier new, monospace">17: volume volume01-replicate-0</font><br>=A0<font face=3D"courier new, monospace">18:=A0=A0=A0=A0 type cluster/replicate</font><br>=A0<font face=3D"courier new, monospace">19:=A0=A0=A0=A0 subvolumes volume01-client-0 volume01-client-1</font><br>=A0<font face=3D"courier new, monospace">20: end-volume</font><br>=A0<font face=3D"courier new, monospace">21: </font><br>=A0<font face=3D"courier new, monospace">22: volume volume01-write-behind</font><br>=A0<font face=3D"courier new, monospace">23:=A0=A0=A0=A0 type performance/write-behind</font><br>=A0<font face=3D"courier new, monospace">24:=A0=A0=A0=A0 subvolumes volume01-replicate-0</font><br>=A0<font face=3D"courier new, monospace">25: end-volume</font><br>=A0<font face=3D"courier new, monospace">26: </font><br>=A0<font face=3D"courier new, monospace">27: volume volume01-read-ahead</font><br>=A0<font face=3D"courier new, monospace">28:=A0=A0=A0=A0 type performance/read-ahead</font><br>=A0<font face=3D"courier new, monospace">29:=A0=A0=A0=A0 subvolumes volume01-write-behind</font><br>=A0<font face=3D"courier new, monospace">30: end-volume</font><br>=A0<font face=3D"courier new, monospace">31: </font><br>=A0<font face=3D"courier new, monospace">32: volume volume01-io-cache</font><br>=A0<font face=3D"courier new, monospace">33:=A0=A0=A0=A0 type performance/io-cache</font><br>=A0<font face=3D"courier new, monospace">34:=A0=A0=A0=A0 subvolumes volume01-read-ahead</font><br>=A0<font face=3D"courier new, monospace">35: end-volume</font><br>=A0<font face=3D"courier new, monospace">36: </font><br>=A0<font face=3D"courier new, monospace">37: volume volume01-quick-read</font><br>=A0<font face=3D"courier new, monospace">38:=A0=A0=A0=A0 type performance/quick-read</font><br>=A0<font face=3D"courier new, monospace">39:=A0=A0=A0=A0 subvolumes volume01-io-cache</font><br>=A0<font face=3D"courier new, monospace">40: end-volume</font><br>=A0<font face=3D"courier new, monospace">41: </font><br>=A0<font face=3D"courier new, monospace">42: volume volume01-stat-prefetch</font><br>=A0<font face=3D"courier new, monospace">43:=A0=A0=A0=A0 type performance/stat-prefetch</font><br>=A0<font face=3D"courier new, monospace">44:=A0=A0=A0=A0 subvolumes volume01-quick-read</font><br>=A0<font face=3D"courier new, monospace">45: end-volume</font><br>=A0<font face=3D"courier new, monospace">46: </font><br>=A0<font face=3D"courier new, monospace">47: volume volume01</font><br>=A0<font face=3D"courier new, monospace">48:=A0=A0=A0=A0 type debug/io-stats</font><br>=A0<font face=3D"courier new, monospace">49:=A0=A0=A0=A0 option latency-measurement off</font><br>=A0<font face=3D"courier new, monospace">50:=A0=A0=A0=A0 option count-fop-hits off</font><br>=A0<font face=3D"courier new, monospace">51:=A0=A0=A0=A0 subvolumes volume01-stat-prefetch</font><br>=A0<font face=3D"courier new, monospace">52: end-volume</font><br><br> </p> --00151773e296a198f904b0efa7db--