So yes indeed I am using ZFS on Linux v.0.6.5 as filesystem behind Gluster. As operating system I use Debian 8.2 GNU/Linux. I also followed that documentation you mention in order to enable POSIX acltype for example on my ZFS volume. I checked and on my two bricks as well as my slave I have the coreutils package with its stat util. I have read quite a few posts of people using ZFS with Gluster and this should not be a problem. Or is this maybe a new bug in GlusterFS? By checking the log file /var/log/glusterfs/geo-replication/reptest/ssh%3A%2F%2Froot%40192.168.40.3%3Agluster%3A%2F%2F127.0.0.1%3Areptest.log I saw the following error message which might help to debug this issue: [2015-09-18 23:41:09.646944] E [resource(/data/reptest/brick):226:logerr] Popen: ssh> bash: /nonexistent/gsyncd: No such file or directory Does this ring any bells? On Saturday, September 19, 2015 6:18 AM, Saravanakumar Arumugam <sarumuga at redhat.com> wrote: Hi, The underlying filesystem which you use seems like ZFS. I don't have much idea about zfs. You may want to check this link: http://www.gluster.org/community/documentation/index.php/GlusterOnZFS As far as the error is concerned, it is trying to use stat command to get inode details. (stat command is provided by coreutils, which is quite a basic package). Could you share your System details? Is it a Linux system ? ps: XFS is the recommended and widely tested filesystem for glusterfs. Thanks, Saravana On 09/19/2015 03:03 AM, ML mail wrote:> Hello, > > I am trying in vain to setup geo-replication on now version 3.7.4 of GlusterFS but it still does not seem to work. I have at least managed to run succesfully the georepsetup using the following command: > > > georepsetup reptest gfsgeo at gfs1geo reptest > > But as soon as I run: > > > gluster volume geo-replication reptest gfs1geo::reptest start > > i see the following error messages every 2 minutes in /var/log/glusterfs/etc-glusterfs-glusterd.vol.log: > > [2015-09-18 21:27:26.341524] I [MSGID: 106488] [glusterd-handler.c:1463:__glusterd_handle_cli_get_volume] 0-glusterd: Received get vol req > [2015-09-18 21:27:26.474240] I [MSGID: 106499] [glusterd-handler.c:4258:__glusterd_handle_status_volume] 0-management: Received status volume req for volume reptest > [2015-09-18 21:27:26.475231] E [MSGID: 106419] [glusterd-utils.c:4972:glusterd_add_inode_size_to_dict] 0-management: could not find (null) to getinode size for data/reptest (zfs): (null) package missing? > > > and nothing really happens. > > Does anyone have an idea what's wrong now? > > Regards > ML > _______________________________________________ > Gluster-users mailing list > Gluster-users at gluster.org > http://www.gluster.org/mailman/listinfo/gluster-users
Saravanakumar Arumugam
2015-Sep-21 06:07 UTC
[Gluster-users] problems with geo-replication on 3.7.4
Replies inline. On 09/19/2015 03:37 PM, ML mail wrote:> So yes indeed I am using ZFS on Linux v.0.6.5 as filesystem behind Gluster. As operating system I use Debian 8.2 GNU/Linux. > > > I also followed that documentation you mention in order to enable POSIX acltype for example on my ZFS volume. > > I checked and on my two bricks as well as my slave I have the coreutils package with its stat util. I have read quite a few posts of people using ZFS with Gluster and this should not be a problem. Or is this maybe a new bug in GlusterFS? > > By checking the log file > /var/log/glusterfs/geo-replication/reptest/ssh%3A%2F%2Froot%40192.168.40.3%3Agluster%3A%2F%2F127.0.0.1%3Areptest.log I saw the following error message which might help to debug this issue: > > [2015-09-18 23:41:09.646944] E [resource(/data/reptest/brick):226:logerr] Popen: ssh> bash: /nonexistent/gsyncd: No such file or directory > > Does this ring any bells? >Do you meant to say , the earlier error "could not find (null) to getinode size for data" is gone and now you are getting this error. check whether these steps helps you : http://irclog.perlgeek.de/gluster/2015-01-08#i_9903500 Please share the complete log , if you still face any issues. Also, report back if it helps, so that we can fix it here.> > > On Saturday, September 19, 2015 6:18 AM, Saravanakumar Arumugam <sarumuga at redhat.com> wrote: > Hi, > > The underlying filesystem which you use seems like ZFS. > > I don't have much idea about zfs. You may want to check this link: > http://www.gluster.org/community/documentation/index.php/GlusterOnZFS > > As far as the error is concerned, it is trying to use stat command to > get inode details. > (stat command is provided by coreutils, which is quite a basic package). > > Could you share your System details? Is it a Linux system ? > > ps: > XFS is the recommended and widely tested filesystem for glusterfs. > > Thanks, > Saravana > > > > On 09/19/2015 03:03 AM, ML mail wrote: >> Hello, >> >> I am trying in vain to setup geo-replication on now version 3.7.4 of GlusterFS but it still does not seem to work. I have at least managed to run succesfully the georepsetup using the following command: >> >> >> georepsetup reptest gfsgeo at gfs1geo reptest >> >> But as soon as I run: >> >> >> gluster volume geo-replication reptest gfs1geo::reptest start >> >> i see the following error messages every 2 minutes in /var/log/glusterfs/etc-glusterfs-glusterd.vol.log: >> >> [2015-09-18 21:27:26.341524] I [MSGID: 106488] [glusterd-handler.c:1463:__glusterd_handle_cli_get_volume] 0-glusterd: Received get vol req >> [2015-09-18 21:27:26.474240] I [MSGID: 106499] [glusterd-handler.c:4258:__glusterd_handle_status_volume] 0-management: Received status volume req for volume reptest >> [2015-09-18 21:27:26.475231] E [MSGID: 106419] [glusterd-utils.c:4972:glusterd_add_inode_size_to_dict] 0-management: could not find (null) to getinode size for data/reptest (zfs): (null) package missing? >> >> >> and nothing really happens. >> >> Does anyone have an idea what's wrong now? >> >> Regards >> ML >> _______________________________________________ >> Gluster-users mailing list >> Gluster-users at gluster.org >> http://www.gluster.org/mailman/listinfo/gluster-users