Hi Deepu, Can you share traceback from slave node. /sunny On Mon, Mar 9, 2020 at 5:08 AM deepu srinivasan <sdeepugd at gmail.com> wrote:> > Hi guys > Have any update on this? > > On Thu, Mar 5, 2020, 12:30 PM deepu srinivasan <sdeepugd at gmail.com> wrote: >> >> Hi Users/Devs >> >> We are getting a faulty status for geo-replication and below are the logs. How to solve this issue? >>> >>> [2020-03-05 06:52:44.858073] E [repce(worker /home/sas/gluster/data/code-ide):214:__call__] RepceClient: call failed call=232079:140660126910272:1583391154.92 method=entry_ops error=OSError >>> [2020-03-05 06:52:44.858309] E [syncdutils(worker /home/sas/gluster/data/code-ide):338:log_raise_exception] <top>: FAIL: >>> Traceback (most recent call last): >>> File "/usr/libexec/glusterfs/python/syncdaemon/gsyncd.py", line 325, in main >>> func(args) >>> File "/usr/libexec/glusterfs/python/syncdaemon/subcmds.py", line 86, in subcmd_worker >>> local.service_loop(remote) >>> File "/usr/libexec/glusterfs/python/syncdaemon/resource.py", line 1297, in service_loop >>> g3.crawlwrap(oneshot=True) >>> File "/usr/libexec/glusterfs/python/syncdaemon/master.py", line 602, in crawlwrap >>> self.crawl() >>> File "/usr/libexec/glusterfs/python/syncdaemon/master.py", line 1592, in crawl >>> self.changelogs_batch_process(changes) >>> File "/usr/libexec/glusterfs/python/syncdaemon/master.py", line 1492, in changelogs_batch_process >>> self.process(batch) >>> File "/usr/libexec/glusterfs/python/syncdaemon/master.py", line 1327, in process >>> self.process_change(change, done, retry) >>> File "/usr/libexec/glusterfs/python/syncdaemon/master.py", line 1221, in process_change >>> failures = self.slave.server.entry_ops(entries) >>> File "/usr/libexec/glusterfs/python/syncdaemon/repce.py", line 233, in __call__ >>> return self.ins(self.meth, *a) >>> File "/usr/libexec/glusterfs/python/syncdaemon/repce.py", line 215, in __call__ >>> raise res >>> OSError: [Errno 1] Operation not permitted >>> [2020-03-05 06:52:44.887593] I [repce(agent /home/sas/gluster/data/code-ide):97:service_loop] RepceServer: terminating on reaching EOF. >>> [2020-03-05 06:52:44.899364] I [gsyncdstatus(monitor):248:set_worker_status] GeorepStatus: Worker Status Change status=Faulty >>> [2020-03-05 06:52:55.288171] I [gsyncdstatus(monitor):248:set_worker_status] GeorepStatus: Worker Status Change status=Initializing... >> >> >> Our Setup Details >> We have one volume at each DC. Below is the configuration >> >> Volume configuration2x3 >> Replication3 >> Distribution2 >> Gluster version7.0 >> Client TypeFuse Mount >> Glusterd process >> GeoReplication Sessionenabled >> Gluster daemon permission in masterroot >> Gluster daemon permission in slaveroot >> Gsynd user daemon in masterroot >> Gsynd user daemon in slavenon-root >> Geo Replication configurationroot(master) - non-root(slave) >>