Alexandre Besnard
2016-Jul-18 16:41 UTC
[Gluster-users] Geo-replication configuration issue
Hello On a fresh Gluster 3.8 install, I am not able to configure a geo-replicated volume. Everything works fine up to starting of the volume however Gluster reports a faulty status. When looking at the logs (gluster_error): [2016-07-18 16:30:04.371686] I [cli.c:730:main] 0-cli: Started running gluster with version 3.8.0 [2016-07-18 16:30:04.435854] I [MSGID: 101190] [event-epoll.c:628:event_dispatch_epoll_worker] 0-epoll: Started thread with index 1 [2016-07-18 16:30:04.435921] I [socket.c:2468:socket_event_handler] 0-transport: disconnecting now [2016-07-18 16:30:04.997986] I [input.c:31:cli_batch] 0-: Exiting with: 0 From the geo-replicated logs, it seems I have a SSH configuration issue: 2016-07-18 16:35:28.293524] I [monitor(monitor):266:monitor] Monitor: ------------------------------------------------------------ [2016-07-18 16:35:28.293740] I [monitor(monitor):267:monitor] Monitor: starting gsyncd worker [2016-07-18 16:35:28.352266] I [gsyncd(/gluster/backupvol):710:main_i] <top>: syncing: gluster://localhost:backupvol -> ssh://root at ks4:gluster://localhost:backupvol [2016-07-18 16:35:28.352489] I [changelogagent(agent):73:__init__] ChangelogAgent: Agent listining... [2016-07-18 16:35:28.492474] E [syncdutils(/gluster/backupvol):252:log_raise_exception] <top>: connection to peer is broken [2016-07-18 16:35:28.492706] E [resource(/gluster/backupvol):226:errlog] Popen: command "ssh -oPasswordAuthentication=no -oStrictHostKeyChecking=no -i /var/lib/glusterd/geo-replication/secret.pem -p 22 -oControlMaster=auto -S /tmp/gsyncd-aux-ssh-Fs2XND/b63292d563144e7818235d683516731d.sock root at ks4 /nonexistent/gsyncd --session-owner 3281242a-ab45-4a0d-99e5-2965b4ac5840 -N --listen --timeout 120 gluster://localhost:backupvol" returned with 255, saying: [2016-07-18 16:35:28.492794] E [resource(/gluster/backupvol):230:logerr] Popen: ssh> key_load_public: invalid format [2016-07-18 16:35:28.492863] E [resource(/gluster/backupvol):230:logerr] Popen: ssh> Permission denied (publickey,password). [2016-07-18 16:35:28.493004] I [syncdutils(/gluster/backupvol):220:finalize] <top>: exiting. [2016-07-18 16:35:28.494045] I [repce(agent):92:service_loop] RepceServer: terminating on reaching EOF. [2016-07-18 16:35:28.494204] I [syncdutils(agent):220:finalize] <top>: exiting. [2016-07-18 16:35:28.494143] I [monitor(monitor):333:monitor] Monitor: worker(/gluster/backupvol) died before establishing connection I tried to fix them to the best of my knowledge but I am missing something. Can you help me to fix it? Thanks, Alex
Hi, Looks like Master Pem keys are not copied to Slave nodes properly, Please cleanup /root/.ssh/authorized_keys in Slave nodes and run Geo-rep create force again. gluster volume geo-replication <MASTERVOL> <SLAVEHOST>::<SLAVEVOL> create push-pem force Do you observe any errors related to hook scripts in glusterd log file? regards Aravinda On 07/18/2016 10:11 PM, Alexandre Besnard wrote:> Hello > > On a fresh Gluster 3.8 install, I am not able to configure a geo-replicated volume. Everything works fine up to starting of the volume however Gluster reports a faulty status. > > When looking at the logs (gluster_error): > > [2016-07-18 16:30:04.371686] I [cli.c:730:main] 0-cli: Started running gluster with version 3.8.0 > [2016-07-18 16:30:04.435854] I [MSGID: 101190] [event-epoll.c:628:event_dispatch_epoll_worker] 0-epoll: Started thread with index 1 > [2016-07-18 16:30:04.435921] I [socket.c:2468:socket_event_handler] 0-transport: disconnecting now > [2016-07-18 16:30:04.997986] I [input.c:31:cli_batch] 0-: Exiting with: 0 > > > > From the geo-replicated logs, it seems I have a SSH configuration issue: > > 2016-07-18 16:35:28.293524] I [monitor(monitor):266:monitor] Monitor: ------------------------------------------------------------ > [2016-07-18 16:35:28.293740] I [monitor(monitor):267:monitor] Monitor: starting gsyncd worker > [2016-07-18 16:35:28.352266] I [gsyncd(/gluster/backupvol):710:main_i] <top>: syncing: gluster://localhost:backupvol -> ssh://root at ks4:gluster://localhost:backupvol > [2016-07-18 16:35:28.352489] I [changelogagent(agent):73:__init__] ChangelogAgent: Agent listining... > [2016-07-18 16:35:28.492474] E [syncdutils(/gluster/backupvol):252:log_raise_exception] <top>: connection to peer is broken > [2016-07-18 16:35:28.492706] E [resource(/gluster/backupvol):226:errlog] Popen: command "ssh -oPasswordAuthentication=no -oStrictHostKeyChecking=no -i /var/lib/glusterd/geo-replication/secret.pem -p 22 -oControlMaster=auto -S /tmp/gsyncd-aux-ssh-Fs2XND/b63292d563144e7818235d683516731d.sock root at ks4 /nonexistent/gsyncd --session-owner 3281242a-ab45-4a0d-99e5-2965b4ac5840 -N --listen --timeout 120 gluster://localhost:backupvol" returned with 255, saying: > [2016-07-18 16:35:28.492794] E [resource(/gluster/backupvol):230:logerr] Popen: ssh> key_load_public: invalid format > [2016-07-18 16:35:28.492863] E [resource(/gluster/backupvol):230:logerr] Popen: ssh> Permission denied (publickey,password). > [2016-07-18 16:35:28.493004] I [syncdutils(/gluster/backupvol):220:finalize] <top>: exiting. > [2016-07-18 16:35:28.494045] I [repce(agent):92:service_loop] RepceServer: terminating on reaching EOF. > [2016-07-18 16:35:28.494204] I [syncdutils(agent):220:finalize] <top>: exiting. > [2016-07-18 16:35:28.494143] I [monitor(monitor):333:monitor] Monitor: worker(/gluster/backupvol) died before establishing connection > > > I tried to fix them to the best of my knowledge but I am missing something. > > Can you help me to fix it? > > Thanks, > Alex > _______________________________________________ > Gluster-users mailing list > Gluster-users at gluster.org > http://www.gluster.org/mailman/listinfo/gluster-users