Hello! Installed packages from SIG on centos7 , at first start it works, but after restart- not: ?glusterd2 --config /etc/glusterd2/glusterd2.toml DEBU[2018-04-04 09:28:16.945267] Starting GlusterD???????????????????????????? pid=221581 source="[main.go:55:main.main]" version=v4.0.0-0 INFO[2018-04-04 09:28:16.945824] loaded configuration from file??????????????? file=/etc/glusterd2/glusterd2.toml source="[config.go:163:main.initConfig]" DEBU[2018-04-04 09:28:16.946343] running with configuration??????????????????? cert-file= clientaddress="192.168.222.24:24007" config=/etc/glusterd2/glusterd2.toml defaultpeerport=24008 etcdcurls="http://192.168.222.24:2379" etcdendpoints="[]" etcdpurls="http://192.168.222.24:2380" key-file= localstatedir=/var/lib/glusterd2 logdir=/var/log/glusterd2 logfile=glusterd2.log loglevel=debug noembed=false peeraddress="192.168.222.24:24008" rundir=/usr/var/run/glusterd2 source="[config.go:129:main.dumpConfigToLog]" statedump=true version=false workdir=/etc/glusterd2 DEBU[2018-04-04 09:28:17.067244] loading templates source="[template.go:64:volgen.LoadTemplates]" templatesdirDEBU[2018-04-04 09:28:17.068207] generated default templates source="[template.go:82:volgen.LoadTemplates]" templates="[brick.graph distreplicate.graph fuse.graph distribute.graph replicate.graph disperse.graph]" DEBU[2018-04-04 09:28:17.068361] loaded template source="[template.go:102:volgen.LoadTemplate]" template=brick.graph DEBU[2018-04-04 09:28:17.068450] loaded template source="[template.go:102:volgen.LoadTemplate]" template=distreplicate.graph DEBU[2018-04-04 09:28:17.068539] loaded template source="[template.go:102:volgen.LoadTemplate]" template=fuse.graph DEBU[2018-04-04 09:28:17.068621] loaded template source="[template.go:102:volgen.LoadTemplate]" template=distribute.graph DEBU[2018-04-04 09:28:17.068798] loaded template source="[template.go:102:volgen.LoadTemplate]" template=replicate.graph DEBU[2018-04-04 09:28:17.068878] loaded template source="[template.go:102:volgen.LoadTemplate]" template=disperse.graph DEBU[2018-04-04 09:28:17.069316] saving updated store config?????????????????? source="[config.go:166:store.GetConfig]" DEBU[2018-04-04 09:28:17.069745] starting embedded store?????????????????????? cafile= certfile= curls="http://192.168.222.24:2379" datadir=/var/lib/glusterd2/store endpoints="http://192.168.222.24:2379" keyfile= logdir=/var/log/glusterd2/store name=10641b8a-7135-4694-9b90-955827c8eba9 purls="http://192.168.222.24:2380" source="[embed.go:32:store.newEmbedStore]" trustedcafile2018-04-04 09:28:17.071331 I | etcdserver/api/v3rpc: grpc: addrConn.resetTransport failed to create client transport: connection error: desc = "transport: dial tcp 192.168.222.24:2379: getsockopt: connection refused"; Reconnecting to {192.168.222.24:2379 <nil>} 2018-04-04 09:28:18.071206 I | etcdserver/api/v3rpc: grpc: addrConn.resetTransport failed to create client transport: connection error: desc = "transport: dial tcp 192.168.222.24:2379: getsockopt: connection refused"; Reconnecting to {192.168.222.24:2379 <nil>} 2018-04-04 09:28:19.681081 I | etcdserver/api/v3rpc: grpc: addrConn.resetTransport failed to create client transport: connection error: desc = "transport: dial tcp 192.168.222.24:2379: getsockopt: connection refused"; Reconnecting to {192.168.222.24:2379 <nil>} 2018-04-04 09:28:22.070811 I | etcdserver/api/v3rpc: Failed to dial 192.168.222.24:2379: context canceled; please retry. ERRO[2018-04-04 09:28:22.070891] failed to start embedded store??????????????? error="dial tcp 192.168.222.24:2379: getsockopt: connection refused" source="[embed.go:36:store.newEmbedStore]" FATA[2018-04-04 09:28:22.071038] Failed to initialize store (etcd client)????? error="dial tcp 192.168.222.24:2379: getsockopt: connection refused" source="[main.go:89:main.main]" cat glusterd2.toml localstatedir = "/var/lib/glusterd2" logdir = "/var/log/glusterd2" logfile = "glusterd2.log" rundir = "/usr/var/run/glusterd2" peeraddress = "192.168.222.24:24008" clientaddress = "192.168.222.24:24007" etcdcurls = "http://192.168.222.24:2379" etcdpurls = "http://192.168.222.24:2380" Any ideas? Thank you!
Hi Dmitry, How many nodes does the cluster have ? If the quorum is lost (majority of nodes are down), additional recovery steps are necessary to bring it back up: https://github.com/gluster/glusterd2/wiki/Recovery On Wed, Apr 4, 2018 at 11:08 AM, Dmitry Melekhov <dm at belkam.com> wrote:> Hello! > > Installed packages from SIG on centos7 , > > at first start it works, but after restart- not: > > > glusterd2 --config /etc/glusterd2/glusterd2.toml > DEBU[2018-04-04 09:28:16.945267] Starting GlusterD > pid=221581 source="[main.go:55:main.main]" version=v4.0.0-0 > INFO[2018-04-04 09:28:16.945824] loaded configuration from > file file=/etc/glusterd2/glusterd2.toml > source="[config.go:163:main.initConfig]" > DEBU[2018-04-04 09:28:16.946343] running with > configuration cert-file= clientaddress="192.168.222.24: > 24007" config=/etc/glusterd2/glusterd2.toml defaultpeerport=24008 > etcdcurls="http://192.168.222.24:2379" etcdendpoints="[]" etcdpurls=" > http://192.168.222.24:2380" key-file= localstatedir=/var/lib/glusterd2 > logdir=/var/log/glusterd2 logfile=glusterd2.log loglevel=debug > noembed=false peeraddress="192.168.222.24:24008" > rundir=/usr/var/run/glusterd2 source="[config.go:129:main.dumpConfigToLog]" > statedump=true version=false workdir=/etc/glusterd2 > DEBU[2018-04-04 09:28:17.067244] loading templates > source="[template.go:64:volgen.LoadTemplates]" templatesdir> DEBU[2018-04-04 09:28:17.068207] generated default templates > source="[template.go:82:volgen.LoadTemplates]" templates="[brick.graph > distreplicate.graph fuse.graph distribute.graph replicate.graph > disperse.graph]" > DEBU[2018-04-04 09:28:17.068361] loaded template > source="[template.go:102:volgen.LoadTemplate]" template=brick.graph > DEBU[2018-04-04 09:28:17.068450] loaded template > source="[template.go:102:volgen.LoadTemplate]" > template=distreplicate.graph > DEBU[2018-04-04 09:28:17.068539] loaded template > source="[template.go:102:volgen.LoadTemplate]" template=fuse.graph > DEBU[2018-04-04 09:28:17.068621] loaded template > source="[template.go:102:volgen.LoadTemplate]" template=distribute.graph > DEBU[2018-04-04 09:28:17.068798] loaded template > source="[template.go:102:volgen.LoadTemplate]" template=replicate.graph > DEBU[2018-04-04 09:28:17.068878] loaded template > source="[template.go:102:volgen.LoadTemplate]" template=disperse.graph > DEBU[2018-04-04 09:28:17.069316] saving updated store > config source="[config.go:166:store.GetConfig]" > DEBU[2018-04-04 09:28:17.069745] starting embedded > store cafile= certfile= curls=" > http://192.168.222.24:2379" datadir=/var/lib/glusterd2/store endpoints=" > http://192.168.222.24:2379" keyfile= logdir=/var/log/glusterd2/store > name=10641b8a-7135-4694-9b90-955827c8eba9 purls="http://192.168.222.24:2 > 380" source="[embed.go:32:store.newEmbedStore]" trustedcafile> 2018-04-04 09:28:17.071331 I | etcdserver/api/v3rpc: grpc: > addrConn.resetTransport failed to create client transport: connection > error: desc = "transport: dial tcp 192.168.222.24:2379: getsockopt: > connection refused"; Reconnecting to {192.168.222.24:2379 <nil>} > 2018-04-04 09:28:18.071206 I | etcdserver/api/v3rpc: grpc: > addrConn.resetTransport failed to create client transport: connection > error: desc = "transport: dial tcp 192.168.222.24:2379: getsockopt: > connection refused"; Reconnecting to {192.168.222.24:2379 <nil>} > 2018-04-04 09:28:19.681081 I | etcdserver/api/v3rpc: grpc: > addrConn.resetTransport failed to create client transport: connection > error: desc = "transport: dial tcp 192.168.222.24:2379: getsockopt: > connection refused"; Reconnecting to {192.168.222.24:2379 <nil>} > 2018-04-04 09:28:22.070811 I | etcdserver/api/v3rpc: Failed to dial > 192.168.222.24:2379: context canceled; please retry. > ERRO[2018-04-04 09:28:22.070891] failed to start embedded > store error="dial tcp 192.168.222.24:2379: getsockopt: > connection refused" source="[embed.go:36:store.newEmbedStore]" > FATA[2018-04-04 09:28:22.071038] Failed to initialize store (etcd > client) error="dial tcp 192.168.222.24:2379: getsockopt: connection > refused" source="[main.go:89:main.main]" > > > cat glusterd2.toml > localstatedir = "/var/lib/glusterd2" > logdir = "/var/log/glusterd2" > logfile = "glusterd2.log" > rundir = "/usr/var/run/glusterd2" > peeraddress = "192.168.222.24:24008" > clientaddress = "192.168.222.24:24007" > etcdcurls = "http://192.168.222.24:2379" > etcdpurls = "http://192.168.222.24:2380" > > > Any ideas? > > > Thank you! > > > > > _______________________________________________ > Gluster-users mailing list > Gluster-users at gluster.org > http://lists.gluster.org/mailman/listinfo/gluster-users-------------- next part -------------- An HTML attachment was scrubbed... URL: <http://lists.gluster.org/pipermail/gluster-users/attachments/20180406/468bb704/attachment.html>
06.04.2018 14:46, Prashanth Pai ?????:> Hi Dmitry, > > How many nodes does the cluster have ? > > If the quorum is lost (majority of nodes are down), additional > recovery steps are necessary to bring it back up: > https://github.com/gluster/glusterd2/wiki/Recovery >Hello! just 2 nodes and looks like we had both down. We tried to create test cluster with 3 nodes, to learn how to use glusterd2, but had this issue when we had only 2 nodes, i.e. after we added second node. just because we found that gluster cli uses localhost by default, but we configured glusterd2 to ethernet interface address, this is another problem we hit, so we restarted both nodes I guess :-) Glusterd2 state looks as pre-alpha for me, so we'll wait for at least beta. Thank you!> > On Wed, Apr 4, 2018 at 11:08 AM, Dmitry Melekhov <dm at belkam.com > <mailto:dm at belkam.com>> wrote: > > Hello! > > Installed packages from SIG on centos7 , > > at first start it works, but after restart- not: > > > ?glusterd2 --config /etc/glusterd2/glusterd2.toml > DEBU[2018-04-04 09:28:16.945267] Starting GlusterD ?????? > pid=221581 source="[main.go:55:main.main]" version=v4.0.0-0 > INFO[2018-04-04 09:28:16.945824] loaded configuration from > file??????????????? file=/etc/glusterd2/glusterd2.toml > source="[config.go:163:main.in <http://main.in>itConfig]" > DEBU[2018-04-04 09:28:16.946343] running with configuration ?? > cert-file= clientaddress="192.168.222.24:24007 > <http://192.168.222.24:24007>" > config=/etc/glusterd2/glusterd2.toml defaultpeerport=24008 > etcdcurls="http://192.168.222.24:2379 > <http://192.168.222.24:2379>" etcdendpoints="[]" > etcdpurls="http://192.168.222.24:2380 > <http://192.168.222.24:2380>" key-file> localstatedir=/var/lib/glusterd2 logdir=/var/log/glusterd2 > logfile=glusterd2.log loglevel=debug noembed=false > peeraddress="192.168.222.24:24008 <http://192.168.222.24:24008>" > rundir=/usr/var/run/glusterd2 > source="[config.go:129:main.dumpConfigToLog]" statedump=true > version=false workdir=/etc/glusterd2 > DEBU[2018-04-04 09:28:17.067244] loading templates > source="[template.go:64:volgen.LoadTemplates]" templatesdir> DEBU[2018-04-04 09:28:17.068207] generated default templates > source="[template.go:82:volgen.LoadTemplates]" > templates="[brick.graph distreplicate.graph fuse.graph > distribute.graph replicate.graph disperse.graph]" > DEBU[2018-04-04 09:28:17.068361] loaded template > source="[template.go:102:volgen.LoadTemplate]" template=brick.graph > DEBU[2018-04-04 09:28:17.068450] loaded template > source="[template.go:102:volgen.LoadTemplate]" > template=distreplicate.graph > DEBU[2018-04-04 09:28:17.068539] loaded template > source="[template.go:102:volgen.LoadTemplate]" template=fuse.graph > DEBU[2018-04-04 09:28:17.068621] loaded template > source="[template.go:102:volgen.LoadTemplate]" > template=distribute.graph > DEBU[2018-04-04 09:28:17.068798] loaded template > source="[template.go:102:volgen.LoadTemplate]" > template=replicate.graph > DEBU[2018-04-04 09:28:17.068878] loaded template > source="[template.go:102:volgen.LoadTemplate]" template=disperse.graph > DEBU[2018-04-04 09:28:17.069316] saving updated store > config?????????????????? source="[config.go:166:store.GetConfig]" > DEBU[2018-04-04 09:28:17.069745] starting embedded > store?????????????????????? cafile= certfile> curls="http://192.168.222.24:2379 <http://192.168.222.24:2379>" > datadir=/var/lib/glusterd2/store > endpoints="http://192.168.222.24:2379 > <http://192.168.222.24:2379>" keyfile> logdir=/var/log/glusterd2/store > name=10641b8a-7135-4694-9b90-955827c8eba9 > purls="http://192.168.222.24:2380 <http://192.168.222.24:2380>" > source="[embed.go:32:store.newEmbedStore]" trustedcafile> 2018-04-04 09:28:17.071331 I | etcdserver/api/v3rpc: grpc: > addrConn.resetTransport failed to create client transport: > connection error: desc = "transport: dial tcp 192.168.222.24:2379 > <http://192.168.222.24:2379>: getsockopt: connection refused"; > Reconnecting to {192.168.222.24:2379 <http://192.168.222.24:2379> > <nil>} > 2018-04-04 09:28:18.071206 I | etcdserver/api/v3rpc: grpc: > addrConn.resetTransport failed to create client transport: > connection error: desc = "transport: dial tcp 192.168.222.24:2379 > <http://192.168.222.24:2379>: getsockopt: connection refused"; > Reconnecting to {192.168.222.24:2379 <http://192.168.222.24:2379> > <nil>} > 2018-04-04 09:28:19.681081 I | etcdserver/api/v3rpc: grpc: > addrConn.resetTransport failed to create client transport: > connection error: desc = "transport: dial tcp 192.168.222.24:2379 > <http://192.168.222.24:2379>: getsockopt: connection refused"; > Reconnecting to {192.168.222.24:2379 <http://192.168.222.24:2379> > <nil>} > 2018-04-04 09:28:22.070811 I | etcdserver/api/v3rpc: Failed to > dial 192.168.222.24:2379 <http://192.168.222.24:2379>: context > canceled; please retry. > ERRO[2018-04-04 09:28:22.070891] failed to start embedded > store??????????????? error="dial tcp 192.168.222.24:2379 > <http://192.168.222.24:2379>: getsockopt: connection refused" > source="[embed.go:36:store.newEmbedStore]" > FATA[2018-04-04 09:28:22.071038] Failed to initialize store (etcd > client)????? error="dial tcp 192.168.222.24:2379 > <http://192.168.222.24:2379>: getsockopt: connection refused" > source="[main.go:89:main.main]" > > > cat glusterd2.toml > localstatedir = "/var/lib/glusterd2" > logdir = "/var/log/glusterd2" > logfile = "glusterd2.log" > rundir = "/usr/var/run/glusterd2" > peeraddress = "192.168.222.24:24008 <http://192.168.222.24:24008>" > clientaddress = "192.168.222.24:24007 <http://192.168.222.24:24007>" > etcdcurls = "http://192.168.222.24:2379" > etcdpurls = "http://192.168.222.24:2380" > > > Any ideas? > > > Thank you! > > > > > _______________________________________________ > Gluster-users mailing list > Gluster-users at gluster.org <mailto:Gluster-users at gluster.org> > http://lists.gluster.org/mailman/listinfo/gluster-users > <http://lists.gluster.org/mailman/listinfo/gluster-users> > >-------------- next part -------------- An HTML attachment was scrubbed... URL: <http://lists.gluster.org/pipermail/gluster-users/attachments/20180406/b91dff0d/attachment.html>