Gluster users - Dec 2014 - Problem starting glusterd on CentOS 6

Hello,

we have a glusterfs 3.6.1 installation on CentOS 6 with two servers and
one brick each. We just saw some trouble with inodes not being able to
be read and decided to shut down one of our servers and run a xfs_repair
and the filesystem.  (This turned up nothing.)

After which we tried to start the glusterd server again, but we only got
a few error messages in the logs and I'm not sure what to do next. Any
help would be very appreciated.

Our systems are gluster1/2 and each has a brick named brick0. If you
need any further information please ask.

The log messages fro gluster2 follow:

data-brick0-brick.log:

[2014-12-04 13:54:54.862104] I [MSGID: 100030] [glusterfsd.c:2018:main]
0-/usr/sbin/glusterfsd: Started running /usr/sbin/glusterfsd version
3.6.1 (args: /usr/sbin/glusterfsd -s gluster2 --volfile-id
data.gluster2.data-brick0-brick -p
/var/lib/glusterd/vols/data/run/gluster2-data-brick0-brick.pid -S
/var/run/75e81344cb7da77f1168ab31c31bfebd.socket --brick-name
/data/brick0/brick -l /var/log/glusterfs/bricks/data-brick0-brick.log
--xlator-option
*-posix.glusterd-uuid=1ad5077c-4314-43f1-84ef-e560ca62e155 --brick-port
49154 --xlator-option data-server.listen-port=49154)
[2014-12-04 13:55:57.868573] E [socket.c:2267:socket_connect_finish]
0-glusterfs: connection to 192.168.1.19:24007 failed (Connection timed
out)
[2014-12-04 13:55:57.868696] E [glusterfsd-mgmt.c:1811:mgmt_rpc_notify]
0-glusterfsd-mgmt: failed to connect with remote-host: gluster2
(Transport endpoint is not connected)
[2014-12-04 13:55:57.868722] I [glusterfsd-mgmt.c:1817:mgmt_rpc_notify]
0-glusterfsd-mgmt: Exhausted all volfile servers
[2014-12-04 13:55:57.869050] W [glusterfsd.c:1194:cleanup_and_exit] (-->
0-: received signum (1), shutting down
[2014-12-04 13:55:57.875266] W [rpc-clnt.c:1562:rpc_clnt_submit]
0-glusterfs: failed to submit rpc-request (XID: 0x1 Program: Gluster
Portmap, ProgVers: 1, Proc: 5) to rpc-transport (glusterfs)

etc-glusterfs-glusterd.vol.log (we get a lot of the following wiht
different UUIDs):

[2014-12-04 14:03:16.431380] W [socket.c:611:__socket_rwv] 0-management:
readv on /var/run/75e81344cb7da77f1168ab31c31bfebd.socket failed
(Invalid argument)


glustershd.log:
[2014-12-04 13:55:57.891652] E [socket.c:2267:socket_connect_finish]
0-data-client-1: connection to 192.168.1.19:24007 failed (Connection
timed out)
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 490 bytes
Desc: not available
URL:
<http://supercolony.gluster.org/pipermail/gluster-users/attachments/20141204/0a477231/attachment.sig>

Here is also a complete debug log from starting glusterd:

	-jhz

http://www.l3s.de/~zab/glusterfs.log
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 490 bytes
Desc: not available
URL:
<http://supercolony.gluster.org/pipermail/gluster-users/attachments/20141204/3b7877a1/attachment.sig>