Hello, I have 5 glusterfs nodes with 3.3.1, last week I upgraded them to version 3.4.2, everything works. This week I like adding more node to it with version 3.4.2, whatever I did can not put the new nodes to the cluster, it always says State: Peer Rejected (Connected) Finally I clean up everything on new nodes and install version 3.3.1, I managed to add the new node to cluster. and then I did an upgrade. after this, I tried to add bricks to volume, glusterfs complains failed. the following is the log: /var/log/glusterfs/glustershd.log [2014-03-26 14:07:00.853501] W [socket.c:514:__socket_rwv] 0-puppet-bucket-client-6: readv failed (No data available) [2014-03-26 14:07:00.853536] I [client.c:2097:client_rpc_notify] 0-puppet-bucket-client-6: disconnected [2014-03-26 14:07:00.854137] W [socket.c:514:__socket_rwv] 0-puppet-bucket-client-7: readv failed (No data available) [2014-03-26 14:07:03.856700] W [socket.c:514:__socket_rwv] 0-puppet-ssl-client-6: readv failed (No data available) [2014-03-26 14:07:03.856739] I [client.c:2097:client_rpc_notify] 0-puppet-ssl-client-6: disconnected [2014-03-26 14:07:03.857543] W [socket.c:514:__socket_rwv] 0-puppet-dist-client-6: readv failed (No data available) [2014-03-26 14:07:03.857592] I [client.c:2097:client_rpc_notify] 0-puppet-dist-client-6: disconnected [2014-03-26 14:07:03.858523] W [socket.c:514:__socket_rwv] 0-puppet-bucket-client-6: readv failed (No data available) [2014-03-26 14:07:03.858559] I [client.c:2097:client_rpc_notify] 0-puppet-bucket-client-6: disconnected [2014-03-26 14:07:03.859330] W [socket.c:514:__socket_rwv] 0-puppet-bucket-client-7: readv failed (No data available) /var/log/glusterfs/bricks/opt-gluster-data-puppet-ssl.log [2014-03-26 13:34:02.302321] I [server-handshake.c:567:server_setvolume] 0-puppet-ssl-server: accepted client from pup-p-cfg002-6006-2014/03/25-20:29:51:414670-puppet-ssl-client-5-0 (version: 3.4.2) [2014-03-26 13:34:02.390477] I [server-handshake.c:567:server_setvolume] 0-puppet-ssl-server: accepted client from pup-p-cfg002-5999-2014/03/25-20:29:50:410326-puppet-ssl-client-5-0 (version: 3.4.2) [2014-03-26 13:35:00.968658] I [server.c:762:server_rpc_notify] 0-puppet-ssl-server: disconnecting connectionfrom pup-p-cfg006-3084-2014/03/26-13:27:50:521718-puppet-ssl-client-5-0 [2014-03-26 13:35:00.968697] I [server-helpers.c:729:server_connection_put] 0-puppet-ssl-server: Shutting down connection pup-p-cfg006-3084-2014/03/26-13:27:50:521718-puppet-ssl-client-5-0 [2014-03-26 13:35:00.968719] I [server-helpers.c:617:server_connection_destroy] 0-puppet-ssl-server: destroyed connection of pup-p-cfg006-3084-2014/03/26-13:27:50:521718-puppet-ssl-client-5-0 [2014-03-26 13:35:00.973661] I [server.c:762:server_rpc_notify] 0-puppet-ssl-server: disconnecting connectionfrom pup-p-cfg006-3079-2014/03/26-13:27:50:514210-puppet-ssl-client-5-0 [2014-03-26 13:35:00.973707] I [server-helpers.c:729:server_connection_put] 0-puppet-ssl-server: Shutting down connection pup-p-cfg006-3079-2014/03/26-13:27:50:514210-puppet-ssl-client-5-0 [2014-03-26 13:35:00.973731] I [server-helpers.c:617:server_connection_destroy] 0-puppet-ssl-server: destroyed connection of pup-p-cfg006-3079-2014/03/26-13:27:50:514210-puppet-ssl-client-5-0 [2014-03-26 13:35:35.916298] I [server-handshake.c:567:server_setvolume] 0-puppet-ssl-server: accepted client from pup-p-cfg006-6366-2014/03/26-13:35:31:901289-puppet-ssl-client-5-0 (version: 3.3.1) [2014-03-26 13:35:35.917272] I [server-handshake.c:567:server_setvolume] 0-puppet-ssl-server: accepted client from pup-p-cfg006-6372-2014/03/26-13:35:31:907067-puppet-ssl-client-5-0 (version: 3.3.1) ^C -- Yang Orange Key: 35745318S1 BBM PIN:7457867C -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://supercolony.gluster.org/pipermail/gluster-users/attachments/20140326/39f9bc4f/attachment.html>