Pat Haley
2020-Aug-27 14:32 UTC
[Gluster-users] gluster volume rebalance making things more unbalanced
Hi, We have distributed gluster volume spread across 4 bricks. Yesterday I noticed that the remaining space was uneven (about 2.7TB, 1.7TB, 1TB, 1TB) so I issued the following rebalance command * |gluster volume rebalance <VOLNAME> start force| Today I see that instead, things have gotten even more unbalanced (64G 853G 6.2T 20K).? I'm killing the rebalance now.? What should I do to make sure that I get a successful rebalance? Thanks Pat|| -- -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- Pat Haley Email: phaley at mit.edu Center for Ocean Engineering Phone: (617) 253-6824 Dept. of Mechanical Engineering Fax: (617) 253-8125 MIT, Room 5-213 http://web.mit.edu/phaley/www/ 77 Massachusetts Avenue Cambridge, MA 02139-4301 -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://lists.gluster.org/pipermail/gluster-users/attachments/20200827/2f547eca/attachment.html>
Strahil Nikolov
2020-Aug-27 14:43 UTC
[Gluster-users] gluster volume rebalance making things more unbalanced
Sadly I have no idea why rebalance did that , so you should check the logs on all nodes for clues. Is there any reason why you used "force" in that command ? Best Regards, Strahil Nikolov ? ?????????, 27 ?????? 2020 ?., 17:32:24 ???????+3, Pat Haley <phaley at mit.edu> ??????: Hi, We have distributed gluster volume spread across 4 bricks.? Yesterday I noticed that the remaining space was uneven (about 2.7TB, 1.7TB, 1TB, 1TB) so I issued the following rebalance command ???? ????* gluster volume rebalance <VOLNAME> start force ???? Today I see that instead, things have gotten even more unbalanced (64G 853G 6.2T 20K).? I'm killing the rebalance now.? What should I do to make sure that I get a successful rebalance? Thanks Pat -- -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- Pat Haley??????????????????????????Email:??phaley at mit.edu Center for Ocean Engineering?????? Phone:??(617) 253-6824 Dept. of Mechanical Engineering????Fax:????(617) 253-8125 MIT, Room 5-213????????????????????http://web.mit.edu/phaley/www/ 77 Massachusetts Avenue Cambridge, MA??02139-4301 ________ Community Meeting Calendar: Schedule - Every 2nd and 4th Tuesday at 14:30 IST / 09:00 UTC Bridge: https://bluejeans.com/441850968 Gluster-users mailing list Gluster-users at gluster.org https://lists.gluster.org/mailman/listinfo/gluster-users
Joe Julian
2020-Aug-27 14:53 UTC
[Gluster-users] gluster volume rebalance making things more unbalanced
When a file should be moved based on its dht hash mapping but the target that it should be moved to has less free space than the origin, the rebalance command does not move the file and leaves the dht pointer in place. When you use "force", you override that behavior and always move each file regardless of free space. In theory, eventually when the rebalance is finished you should end up with utilization mostly balanced but as the rebalance is processing you may end up in the state you show. On August 27, 2020 7:32:16 AM PDT, Pat Haley <phaley at mit.edu> wrote:> >Hi, > >We have distributed gluster volume spread across 4 bricks. Yesterday I >noticed that the remaining space was uneven (about 2.7TB, 1.7TB, 1TB, >1TB) so I issued the following rebalance command > > * |gluster volume rebalance <VOLNAME> start force| > >Today I see that instead, things have gotten even more unbalanced (64G >853G 6.2T 20K).? I'm killing the rebalance now.? What should I do to >make sure that I get a successful rebalance? > >Thanks > >Pat|| > >-- > >-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- >Pat Haley Email: phaley at mit.edu >Center for Ocean Engineering Phone: (617) 253-6824 >Dept. of Mechanical Engineering Fax: (617) 253-8125 >MIT, Room 5-213 http://web.mit.edu/phaley/www/ >77 Massachusetts Avenue >Cambridge, MA 02139-4301-- Sent from my Android device with K-9 Mail. Please excuse my brevity. -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://lists.gluster.org/pipermail/gluster-users/attachments/20200827/cd5a8fbc/attachment.html>