Lalatendu Mohanty
2014-Jan-17 14:53 UTC
[Gluster-users] Issue with rebalance on 3.5.0-0.1.beta1
Hi All,
I came across a rebalance issue and reported a bug for it i.e. BZ
1054816, Rebalance reporting failure for file migrations on
3.5.0-0.1.beta1.
I can see failures in "rebalance status" output and also in rebalance
logs. I have provided the logs and steps in the bug.
gluster v rebalance volume2 status
Node Rebalanced-files size
scanned failures skipped status run time in secs
--------- ----------- -----------
----------- ----------- ----------- ------------ --------------
localhost 22
45.0KB 105116 3406 0 completed
856.00
10.16.159.83 8 18.0KB
105099 10981 0 completed 807.00
From Rebalance logs:
[2014-01-17 06:49:50.399810] E
[dht-rebalance.c:1289:gf_defrag_migrate_data] 0-volume2-dht:
/io/TestDir0/TestDir0/TestDir0/TestDir0/TestDir0/TestDir3/TestDir1/TestDir4/TestDir1/TestDir7/a1:
failed to get trusted.distribute.linkinfo key - Invalid argument
[2014-01-17 06:49:50.503700] E
[dht-rebalance.c:1289:gf_defrag_migrate_data] 0-volume2-dht:
/io/TestDir0/TestDir0/TestDir0/TestDir0/TestDir0/TestDir3/TestDir1/TestDir4/TestDir2/TestDir0/a0:
failed to get trusted.distribute.linkinfo key - Invalid argument
[2014-01-17 06:49:50.504809] E
[dht-rebalance.c:1289:gf_defrag_migrate_data] 0-volume2-dht:
/io/TestDir0/TestDir0/TestDir0/TestDir0/TestDir0/TestDir3/TestDir1/TestDir4/TestDir2/TestDir0/a1:
failed to get trusted.distribute.linkinfo key - Invalid argument
[2014-01-17 06:49:51.571233] E
[dht-rebalance.c:1289:gf_defrag_migrate_data] 0-volume2-dht:
/io/TestDir0/TestDir0/TestDir0/TestDir0/TestDir0/TestDir3/TestDir1/TestDir4/TestDir5/a0:
failed to get trusted.distribute.linkinfo key - Success
[2014-01-17 06:49:51.572306] E
[dht-rebalance.c:1289:gf_defrag_migrate_data] 0-volume2-dht:
/io/TestDir0/TestDir0/TestDir0/TestDir0/TestDir0/TestDir3/TestDir1/TestDir4/TestDir5/a1:
failed to get trusted.distribute.linkinfo key - Invalid argument
[2014-01-17 06:49:53.077829] E
[dht-rebalance.c:1289:gf_defrag_migrate_data] 0-volume2-dht: /nfs-io/a8:
failed to get trusted.distribute.linkinfo key - Invalid argument
[2014-01-17 06:49:53.078587] E
[dht-rebalance.c:1289:gf_defrag_migrate_data] 0-volume2-dht: /nfs-io/b1:
failed to get trusted.distribute.linkinfo key - Invalid argument
[2014-01-17 06:49:53.079561] E
[dht-rebalance.c:1289:gf_defrag_migrate_data] 0-volume2-dht: /nfs-io/b2:
failed to get trusted.distribute.linkinfo key - Invalid argument
[2014-01-17 06:49:53.080469] E
[dht-rebalance.c:1289:gf_defrag_migrate_data] 0-volume2-dht: /nfs-io/b3:
failed to get trusted.distribute.linkinfo key - Invalid argument
[2014-01-17 06:49:53.081263] E
[dht-rebalance.c:1289:gf_defrag_migrate_data] 0-volume2-dht: /nfs-io/b4:
failed to get trusted.distribute.linkinfo key - Invalid argument
[2014-01-17 06:49:53.082186] E
[dht-rebalance.c:1289:gf_defrag_migrate_data] 0-volume2-dht: /nfs-io/b9:
failed to get trusted.distribute.linkinfo key - Invalid argument
[2014-01-17 06:49:53.083123] E
[dht-rebalance.c:1289:gf_defrag_migrate_data] 0-volume2-dht: /nfs-io/c0:
failed to get trusted.distribute.linkinfo key - Invalid argument
-Lala
Lalatendu Mohanty
2014-Jan-18 05:07 UTC
[Gluster-users] Issue with rebalance on 3.5.0-0.1.beta1
Adding Gluster devel mailing list. On 01/17/2014 08:23 PM, Lalatendu Mohanty wrote:> Hi All, > > I came across a rebalance issue and reported a bug for it i.e. BZ > 1054816, Rebalance reporting failure for file migrations on > 3.5.0-0.1.beta1. > > I can see failures in "rebalance status" output and also in rebalance > logs. I have provided the logs and steps in the bug. > > gluster v rebalance volume2 status > > Node Rebalanced-files size > scanned failures skipped status run time in secs > --------- ----------- > ----------- ----------- ----------- ----------- ------------ > -------------- > localhost 22 > 45.0KB 105116 3406 0 completed > 856.00 > 10.16.159.83 8 > 18.0KB 105099 10981 0 completed > 807.00 > > From Rebalance logs: > > [2014-01-17 06:49:50.399810] E > [dht-rebalance.c:1289:gf_defrag_migrate_data] 0-volume2-dht: > /io/TestDir0/TestDir0/TestDir0/TestDir0/TestDir0/TestDir3/TestDir1/TestDir4/TestDir1/TestDir7/a1: > failed to get trusted.distribute.linkinfo key - Invalid argument > [2014-01-17 06:49:50.503700] E > [dht-rebalance.c:1289:gf_defrag_migrate_data] 0-volume2-dht: > /io/TestDir0/TestDir0/TestDir0/TestDir0/TestDir0/TestDir3/TestDir1/TestDir4/TestDir2/TestDir0/a0: > failed to get trusted.distribute.linkinfo key - Invalid argument > [2014-01-17 06:49:50.504809] E > [dht-rebalance.c:1289:gf_defrag_migrate_data] 0-volume2-dht: > /io/TestDir0/TestDir0/TestDir0/TestDir0/TestDir0/TestDir3/TestDir1/TestDir4/TestDir2/TestDir0/a1: > failed to get trusted.distribute.linkinfo key - Invalid argument > [2014-01-17 06:49:51.571233] E > [dht-rebalance.c:1289:gf_defrag_migrate_data] 0-volume2-dht: > /io/TestDir0/TestDir0/TestDir0/TestDir0/TestDir0/TestDir3/TestDir1/TestDir4/TestDir5/a0: > failed to get trusted.distribute.linkinfo key - Success > [2014-01-17 06:49:51.572306] E > [dht-rebalance.c:1289:gf_defrag_migrate_data] 0-volume2-dht: > /io/TestDir0/TestDir0/TestDir0/TestDir0/TestDir0/TestDir3/TestDir1/TestDir4/TestDir5/a1: > failed to get trusted.distribute.linkinfo key - Invalid argument > [2014-01-17 06:49:53.077829] E > [dht-rebalance.c:1289:gf_defrag_migrate_data] 0-volume2-dht: > /nfs-io/a8: failed to get trusted.distribute.linkinfo key - Invalid > argument > [2014-01-17 06:49:53.078587] E > [dht-rebalance.c:1289:gf_defrag_migrate_data] 0-volume2-dht: > /nfs-io/b1: failed to get trusted.distribute.linkinfo key - Invalid > argument > [2014-01-17 06:49:53.079561] E > [dht-rebalance.c:1289:gf_defrag_migrate_data] 0-volume2-dht: > /nfs-io/b2: failed to get trusted.distribute.linkinfo key - Invalid > argument > [2014-01-17 06:49:53.080469] E > [dht-rebalance.c:1289:gf_defrag_migrate_data] 0-volume2-dht: > /nfs-io/b3: failed to get trusted.distribute.linkinfo key - Invalid > argument > [2014-01-17 06:49:53.081263] E > [dht-rebalance.c:1289:gf_defrag_migrate_data] 0-volume2-dht: > /nfs-io/b4: failed to get trusted.distribute.linkinfo key - Invalid > argument > [2014-01-17 06:49:53.082186] E > [dht-rebalance.c:1289:gf_defrag_migrate_data] 0-volume2-dht: > /nfs-io/b9: failed to get trusted.distribute.linkinfo key - Invalid > argument > [2014-01-17 06:49:53.083123] E > [dht-rebalance.c:1289:gf_defrag_migrate_data] 0-volume2-dht: > /nfs-io/c0: failed to get trusted.distribute.linkinfo key - Invalid > argument > > > -Lala > > _______________________________________________ > Gluster-users mailing list > Gluster-users at gluster.org > http://supercolony.gluster.org/mailman/listinfo/gluster-users