Displaying 10 results from an estimated 10 matches for "dht_migrate_fil".
Did you mean:
dht_migrate_file
2013 Nov 09
2
Failed rebalance - lost files, inaccessible files, permission issues
...r uploads. That
was a two-day-long wrong-tree barking session because I didn't
understand the architecture.
When I looked at the individual cases of lost or corrupted files, one
thing kept staring at me in the face until I recognized it:
[2013-11-02 03:56:36.472170] I [dht-rebalance.c:647:dht_migrate_file]
0-mdfs-dht: /REDACTED/mdfs/AKG/akgphotos/docs/000/002: attempting to
move from mdfs-replicate-2 to mdfs-replicate-12
[2013-11-02 03:56:36.472186] I [dht-rebalance.c:647:dht_migrate_file]
0-mdfs-dht: /REDACTED/mdfs/AKG/akgphotos/docs/000/002: attempting to
move from mdfs-replicate-2 to mdfs-re...
2018 May 23
0
Rebalance state stuck or corrupted
...opped. Time taken is 749380.00 secs
[2018-05-23 17:32:55.262234] I [MSGID: 109028]
[dht-rebalance.c:4083:gf_defrag_status_get] 0-glusterfs: Files migrated:
821417, size: 25797609415002, lookups: 1162021, failures: 0, skipped: 1814
[2018-05-23 17:32:55.777149] I [MSGID: 109022]
[dht-rebalance.c:1703:dht_migrate_file] 0-gv0-dht: completed migration of
/pnrsy/v-zhli2/generated/ende_with_teacher/model/translate_ende_wmt32k_distill/transformer_nat-transformer_nat_base_v1-id016_lr0.1_4000_reg5.0_neighbor_hinge0.5_exp_distill_2.0_no_average_kl/model.ckpt-50724.data-00002-of-00003
from subvolume gv0-replicate-0 to g...
2017 Oct 19
3
gluster tiering errors
...ayout for
path=/path/to/<file>
[2017-10-19 17:52:07.526088] E [MSGID: 109023]
[dht-rebalance.c:757:__dht_rebalance_create_dst_file]
0-<vol>-tier-dht: failed to create <file> on <vol>-hot-dht [Input/output
error]
[2017-10-19 17:52:07.526111] E [MSGID: 0]
[dht-rebalance.c:1696:dht_migrate_file]
0-<vol>-tier-dht: Create dst failed on - <vol>-hot-dht for file - <file>
[2017-10-19 17:52:07.527214] E [MSGID: 109037]
[tier.c:969:tier_migrate_link] 0-<vol>-tier-dht: Failed to migrate <file>
[No space left on device]
[2017-10-19 17:52:07.527244] I [MSGID: 109038]...
2017 Oct 24
2
gluster tiering errors
...>> [2017-10-19 17:52:07.526088] E [MSGID: 109023]
>> [dht-rebalance.c:757:__dht_rebalance_create_dst_file] 0-<vol>-tier-dht:
>> failed to create <file> on <vol>-hot-dht [Input/output error]
>> [2017-10-19 17:52:07.526111] E [MSGID: 0] [dht-rebalance.c:1696:dht_migrate_file]
>> 0-<vol>-tier-dht: Create dst failed on - <vol>-hot-dht for file - <file>
>> [2017-10-19 17:52:07.527214] E [MSGID: 109037]
>> [tier.c:969:tier_migrate_link] 0-<vol>-tier-dht: Failed to migrate <file>
>> [No space left on device]
>> [2...
2017 Oct 27
0
gluster tiering errors
...017-10-19 17:52:07.526088] E [MSGID: 109023]
>>> [dht-rebalance.c:757:__dht_rebalance_create_dst_file] 0-<vol>-tier-dht:
>>> failed to create <file> on <vol>-hot-dht [Input/output error]
>>> [2017-10-19 17:52:07.526111] E [MSGID: 0] [dht-rebalance.c:1696:dht_migrate_file]
>>> 0-<vol>-tier-dht: Create dst failed on - <vol>-hot-dht for file - <file>
>>> [2017-10-19 17:52:07.527214] E [MSGID: 109037]
>>> [tier.c:969:tier_migrate_link] 0-<vol>-tier-dht: Failed to migrate <file>
>>> [No space left on dev...
2017 Oct 22
0
gluster tiering errors
.../to/<file>
> [2017-10-19 17:52:07.526088] E [MSGID: 109023]
> [dht-rebalance.c:757:__dht_rebalance_create_dst_file] 0-<vol>-tier-dht:
> failed to create <file> on <vol>-hot-dht [Input/output error]
> [2017-10-19 17:52:07.526111] E [MSGID: 0] [dht-rebalance.c:1696:dht_migrate_file]
> 0-<vol>-tier-dht: Create dst failed on - <vol>-hot-dht for file - <file>
> [2017-10-19 17:52:07.527214] E [MSGID: 109037]
> [tier.c:969:tier_migrate_link] 0-<vol>-tier-dht: Failed to migrate <file>
> [No space left on device]
> [2017-10-19 17:52:07.5...
2017 Oct 22
1
gluster tiering errors
...>> [2017-10-19 17:52:07.526088] E [MSGID: 109023]
>> [dht-rebalance.c:757:__dht_rebalance_create_dst_file] 0-<vol>-tier-dht:
>> failed to create <file> on <vol>-hot-dht [Input/output error]
>> [2017-10-19 17:52:07.526111] E [MSGID: 0] [dht-rebalance.c:1696:dht_migrate_file]
>> 0-<vol>-tier-dht: Create dst failed on - <vol>-hot-dht for file - <file>
>> [2017-10-19 17:52:07.527214] E [MSGID: 109037]
>> [tier.c:969:tier_migrate_link] 0-<vol>-tier-dht: Failed to migrate <file>
>> [No space left on device]
>> [2...
2012 Jun 28
1
Rebalance failures
...mpleted
gs2 0 0
45079 0 completed
gs4 0 0
45069 0 completed
The logs for this show:
[2012-06-28 13:35:54.100842] I [dht-rebalance.c:639:dht_migrate_file]
0-MAIL-dht:
/testuser393/maildir/new/1340909913.V14Ia51f68d6a66824a5M364717.test-gluster-client1:
attempting to move from MAIL-replicate-1 to MAIL-replicate-0
[2012-06-28 13:35:54.111880] W [dht-rebalance.c:353:__dht_check_free_space]
0-MAIL-dht: data movement attempted from node (MAIL-replicate-...
2013 Nov 06
0
remove-brick very slow for (distributed-)replicated volumes?
...this the expected speed for the operation or could there be an
issue? The only problem that I suspect is that the rebalance log for
the volume has the following kind of line for each file so I dont know
if this check is slowing down the process:
[2013-11-06 11:36:29.307612] I [dht-rebalance.c:860:dht_migrate_file]
0-v1-dht: completed migration of /file299 from subvolume
v1-replicate-0 to v1-replicate-1
[root at s5n9 ~]# gluster volume remove-brick v1
s5n9.testing.lan:/data/v1 s5n10.testing.lan:/data/v1 status
Node Rebalanced-files
size scanned failures...
2013 Mar 05
1
memory leak in 3.3.1 rebalance?
.../var/lib/glusterd/vols/bigdata/rebalance/5c338e03-28ff-429b-b702-0a04e25565f8.sock
--pid-file
/var/lib/glusterd/vols/bigdata/rebalance/5c338e03-28ff-429b-b702-0a04e25565f8.pid
-l /var/log/glusterfs/bigdata-rebalance.log
I am seeing a lot of:
[2013-03-05 10:59:51.170051] I [dht-rebalance.c:647:dht_migrate_file]
0-bigdata-dht: /a/c/lu/lu-nod/_4.nrm: attempting to move from
bigdata-replicate-23 to bigdata-replicate-17
[2013-03-05 10:59:51.296487] W
[dht-rebalance.c:361:__dht_check_free_space] 0-bigdata-dht: data
movement attempted from node (bigdata-replicate-23) with higher disk
space to a node (big...