phil cryer
2010-May-04 15:26 UTC
[Gluster-users] Posix warning : Access to ... is crossing device
I have a distributed/replicated setup with Glusterfs 3.0.2, that I'm
testing on 4 servers, each with access to /mnt/gluster (which consists
of all directories /mnt/data01 - data24) on each server. I'm using
configs I built from volgen, but every time I access a file (via an
'ls -l') for the first time, I get all of these messages in my logs on
each server:
[2010-05-04 10:50:30] W [posix.c:246:posix_lstat_with_gen] posix1:
Access to /mnt/data01//.. (on dev 16771) is crossing device (2257)
[2010-05-04 10:50:30] W [posix.c:246:posix_lstat_with_gen] posix3:
Access to /mnt/data03//.. (on dev 16771) is crossing device (2241)
[2010-05-04 10:50:30] W [posix.c:246:posix_lstat_with_gen] posix5:
Access to /mnt/data05//.. (on dev 16771) is crossing device (2225)
[2010-05-04 10:50:30] W [posix.c:246:posix_lstat_with_gen] posix5:
Access to /mnt/data05//.. (on dev 16771) is crossing device (2225)
[2010-05-04 10:50:30] W [posix.c:246:posix_lstat_with_gen] posix7:
Access to /mnt/data07//.. (on dev 16771) is crossing device (16705)
[2010-05-04 10:50:30] W [posix.c:246:posix_lstat_with_gen] posix7:
Access to /mnt/data07//.. (on dev 16771) is crossing device (16705)
[2010-05-04 10:50:30] W [posix.c:246:posix_lstat_with_gen] posix9:
Access to /mnt/data09//.. (on dev 16771) is crossing device (2161)
[2010-05-04 10:50:30] W [posix.c:246:posix_lstat_with_gen] posix11:
Access to /mnt/data11//.. (on dev 16771) is crossing device (2113)
[2010-05-04 10:50:30] W [posix.c:246:posix_lstat_with_gen] posix11:
Access to /mnt/data11//.. (on dev 16771) is crossing device (2113)
[2010-05-04 10:50:30] W [posix.c:246:posix_lstat_with_gen] posix13:
Access to /mnt/data13//.. (on dev 16771) is crossing device (2081)
[2010-05-04 10:50:30] W [posix.c:246:posix_lstat_with_gen] posix15:
Access to /mnt/data15//.. (on dev 16771) is crossing device (16689)
[2010-05-04 10:50:30] W [posix.c:246:posix_lstat_with_gen] posix15:
Access to /mnt/data15//.. (on dev 16771) is crossing device (16689)
[2010-05-04 10:50:30] W [posix.c:246:posix_lstat_with_gen] posix17:
Access to /mnt/data17//.. (on dev 16771) is crossing device (2289)
[2010-05-04 10:50:30] W [posix.c:246:posix_lstat_with_gen] posix19:
Access to /mnt/data19//.. (on dev 16771) is crossing device (2049)
[2010-05-04 10:50:30] W [posix.c:246:posix_lstat_with_gen] posix21:
Access to /mnt/data21//.. (on dev 16771) is crossing device (16737)
[2010-05-04 10:50:30] W [posix.c:246:posix_lstat_with_gen] posix23:
Access to /mnt/data23//.. (on dev 16771) is crossing device (2065)
[2010-05-04 10:50:30] W [posix.c:246:posix_lstat_with_gen] posix23:
Access to /mnt/data23//.. (on dev 16771) is crossing device (2065)
What do I have setup incorrectly here? My config files are below, thanks.
# cat /etc/glusterfs/glusterfs.vol
########################################
## glusterfs.vol
## phil.cryer at mobot.org
########################################
# 128.128.164.74 clustr-01
# 128.128.164.89 clustr-02
# 128.128.164.215 clustr-03
# 128.128.164.217 clustr-04
# 128.128.164.218 clustr-05
# 128.128.164.219 clustr-06
########################################
# RAID 1
# TRANSPORT-TYPE tcp
########################################
########################################
volume clustr-03-1
type protocol/client
option transport-type tcp
option remote-host clustr-03
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick1
end-volume
volume clustr-03-2
type protocol/client
option transport-type tcp
option remote-host clustr-03
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick2
end-volume
volume clustr-03-3
type protocol/client
option transport-type tcp
option remote-host clustr-03
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick3
end-volume
volume clustr-03-4
type protocol/client
option transport-type tcp
option remote-host clustr-03
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick4
end-volume
volume clustr-03-5
type protocol/client
option transport-type tcp
option remote-host clustr-03
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick5
end-volume
volume clustr-03-6
type protocol/client
option transport-type tcp
option remote-host clustr-03
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick6
end-volume
volume clustr-03-7
type protocol/client
option transport-type tcp
option remote-host clustr-03
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick7
end-volume
volume clustr-03-8
type protocol/client
option transport-type tcp
option remote-host clustr-03
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick8
end-volume
volume clustr-03-9
type protocol/client
option transport-type tcp
option remote-host clustr-03
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick9
end-volume
volume clustr-03-10
type protocol/client
option transport-type tcp
option remote-host clustr-03
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick10
end-volume
volume clustr-03-11
type protocol/client
option transport-type tcp
option remote-host clustr-03
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick11
end-volume
volume clustr-03-12
type protocol/client
option transport-type tcp
option remote-host clustr-03
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick12
end-volume
volume clustr-03-13
type protocol/client
option transport-type tcp
option remote-host clustr-03
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick13
end-volume
volume clustr-03-14
type protocol/client
option transport-type tcp
option remote-host clustr-03
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick14
end-volume
volume clustr-03-15
type protocol/client
option transport-type tcp
option remote-host clustr-03
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick15
end-volume
volume clustr-03-16
type protocol/client
option transport-type tcp
option remote-host clustr-03
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick16
end-volume
volume clustr-03-17
type protocol/client
option transport-type tcp
option remote-host clustr-03
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick17
end-volume
volume clustr-03-18
type protocol/client
option transport-type tcp
option remote-host clustr-03
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick18
end-volume
volume clustr-03-19
type protocol/client
option transport-type tcp
option remote-host clustr-03
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick19
end-volume
volume clustr-03-20
type protocol/client
option transport-type tcp
option remote-host clustr-03
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick20
end-volume
volume clustr-03-21
type protocol/client
option transport-type tcp
option remote-host clustr-03
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick21
end-volume
volume clustr-03-22
type protocol/client
option transport-type tcp
option remote-host clustr-03
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick22
end-volume
volume clustr-03-23
type protocol/client
option transport-type tcp
option remote-host clustr-03
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick23
end-volume
volume clustr-03-24
type protocol/client
option transport-type tcp
option remote-host clustr-03
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick24
end-volume
########################################
volume clustr-06-1
type protocol/client
option transport-type tcp
option remote-host clustr-06
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick1
end-volume
volume clustr-06-2
type protocol/client
option transport-type tcp
option remote-host clustr-06
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick2
end-volume
volume clustr-06-3
type protocol/client
option transport-type tcp
option remote-host clustr-06
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick3
end-volume
volume clustr-06-4
type protocol/client
option transport-type tcp
option remote-host clustr-06
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick4
end-volume
volume clustr-06-5
type protocol/client
option transport-type tcp
option remote-host clustr-06
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick5
end-volume
volume clustr-06-6
type protocol/client
option transport-type tcp
option remote-host clustr-06
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick6
end-volume
volume clustr-06-7
type protocol/client
option transport-type tcp
option remote-host clustr-06
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick7
end-volume
volume clustr-06-8
type protocol/client
option transport-type tcp
option remote-host clustr-06
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick8
end-volume
volume clustr-06-9
type protocol/client
option transport-type tcp
option remote-host clustr-06
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick9
end-volume
volume clustr-06-10
type protocol/client
option transport-type tcp
option remote-host clustr-06
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick10
end-volume
volume clustr-06-11
type protocol/client
option transport-type tcp
option remote-host clustr-06
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick11
end-volume
volume clustr-06-12
type protocol/client
option transport-type tcp
option remote-host clustr-06
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick12
end-volume
volume clustr-06-13
type protocol/client
option transport-type tcp
option remote-host clustr-06
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick13
end-volume
volume clustr-06-14
type protocol/client
option transport-type tcp
option remote-host clustr-06
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick14
end-volume
volume clustr-06-15
type protocol/client
option transport-type tcp
option remote-host clustr-06
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick15
end-volume
volume clustr-06-16
type protocol/client
option transport-type tcp
option remote-host clustr-06
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick16
end-volume
volume clustr-06-17
type protocol/client
option transport-type tcp
option remote-host clustr-06
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick17
end-volume
volume clustr-06-18
type protocol/client
option transport-type tcp
option remote-host clustr-06
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick18
end-volume
volume clustr-06-19
type protocol/client
option transport-type tcp
option remote-host clustr-06
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick19
end-volume
volume clustr-06-20
type protocol/client
option transport-type tcp
option remote-host clustr-06
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick20
end-volume
volume clustr-06-21
type protocol/client
option transport-type tcp
option remote-host clustr-06
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick21
end-volume
volume clustr-06-22
type protocol/client
option transport-type tcp
option remote-host clustr-06
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick22
end-volume
volume clustr-06-23
type protocol/client
option transport-type tcp
option remote-host clustr-06
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick23
end-volume
volume clustr-06-24
type protocol/client
option transport-type tcp
option remote-host clustr-06
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick24
end-volume
########################################
volume clustr-01-1
type protocol/client
option transport-type tcp
option remote-host clustr-01
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick1
end-volume
volume clustr-01-2
type protocol/client
option transport-type tcp
option remote-host clustr-01
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick2
end-volume
volume clustr-01-3
type protocol/client
option transport-type tcp
option remote-host clustr-01
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick3
end-volume
volume clustr-01-4
type protocol/client
option transport-type tcp
option remote-host clustr-01
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick4
end-volume
volume clustr-01-5
type protocol/client
option transport-type tcp
option remote-host clustr-01
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick5
end-volume
volume clustr-01-6
type protocol/client
option transport-type tcp
option remote-host clustr-01
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick6
end-volume
volume clustr-01-7
type protocol/client
option transport-type tcp
option remote-host clustr-01
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick7
end-volume
volume clustr-01-8
type protocol/client
option transport-type tcp
option remote-host clustr-01
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick8
end-volume
volume clustr-01-9
type protocol/client
option transport-type tcp
option remote-host clustr-01
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick9
end-volume
volume clustr-01-10
type protocol/client
option transport-type tcp
option remote-host clustr-01
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick10
end-volume
volume clustr-01-11
type protocol/client
option transport-type tcp
option remote-host clustr-01
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick11
end-volume
volume clustr-01-12
type protocol/client
option transport-type tcp
option remote-host clustr-01
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick12
end-volume
volume clustr-01-13
type protocol/client
option transport-type tcp
option remote-host clustr-01
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick13
end-volume
volume clustr-01-14
type protocol/client
option transport-type tcp
option remote-host clustr-01
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick14
end-volume
volume clustr-01-15
type protocol/client
option transport-type tcp
option remote-host clustr-01
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick15
end-volume
volume clustr-01-16
type protocol/client
option transport-type tcp
option remote-host clustr-01
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick16
end-volume
volume clustr-01-17
type protocol/client
option transport-type tcp
option remote-host clustr-01
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick17
end-volume
volume clustr-01-18
type protocol/client
option transport-type tcp
option remote-host clustr-01
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick18
end-volume
volume clustr-01-19
type protocol/client
option transport-type tcp
option remote-host clustr-01
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick19
end-volume
volume clustr-01-20
type protocol/client
option transport-type tcp
option remote-host clustr-01
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick20
end-volume
volume clustr-01-21
type protocol/client
option transport-type tcp
option remote-host clustr-01
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick21
end-volume
volume clustr-01-22
type protocol/client
option transport-type tcp
option remote-host clustr-01
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick22
end-volume
volume clustr-01-23
type protocol/client
option transport-type tcp
option remote-host clustr-01
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick23
end-volume
volume clustr-01-24
type protocol/client
option transport-type tcp
option remote-host clustr-01
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick24
end-volume
########################################
volume clustr-02-1
type protocol/client
option transport-type tcp
option remote-host clustr-02
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick1
end-volume
volume clustr-02-2
type protocol/client
option transport-type tcp
option remote-host clustr-02
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick2
end-volume
volume clustr-02-3
type protocol/client
option transport-type tcp
option remote-host clustr-02
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick3
end-volume
volume clustr-02-4
type protocol/client
option transport-type tcp
option remote-host clustr-02
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick4
end-volume
volume clustr-02-5
type protocol/client
option transport-type tcp
option remote-host clustr-02
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick5
end-volume
volume clustr-02-6
type protocol/client
option transport-type tcp
option remote-host clustr-02
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick6
end-volume
volume clustr-02-7
type protocol/client
option transport-type tcp
option remote-host clustr-02
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick7
end-volume
volume clustr-02-8
type protocol/client
option transport-type tcp
option remote-host clustr-02
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick8
end-volume
volume clustr-02-9
type protocol/client
option transport-type tcp
option remote-host clustr-02
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick9
end-volume
volume clustr-02-10
type protocol/client
option transport-type tcp
option remote-host clustr-02
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick10
end-volume
volume clustr-02-11
type protocol/client
option transport-type tcp
option remote-host clustr-02
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick11
end-volume
volume clustr-02-12
type protocol/client
option transport-type tcp
option remote-host clustr-02
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick12
end-volume
volume clustr-02-13
type protocol/client
option transport-type tcp
option remote-host clustr-02
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick13
end-volume
volume clustr-02-14
type protocol/client
option transport-type tcp
option remote-host clustr-02
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick14
end-volume
volume clustr-02-15
type protocol/client
option transport-type tcp
option remote-host clustr-02
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick15
end-volume
volume clustr-02-16
type protocol/client
option transport-type tcp
option remote-host clustr-02
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick16
end-volume
volume clustr-02-17
type protocol/client
option transport-type tcp
option remote-host clustr-02
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick17
end-volume
volume clustr-02-18
type protocol/client
option transport-type tcp
option remote-host clustr-02
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick18
end-volume
volume clustr-02-19
type protocol/client
option transport-type tcp
option remote-host clustr-02
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick19
end-volume
volume clustr-02-20
type protocol/client
option transport-type tcp
option remote-host clustr-02
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick20
end-volume
volume clustr-02-21
type protocol/client
option transport-type tcp
option remote-host clustr-02
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick21
end-volume
volume clustr-02-22
type protocol/client
option transport-type tcp
option remote-host clustr-02
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick22
end-volume
volume clustr-02-23
type protocol/client
option transport-type tcp
option remote-host clustr-02
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick23
end-volume
volume clustr-02-24
type protocol/client
option transport-type tcp
option remote-host clustr-02
option transport.socket.nodelay on
option transport.remote-port 6996
option remote-subvolume brick24
end-volume
########################################
########################################
volume mirror-0
type cluster/replicate
subvolumes clustr-03-1 clustr-03-2
end-volume
volume mirror-1
type cluster/replicate
subvolumes clustr-03-3 clustr-03-4
end-volume
volume mirror-2
type cluster/replicate
subvolumes clustr-03-5 clustr-03-6
end-volume
volume mirror-3
type cluster/replicate
subvolumes clustr-03-7 clustr-03-8
end-volume
volume mirror-4
type cluster/replicate
subvolumes clustr-03-9 clustr-03-10
end-volume
volume mirror-5
type cluster/replicate
subvolumes clustr-03-11 clustr-03-12
end-volume
volume mirror-6
type cluster/replicate
subvolumes clustr-03-13 clustr-03-14
end-volume
volume mirror-7
type cluster/replicate
subvolumes clustr-03-15 clustr-03-16
end-volume
volume mirror-8
type cluster/replicate
subvolumes clustr-03-17 clustr-03-18
end-volume
volume mirror-9
type cluster/replicate
subvolumes clustr-03-19 clustr-03-20
end-volume
volume mirror-10
type cluster/replicate
subvolumes clustr-03-21 clustr-03-22
end-volume
volume mirror-11
type cluster/replicate
subvolumes clustr-03-23 clustr-03-24
end-volume
########################################
volume mirror-12
type cluster/replicate
subvolumes clustr-06-1 clustr-06-2
end-volume
volume mirror-13
type cluster/replicate
subvolumes clustr-06-3 clustr-06-4
end-volume
volume mirror-14
type cluster/replicate
subvolumes clustr-06-5 clustr-06-6
end-volume
volume mirror-15
type cluster/replicate
subvolumes clustr-06-7 clustr-06-8
end-volume
volume mirror-16
type cluster/replicate
subvolumes clustr-06-9 clustr-06-10
end-volume
volume mirror-17
type cluster/replicate
subvolumes clustr-06-11 clustr-06-12
end-volume
volume mirror-18
type cluster/replicate
subvolumes clustr-06-13 clustr-06-14
end-volume
volume mirror-19
type cluster/replicate
subvolumes clustr-06-15 clustr-06-16
end-volume
volume mirror-20
type cluster/replicate
subvolumes clustr-06-17 clustr-06-18
end-volume
volume mirror-21
type cluster/replicate
subvolumes clustr-06-19 clustr-06-20
end-volume
volume mirror-22
type cluster/replicate
subvolumes clustr-06-21 clustr-06-22
end-volume
volume mirror-23
type cluster/replicate
subvolumes clustr-06-23 clustr-06-24
end-volume
########################################
volume mirror-24
type cluster/replicate
subvolumes clustr-01-1 clustr-01-2
end-volume
volume mirror-25
type cluster/replicate
subvolumes clustr-01-3 clustr-01-4
end-volume
volume mirror-26
type cluster/replicate
subvolumes clustr-01-5 clustr-01-6
end-volume
volume mirror-27
type cluster/replicate
subvolumes clustr-01-7 clustr-01-8
end-volume
volume mirror-28
type cluster/replicate
subvolumes clustr-01-9 clustr-01-10
end-volume
volume mirror-29
type cluster/replicate
subvolumes clustr-01-11 clustr-01-12
end-volume
volume mirror-30
type cluster/replicate
subvolumes clustr-01-13 clustr-01-14
end-volume
volume mirror-31
type cluster/replicate
subvolumes clustr-01-15 clustr-01-16
end-volume
volume mirror-32
type cluster/replicate
subvolumes clustr-01-17 clustr-01-18
end-volume
volume mirror-33
type cluster/replicate
subvolumes clustr-01-19 clustr-01-20
end-volume
volume mirror-34
type cluster/replicate
subvolumes clustr-01-21 clustr-01-22
end-volume
volume mirror-35
type cluster/replicate
subvolumes clustr-01-23 clustr-01-24
end-volume
########################################
volume mirror-36
type cluster/replicate
subvolumes clustr-02-1 clustr-02-2
end-volume
volume mirror-37
type cluster/replicate
subvolumes clustr-02-3 clustr-02-4
end-volume
volume mirror-38
type cluster/replicate
subvolumes clustr-02-5 clustr-02-6
end-volume
volume mirror-39
type cluster/replicate
subvolumes clustr-02-7 clustr-02-8
end-volume
volume mirror-40
type cluster/replicate
subvolumes clustr-02-9 clustr-02-10
end-volume
volume mirror-41
type cluster/replicate
subvolumes clustr-02-11 clustr-02-12
end-volume
volume mirror-42
type cluster/replicate
subvolumes clustr-02-13 clustr-02-14
end-volume
volume mirror-43
type cluster/replicate
subvolumes clustr-02-15 clustr-02-16
end-volume
volume mirror-44
type cluster/replicate
subvolumes clustr-02-17 clustr-02-18
end-volume
volume mirror-45
type cluster/replicate
subvolumes clustr-02-19 clustr-02-20
end-volume
volume mirror-46
type cluster/replicate
subvolumes clustr-02-21 clustr-02-22
end-volume
volume mirror-47
type cluster/replicate
subvolumes clustr-02-23 clustr-02-24
end-volume
########################################
########################################
volume distribute
type cluster/distribute
subvolumes mirror-0 mirror-1 mirror-2 mirror-3 mirror-4 mirror-5
mirror-6 mirror-7 mirror-8 mirror-9 mirror-10 mirror-11 mirror-12
mirror-13 mirror-14 mirror-15 mirror-16 mirror-17 mirror-18 mirror-19
mirror-20 mirror-21 mirror-22 mirror-23 mirror-24 mirror-25 mirror-26
mirror-27 mirror-28 mirror-29 mirror-30 mirror-31 mirror-32 mirror-33
mirror-34 mirror-35 mirror-36 mirror-37 mirror-38 mirror-39 mirror-40
mirror-41 mirror-42 mirror-43 mirror-44 mirror-45 mirror-46 mirror-47
end-volume
########################################
########################################
volume writebehind
type performance/write-behind
option cache-size 4MB
subvolumes distribute
end-volume
volume readahead
type performance/read-ahead
option page-count 4
subvolumes writebehind
end-volume
volume iocache
type performance/io-cache
option cache-size `grep 'MemTotal' /proc/meminfo | awk '{print
$2
* 0.2 / 1024}' | cut -f1 -d.`MB
option cache-timeout 1
subvolumes readahead
end-volume
volume quickread
type performance/quick-read
option cache-timeout 1
option max-file-size 64kB
subvolumes iocache
end-volume
volume statprefetch
type performance/stat-prefetch
subvolumes quickread
end-volume
########################################
########################################
# cat /etc/glusterfs/glusterfsd.vol
## file auto generated by /usr/local/bin/glusterfs-volgen (export.vol)
# Cmd line:
# $ /usr/local/bin/glusterfs-volgen --name store-0405 --raid 1
clustr-04:/mnt/data01 clustr-04:/mnt/data02 clustr-04:/mnt/data03
clustr-04:/mnt/data04 clustr-04:/mnt/data05 clustr-04:/mnt/data06
clustr-04:/mnt/data07 clustr-04:/mnt/data08 clustr-04:/mnt/data09
clustr-04:/mnt/data10 clustr-04:/mnt/data11 clustr-04:/mnt/data12
clustr-04:/mnt/data13 clustr-04:/mnt/data14 clustr-04:/mnt/data15
clustr-04:/mnt/data16 clustr-04:/mnt/data17 clustr-04:/mnt/data18
clustr-04:/mnt/data19 clustr-04:/mnt/data20 clustr-04:/mnt/data21
clustr-04:/mnt/data22 clustr-04:/mnt/data23 clustr-04:/mnt/data24
clustr-05:/mnt/data01 clustr-05:/mnt/data02 clustr-05:/mnt/data03
clustr-05:/mnt/data04 clustr-05:/mnt/data05 clustr-05:/mnt/data06
clustr-05:/mnt/data07 clustr-05:/mnt/data08 clustr-05:/mnt/data09
clustr-05:/mnt/data10 clustr-05:/mnt/data11 clustr-05:/mnt/data12
clustr-05:/mnt/data13 clustr-05:/mnt/data14 clustr-05:/mnt/data15
clustr-05:/mnt/data16 clustr-05:/mnt/data17 clustr-05:/mnt/data18
clustr-05:/mnt/data19 clustr-05:/mnt/data20 clustr-05:/mnt/data21
clustr-05:/mnt/data22 clustr-05:/mnt/data23 clustr-05:/mnt/data24
########################################
## glusterfs.vol
## phil.cryer at mobot.org
########################################
# 128.128.164.74 clustr-01
# 128.128.164.89 clustr-02
# 128.128.164.215 clustr-03
# 128.128.164.217 clustr-04
# 128.128.164.218 clustr-05
# 128.128.164.219 clustr-06
########################################
volume posix1
type storage/posix
option directory /mnt/data01
end-volume
volume locks1
type features/locks
subvolumes posix1
end-volume
volume brick1
type performance/io-threads
option thread-count 8
subvolumes locks1
end-volume
volume posix2
type storage/posix
option directory /mnt/data02
end-volume
volume locks2
type features/locks
subvolumes posix2
end-volume
volume brick2
type performance/io-threads
option thread-count 8
subvolumes locks2
end-volume
volume posix3
type storage/posix
option directory /mnt/data03
end-volume
volume locks3
type features/locks
subvolumes posix3
end-volume
volume brick3
type performance/io-threads
option thread-count 8
subvolumes locks3
end-volume
volume posix4
type storage/posix
option directory /mnt/data04
end-volume
volume locks4
type features/locks
subvolumes posix4
end-volume
volume brick4
type performance/io-threads
option thread-count 8
subvolumes locks4
end-volume
volume posix5
type storage/posix
option directory /mnt/data05
end-volume
volume locks5
type features/locks
subvolumes posix5
end-volume
volume brick5
type performance/io-threads
option thread-count 8
subvolumes locks5
end-volume
volume posix6
type storage/posix
option directory /mnt/data06
end-volume
volume locks6
type features/locks
subvolumes posix6
end-volume
volume brick6
type performance/io-threads
option thread-count 8
subvolumes locks6
end-volume
volume posix7
type storage/posix
option directory /mnt/data07
end-volume
volume locks7
type features/locks
subvolumes posix7
end-volume
volume brick7
type performance/io-threads
option thread-count 8
subvolumes locks7
end-volume
volume posix8
type storage/posix
option directory /mnt/data08
end-volume
volume locks8
type features/locks
subvolumes posix8
end-volume
volume brick8
type performance/io-threads
option thread-count 8
subvolumes locks8
end-volume
volume posix9
type storage/posix
option directory /mnt/data09
end-volume
volume locks9
type features/locks
subvolumes posix9
end-volume
volume brick9
type performance/io-threads
option thread-count 8
subvolumes locks9
end-volume
volume posix10
type storage/posix
option directory /mnt/data10
end-volume
volume locks10
type features/locks
subvolumes posix10
end-volume
volume brick10
type performance/io-threads
option thread-count 8
subvolumes locks10
end-volume
volume posix11
type storage/posix
option directory /mnt/data11
end-volume
volume locks11
type features/locks
subvolumes posix11
end-volume
volume brick11
type performance/io-threads
option thread-count 8
subvolumes locks11
end-volume
volume posix12
type storage/posix
option directory /mnt/data12
end-volume
volume locks12
type features/locks
subvolumes posix12
end-volume
volume brick12
type performance/io-threads
option thread-count 8
subvolumes locks12
end-volume
volume posix13
type storage/posix
option directory /mnt/data13
end-volume
volume locks13
type features/locks
subvolumes posix13
end-volume
volume brick13
type performance/io-threads
option thread-count 8
subvolumes locks13
end-volume
volume posix14
type storage/posix
option directory /mnt/data14
end-volume
volume locks14
type features/locks
subvolumes posix14
end-volume
volume brick14
type performance/io-threads
option thread-count 8
subvolumes locks14
end-volume
volume posix15
type storage/posix
option directory /mnt/data15
end-volume
volume locks15
type features/locks
subvolumes posix15
end-volume
volume brick15
type performance/io-threads
option thread-count 8
subvolumes locks15
end-volume
volume posix16
type storage/posix
option directory /mnt/data16
end-volume
volume locks16
type features/locks
subvolumes posix16
end-volume
volume brick16
type performance/io-threads
option thread-count 8
subvolumes locks16
end-volume
volume posix17
type storage/posix
option directory /mnt/data17
end-volume
volume locks17
type features/locks
subvolumes posix17
end-volume
volume brick17
type performance/io-threads
option thread-count 8
subvolumes locks17
end-volume
volume posix18
type storage/posix
option directory /mnt/data18
end-volume
volume locks18
type features/locks
subvolumes posix18
end-volume
volume brick18
type performance/io-threads
option thread-count 8
subvolumes locks18
end-volume
volume posix19
type storage/posix
option directory /mnt/data19
end-volume
volume locks19
type features/locks
subvolumes posix19
end-volume
volume brick19
type performance/io-threads
option thread-count 8
subvolumes locks19
end-volume
volume posix20
type storage/posix
option directory /mnt/data20
end-volume
volume locks20
type features/locks
subvolumes posix20
end-volume
volume brick20
type performance/io-threads
option thread-count 8
subvolumes locks20
end-volume
volume posix21
type storage/posix
option directory /mnt/data21
end-volume
volume locks21
type features/locks
subvolumes posix21
end-volume
volume brick21
type performance/io-threads
option thread-count 8
subvolumes locks21
end-volume
volume posix22
type storage/posix
option directory /mnt/data22
end-volume
volume locks22
type features/locks
subvolumes posix22
end-volume
volume brick22
type performance/io-threads
option thread-count 8
subvolumes locks22
end-volume
volume posix23
type storage/posix
option directory /mnt/data23
end-volume
volume locks23
type features/locks
subvolumes posix23
end-volume
volume brick23
type performance/io-threads
option thread-count 8
subvolumes locks23
end-volume
volume posix24
type storage/posix
option directory /mnt/data24
end-volume
volume locks24
type features/locks
subvolumes posix24
end-volume
volume brick24
type performance/io-threads
option thread-count 8
subvolumes locks24
end-volume
volume server-tcp
type protocol/server
option transport-type tcp
option auth.addr.brick1.allow *
option auth.addr.brick2.allow *
option auth.addr.brick3.allow *
option auth.addr.brick4.allow *
option auth.addr.brick5.allow *
option auth.addr.brick6.allow *
option auth.addr.brick7.allow *
option auth.addr.brick8.allow *
option auth.addr.brick9.allow *
option auth.addr.brick10.allow *
option auth.addr.brick11.allow *
option auth.addr.brick12.allow *
option auth.addr.brick13.allow *
option auth.addr.brick14.allow *
option auth.addr.brick15.allow *
option auth.addr.brick16.allow *
option auth.addr.brick17.allow *
option auth.addr.brick18.allow *
option auth.addr.brick19.allow *
option auth.addr.brick20.allow *
option auth.addr.brick21.allow *
option auth.addr.brick22.allow *
option auth.addr.brick23.allow *
option auth.addr.brick24.allow *
option transport.socket.listen-port 6996
option transport.socket.nodelay on
subvolumes brick1 brick2 brick3 brick4 brick5 brick6 brick7 brick8
brick9 brick10 brick11 brick12 brick13 brick14 brick15 brick16 brick17
brick18 brick19 brick20 brick21 brick22 brick23 brick24
end-volume
phil cryer
2010-May-04 18:34 UTC
[Gluster-users] Posix warning : Access to ... is crossing device
FYI - this is fixed, samppah on IRC suggesting updating to the latest (3.04) and that fixed it, and an issue with not being able to delete files. P On Tue, May 4, 2010 at 10:26 AM, phil cryer <phil at cryer.us> wrote:> I have a distributed/replicated setup with Glusterfs 3.0.2, that I'm > testing on 4 servers, each with access to /mnt/gluster (which consists > of all directories /mnt/data01 - data24) on each server. ?I'm using > configs I built from volgen, but every time I access a file (via an > 'ls -l') for the first time, I get all of these messages in my logs on > each server: > > [2010-05-04 10:50:30] W [posix.c:246:posix_lstat_with_gen] posix1: > Access to /mnt/data01//.. (on dev 16771) is crossing device (2257) > [2010-05-04 10:50:30] W [posix.c:246:posix_lstat_with_gen] posix3: > Access to /mnt/data03//.. (on dev 16771) is crossing device (2241) > [2010-05-04 10:50:30] W [posix.c:246:posix_lstat_with_gen] posix5: > Access to /mnt/data05//.. (on dev 16771) is crossing device (2225) > [2010-05-04 10:50:30] W [posix.c:246:posix_lstat_with_gen] posix5: > Access to /mnt/data05//.. (on dev 16771) is crossing device (2225) > [2010-05-04 10:50:30] W [posix.c:246:posix_lstat_with_gen] posix7: > Access to /mnt/data07//.. (on dev 16771) is crossing device (16705) > [2010-05-04 10:50:30] W [posix.c:246:posix_lstat_with_gen] posix7: > Access to /mnt/data07//.. (on dev 16771) is crossing device (16705) > [2010-05-04 10:50:30] W [posix.c:246:posix_lstat_with_gen] posix9: > Access to /mnt/data09//.. (on dev 16771) is crossing device (2161) > [2010-05-04 10:50:30] W [posix.c:246:posix_lstat_with_gen] posix11: > Access to /mnt/data11//.. (on dev 16771) is crossing device (2113) > [2010-05-04 10:50:30] W [posix.c:246:posix_lstat_with_gen] posix11: > Access to /mnt/data11//.. (on dev 16771) is crossing device (2113) > [2010-05-04 10:50:30] W [posix.c:246:posix_lstat_with_gen] posix13: > Access to /mnt/data13//.. (on dev 16771) is crossing device (2081) > [2010-05-04 10:50:30] W [posix.c:246:posix_lstat_with_gen] posix15: > Access to /mnt/data15//.. (on dev 16771) is crossing device (16689) > [2010-05-04 10:50:30] W [posix.c:246:posix_lstat_with_gen] posix15: > Access to /mnt/data15//.. (on dev 16771) is crossing device (16689) > [2010-05-04 10:50:30] W [posix.c:246:posix_lstat_with_gen] posix17: > Access to /mnt/data17//.. (on dev 16771) is crossing device (2289) > [2010-05-04 10:50:30] W [posix.c:246:posix_lstat_with_gen] posix19: > Access to /mnt/data19//.. (on dev 16771) is crossing device (2049) > [2010-05-04 10:50:30] W [posix.c:246:posix_lstat_with_gen] posix21: > Access to /mnt/data21//.. (on dev 16771) is crossing device (16737) > [2010-05-04 10:50:30] W [posix.c:246:posix_lstat_with_gen] posix23: > Access to /mnt/data23//.. (on dev 16771) is crossing device (2065) > [2010-05-04 10:50:30] W [posix.c:246:posix_lstat_with_gen] posix23: > Access to /mnt/data23//.. (on dev 16771) is crossing device (2065) > > What do I have setup incorrectly here? ?My config files are below, thanks. > > > # cat /etc/glusterfs/glusterfs.vol > > ######################################## > ## glusterfs.vol > ## phil.cryer at mobot.org > ######################################## > # ?128.128.164.74 ?clustr-01 > # ?128.128.164.89 ?clustr-02 > # ?128.128.164.215 clustr-03 > # ?128.128.164.217 clustr-04 > # ?128.128.164.218 clustr-05 > # ?128.128.164.219 clustr-06 > ######################################## > # RAID 1 > # TRANSPORT-TYPE tcp > ######################################## > ######################################## > volume clustr-03-1 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-03 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick1 > end-volume > volume clustr-03-2 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-03 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick2 > end-volume > volume clustr-03-3 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-03 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick3 > end-volume > volume clustr-03-4 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-03 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick4 > end-volume > volume clustr-03-5 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-03 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick5 > end-volume > volume clustr-03-6 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-03 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick6 > end-volume > volume clustr-03-7 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-03 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick7 > end-volume > volume clustr-03-8 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-03 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick8 > end-volume > volume clustr-03-9 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-03 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick9 > end-volume > volume clustr-03-10 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-03 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick10 > end-volume > volume clustr-03-11 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-03 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick11 > end-volume > volume clustr-03-12 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-03 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick12 > end-volume > volume clustr-03-13 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-03 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick13 > end-volume > volume clustr-03-14 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-03 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick14 > end-volume > volume clustr-03-15 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-03 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick15 > end-volume > volume clustr-03-16 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-03 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick16 > end-volume > volume clustr-03-17 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-03 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick17 > end-volume > volume clustr-03-18 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-03 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick18 > end-volume > volume clustr-03-19 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-03 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick19 > end-volume > volume clustr-03-20 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-03 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick20 > end-volume > volume clustr-03-21 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-03 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick21 > end-volume > volume clustr-03-22 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-03 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick22 > end-volume > volume clustr-03-23 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-03 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick23 > end-volume > volume clustr-03-24 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-03 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick24 > end-volume > ######################################## > volume clustr-06-1 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-06 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick1 > end-volume > volume clustr-06-2 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-06 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick2 > end-volume > volume clustr-06-3 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-06 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick3 > end-volume > volume clustr-06-4 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-06 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick4 > end-volume > volume clustr-06-5 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-06 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick5 > end-volume > volume clustr-06-6 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-06 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick6 > end-volume > volume clustr-06-7 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-06 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick7 > end-volume > volume clustr-06-8 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-06 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick8 > end-volume > volume clustr-06-9 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-06 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick9 > end-volume > volume clustr-06-10 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-06 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick10 > end-volume > volume clustr-06-11 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-06 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick11 > end-volume > volume clustr-06-12 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-06 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick12 > end-volume > volume clustr-06-13 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-06 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick13 > end-volume > volume clustr-06-14 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-06 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick14 > end-volume > volume clustr-06-15 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-06 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick15 > end-volume > volume clustr-06-16 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-06 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick16 > end-volume > volume clustr-06-17 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-06 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick17 > end-volume > volume clustr-06-18 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-06 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick18 > end-volume > volume clustr-06-19 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-06 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick19 > end-volume > volume clustr-06-20 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-06 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick20 > end-volume > volume clustr-06-21 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-06 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick21 > end-volume > volume clustr-06-22 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-06 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick22 > end-volume > volume clustr-06-23 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-06 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick23 > end-volume > volume clustr-06-24 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-06 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick24 > end-volume > ######################################## > volume clustr-01-1 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-01 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick1 > end-volume > volume clustr-01-2 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-01 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick2 > end-volume > volume clustr-01-3 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-01 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick3 > end-volume > volume clustr-01-4 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-01 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick4 > end-volume > volume clustr-01-5 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-01 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick5 > end-volume > volume clustr-01-6 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-01 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick6 > end-volume > volume clustr-01-7 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-01 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick7 > end-volume > volume clustr-01-8 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-01 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick8 > end-volume > volume clustr-01-9 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-01 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick9 > end-volume > volume clustr-01-10 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-01 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick10 > end-volume > volume clustr-01-11 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-01 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick11 > end-volume > volume clustr-01-12 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-01 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick12 > end-volume > volume clustr-01-13 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-01 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick13 > end-volume > volume clustr-01-14 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-01 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick14 > end-volume > volume clustr-01-15 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-01 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick15 > end-volume > volume clustr-01-16 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-01 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick16 > end-volume > volume clustr-01-17 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-01 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick17 > end-volume > volume clustr-01-18 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-01 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick18 > end-volume > volume clustr-01-19 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-01 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick19 > end-volume > volume clustr-01-20 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-01 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick20 > end-volume > volume clustr-01-21 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-01 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick21 > end-volume > volume clustr-01-22 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-01 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick22 > end-volume > volume clustr-01-23 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-01 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick23 > end-volume > volume clustr-01-24 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-01 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick24 > end-volume > ######################################## > volume clustr-02-1 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-02 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick1 > end-volume > volume clustr-02-2 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-02 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick2 > end-volume > volume clustr-02-3 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-02 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick3 > end-volume > volume clustr-02-4 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-02 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick4 > end-volume > volume clustr-02-5 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-02 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick5 > end-volume > volume clustr-02-6 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-02 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick6 > end-volume > volume clustr-02-7 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-02 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick7 > end-volume > volume clustr-02-8 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-02 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick8 > end-volume > volume clustr-02-9 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-02 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick9 > end-volume > volume clustr-02-10 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-02 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick10 > end-volume > volume clustr-02-11 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-02 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick11 > end-volume > volume clustr-02-12 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-02 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick12 > end-volume > volume clustr-02-13 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-02 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick13 > end-volume > volume clustr-02-14 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-02 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick14 > end-volume > volume clustr-02-15 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-02 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick15 > end-volume > volume clustr-02-16 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-02 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick16 > end-volume > volume clustr-02-17 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-02 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick17 > end-volume > volume clustr-02-18 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-02 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick18 > end-volume > volume clustr-02-19 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-02 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick19 > end-volume > volume clustr-02-20 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-02 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick20 > end-volume > volume clustr-02-21 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-02 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick21 > end-volume > volume clustr-02-22 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-02 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick22 > end-volume > volume clustr-02-23 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-02 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick23 > end-volume > volume clustr-02-24 > ? ?type protocol/client > ? ?option transport-type tcp > ? ?option remote-host clustr-02 > ? ?option transport.socket.nodelay on > ? ?option transport.remote-port 6996 > ? ?option remote-subvolume brick24 > end-volume > ######################################## > ######################################## > volume mirror-0 > ? ?type cluster/replicate > ? ?subvolumes clustr-03-1 clustr-03-2 > end-volume > volume mirror-1 > ? ?type cluster/replicate > ? ?subvolumes clustr-03-3 clustr-03-4 > end-volume > volume mirror-2 > ? ?type cluster/replicate > ? ?subvolumes clustr-03-5 clustr-03-6 > end-volume > volume mirror-3 > ? ?type cluster/replicate > ? ?subvolumes clustr-03-7 clustr-03-8 > end-volume > volume mirror-4 > ? ?type cluster/replicate > ? ?subvolumes clustr-03-9 clustr-03-10 > end-volume > volume mirror-5 > ? ?type cluster/replicate > ? ?subvolumes clustr-03-11 clustr-03-12 > end-volume > volume mirror-6 > ? ?type cluster/replicate > ? ?subvolumes clustr-03-13 clustr-03-14 > end-volume > volume mirror-7 > ? ?type cluster/replicate > ? ?subvolumes clustr-03-15 clustr-03-16 > end-volume > volume mirror-8 > ? ?type cluster/replicate > ? ?subvolumes clustr-03-17 clustr-03-18 > end-volume > volume mirror-9 > ? ?type cluster/replicate > ? ?subvolumes clustr-03-19 clustr-03-20 > end-volume > volume mirror-10 > ? ?type cluster/replicate > ? ?subvolumes clustr-03-21 clustr-03-22 > end-volume > volume mirror-11 > ? ?type cluster/replicate > ? ?subvolumes clustr-03-23 clustr-03-24 > end-volume > ######################################## > volume mirror-12 > ? ?type cluster/replicate > ? ?subvolumes clustr-06-1 clustr-06-2 > end-volume > volume mirror-13 > ? ?type cluster/replicate > ? ?subvolumes clustr-06-3 clustr-06-4 > end-volume > volume mirror-14 > ? ?type cluster/replicate > ? ?subvolumes clustr-06-5 clustr-06-6 > end-volume > volume mirror-15 > ? ?type cluster/replicate > ? ?subvolumes clustr-06-7 clustr-06-8 > end-volume > volume mirror-16 > ? ?type cluster/replicate > ? ?subvolumes clustr-06-9 clustr-06-10 > end-volume > volume mirror-17 > ? ?type cluster/replicate > ? ?subvolumes clustr-06-11 clustr-06-12 > end-volume > volume mirror-18 > ? ?type cluster/replicate > ? ?subvolumes clustr-06-13 clustr-06-14 > end-volume > volume mirror-19 > ? ?type cluster/replicate > ? ?subvolumes clustr-06-15 clustr-06-16 > end-volume > volume mirror-20 > ? ?type cluster/replicate > ? ?subvolumes clustr-06-17 clustr-06-18 > end-volume > volume mirror-21 > ? ?type cluster/replicate > ? ?subvolumes clustr-06-19 clustr-06-20 > end-volume > volume mirror-22 > ? ?type cluster/replicate > ? ?subvolumes clustr-06-21 clustr-06-22 > end-volume > volume mirror-23 > ? ?type cluster/replicate > ? ?subvolumes clustr-06-23 clustr-06-24 > end-volume > ######################################## > volume mirror-24 > ? ?type cluster/replicate > ? ?subvolumes clustr-01-1 clustr-01-2 > end-volume > volume mirror-25 > ? ?type cluster/replicate > ? ?subvolumes clustr-01-3 clustr-01-4 > end-volume > volume mirror-26 > ? ?type cluster/replicate > ? ?subvolumes clustr-01-5 clustr-01-6 > end-volume > volume mirror-27 > ? ?type cluster/replicate > ? ?subvolumes clustr-01-7 clustr-01-8 > end-volume > volume mirror-28 > ? ?type cluster/replicate > ? ?subvolumes clustr-01-9 clustr-01-10 > end-volume > volume mirror-29 > ? ?type cluster/replicate > ? ?subvolumes clustr-01-11 clustr-01-12 > end-volume > volume mirror-30 > ? ?type cluster/replicate > ? ?subvolumes clustr-01-13 clustr-01-14 > end-volume > volume mirror-31 > ? ?type cluster/replicate > ? ?subvolumes clustr-01-15 clustr-01-16 > end-volume > volume mirror-32 > ? ?type cluster/replicate > ? ?subvolumes clustr-01-17 clustr-01-18 > end-volume > volume mirror-33 > ? ?type cluster/replicate > ? ?subvolumes clustr-01-19 clustr-01-20 > end-volume > volume mirror-34 > ? ?type cluster/replicate > ? ?subvolumes clustr-01-21 clustr-01-22 > end-volume > volume mirror-35 > ? ?type cluster/replicate > ? ?subvolumes clustr-01-23 clustr-01-24 > end-volume > ######################################## > volume mirror-36 > ? ?type cluster/replicate > ? ?subvolumes clustr-02-1 clustr-02-2 > end-volume > volume mirror-37 > ? ?type cluster/replicate > ? ?subvolumes clustr-02-3 clustr-02-4 > end-volume > volume mirror-38 > ? ?type cluster/replicate > ? ?subvolumes clustr-02-5 clustr-02-6 > end-volume > volume mirror-39 > ? ?type cluster/replicate > ? ?subvolumes clustr-02-7 clustr-02-8 > end-volume > volume mirror-40 > ? ?type cluster/replicate > ? ?subvolumes clustr-02-9 clustr-02-10 > end-volume > volume mirror-41 > ? ?type cluster/replicate > ? ?subvolumes clustr-02-11 clustr-02-12 > end-volume > volume mirror-42 > ? ?type cluster/replicate > ? ?subvolumes clustr-02-13 clustr-02-14 > end-volume > volume mirror-43 > ? ?type cluster/replicate > ? ?subvolumes clustr-02-15 clustr-02-16 > end-volume > volume mirror-44 > ? ?type cluster/replicate > ? ?subvolumes clustr-02-17 clustr-02-18 > end-volume > volume mirror-45 > ? ?type cluster/replicate > ? ?subvolumes clustr-02-19 clustr-02-20 > end-volume > volume mirror-46 > ? ?type cluster/replicate > ? ?subvolumes clustr-02-21 clustr-02-22 > end-volume > volume mirror-47 > ? ?type cluster/replicate > ? ?subvolumes clustr-02-23 clustr-02-24 > end-volume > ######################################## > ######################################## > volume distribute > ? ?type cluster/distribute > ? ?subvolumes mirror-0 mirror-1 mirror-2 mirror-3 mirror-4 mirror-5 > mirror-6 mirror-7 mirror-8 mirror-9 mirror-10 mirror-11 mirror-12 > mirror-13 mirror-14 mirror-15 mirror-16 mirror-17 mirror-18 mirror-19 > mirror-20 mirror-21 mirror-22 mirror-23 mirror-24 mirror-25 mirror-26 > mirror-27 mirror-28 mirror-29 mirror-30 mirror-31 mirror-32 mirror-33 > mirror-34 mirror-35 mirror-36 mirror-37 mirror-38 mirror-39 mirror-40 > mirror-41 mirror-42 mirror-43 mirror-44 mirror-45 mirror-46 mirror-47 > end-volume > ######################################## > ######################################## > volume writebehind > ? ?type performance/write-behind > ? ?option cache-size 4MB > ? ?subvolumes distribute > end-volume > volume readahead > ? ?type performance/read-ahead > ? ?option page-count 4 > ? ?subvolumes writebehind > end-volume > volume iocache > ? ?type performance/io-cache > ? ?option cache-size `grep 'MemTotal' /proc/meminfo ?| awk '{print $2 > * 0.2 / 1024}' | cut -f1 -d.`MB > ? ?option cache-timeout 1 > ? ?subvolumes readahead > end-volume > volume quickread > ? ?type performance/quick-read > ? ?option cache-timeout 1 > ? ?option max-file-size 64kB > ? ?subvolumes iocache > end-volume > volume statprefetch > ? ?type performance/stat-prefetch > ? ?subvolumes quickread > end-volume > ######################################## > ######################################## > > > > > > # cat /etc/glusterfs/glusterfsd.vol > > ## file auto generated by /usr/local/bin/glusterfs-volgen (export.vol) > # Cmd line: > # $ /usr/local/bin/glusterfs-volgen --name store-0405 --raid 1 > clustr-04:/mnt/data01 clustr-04:/mnt/data02 clustr-04:/mnt/data03 > clustr-04:/mnt/data04 clustr-04:/mnt/data05 clustr-04:/mnt/data06 > clustr-04:/mnt/data07 clustr-04:/mnt/data08 clustr-04:/mnt/data09 > clustr-04:/mnt/data10 clustr-04:/mnt/data11 clustr-04:/mnt/data12 > clustr-04:/mnt/data13 clustr-04:/mnt/data14 clustr-04:/mnt/data15 > clustr-04:/mnt/data16 clustr-04:/mnt/data17 clustr-04:/mnt/data18 > clustr-04:/mnt/data19 clustr-04:/mnt/data20 clustr-04:/mnt/data21 > clustr-04:/mnt/data22 clustr-04:/mnt/data23 clustr-04:/mnt/data24 > clustr-05:/mnt/data01 clustr-05:/mnt/data02 clustr-05:/mnt/data03 > clustr-05:/mnt/data04 clustr-05:/mnt/data05 clustr-05:/mnt/data06 > clustr-05:/mnt/data07 clustr-05:/mnt/data08 clustr-05:/mnt/data09 > clustr-05:/mnt/data10 clustr-05:/mnt/data11 clustr-05:/mnt/data12 > clustr-05:/mnt/data13 clustr-05:/mnt/data14 clustr-05:/mnt/data15 > clustr-05:/mnt/data16 clustr-05:/mnt/data17 clustr-05:/mnt/data18 > clustr-05:/mnt/data19 clustr-05:/mnt/data20 clustr-05:/mnt/data21 > clustr-05:/mnt/data22 clustr-05:/mnt/data23 clustr-05:/mnt/data24 > ######################################## > ## glusterfs.vol > ## phil.cryer at mobot.org > ######################################## > # ?128.128.164.74 ?clustr-01 > # ?128.128.164.89 ?clustr-02 > # ?128.128.164.215 clustr-03 > # ?128.128.164.217 clustr-04 > # ?128.128.164.218 clustr-05 > # ?128.128.164.219 clustr-06 > ######################################## > volume posix1 > ?type storage/posix > ?option directory /mnt/data01 > end-volume > > volume locks1 > ? ?type features/locks > ? ?subvolumes posix1 > end-volume > > volume brick1 > ? ?type performance/io-threads > ? ?option thread-count 8 > ? ?subvolumes locks1 > end-volume > > volume posix2 > ?type storage/posix > ?option directory /mnt/data02 > end-volume > > volume locks2 > ? ?type features/locks > ? ?subvolumes posix2 > end-volume > > volume brick2 > ? ?type performance/io-threads > ? ?option thread-count 8 > ? ?subvolumes locks2 > end-volume > > volume posix3 > ?type storage/posix > ?option directory /mnt/data03 > end-volume > > volume locks3 > ? ?type features/locks > ? ?subvolumes posix3 > end-volume > > volume brick3 > ? ?type performance/io-threads > ? ?option thread-count 8 > ? ?subvolumes locks3 > end-volume > > volume posix4 > ?type storage/posix > ?option directory /mnt/data04 > end-volume > > volume locks4 > ? ?type features/locks > ? ?subvolumes posix4 > end-volume > > volume brick4 > ? ?type performance/io-threads > ? ?option thread-count 8 > ? ?subvolumes locks4 > end-volume > > volume posix5 > ?type storage/posix > ?option directory /mnt/data05 > end-volume > > volume locks5 > ? ?type features/locks > ? ?subvolumes posix5 > end-volume > > volume brick5 > ? ?type performance/io-threads > ? ?option thread-count 8 > ? ?subvolumes locks5 > end-volume > > volume posix6 > ?type storage/posix > ?option directory /mnt/data06 > end-volume > > volume locks6 > ? ?type features/locks > ? ?subvolumes posix6 > end-volume > > volume brick6 > ? ?type performance/io-threads > ? ?option thread-count 8 > ? ?subvolumes locks6 > end-volume > > volume posix7 > ?type storage/posix > ?option directory /mnt/data07 > end-volume > > volume locks7 > ? ?type features/locks > ? ?subvolumes posix7 > end-volume > > volume brick7 > ? ?type performance/io-threads > ? ?option thread-count 8 > ? ?subvolumes locks7 > end-volume > > volume posix8 > ?type storage/posix > ?option directory /mnt/data08 > end-volume > > volume locks8 > ? ?type features/locks > ? ?subvolumes posix8 > end-volume > > volume brick8 > ? ?type performance/io-threads > ? ?option thread-count 8 > ? ?subvolumes locks8 > end-volume > > volume posix9 > ?type storage/posix > ?option directory /mnt/data09 > end-volume > > volume locks9 > ? ?type features/locks > ? ?subvolumes posix9 > end-volume > > volume brick9 > ? ?type performance/io-threads > ? ?option thread-count 8 > ? ?subvolumes locks9 > end-volume > > volume posix10 > ?type storage/posix > ?option directory /mnt/data10 > end-volume > > volume locks10 > ? ?type features/locks > ? ?subvolumes posix10 > end-volume > > volume brick10 > ? ?type performance/io-threads > ? ?option thread-count 8 > ? ?subvolumes locks10 > end-volume > > volume posix11 > ?type storage/posix > ?option directory /mnt/data11 > end-volume > > volume locks11 > ? ?type features/locks > ? ?subvolumes posix11 > end-volume > > volume brick11 > ? ?type performance/io-threads > ? ?option thread-count 8 > ? ?subvolumes locks11 > end-volume > > volume posix12 > ?type storage/posix > ?option directory /mnt/data12 > end-volume > > volume locks12 > ? ?type features/locks > ? ?subvolumes posix12 > end-volume > > volume brick12 > ? ?type performance/io-threads > ? ?option thread-count 8 > ? ?subvolumes locks12 > end-volume > > volume posix13 > ?type storage/posix > ?option directory /mnt/data13 > end-volume > > volume locks13 > ? ?type features/locks > ? ?subvolumes posix13 > end-volume > > volume brick13 > ? ?type performance/io-threads > ? ?option thread-count 8 > ? ?subvolumes locks13 > end-volume > > volume posix14 > ?type storage/posix > ?option directory /mnt/data14 > end-volume > > volume locks14 > ? ?type features/locks > ? ?subvolumes posix14 > end-volume > > volume brick14 > ? ?type performance/io-threads > ? ?option thread-count 8 > ? ?subvolumes locks14 > end-volume > > volume posix15 > ?type storage/posix > ?option directory /mnt/data15 > end-volume > > volume locks15 > ? ?type features/locks > ? ?subvolumes posix15 > end-volume > > volume brick15 > ? ?type performance/io-threads > ? ?option thread-count 8 > ? ?subvolumes locks15 > end-volume > > volume posix16 > ?type storage/posix > ?option directory /mnt/data16 > end-volume > > volume locks16 > ? ?type features/locks > ? ?subvolumes posix16 > end-volume > > volume brick16 > ? ?type performance/io-threads > ? ?option thread-count 8 > ? ?subvolumes locks16 > end-volume > > volume posix17 > ?type storage/posix > ?option directory /mnt/data17 > end-volume > > volume locks17 > ? ?type features/locks > ? ?subvolumes posix17 > end-volume > > volume brick17 > ? ?type performance/io-threads > ? ?option thread-count 8 > ? ?subvolumes locks17 > end-volume > > volume posix18 > ?type storage/posix > ?option directory /mnt/data18 > end-volume > > volume locks18 > ? ?type features/locks > ? ?subvolumes posix18 > end-volume > > volume brick18 > ? ?type performance/io-threads > ? ?option thread-count 8 > ? ?subvolumes locks18 > end-volume > > volume posix19 > ?type storage/posix > ?option directory /mnt/data19 > end-volume > > volume locks19 > ? ?type features/locks > ? ?subvolumes posix19 > end-volume > > volume brick19 > ? ?type performance/io-threads > ? ?option thread-count 8 > ? ?subvolumes locks19 > end-volume > > volume posix20 > ?type storage/posix > ?option directory /mnt/data20 > end-volume > > volume locks20 > ? ?type features/locks > ? ?subvolumes posix20 > end-volume > > volume brick20 > ? ?type performance/io-threads > ? ?option thread-count 8 > ? ?subvolumes locks20 > end-volume > > volume posix21 > ?type storage/posix > ?option directory /mnt/data21 > end-volume > > volume locks21 > ? ?type features/locks > ? ?subvolumes posix21 > end-volume > > volume brick21 > ? ?type performance/io-threads > ? ?option thread-count 8 > ? ?subvolumes locks21 > end-volume > > volume posix22 > ?type storage/posix > ?option directory /mnt/data22 > end-volume > > volume locks22 > ? ?type features/locks > ? ?subvolumes posix22 > end-volume > > volume brick22 > ? ?type performance/io-threads > ? ?option thread-count 8 > ? ?subvolumes locks22 > end-volume > > volume posix23 > ?type storage/posix > ?option directory /mnt/data23 > end-volume > > volume locks23 > ? ?type features/locks > ? ?subvolumes posix23 > end-volume > > volume brick23 > ? ?type performance/io-threads > ? ?option thread-count 8 > ? ?subvolumes locks23 > end-volume > > volume posix24 > ?type storage/posix > ?option directory /mnt/data24 > end-volume > > volume locks24 > ? ?type features/locks > ? ?subvolumes posix24 > end-volume > > volume brick24 > ? ?type performance/io-threads > ? ?option thread-count 8 > ? ?subvolumes locks24 > end-volume > > volume server-tcp > ? ?type protocol/server > ? ?option transport-type tcp > ? ?option auth.addr.brick1.allow * > ? ?option auth.addr.brick2.allow * > ? ?option auth.addr.brick3.allow * > ? ?option auth.addr.brick4.allow * > ? ?option auth.addr.brick5.allow * > ? ?option auth.addr.brick6.allow * > ? ?option auth.addr.brick7.allow * > ? ?option auth.addr.brick8.allow * > ? ?option auth.addr.brick9.allow * > ? ?option auth.addr.brick10.allow * > ? ?option auth.addr.brick11.allow * > ? ?option auth.addr.brick12.allow * > ? ?option auth.addr.brick13.allow * > ? ?option auth.addr.brick14.allow * > ? ?option auth.addr.brick15.allow * > ? ?option auth.addr.brick16.allow * > ? ?option auth.addr.brick17.allow * > ? ?option auth.addr.brick18.allow * > ? ?option auth.addr.brick19.allow * > ? ?option auth.addr.brick20.allow * > ? ?option auth.addr.brick21.allow * > ? ?option auth.addr.brick22.allow * > ? ?option auth.addr.brick23.allow * > ? ?option auth.addr.brick24.allow * > ? ?option transport.socket.listen-port 6996 > ? ?option transport.socket.nodelay on > ? ?subvolumes brick1 brick2 brick3 brick4 brick5 brick6 brick7 brick8 > brick9 brick10 brick11 brick12 brick13 brick14 brick15 brick16 brick17 > brick18 brick19 brick20 brick21 brick22 brick23 brick24 > end-volume >-- http://philcryer.com