Hello Strahil, Thanks for your answer. I don't find the word "sharding" in the configfiles. There is not much shared data (24GB), and only 1 brick: --- root at xxx:/etc/glusterfs# gluster volume info DATA Volume Name: DATA Type: Distribute Volume ID: db53ece1-5def-4f7c-b59d-3a230824032a Status: Started Snapshot Count: 0 Number of Bricks: 1 Transport-type: tcp Bricks: Brick1: xxx-vpn:/DATA Options Reconfigured: transport.address-family: inet nfs.disable: on ---- (I have edited this a bit for privacy of my customer). I think they have used glusterfs because it can do ACLs. With regards, Paul van der Vlis Op 15-05-19 om 14:59 schreef Strahil Nikolov:> Most probably you use sharding , which splits the files into smaller > chunks so you can fit a 1TB file into gluster nodes with bricks of > smaller size. > So if you have 2 dispersed servers each having 500Gb brick->? without > sharding you won't be able to store files larger than the brick size - > no matter you have free space on the other server. > > When sharding is enabled - you will see on the brick the first shard as > a file and the rest is in a hidden folder called ".shards" (or something > like that). > > The benefit is also viewable when you need to do some maintenance on a > gluster node, as you will need to heal only the shards containing > modified by the customers' data. > > Best Regards, > Strahil Nikolov > > > ? ?????, 15 ??? 2019 ?., 7:31:39 ?. ???????-4, Paul van der Vlis > <paul at vandervlis.nl> ??????: > > > Hello, > > I am the new sysadmin of an organization what uses Glusterfs. > I did not set it up, and I don't know much about Glusterfs. > > What I do not understand is that I do not see all data in the mount. > Not as root, not as a normal user who has privileges. > > When I do "ls" in one of the subdirectories I don't see any data, but > this data exists at the server! > > In another subdirectory I see everything fine, the rights of the > directories and files inside are the same. > > I mount with something like: > /bin/mount -t glusterfs -o acl 10.8.0.1:/data /data > I see data in /data/VOORBEELD/, and I don't see any data in /data/ALGEMEEN/. > > I don't see something special in /etc/exports or in /etc/glusterfs on > the server. > > Is there maybe a mechanism in Glusterfs what can exclude data from > export?? Or is there a way to debug this problem? > > With regards, > Paul van der Vlis > > ---- > # file: VOORBEELD > # owner: root > # group: secretariaat > # flags: -s- > user::rwx > group::rwx > group:medewerkers:r-x > mask::rwx > other::--- > default:user::rwx > default:group::rwx > default:group:medewerkers:r-x > default:mask::rwx > default:other::--- > > # file: ALGEMEEN > # owner: root > # group: secretariaat > # flags: -s- > user::rwx > group::rwx > group:medewerkers:r-x > mask::rwx > other::--- > default:user::rwx > default:group::rwx > default:group:medewerkers:r-x > default:mask::rwx > default:other::--- > ------ > > > > > > -- > Paul van der Vlis Linux systeembeheer Groningen > https://www.vandervlis.nl/ > _______________________________________________ > Gluster-users mailing list > Gluster-users at gluster.org <mailto:Gluster-users at gluster.org> > https://lists.gluster.org/mailman/listinfo/gluster-users-- Paul van der Vlis Linux systeembeheer Groningen https://www.vandervlis.nl/
Hi Paul, A few questions: Which version of gluster are you using? Did this behaviour start recently? As in were the contents of that directory visible earlier? Regards, Nithya On Wed, 15 May 2019 at 18:55, Paul van der Vlis <paul at vandervlis.nl> wrote:> Hello Strahil, > > Thanks for your answer. I don't find the word "sharding" in the > configfiles. There is not much shared data (24GB), and only 1 brick: > --- > root at xxx:/etc/glusterfs# gluster volume info DATA > > Volume Name: DATA > Type: Distribute > Volume ID: db53ece1-5def-4f7c-b59d-3a230824032a > Status: Started > Snapshot Count: 0 > Number of Bricks: 1 > Transport-type: tcp > Bricks: > Brick1: xxx-vpn:/DATA > Options Reconfigured: > transport.address-family: inet > nfs.disable: on > ---- > (I have edited this a bit for privacy of my customer). > > I think they have used glusterfs because it can do ACLs. > > With regards, > Paul van der Vlis > > > Op 15-05-19 om 14:59 schreef Strahil Nikolov: > > Most probably you use sharding , which splits the files into smaller > > chunks so you can fit a 1TB file into gluster nodes with bricks of > > smaller size. > > So if you have 2 dispersed servers each having 500Gb brick-> without > > sharding you won't be able to store files larger than the brick size - > > no matter you have free space on the other server. > > > > When sharding is enabled - you will see on the brick the first shard as > > a file and the rest is in a hidden folder called ".shards" (or something > > like that). > > > > The benefit is also viewable when you need to do some maintenance on a > > gluster node, as you will need to heal only the shards containing > > modified by the customers' data. > > > > Best Regards, > > Strahil Nikolov > > > > > > ? ?????, 15 ??? 2019 ?., 7:31:39 ?. ???????-4, Paul van der Vlis > > <paul at vandervlis.nl> ??????: > > > > > > Hello, > > > > I am the new sysadmin of an organization what uses Glusterfs. > > I did not set it up, and I don't know much about Glusterfs. > > > > What I do not understand is that I do not see all data in the mount. > > Not as root, not as a normal user who has privileges. > > > > When I do "ls" in one of the subdirectories I don't see any data, but > > this data exists at the server! > > > > In another subdirectory I see everything fine, the rights of the > > directories and files inside are the same. > > > > I mount with something like: > > /bin/mount -t glusterfs -o acl 10.8.0.1:/data /data > > I see data in /data/VOORBEELD/, and I don't see any data in > /data/ALGEMEEN/. > > > > I don't see something special in /etc/exports or in /etc/glusterfs on > > the server. > > > > Is there maybe a mechanism in Glusterfs what can exclude data from > > export? Or is there a way to debug this problem? > > > > With regards, > > Paul van der Vlis > > > > ---- > > # file: VOORBEELD > > # owner: root > > # group: secretariaat > > # flags: -s- > > user::rwx > > group::rwx > > group:medewerkers:r-x > > mask::rwx > > other::--- > > default:user::rwx > > default:group::rwx > > default:group:medewerkers:r-x > > default:mask::rwx > > default:other::--- > > > > # file: ALGEMEEN > > # owner: root > > # group: secretariaat > > # flags: -s- > > user::rwx > > group::rwx > > group:medewerkers:r-x > > mask::rwx > > other::--- > > default:user::rwx > > default:group::rwx > > default:group:medewerkers:r-x > > default:mask::rwx > > default:other::--- > > ------ > > > > > > > > > > > > -- > > Paul van der Vlis Linux systeembeheer Groningen > > https://www.vandervlis.nl/ > > _______________________________________________ > > Gluster-users mailing list > > Gluster-users at gluster.org <mailto:Gluster-users at gluster.org> > > https://lists.gluster.org/mailman/listinfo/gluster-users > > > > -- > Paul van der Vlis Linux systeembeheer Groningen > https://www.vandervlis.nl/ > _______________________________________________ > Gluster-users mailing list > Gluster-users at gluster.org > https://lists.gluster.org/mailman/listinfo/gluster-users-------------- next part -------------- An HTML attachment was scrubbed... URL: <http://lists.gluster.org/pipermail/gluster-users/attachments/20190515/ed593445/attachment.html>
Check with 'gluster volume info <volume_name> | grep shard'
If you have it enabled it should show:features.shard: on
Keep in mind that disabling sharding is really bad, so if you really use it - do
not disable sharding - will cause a real mess.
Best Regards,Strahil Nikolov
? ?????, 15 ??? 2019 ?., 16:24:20 ?. ???????+3, Paul van der Vlis <paul
at vandervlis.nl> ??????:
Hello Strahil,
Thanks for your answer. I don't find the word "sharding" in the
configfiles. There is not much shared data (24GB), and only 1 brick:
---
root at xxx:/etc/glusterfs# gluster volume info DATA
Volume Name: DATA
Type: Distribute
Volume ID: db53ece1-5def-4f7c-b59d-3a230824032a
Status: Started
Snapshot Count: 0
Number of Bricks: 1
Transport-type: tcp
Bricks:
Brick1: xxx-vpn:/DATA
Options Reconfigured:
transport.address-family: inet
nfs.disable: on
----
(I have edited this a bit for privacy of my customer).
I think they have used glusterfs because it can do ACLs.
With regards,
Paul van der Vlis
Op 15-05-19 om 14:59 schreef Strahil Nikolov:> Most probably you use sharding , which splits the files into smaller
> chunks so you can fit a 1TB file into gluster nodes with bricks of
> smaller size.
> So if you have 2 dispersed servers each having 500Gb brick->? without
> sharding you won't be able to store files larger than the brick size -
> no matter you have free space on the other server.
>
> When sharding is enabled - you will see on the brick the first shard as
> a file and the rest is in a hidden folder called ".shards" (or
something
> like that).
>
> The benefit is also viewable when you need to do some maintenance on a
> gluster node, as you will need to heal only the shards containing
> modified by the customers' data.
>
> Best Regards,
> Strahil Nikolov
>
>
> ? ?????, 15 ??? 2019 ?., 7:31:39 ?. ???????-4, Paul van der Vlis
> <paul at vandervlis.nl> ??????:
>
>
> Hello,
>
> I am the new sysadmin of an organization what uses Glusterfs.
> I did not set it up, and I don't know much about Glusterfs.
>
> What I do not understand is that I do not see all data in the mount.
> Not as root, not as a normal user who has privileges.
>
> When I do "ls" in one of the subdirectories I don't see any
data, but
> this data exists at the server!
>
> In another subdirectory I see everything fine, the rights of the
> directories and files inside are the same.
>
> I mount with something like:
> /bin/mount -t glusterfs -o acl 10.8.0.1:/data /data
> I see data in /data/VOORBEELD/, and I don't see any data in
/data/ALGEMEEN/.
>
> I don't see something special in /etc/exports or in /etc/glusterfs on
> the server.
>
> Is there maybe a mechanism in Glusterfs what can exclude data from
> export?? Or is there a way to debug this problem?
>
> With regards,
> Paul van der Vlis
>
> ----
> # file: VOORBEELD
> # owner: root
> # group: secretariaat
> # flags: -s-
> user::rwx
> group::rwx
> group:medewerkers:r-x
> mask::rwx
> other::---
> default:user::rwx
> default:group::rwx
> default:group:medewerkers:r-x
> default:mask::rwx
> default:other::---
>
> # file: ALGEMEEN
> # owner: root
> # group: secretariaat
> # flags: -s-
> user::rwx
> group::rwx
> group:medewerkers:r-x
> mask::rwx
> other::---
> default:user::rwx
> default:group::rwx
> default:group:medewerkers:r-x
> default:mask::rwx
> default:other::---
> ------
>
>
>
>
>
> --
> Paul van der Vlis Linux systeembeheer Groningen
> https://www.vandervlis.nl/
> _______________________________________________
> Gluster-users mailing list
> Gluster-users at gluster.org <mailto:Gluster-users at gluster.org>
> https://lists.gluster.org/mailman/listinfo/gluster-users
--
Paul van der Vlis Linux systeembeheer Groningen
https://www.vandervlis.nl/
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://lists.gluster.org/pipermail/gluster-users/attachments/20190515/3ed9ae4f/attachment.html>