Op 15-05-19 om 15:45 schreef Nithya Balachandran:> Hi Paul, > > A few questions: > Which version of gluster are you using?On the server and some clients: glusterfs 4.1.2 On a new client: glusterfs 5.5> Did this behaviour start recently? As in were the contents of that > directory visible earlier?This directory was normally used in the headoffice, and there is direct access to the files without Glusterfs. So I don't know. With regards, Paul van der Vlis> Regards, > Nithya > > > On Wed, 15 May 2019 at 18:55, Paul van der Vlis <paul at vandervlis.nl > <mailto:paul at vandervlis.nl>> wrote: > > Hello Strahil, > > Thanks for your answer. I don't find the word "sharding" in the > configfiles. There is not much shared data (24GB), and only 1 brick: > --- > root at xxx:/etc/glusterfs# gluster volume info DATA > > Volume Name: DATA > Type: Distribute > Volume ID: db53ece1-5def-4f7c-b59d-3a230824032a > Status: Started > Snapshot Count: 0 > Number of Bricks: 1 > Transport-type: tcp > Bricks: > Brick1: xxx-vpn:/DATA > Options Reconfigured: > transport.address-family: inet > nfs.disable: on > ---- > (I have edited this a bit for privacy of my customer). > > I think they have used glusterfs because it can do ACLs. > > With regards, > Paul van der Vlis > > > Op 15-05-19 om 14:59 schreef Strahil Nikolov: > > Most probably you use sharding , which splits the files into smaller > > chunks so you can fit a 1TB file into gluster nodes with bricks of > > smaller size. > > So if you have 2 dispersed servers each having 500Gb brick->? without > > sharding you won't be able to store files larger than the brick size - > > no matter you have free space on the other server. > > > > When sharding is enabled - you will see on the brick the first > shard as > > a file and the rest is in a hidden folder called ".shards" (or > something > > like that). > > > > The benefit is also viewable when you need to do some maintenance on a > > gluster node, as you will need to heal only the shards containing > > modified by the customers' data. > > > > Best Regards, > > Strahil Nikolov > > > > > > ? ?????, 15 ??? 2019 ?., 7:31:39 ?. ???????-4, Paul van der Vlis > > <paul at vandervlis.nl <mailto:paul at vandervlis.nl>> ??????: > > > > > > Hello, > > > > I am the new sysadmin of an organization what uses Glusterfs. > > I did not set it up, and I don't know much about Glusterfs. > > > > What I do not understand is that I do not see all data in the mount. > > Not as root, not as a normal user who has privileges. > > > > When I do "ls" in one of the subdirectories I don't see any data, but > > this data exists at the server! > > > > In another subdirectory I see everything fine, the rights of the > > directories and files inside are the same. > > > > I mount with something like: > > /bin/mount -t glusterfs -o acl 10.8.0.1:/data /data > > I see data in /data/VOORBEELD/, and I don't see any data in > /data/ALGEMEEN/. > > > > I don't see something special in /etc/exports or in /etc/glusterfs on > > the server. > > > > Is there maybe a mechanism in Glusterfs what can exclude data from > > export?? Or is there a way to debug this problem? > > > > With regards, > > Paul van der Vlis > > > > ---- > > # file: VOORBEELD > > # owner: root > > # group: secretariaat > > # flags: -s- > > user::rwx > > group::rwx > > group:medewerkers:r-x > > mask::rwx > > other::--- > > default:user::rwx > > default:group::rwx > > default:group:medewerkers:r-x > > default:mask::rwx > > default:other::--- > > > > # file: ALGEMEEN > > # owner: root > > # group: secretariaat > > # flags: -s- > > user::rwx > > group::rwx > > group:medewerkers:r-x > > mask::rwx > > other::--- > > default:user::rwx > > default:group::rwx > > default:group:medewerkers:r-x > > default:mask::rwx > > default:other::--- > > ------ > > > > > > > > > > > > -- > > Paul van der Vlis Linux systeembeheer Groningen > > https://www.vandervlis.nl/ > > _______________________________________________ > > Gluster-users mailing list > > Gluster-users at gluster.org <mailto:Gluster-users at gluster.org> > <mailto:Gluster-users at gluster.org <mailto:Gluster-users at gluster.org>> > > https://lists.gluster.org/mailman/listinfo/gluster-users > > > > -- > Paul van der Vlis Linux systeembeheer Groningen > https://www.vandervlis.nl/ > _______________________________________________ > Gluster-users mailing list > Gluster-users at gluster.org <mailto:Gluster-users at gluster.org> > https://lists.gluster.org/mailman/listinfo/gluster-users >-- Paul van der Vlis Linux systeembeheer Groningen https://www.vandervlis.nl/
It seems that I got confused.So you see the files on the bricks (servers) , but
not when you mount glusterfs on the clients ?
If so - this is not the sharding feature as it works the opposite way.
Best Regards,Strahil Nikolov
? ?????????, 16 ??? 2019 ?., 0:35:04 ?. ???????+3, Paul van der Vlis
<paul at vandervlis.nl> ??????:
Op 15-05-19 om 15:45 schreef Nithya Balachandran:> Hi Paul,
>
> A few questions:
> Which version of gluster are you using?
On the server and some clients: glusterfs 4.1.2
On a new client: glusterfs 5.5
> Did this behaviour start recently? As in were the contents of that
> directory visible earlier?
This directory was normally used in the headoffice, and there is direct
access to the files without Glusterfs. So I don't know.
With regards,
Paul van der Vlis
> Regards,
> Nithya
>
>
> On Wed, 15 May 2019 at 18:55, Paul van der Vlis <paul at vandervlis.nl
> <mailto:paul at vandervlis.nl>> wrote:
>
>? ? Hello Strahil,
>
>? ? Thanks for your answer. I don't find the word "sharding"
in the
>? ? configfiles. There is not much shared data (24GB), and only 1 brick:
>? ? ---
>? ? root at xxx:/etc/glusterfs# gluster volume info DATA
>
>? ? Volume Name: DATA
>? ? Type: Distribute
>? ? Volume ID: db53ece1-5def-4f7c-b59d-3a230824032a
>? ? Status: Started
>? ? Snapshot Count: 0
>? ? Number of Bricks: 1
>? ? Transport-type: tcp
>? ? Bricks:
>? ? Brick1: xxx-vpn:/DATA
>? ? Options Reconfigured:
>? ? transport.address-family: inet
>? ? nfs.disable: on
>? ? ----
>? ? (I have edited this a bit for privacy of my customer).
>
>? ? I think they have used glusterfs because it can do ACLs.
>
>? ? With regards,
>? ? Paul van der Vlis
>
>
>? ? Op 15-05-19 om 14:59 schreef Strahil Nikolov:
>? ? > Most probably you use sharding , which splits the files into
smaller
>? ? > chunks so you can fit a 1TB file into gluster nodes with bricks of
>? ? > smaller size.
>? ? > So if you have 2 dispersed servers each having 500Gb brick->?
without
>? ? > sharding you won't be able to store files larger than the brick
size -
>? ? > no matter you have free space on the other server.
>? ? >
>? ? > When sharding is enabled - you will see on the brick the first
>? ? shard as
>? ? > a file and the rest is in a hidden folder called
".shards" (or
>? ? something
>? ? > like that).
>? ? >
>? ? > The benefit is also viewable when you need to do some maintenance
on a
>? ? > gluster node, as you will need to heal only the shards containing
>? ? > modified by the customers' data.
>? ? >
>? ? > Best Regards,
>? ? > Strahil Nikolov
>? ? >
>? ? >
>? ? > ? ?????, 15 ??? 2019 ?., 7:31:39 ?. ???????-4, Paul van der Vlis
>? ? > <paul at vandervlis.nl <mailto:paul at vandervlis.nl>>
??????:
>? ? >
>? ? >
>? ? > Hello,
>? ? >
>? ? > I am the new sysadmin of an organization what uses Glusterfs.
>? ? > I did not set it up, and I don't know much about Glusterfs.
>? ? >
>? ? > What I do not understand is that I do not see all data in the
mount.
>? ? > Not as root, not as a normal user who has privileges.
>? ? >
>? ? > When I do "ls" in one of the subdirectories I don't
see any data, but
>? ? > this data exists at the server!
>? ? >
>? ? > In another subdirectory I see everything fine, the rights of the
>? ? > directories and files inside are the same.
>? ? >
>? ? > I mount with something like:
>? ? > /bin/mount -t glusterfs -o acl 10.8.0.1:/data /data
>? ? > I see data in /data/VOORBEELD/, and I don't see any data in
>? ? /data/ALGEMEEN/.
>? ? >
>? ? > I don't see something special in /etc/exports or in
/etc/glusterfs on
>? ? > the server.
>? ? >
>? ? > Is there maybe a mechanism in Glusterfs what can exclude data from
>? ? > export?? Or is there a way to debug this problem?
>? ? >
>? ? > With regards,
>? ? > Paul van der Vlis
>? ? >
>? ? > ----
>? ? > # file: VOORBEELD
>? ? > # owner: root
>? ? > # group: secretariaat
>? ? > # flags: -s-
>? ? > user::rwx
>? ? > group::rwx
>? ? > group:medewerkers:r-x
>? ? > mask::rwx
>? ? > other::---
>? ? > default:user::rwx
>? ? > default:group::rwx
>? ? > default:group:medewerkers:r-x
>? ? > default:mask::rwx
>? ? > default:other::---
>? ? >
>? ? > # file: ALGEMEEN
>? ? > # owner: root
>? ? > # group: secretariaat
>? ? > # flags: -s-
>? ? > user::rwx
>? ? > group::rwx
>? ? > group:medewerkers:r-x
>? ? > mask::rwx
>? ? > other::---
>? ? > default:user::rwx
>? ? > default:group::rwx
>? ? > default:group:medewerkers:r-x
>? ? > default:mask::rwx
>? ? > default:other::---
>? ? > ------
>? ? >
>? ? >
>? ? >
>? ? >
>? ? >
>? ? > --
>? ? > Paul van der Vlis Linux systeembeheer Groningen
>? ? > https://www.vandervlis.nl/
>? ? > _______________________________________________
>? ? > Gluster-users mailing list
>? ? > Gluster-users at gluster.org <mailto:Gluster-users at
gluster.org>
>? ? <mailto:Gluster-users at gluster.org <mailto:Gluster-users at
gluster.org>>
>? ? > https://lists.gluster.org/mailman/listinfo/gluster-users
>
>
>
>? ? --
>? ? Paul van der Vlis Linux systeembeheer Groningen
>? ? https://www.vandervlis.nl/
>? ? _______________________________________________
>? ? Gluster-users mailing list
>? ? Gluster-users at gluster.org <mailto:Gluster-users at gluster.org>
>? ? https://lists.gluster.org/mailman/listinfo/gluster-users
>
--
Paul van der Vlis Linux systeembeheer Groningen
https://www.vandervlis.nl/
_______________________________________________
Gluster-users mailing list
Gluster-users at gluster.org
https://lists.gluster.org/mailman/listinfo/gluster-users
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://lists.gluster.org/pipermail/gluster-users/attachments/20190515/17c14a89/attachment.html>
On Thu, 16 May 2019 at 03:05, Paul van der Vlis <paul at vandervlis.nl> wrote:> Op 15-05-19 om 15:45 schreef Nithya Balachandran: > > Hi Paul, > > > > A few questions: > > Which version of gluster are you using? > > On the server and some clients: glusterfs 4.1.2 > On a new client: glusterfs 5.5 > > Is the same behaviour seen on both client versions?> > Did this behaviour start recently? As in were the contents of that > > directory visible earlier? > > This directory was normally used in the headoffice, and there is direct > access to the files without Glusterfs. So I don't know. >Do you mean that they access the files on the gluster volume without using the client or that these files were stored elsewhere earlier (not on gluster)? Files on a gluster volume should never be accessed directly. To debug this further, please send the following: 1. The directory contents when the listing is performed directly on the brick. 2. The tcpdump of the gluster client when listing the directory using the following command: tcpdump -i any -s 0 -w /var/tmp/dirls.pcap tcp and not port 22 You can send these directly to me in case you want to keep the information private. Regards, Nithya> > With regards, > Paul van der Vlis > > > Regards, > > Nithya > > > > > > On Wed, 15 May 2019 at 18:55, Paul van der Vlis <paul at vandervlis.nl > > <mailto:paul at vandervlis.nl>> wrote: > > > > Hello Strahil, > > > > Thanks for your answer. I don't find the word "sharding" in the > > configfiles. There is not much shared data (24GB), and only 1 brick: > > --- > > root at xxx:/etc/glusterfs# gluster volume info DATA > > > > Volume Name: DATA > > Type: Distribute > > Volume ID: db53ece1-5def-4f7c-b59d-3a230824032a > > Status: Started > > Snapshot Count: 0 > > Number of Bricks: 1 > > Transport-type: tcp > > Bricks: > > Brick1: xxx-vpn:/DATA > > Options Reconfigured: > > transport.address-family: inet > > nfs.disable: on > > ---- > > (I have edited this a bit for privacy of my customer). > > > > I think they have used glusterfs because it can do ACLs. > > > > With regards, > > Paul van der Vlis > > > > > > Op 15-05-19 om 14:59 schreef Strahil Nikolov: > > > Most probably you use sharding , which splits the files into > smaller > > > chunks so you can fit a 1TB file into gluster nodes with bricks of > > > smaller size. > > > So if you have 2 dispersed servers each having 500Gb brick-> > without > > > sharding you won't be able to store files larger than the brick > size - > > > no matter you have free space on the other server. > > > > > > When sharding is enabled - you will see on the brick the first > > shard as > > > a file and the rest is in a hidden folder called ".shards" (or > > something > > > like that). > > > > > > The benefit is also viewable when you need to do some maintenance > on a > > > gluster node, as you will need to heal only the shards containing > > > modified by the customers' data. > > > > > > Best Regards, > > > Strahil Nikolov > > > > > > > > > ? ?????, 15 ??? 2019 ?., 7:31:39 ?. ???????-4, Paul van der Vlis > > > <paul at vandervlis.nl <mailto:paul at vandervlis.nl>> ??????: > > > > > > > > > Hello, > > > > > > I am the new sysadmin of an organization what uses Glusterfs. > > > I did not set it up, and I don't know much about Glusterfs. > > > > > > What I do not understand is that I do not see all data in the > mount. > > > Not as root, not as a normal user who has privileges. > > > > > > When I do "ls" in one of the subdirectories I don't see any data, > but > > > this data exists at the server! > > > > > > In another subdirectory I see everything fine, the rights of the > > > directories and files inside are the same. > > > > > > I mount with something like: > > > /bin/mount -t glusterfs -o acl 10.8.0.1:/data /data > > > I see data in /data/VOORBEELD/, and I don't see any data in > > /data/ALGEMEEN/. > > > > > > I don't see something special in /etc/exports or in /etc/glusterfs > on > > > the server. > > > > > > Is there maybe a mechanism in Glusterfs what can exclude data from > > > export? Or is there a way to debug this problem? > > > > > > With regards, > > > Paul van der Vlis > > > > > > ---- > > > # file: VOORBEELD > > > # owner: root > > > # group: secretariaat > > > # flags: -s- > > > user::rwx > > > group::rwx > > > group:medewerkers:r-x > > > mask::rwx > > > other::--- > > > default:user::rwx > > > default:group::rwx > > > default:group:medewerkers:r-x > > > default:mask::rwx > > > default:other::--- > > > > > > # file: ALGEMEEN > > > # owner: root > > > # group: secretariaat > > > # flags: -s- > > > user::rwx > > > group::rwx > > > group:medewerkers:r-x > > > mask::rwx > > > other::--- > > > default:user::rwx > > > default:group::rwx > > > default:group:medewerkers:r-x > > > default:mask::rwx > > > default:other::--- > > > ------ > > > > > > > > > > > > > > > > > > -- > > > Paul van der Vlis Linux systeembeheer Groningen > > > https://www.vandervlis.nl/ > > > _______________________________________________ > > > Gluster-users mailing list > > > Gluster-users at gluster.org <mailto:Gluster-users at gluster.org> > > <mailto:Gluster-users at gluster.org <mailto:Gluster-users at gluster.org > >> > > > https://lists.gluster.org/mailman/listinfo/gluster-users > > > > > > > > -- > > Paul van der Vlis Linux systeembeheer Groningen > > https://www.vandervlis.nl/ > > _______________________________________________ > > Gluster-users mailing list > > Gluster-users at gluster.org <mailto:Gluster-users at gluster.org> > > https://lists.gluster.org/mailman/listinfo/gluster-users > > > > > > -- > Paul van der Vlis Linux systeembeheer Groningen > https://www.vandervlis.nl/ >-------------- next part -------------- An HTML attachment was scrubbed... URL: <http://lists.gluster.org/pipermail/gluster-users/attachments/20190516/cd0fab21/attachment.html>