Hello list, glusterfs 5.4-1 on Debian Buster (both servers and clients) I'm quite new to GFS and it's an old problem I know. When running a simple "ls -alR" on a local directory containing 50MB and 3468 files it takes: real 0m0.567s user 0m0.084s sys 0m0.168s Same thing for a copy of that dir on GFS takes more than 5 seconds: real 0m5.557s user 0m0.128s sys 0m0.208s Ok. But from my workstation at home, an "ls -alR" of that directory takes more than half an hour and the upload is more than 2GB (no typo: TWO Gigabytes). To keep it simple, the ls of a few directories: $ time ls all xabc-db xabc-dc1 xabc-gluster xabc-mail xabc-otp xabc-smtp real 0m5.766s user 0m0.001s sys 0m0.003s it receives 56kB and sends 2.3 MB for a simple ls. This is weird isn't it? Why this huge upload? Changing these options mentioned here doesn't make any difference: https://lists.gluster.org/pipermail/gluster-users/2016-January/024865.html Anyone a hint? Or should I drop GFS? This is unusable IMHO. Richard. -- richard lucassen http://contact.xaq.nl/
https://bugzilla.redhat.com/show_bug.cgi?id=1673058 Regards, Marcelo H. Terres <mhterres at gmail.com> https://www.mundoopensource.com.br https://twitter.com/mhterres https://linkedin.com/in/marceloterres On Wed, 27 Mar 2019 at 14:32, richard lucassen <mailinglists at lucassen.org> wrote:> Hello list, > > glusterfs 5.4-1 on Debian Buster (both servers and clients) > > I'm quite new to GFS and it's an old problem I know. When running a > simple "ls -alR" on a local directory containing 50MB and 3468 files it > takes: > > real 0m0.567s > user 0m0.084s > sys 0m0.168s > > Same thing for a copy of that dir on GFS takes more than 5 seconds: > > real 0m5.557s > user 0m0.128s > sys 0m0.208s > > Ok. But from my workstation at home, an "ls -alR" of that directory > takes more than half an hour and the upload is more than 2GB (no typo: > TWO Gigabytes). To keep it simple, the ls of a few directories: > > $ time ls > all xabc-db xabc-dc1 xabc-gluster xabc-mail xabc-otp xabc-smtp > > real 0m5.766s > user 0m0.001s > sys 0m0.003s > > it receives 56kB and sends 2.3 MB for a simple ls. > > This is weird isn't it? Why this huge upload? > > Changing these options mentioned here doesn't make any difference: > > https://lists.gluster.org/pipermail/gluster-users/2016-January/024865.html > > Anyone a hint? Or should I drop GFS? This is unusable IMHO. > > Richard. > > -- > richard lucassen > http://contact.xaq.nl/ > _______________________________________________ > Gluster-users mailing list > Gluster-users at gluster.org > https://lists.gluster.org/mailman/listinfo/gluster-users >-------------- next part -------------- An HTML attachment was scrubbed... URL: <http://lists.gluster.org/pipermail/gluster-users/attachments/20190327/48eee23e/attachment.html>
First, your statement and subject is hyperbolic and combative. In general it's best not to begin any approach for help with an uneducated attack on a community. GFS (Global File System) is an entirely different project but I'm going to assume you're in the right place and actually asking about GlusterFS. You haven't described your use case so I'll make an assumption that your intent is to sync files from your office to your home. I'll further guess that you're replicating one brick at home and the other at the office. Yes, this is generally an unusable use case for to latency and connectivity reasons. Your 2Gb transfer was very likely a self heal due to a connectivity problem from one of your clients. When your home client performed a lookup() of the files, it caught the discrepancy and fixed it. The latency is multiplied due to the very nature of clustering and your latent connection. For a more useful answer, I'd suggest describing your needs and asking for help. There is tons of experienced storage professionals here that are happy to share their knowledge and advice. On March 27, 2019 7:23:35 AM PDT, richard lucassen <mailinglists at lucassen.org> wrote:>Hello list, > >glusterfs 5.4-1 on Debian Buster (both servers and clients) > >I'm quite new to GFS and it's an old problem I know. When running a >simple "ls -alR" on a local directory containing 50MB and 3468 files it >takes: > >real 0m0.567s >user 0m0.084s >sys 0m0.168s > >Same thing for a copy of that dir on GFS takes more than 5 seconds: > >real 0m5.557s >user 0m0.128s >sys 0m0.208s > >Ok. But from my workstation at home, an "ls -alR" of that directory >takes more than half an hour and the upload is more than 2GB (no typo: >TWO Gigabytes). To keep it simple, the ls of a few directories: > >$ time ls >all xabc-db xabc-dc1 xabc-gluster xabc-mail xabc-otp xabc-smtp > >real 0m5.766s >user 0m0.001s >sys 0m0.003s > >it receives 56kB and sends 2.3 MB for a simple ls. > >This is weird isn't it? Why this huge upload? > >Changing these options mentioned here doesn't make any difference: > >https://lists.gluster.org/pipermail/gluster-users/2016-January/024865.html > >Anyone a hint? Or should I drop GFS? This is unusable IMHO. > >Richard. > >-- >richard lucassen >http://contact.xaq.nl/ >_______________________________________________ >Gluster-users mailing list >Gluster-users at gluster.org >https://lists.gluster.org/mailman/listinfo/gluster-users-- Sent from my Android device with K-9 Mail. Please excuse my brevity. -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://lists.gluster.org/pipermail/gluster-users/attachments/20190327/5233721d/attachment.html>