similar to: Gluster status fails

Hi I am running a 400TB five node purely distributed gluster setup. I am troubleshooting an issue where some times files creation fails. I found that volume status is not working gluster volume status Another transaction is in progress for atlasglust. Please try again after sometime. When I tried from other node then it seems two nodes have Locking issue gluster volume status Locking failed

Hi Mohammad, A lot of time is being spent in addressing metadata calls as expected. Can you consider testing out with 3.11 with md-cache [1] and readdirp [2] improvements? Adding Poornima and Raghavendra who worked on these enhancements to help out further. Thanks, Vijay [1] https://gluster.readthedocs.io/en/latest/release-notes/3.9.0/ [2] https://github.com/gluster/glusterfs/issues/166 On

Hi Vijay Did you manage to look into the gluster profile logs ? Thanks Kashif On Mon, Jun 12, 2017 at 11:40 AM, mohammad kashif <kashif.alig at gmail.com> wrote: > Hi Vijay > > I have enabled client profiling and used this script > https://github.com/bengland2/gluster-profile-analysis/blob/ > master/gvp-client.sh to extract data. I am attaching output files. I >

Hi Kashif, Thank you for your feedback! Do you have some data on the nature of performance improvement observed with 3.11 in the new setup? Adding Raghavendra and Poornima for validation of configuration and help with identifying why certain files disappeared from the mount point after enabling readdir-optimize. Regards, Vijay On 07/11/2017 11:06 AM, mohammad kashif wrote: > Hi Vijay and

Would it be possible for you to turn on client profiling and then run du? Instructions for turning on client profiling can be found at [1]. Providing the client profile information can help us figure out where the latency could be stemming from. Regards, Vijay [1] https://gluster.readthedocs.io/en/latest/Administrator%20Guide/Performance%20Testing/#client-side-profiling On Fri, Jun 9, 2017 at

Hi Vijay I have enabled client profiling and used this script https://github.com/bengland2/gluster-profile-analysis/blob/master/gvp-client.sh to extract data. I am attaching output files. I don't have any reference data to compare with my output. Hopefully you can make some sense out of it. On Sat, Jun 10, 2017 at 10:47 AM, Vijay Bellur <vbellur at redhat.com> wrote: > Would it be

Hi Vijay Thanks for your quick response. I am using gluster 3.8.11 on Centos 7 servers glusterfs-3.8.11-1.el7.x86_64 clients are centos 6 but I tested with a centos 7 client as well and results didn't change gluster volume info Volume Name: atlasglust Type: Distribute Volume ID: fbf0ebb8-deab-4388-9d8a-f722618a624b Status: Started Snapshot Count: 0 Number of Bricks: 5 Transport-type: tcp

Can you please provide more details about your volume configuration and the version of gluster that you are using? Regards, Vijay On Fri, Jun 9, 2017 at 5:35 PM, mohammad kashif <kashif.alig at gmail.com> wrote: > Hi > > I have just moved our 400 TB HPC storage from lustre to gluster. It is > part of a research institute and users have very small files to big files > ( few

I rather like agedu It probably does what you want. But as Mohammad says you do have to traverse your filesystem. https://www.chiark.greenend.org.uk/~sgtatham/agedu/ agedu: track down wasted disk space - chiark home page<https://www.chiark.greenend.org.uk/~sgtatham/agedu/> www.chiark.greenend.org.uk agedu. a Unix utility for tracking down wasted disk space Introduction. Suppose

Hi Alex, John Thanks for confirming my suspicion that there is no getting away from POSIX tree traversal . I was aware of age-du but not robinhood. Cheers Kashif On Wed, May 2, 2018 at 8:57 AM, JOHE (John Hearns) <JOHE at novozymes.com> wrote: > I rather like agedu It probably does what you want. > > But as Mohammad says you do have to traverse your filesystem. > >

Hi I have just moved our 400 TB HPC storage from lustre to gluster. It is part of a research institute and users have very small files to big files ( few KB to 20GB) . Our setup consists of 5 servers, each with 96TB RAID 6 disks. All servers are connected through 10G ethernet but not all clients. Gluster volumes are distributed without any replication. There are approximately 80 million files in

On 13 December 2017 at 17:34, mohammad kashif <kashif.alig at gmail.com> wrote: > Hi > > I have a five node 300 TB distributed gluster volume with zero > replication. I am planning to add two more servers which will add around > 120 TB. After fixing the layout, can I rebalance the volume while clients > are online and accessing the data? > > Hi, Yes, you can. Are

Hi, There are several programs that will basically take the outputs of your scans and store the results in a database. If you size the database appropriately, then querying that database will be much quicker than querying the filesystem. But of course the results will be a little bit outdated. One such project is robinhood. https://github.com/cea-hpc/robinhood/wiki A simpler way might be to

Hi I have a five node 300 TB distributed gluster volume with zero replication. I am planning to add two more servers which will add around 120 TB. After fixing the layout, can I rebalance the volume while clients are online and accessing the data? Thanks Kashif -------------- next part -------------- An HTML attachment was scrubbed... URL:

Hi Is there any easy way to find usage per user in Gluster? We have 300TB storage with almost 100 million files. Running du take too much time. Are people aware of any other tool which can be used to break up storage per user? Thanks Kashif -------------- next part -------------- An HTML attachment was scrubbed... URL:

hello list, I'm trying to install ganglia-gmetad on centos 5.6. rrdtool is already installed and librrd is there. But for some reason when I go to install this package it doesn't see that it is. [root at VIRTCENT11:/usr/local/src/ganglia-3.2.0] #yum install ganglia-gmetad Loaded plugins: fastestmirror, security Loading mirror speeds from cached hostfile * base: mirrors.lga7.us.voxel.net

We run ganglia on a 35 node cluster (plus a few odds and ends). It seems pretty lightweight. I've just finished installing the latest versions at home on old slow 32-bit kit and it seems again to be very lightweight. You will need to install libconfuse and RRD though, the former comes as a tarball. You'll need to configure/make/make install and then tell yum to ignore the missing

Hello All We need to connect our client's offices located in Dubai and Pakistan. Suggest us some economical solution. -- Kashif Naeem Business Development Manager Hadi Telecom www.haditelecom.com Cell: +92 (0)345 4226006 Office: +92 (0)42 5692766 Email: kashif at haditelecom.com MSN: kashif__naeem at hotmail.com Gmail: meet.kashif at gmail.com Skype: kashif.naeem 302 Y Commercial Area,

Hello All We have started a voice portal for Parents and Students. They can listen Grades, Attendance status and other relevant information over *phone*. Please read features below and to listen Demo IVR call at *00 92 42 8315427. *Initially we are deploying it for a School and planning to spread it for Colleges and Universities. *Your comments and feedback are valuable to us.* *TeleKaam

Hello All One of our client Bank has 900 employees working in different locations. They need to record all internal and external calls. Can any body suggest Call Recording Solution for this requirement. We need to know the Hardware / Bandwidth and all requirements and costing. Regards, -- Kashif Naeem Business Development Manager Hadi Telecom www.haditelecom.com Cell: +92 (0)345 4226006