Hello,
After I finish setup 5 nodes cluster to serve a lustre file system
(1 MGS+MDT, 4 OSTs). I found that the reported total file system size
seems to be vary from time to time. For example,
[somsak_sr@araya data]$ df | grep lustre
/dev/loop6 10498848 443328 9455520 5% /mnt/lustre-mgs0
10.1.1.1@tcp:/lustre 236232368 202771268 21444460 91% /mnt/lustre
[somsak_sr@araya data]$ dd if=/dev/zero of=test bs=1M count=1000
1000+0 records in
1000+0 records out
[somsak_sr@araya data]$ df | grep lustre
/dev/loop6 10498848 443328 9455520 5% /mnt/lustre-mgs0
10.1.1.1@tcp:/lustre 236232368 203794248 20420456 91% /mnt/lustre
[somsak_sr@araya data]$ rm -f test
[somsak_sr@araya data]$ dd if=/dev/zero of=test bs=1M count=1000
dd: writing `test'': No space left on device
209+0 records in
208+0 records out
[somsak_sr@araya data]$ rm -f test
[somsak_sr@araya data]$ df | grep lustre
/dev/loop6 10498848 443328 9455520 5% /mnt/lustre-mgs0
10.1.1.1@tcp:/lustre 236232368 202771268 21443436 91% /mnt/lustre
[somsak_sr@araya data]$ dd if=/dev/zero of=test bs=1M
count=1000
1000+0 records in
1000+0 records out
Note that, no other process using the file system at the time.
Here''s the output of "lfs df"
[somsak_sr@araya ~]$ lfs df
UUID 1K-blocks Used Available Use% Mounted on
lustre-MDT0000_UUID 10498848 1043328 9455520 9 /mnt/lustre[MDT:0]
lustre-OST0000_UUID 59058092 54139312 4918780 91 /mnt/lustre[OST:0]
lustre-OST0001_UUID 59058092 58844504 213588 99 /mnt/lustre[OST:1]
lustre-OST0002_UUID 59058092 42906580 16151512 72 /mnt/lustre[OST:2]
lustre-OST0003_UUID 59058092 58881128 176964 99 /mnt/lustre[OST:3]
filesystem summary: 236232368 214771524 21460844 90 /mnt/lustre
[somsak_sr@araya ~]$ lfs df -i
UUID Inodes IUsed IFree IUse% Mounted on
lustre-MDT0000_UUID 2517606 3726 2513880 0 /mnt/lustre[MDT:0]
lustre-OST0000_UUID 1980714 1003 1979711 0 /mnt/lustre[OST:0]
lustre-OST0001_UUID 804355 942 803413 0 /mnt/lustre[OST:1]
lustre-OST0002_UUID 3751936 1005 3750931 0 /mnt/lustre[OST:2]
lustre-OST0003_UUID 795258 1001 794257 0 /mnt/lustre[OST:3]
filesystem summary: 2517606 3726 2513880 0 /mnt/lustre
How can I use the file system to its maximum capacity? There should
be at least 8-9% left, about 20-30GB.
Thank you very much
--
-----------------------------------------------------------------------------------
Somsak Sriprayoonsakul
Thai National Grid Center
Software Industry Promotion Agency
Ministry of ICT, Thailand
somsak_sr@thaigrid.or.th
-----------------------------------------------------------------------------------