CentOS - Nov 2008 - disk space issues...any help is greatly appreciated

Hi all,

Please pardon my newbie-ness on this issue....I've a / partition which 
is full (quite suddenly, actually) and I'm not sure how to fix this.

I've searched for uneeded logs, etc in /var/log and /tmp to no avail. 
The system is CentOS 5.2 and is not connected to the internet, serves as 
a local LAN server running stock stuff...sendmail, dovecot, 
apache..nothing strange or special going on.

I have additional HDDs available if growing the partition is in order 
(would appreciate pointers to that, if applicable), but I'm really 
stumped as to where the space is being eaten up.

Thanks in advance,
-Ray


My layout is:

#df -h
Filesystem            Size  Used Avail Use% Mounted on
/dev/mapper/VolGroup00-LogVol00
                      131G  130G     0 100% /
/dev/sdc1             271G  156G  102G  61% /home
/dev/sdd1             271G  4.5G  253G   2% /home/905
/dev/sda1              99M   29M   66M  31% /boot
tmpfs                 442M     0  442M   0% /dev/shm



# cat /etc/fstab
/dev/VolGroup00/LogVol00 /                       ext3    defaults        1 1
LABEL=/home             /home                   ext3    defaults        1 2
LABEL=/home/905         /home/905               ext3    defaults        1 2
LABEL=/boot             /boot                   ext3    defaults        1 2
tmpfs                   /dev/shm                tmpfs   defaults        0 0
devpts                  /dev/pts                devpts  gid=5,mode=620  0 0
sysfs                   /sys                    sysfs   defaults        0 0
proc                    /proc                   proc    defaults        0 0
/dev/VolGroup00/LogVol01 swap                    swap    defaults        0 0



# cat /etc/mtab
/dev/mapper/VolGroup00-LogVol00 / ext3 rw 0 0
proc /proc proc rw 0 0
sysfs /sys sysfs rw 0 0
devpts /dev/pts devpts rw,gid=5,mode=620 0 0
/dev/sdc1 /home ext3 rw 0 0
/dev/sdd1 /home/905 ext3 rw 0 0
/dev/sda1 /boot ext3 rw 0 0
tmpfs /dev/shm tmpfs rw 0 0
none /proc/sys/fs/binfmt_misc binfmt_misc rw 0 0
sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw 0 0

On Wed, Nov 26, 2008 at 4:50 PM, Ray Leventhal <centos at swhi.net>
wrote:
> Hi all,
>
> Please pardon my newbie-ness on this issue....I've a / partition which
is
> full (quite suddenly, actually) and I'm not sure how to fix this.
>
> I've searched for uneeded logs, etc in /var/log and /tmp to no avail.
The
> system is CentOS 5.2 and is not connected to the internet, serves as a
local
> LAN server running stock stuff...sendmail, dovecot, apache..nothing strange
> or special going on.
>
> I have additional HDDs available if growing the partition is in order
(would
> appreciate pointers to that, if applicable), but I'm really stumped as
to
> where the space is being eaten up.
>
> Thanks in advance,
> -Ray
>
>
> My layout is:
>
> #df -h
> Filesystem            Size  Used Avail Use% Mounted on
> /dev/mapper/VolGroup00-LogVol00
>                     131G  130G     0 100% /
> /dev/sdc1             271G  156G  102G  61% /home
> /dev/sdd1             271G  4.5G  253G   2% /home/905
> /dev/sda1              99M   29M   66M  31% /boot
> tmpfs                 442M     0  442M   0% /dev/shm
>
>
>
> # cat /etc/fstab
> /dev/VolGroup00/LogVol00 /                       ext3    defaults        1
1
> LABEL=/home             /home                   ext3    defaults        1 2
> LABEL=/home/905         /home/905               ext3    defaults        1 2
> LABEL=/boot             /boot                   ext3    defaults        1 2
> tmpfs                   /dev/shm                tmpfs   defaults        0 0
> devpts                  /dev/pts                devpts  gid=5,mode=620  0 0
> sysfs                   /sys                    sysfs   defaults        0 0
> proc                    /proc                   proc    defaults        0 0
> /dev/VolGroup00/LogVol01 swap                    swap    defaults        0
0
>
>
>
> # cat /etc/mtab
> /dev/mapper/VolGroup00-LogVol00 / ext3 rw 0 0
> proc /proc proc rw 0 0
> sysfs /sys sysfs rw 0 0
> devpts /dev/pts devpts rw,gid=5,mode=620 0 0
> /dev/sdc1 /home ext3 rw 0 0
> /dev/sdd1 /home/905 ext3 rw 0 0
> /dev/sda1 /boot ext3 rw 0 0
> tmpfs /dev/shm tmpfs rw 0 0
> none /proc/sys/fs/binfmt_misc binfmt_misc rw 0 0
> sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw 0 0
>
>
> _______________________________________________

Do a search for coredump file (i.e. run updatedb && locate core.*) -
they can often fill up the HDD very quicly if something coredumps.


-- 

Kind Regards
Rudi Ahlers

Ray Leventhal <> scribbled on Wednesday, November 26, 2008 3:50 PM:
> I have additional HDDs available if growing the partition is in order
> (would appreciate pointers to that, if applicable), but I'm really
> stumped as to where the space is being eaten up.
Try a yum clean all. That might help. But if it's as you say, not connected
to
the internet, you probably are not running yum at all, so it might not help. 
Check your temp-directories and clean out as necessary.

You still have 1gig free. Did you do a full install? If you can live with it, 
uninstall packages you don't need.
-- 
/Sorin 
-------------- next part --------------
A non-text attachment was scrubbed...
Name: smime.p7s
Type: application/x-pkcs7-signature
Size: 5126 bytes
Desc: not available
URL:
<http://lists.centos.org/pipermail/centos/attachments/20081126/71e56079/attachment-0003.bin>

On Wed, 2008-11-26 at 09:50 -0500, Ray Leventhal wrote:
> Hi all,
> 
> Please pardon my newbie-ness on this issue....I've a / partition which 
> is full (quite suddenly, actually) and I'm not sure how to fix this.
> 
> I've searched for uneeded logs, etc in /var/log and /tmp to no avail. 
> The system is CentOS 5.2 and is not connected to the internet, serves as 
> a local LAN server running stock stuff...sendmail, dovecot, 
> apache..nothing strange or special going on.
I suggest "man du ..." with the -x or --one-file-system flag along
with
the others. That will tell you where the largest stuf is at. Then you
can cd into suspect places and do it again to get clues as to the hogs.
> 
> I have additional HDDs available if growing the partition is in order 
> (would appreciate pointers to that, if applicable), but I'm really 
> stumped as to where the space is being eaten up.
If you need to do that after the above investigation, it will not be
hard as pvcreate and lgexpand (?, man not at hand) will allow easy
expansion.

<snip>

HTH
-- 
Bill

Sorin Srbu wrote:
> Ray Leventhal <> scribbled on Wednesday, November 26, 2008 3:50 PM:
>
>   
>> I have additional HDDs available if growing the partition is in order
>> (would appreciate pointers to that, if applicable), but I'm really
>> stumped as to where the space is being eaten up.
>>     
>
> Try a yum clean all. That might help. But if it's as you say, not
connected to
> the internet, you probably are not running yum at all, so it might not
help.
> Check your temp-directories and clean out as necessary.
>
> You still have 1gig free. Did you do a full install? If you can live with
it,
> uninstall packages you don't need.
>   
> ------------------------------------------------------------------------
>
> _______________________________________________
> CentOS mailing list
> CentOS at centos.org
> http://lists.centos.org/mailman/listinfo/centos
>   
Hi Sorin,

It was a nearly-full install and I do connect periodically to do 
updates.  I did a yum clean all before writing to the list, with no 
significant change to the disk usage.

I will list packages next and see what can be removed safely.  I truly 
don't know what is filling the 130G...this should be more than 
sufficient as I've loaded CentOS5.x on many systems without this issue.

Thanks again for your input,
-Ray

Ray Leventhal wrote:
> Hi all,
>
> Please pardon my newbie-ness on this issue....I've a / partition which 
> is full (quite suddenly, actually) and I'm not sure how to fix this.
>
> I've searched for uneeded logs, etc in /var/log and /tmp to no avail. 
> The system is CentOS 5.2 and is not connected to the internet, serves 
> as a local LAN server running stock stuff...sendmail, dovecot, 
> apache..nothing strange or special going on.
>
> I have additional HDDs available if growing the partition is in order 
> (would appreciate pointers to that, if applicable), but I'm really 
> stumped as to where the space is being eaten up.
>
> Thanks in advance,
> -Ray
>
>
> My layout is:
>
> #df -h
> Filesystem            Size  Used Avail Use% Mounted on
> /dev/mapper/VolGroup00-LogVol00
>                      131G  130G     0 100% /
> /dev/sdc1             271G  156G  102G  61% /home
> /dev/sdd1             271G  4.5G  253G   2% /home/905
> /dev/sda1              99M   29M   66M  31% /boot
> tmpfs                 442M     0  442M   0% /dev/shm
>
>
>
> # cat /etc/fstab
> /dev/VolGroup00/LogVol00 /                       ext3    
> defaults        1 1
> LABEL=/home             /home                   ext3    
> defaults        1 2
> LABEL=/home/905         /home/905               ext3    
> defaults        1 2
> LABEL=/boot             /boot                   ext3    
> defaults        1 2
> tmpfs                   /dev/shm                tmpfs   
> defaults        0 0
> devpts                  /dev/pts                devpts  
> gid=5,mode=620  0 0
> sysfs                   /sys                    sysfs   
> defaults        0 0
> proc                    /proc                   proc    
> defaults        0 0
> /dev/VolGroup00/LogVol01 swap                    swap    
> defaults        0 0
>
>
>
> # cat /etc/mtab
> /dev/mapper/VolGroup00-LogVol00 / ext3 rw 0 0
> proc /proc proc rw 0 0
> sysfs /sys sysfs rw 0 0
> devpts /dev/pts devpts rw,gid=5,mode=620 0 0
> /dev/sdc1 /home ext3 rw 0 0
> /dev/sdd1 /home/905 ext3 rw 0 0
> /dev/sda1 /boot ext3 rw 0 0
> tmpfs /dev/shm tmpfs rw 0 0
> none /proc/sys/fs/binfmt_misc binfmt_misc rw 0 0
> sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw 0 0
>
I'm working myself out of one those unhappy situations right now.  The 
way I always start is to pick some arbitrary value of file size, larger 
than which there will (or should) be a very small number of files and then:
# find / -size +2G -print
...which will present me with a list of candidates for removal.

Sorin Srbu wrote:
> Ray Leventhal <> scribbled on Wednesday, November 26, 2008 3:50 PM:
>
>   
>> I have additional HDDs available if growing the partition is in order
>> (would appreciate pointers to that, if applicable), but I'm really
>> stumped as to where the space is being eaten up.
>>     
>
> Try a yum clean all. That might help. But if it's as you say, not
connected to
> the internet, you probably are not running yum at all, so it might not
help.
> Check your temp-directories and clean out as necessary.
> <snip>
>
Thanks to all who replied.

/ filled up when my nightly rsync snapshot did something which I'm still 
looking into.

I run a nightly rsync script to make copies (to an external HDD 
connected via USB) of user data files:

#backup to USB drive location for /home
# /media/bkup is /dev/sdg1 (USB 700GB drive)
rsync -av --delete /home/ /media/bkup
cd

Well, in /media, there were 2 folders, not just one.../bkup and /bkup_  
as well as 2 .lock files.  I determined which was the last complete 
backup and deleted the other... needless to say / space began to 
increase, but I'm truly puzzled about why a mount point would take up 
space on / when the media is external.

Anyone with insight into my flawed logic, please let me know :)

Thanks for all help and the ongoing knowledge gained from this list.

-Ray

Ray Leventhal schrieb:
> Hi all,
>
> Please pardon my newbie-ness on this issue....I've a / partition which
> is full (quite suddenly, actually) and I'm not sure how to fix this.
>

du -xck / |sort -n -r |less


If du << df, then reboot.
Maybe you've got open filehandles...


Rainer

Sorin Srbu wrote:
> Ray Leventhal <> scribbled on Wednesday, November 26, 2008 3:50 PM:
>
>   
>> I have additional HDDs available if growing the partition is in order
>> (would appreciate pointers to that, if applicable), but I'm really
>> stumped as to where the space is being eaten up.
>>     
>
> Try a yum clean all. That might help. But if it's as you say, not
connected to
>   
Hi again all,

There was a 3.5hr power outage last night which explains it all.  Sadly, 
I've got some investigation to do about why my *supposed* 5hrs of 
battery backup didn't last long enough to cover, but the
mount point was, in fact, unmounted and so rsync did it's job right into 
the folder as opposed to the ext. drive.

As always, my sincere thanks to this list and to our CentOS maintainers.

Kindest regards,
-Ray