Hi all. I have a 50 GB OCFS2 file system. I'm currently using ~26GB of space but df is reporting 43 GB used. Any ideas how to find out where the missing 17GB is at? The file system was formatted with a 16K cluster & 4K block size. Thanks, Matt -------------- next part -------------- An HTML attachment was scrubbed... URL: http://oss.oracle.com/pipermail/ocfs2-users/attachments/20060920/a1dbbe3c/attachment.html
Did you remove some large files recently? If so, check the orphan_dir and truncate_log for all the slots. 1. Start debugfs: # debugfs.ocfs2 /dev/sdX 2. List system directory: > ls -l // 3. List files in all orphan_dir(s): > ls -l //orphan_dir:0000 If there are files, means some process in the cluster is still using that file. 4. stat all trancate_log(s): > stat //truncate_log:0000 I will be surprised if you see any bits here. If there are, do "sync;sync;sync;" on the appropriate node. 5. You can find the appropriate node by dumping the slotmap: > slotmap Find the slot-to-nodenum mapping. Do the sync on that node. For this and more, refer to the on-disk format support guide. http://oss.oracle.com/projects/ocfs2/dist/documentation/03-disk_format.pdf Matthew Flusche wrote:> > Hi all. > > I have a 50 GB OCFS2 file system. I?m currently using ~26GB of space > but df is reporting 43 GB used. Any ideas how to find out where the > missing 17GB is at? > > The file system was formatted with a 16K cluster & 4K block size. > > Thanks, > > Matt > > ------------------------------------------------------------------------ > > _______________________________________________ > Ocfs2-users mailing list > Ocfs2-users@oss.oracle.com > http://oss.oracle.com/mailman/listinfo/ocfs2-users >
There has been a lot of file system activity recently. I have files in orphan_dir:0000 and orphan_dir:0002. But that doesn't seem to account for the 17 GB missing. The truncate logs seem clean. So having files in orphan_dir:0000 is telling me that the node in slot 0 deleted files and another node(s) still has the file open, correct? Matt debugfs: ls -l //orphan_dir:0000 16 drwxr-xr-x 13 0 0 774144 10-Sep-2006 00:08 . 10 drwxr-xr-x 6 0 0 4096 2-May-2006 16:11 .. 3052182 drwxrwxrwx 0 501 500 4096 19-Jul-2006 17:50 00000000002e9296 8234094 drwxrwxrwx 0 501 500 4096 19-Jul-2006 17:50 00000000007da46e 13063783 drwxrwxrwx 0 501 500 4096 19-Jul-2006 17:50 0000000000c75667 7869995 drwxrwxrwx 0 501 500 4096 22-Aug-2006 13:27 000000000078162b 3741473 drwxrwxrwx 0 501 500 4096 22-Aug-2006 13:29 0000000000391721 3351057 drwxrwxrwx 0 501 500 4096 19-Jul-2006 17:50 0000000000332211 7842503 drwxrwxrwx 0 501 500 4096 19-Jul-2006 17:50 000000000077aac7 2056493 drwxrwxrwx 0 501 500 4096 5-Sep-2006 08:53 00000000001f612d 7861894 drwxrwxrwx 0 501 500 4096 5-Sep-2006 08:53 000000000077f686 1487817 drwxrwxrwx 0 501 500 4096 5-Sep-2006 08:53 000000000016b3c9 1702439 drwxrwxrwx 0 501 500 4096 5-Sep-2006 08:53 000000000019fa27 debugfs: ls -l //orphan_dir:0002 18 drwxr-xr-x 2 0 0 94208 5-Jul-2006 17:13 . 10 drwxr-xr-x 6 0 0 4096 2-May-2006 16:11 .. 4301446 -rw-r--r-- 0 503 500 0 12-Aug-2006 10:40 000000000041a286 -----Original Message----- From: Sunil Mushran [mailto:Sunil.Mushran@oracle.com] Sent: Wednesday, September 20, 2006 12:32 PM To: Matthew Flusche Cc: Ocfs2-users@oss.oracle.com Subject: Re: [Ocfs2-users] ocfs2 - disk usage inconsistencies Did you remove some large files recently? If so, check the orphan_dir and truncate_log for all the slots. 1. Start debugfs: # debugfs.ocfs2 /dev/sdX 2. List system directory: > ls -l // 3. List files in all orphan_dir(s): > ls -l //orphan_dir:0000 If there are files, means some process in the cluster is still using that file. 4. stat all trancate_log(s): > stat //truncate_log:0000 I will be surprised if you see any bits here. If there are, do "sync;sync;sync;" on the appropriate node. 5. You can find the appropriate node by dumping the slotmap: > slotmap Find the slot-to-nodenum mapping. Do the sync on that node. For this and more, refer to the on-disk format support guide. http://oss.oracle.com/projects/ocfs2/dist/documentation/03-disk_format.p df Matthew Flusche wrote:> > Hi all. > > I have a 50 GB OCFS2 file system. I'm currently using ~26GB of space > but df is reporting 43 GB used. Any ideas how to find out where the > missing 17GB is at? > > The file system was formatted with a 16K cluster & 4K block size. > > Thanks, > > Matt > >------------------------------------------------------------------------> > _______________________________________________ > Ocfs2-users mailing list > Ocfs2-users@oss.oracle.com > http://oss.oracle.com/mailman/listinfo/ocfs2-users >
When I stat the only file listed in //orphan_dir:0002 it shows 0 clusters. There are only directories listed in //orphan_dir:0000 and none of the directories have contents. So my next courses of action (since I don't know what has these unlinked files opened) would be to stop every process accessing this file system? Possibly umount/mount the file system? would fsck.ocfs2 clean this up? -----Original Message----- From: Sunil Mushran [mailto:Sunil.Mushran@oracle.com] Sent: Wednesday, September 20, 2006 1:52 PM To: Matthew Flusche Cc: Ocfs2-users@oss.oracle.com Subject: Re: [Ocfs2-users] ocfs2 - disk usage inconsistencies Another node or that node itself. As far as the filesize goes, "ls -l" does not give the ondisk size. Do "stat <inodenum>" on the unlinked files and see the "Clusters". Matthew Flusche wrote:> There has been a lot of file system activity recently. > > I have files in orphan_dir:0000 and orphan_dir:0002. But that doesn't > seem to account for the 17 GB missing. The truncate logs seem clean. > So having files in orphan_dir:0000 is telling me that the node in slot0> deleted files and another node(s) still has the file open, correct? > > Matt > > debugfs: ls -l //orphan_dir:0000 > 16 drwxr-xr-x 13 0 0 774144 > 10-Sep-2006 00:08 . > 10 drwxr-xr-x 6 0 0 4096 > 2-May-2006 16:11 .. > 3052182 drwxrwxrwx 0 501 500 4096 > 19-Jul-2006 17:50 00000000002e9296 > 8234094 drwxrwxrwx 0 501 500 4096 > 19-Jul-2006 17:50 00000000007da46e > 13063783 drwxrwxrwx 0 501 500 4096 > 19-Jul-2006 17:50 0000000000c75667 > 7869995 drwxrwxrwx 0 501 500 4096 > 22-Aug-2006 13:27 000000000078162b > 3741473 drwxrwxrwx 0 501 500 4096 > 22-Aug-2006 13:29 0000000000391721 > 3351057 drwxrwxrwx 0 501 500 4096 > 19-Jul-2006 17:50 0000000000332211 > 7842503 drwxrwxrwx 0 501 500 4096 > 19-Jul-2006 17:50 000000000077aac7 > 2056493 drwxrwxrwx 0 501 500 4096 > 5-Sep-2006 08:53 00000000001f612d > 7861894 drwxrwxrwx 0 501 500 4096 > 5-Sep-2006 08:53 000000000077f686 > 1487817 drwxrwxrwx 0 501 500 4096 > 5-Sep-2006 08:53 000000000016b3c9 > 1702439 drwxrwxrwx 0 501 500 4096 > 5-Sep-2006 08:53 000000000019fa27 > > debugfs: ls -l //orphan_dir:0002 > 18 drwxr-xr-x 2 0 0 94208 > 5-Jul-2006 17:13 . > 10 drwxr-xr-x 6 0 0 4096 > 2-May-2006 16:11 .. > 4301446 -rw-r--r-- 0 503 500 0 > 12-Aug-2006 10:40 000000000041a286 > > -----Original Message----- > From: Sunil Mushran [mailto:Sunil.Mushran@oracle.com] > Sent: Wednesday, September 20, 2006 12:32 PM > To: Matthew Flusche > Cc: Ocfs2-users@oss.oracle.com > Subject: Re: [Ocfs2-users] ocfs2 - disk usage inconsistencies > > Did you remove some large files recently? If so, check the orphan_dir > and truncate_log for all the slots. > > 1. Start debugfs: > # debugfs.ocfs2 /dev/sdX > > 2. List system directory: > > ls -l // > > 3. List files in all orphan_dir(s): > > ls -l //orphan_dir:0000 > > If there are files, means some process in the cluster is still using > that file. > > 4. stat all trancate_log(s): > > stat //truncate_log:0000 > > I will be surprised if you see any bits here. If there are, do > "sync;sync;sync;" on the > appropriate node. > > 5. You can find the appropriate node by dumping the slotmap: > > slotmap > Find the slot-to-nodenum mapping. Do the sync on that node. > > For this and more, refer to the on-disk format support guide. >http://oss.oracle.com/projects/ocfs2/dist/documentation/03-disk_format.p> df > > Matthew Flusche wrote: > >> Hi all. >> >> I have a 50 GB OCFS2 file system. I'm currently using ~26GB of space >> but df is reporting 43 GB used. Any ideas how to find out where the >> missing 17GB is at? >> >> The file system was formatted with a 16K cluster & 4K block size. >> >> Thanks, >> >> Matt >> >> >> >------------------------------------------------------------------------> >> _______________________________________________ >> Ocfs2-users mailing list >> Ocfs2-users@oss.oracle.com >> http://oss.oracle.com/mailman/listinfo/ocfs2-users >> >> > > _______________________________________________ > Ocfs2-users mailing list > Ocfs2-users@oss.oracle.com > http://oss.oracle.com/mailman/listinfo/ocfs2-users >
I unmounted the file system from each node and ran the fsck.ocfs2 on it. That cleaned up the orphan_dirs but I did not get my 17 GB of space back. Any other suggestions? Am I going to have to backup,format,restore to fix this? -----Original Message----- From: Sunil Mushran [mailto:Sunil.Mushran@oracle.com] Sent: Wednesday, September 20, 2006 2:31 PM To: Matthew Flusche Cc: Ocfs2-users@oss.oracle.com Subject: Re: [Ocfs2-users] ocfs2 - disk usage inconsistencies Yes. Matthew Flusche wrote:> When I stat the only file listed in //orphan_dir:0002 it shows 0 > clusters. There are only directories listed in //orphan_dir:0000 and > none of the directories have contents. So my next courses of action > (since I don't know what has these unlinked files opened) would be to > stop every process accessing this file system? Possibly umount/mount > the file system? would fsck.ocfs2 clean this up? > > -----Original Message----- > From: Sunil Mushran [mailto:Sunil.Mushran@oracle.com] > Sent: Wednesday, September 20, 2006 1:52 PM > To: Matthew Flusche > Cc: Ocfs2-users@oss.oracle.com > Subject: Re: [Ocfs2-users] ocfs2 - disk usage inconsistencies > > Another node or that node itself. > > As far as the filesize goes, "ls -l" does not give the ondisk size. > Do "stat <inodenum>" on the unlinked files and see the "Clusters". > > Matthew Flusche wrote: > >> There has been a lot of file system activity recently. >> >> I have files in orphan_dir:0000 and orphan_dir:0002. But thatdoesn't>> seem to account for the 17 GB missing. The truncate logs seem clean. >> So having files in orphan_dir:0000 is telling me that the node inslot>> > 0 > >> deleted files and another node(s) still has the file open, correct? >> >> Matt >> >> debugfs: ls -l //orphan_dir:0000 >> 16 drwxr-xr-x 13 0 0 774144 >> 10-Sep-2006 00:08 . >> 10 drwxr-xr-x 6 0 0 4096 >> 2-May-2006 16:11 .. >> 3052182 drwxrwxrwx 0 501 500 4096 >> 19-Jul-2006 17:50 00000000002e9296 >> 8234094 drwxrwxrwx 0 501 500 4096 >> 19-Jul-2006 17:50 00000000007da46e >> 13063783 drwxrwxrwx 0 501 500 4096 >> 19-Jul-2006 17:50 0000000000c75667 >> 7869995 drwxrwxrwx 0 501 500 4096 >> 22-Aug-2006 13:27 000000000078162b >> 3741473 drwxrwxrwx 0 501 500 4096 >> 22-Aug-2006 13:29 0000000000391721 >> 3351057 drwxrwxrwx 0 501 500 4096 >> 19-Jul-2006 17:50 0000000000332211 >> 7842503 drwxrwxrwx 0 501 500 4096 >> 19-Jul-2006 17:50 000000000077aac7 >> 2056493 drwxrwxrwx 0 501 500 4096 >> 5-Sep-2006 08:53 00000000001f612d >> 7861894 drwxrwxrwx 0 501 500 4096 >> 5-Sep-2006 08:53 000000000077f686 >> 1487817 drwxrwxrwx 0 501 500 4096 >> 5-Sep-2006 08:53 000000000016b3c9 >> 1702439 drwxrwxrwx 0 501 500 4096 >> 5-Sep-2006 08:53 000000000019fa27 >> >> debugfs: ls -l //orphan_dir:0002 >> 18 drwxr-xr-x 2 0 0 94208 >> 5-Jul-2006 17:13 . >> 10 drwxr-xr-x 6 0 0 4096 >> 2-May-2006 16:11 .. >> 4301446 -rw-r--r-- 0 503 500 0 >> 12-Aug-2006 10:40 000000000041a286 >> >> -----Original Message----- >> From: Sunil Mushran [mailto:Sunil.Mushran@oracle.com] >> Sent: Wednesday, September 20, 2006 12:32 PM >> To: Matthew Flusche >> Cc: Ocfs2-users@oss.oracle.com >> Subject: Re: [Ocfs2-users] ocfs2 - disk usage inconsistencies >> >> Did you remove some large files recently? If so, check the orphan_dir >> and truncate_log for all the slots. >> >> 1. Start debugfs: >> # debugfs.ocfs2 /dev/sdX >> >> 2. List system directory: >> > ls -l // >> >> 3. List files in all orphan_dir(s): >> > ls -l //orphan_dir:0000 >> >> If there are files, means some process in the cluster is still using >> that file. >> >> 4. stat all trancate_log(s): >> > stat //truncate_log:0000 >> >> I will be surprised if you see any bits here. If there are, do >> "sync;sync;sync;" on the >> appropriate node. >> >> 5. You can find the appropriate node by dumping the slotmap: >> > slotmap >> Find the slot-to-nodenum mapping. Do the sync on that node. >> >> For this and more, refer to the on-disk format support guide. >> >> >http://oss.oracle.com/projects/ocfs2/dist/documentation/03-disk_format.p> >> df >> >> Matthew Flusche wrote: >> >> >>> Hi all. >>> >>> I have a 50 GB OCFS2 file system. I'm currently using ~26GB of space>>> but df is reporting 43 GB used. Any ideas how to find out where the >>> missing 17GB is at? >>> >>> The file system was formatted with a 16K cluster & 4K block size. >>> >>> Thanks, >>> >>> Matt >>> >>> >>> >>> >------------------------------------------------------------------------> >> >> >>> _______________________________________________ >>> Ocfs2-users mailing list >>> Ocfs2-users@oss.oracle.com >>> http://oss.oracle.com/mailman/listinfo/ocfs2-users >>> >>> >>> >> _______________________________________________ >> Ocfs2-users mailing list >> Ocfs2-users@oss.oracle.com >> http://oss.oracle.com/mailman/listinfo/ocfs2-users >> >>
I created another 50 GB OCFS2 file system with the same parameters (16k cluster 4k block) and copied the contents of the original file system. My 26GB of data only takes up 38GB now (43 GB on the original file system). After I delete all the contents of the new file system, there is still 3.7 GB used. Any ideas? -----Original Message----- From: ocfs2-users-bounces@oss.oracle.com [mailto:ocfs2-users-bounces@oss.oracle.com] On Behalf Of Matthew Flusche Sent: Sunday, September 24, 2006 3:06 PM To: Sunil Mushran Cc: Ocfs2-users@oss.oracle.com Subject: RE: [Ocfs2-users] ocfs2 - disk usage inconsistencies I unmounted the file system from each node and ran the fsck.ocfs2 on it. That cleaned up the orphan_dirs but I did not get my 17 GB of space back. Any other suggestions? Am I going to have to backup,format,restore to fix this? -----Original Message----- From: Sunil Mushran [mailto:Sunil.Mushran@oracle.com] Sent: Wednesday, September 20, 2006 2:31 PM To: Matthew Flusche Cc: Ocfs2-users@oss.oracle.com Subject: Re: [Ocfs2-users] ocfs2 - disk usage inconsistencies Yes. Matthew Flusche wrote:> When I stat the only file listed in //orphan_dir:0002 it shows 0 > clusters. There are only directories listed in //orphan_dir:0000 and > none of the directories have contents. So my next courses of action > (since I don't know what has these unlinked files opened) would be to > stop every process accessing this file system? Possibly umount/mount > the file system? would fsck.ocfs2 clean this up? > > -----Original Message----- > From: Sunil Mushran [mailto:Sunil.Mushran@oracle.com] > Sent: Wednesday, September 20, 2006 1:52 PM > To: Matthew Flusche > Cc: Ocfs2-users@oss.oracle.com > Subject: Re: [Ocfs2-users] ocfs2 - disk usage inconsistencies > > Another node or that node itself. > > As far as the filesize goes, "ls -l" does not give the ondisk size. > Do "stat <inodenum>" on the unlinked files and see the "Clusters". > > Matthew Flusche wrote: > >> There has been a lot of file system activity recently. >> >> I have files in orphan_dir:0000 and orphan_dir:0002. But thatdoesn't>> seem to account for the 17 GB missing. The truncate logs seem clean. >> So having files in orphan_dir:0000 is telling me that the node inslot>> > 0 > >> deleted files and another node(s) still has the file open, correct? >> >> Matt >> >> debugfs: ls -l //orphan_dir:0000 >> 16 drwxr-xr-x 13 0 0 774144 >> 10-Sep-2006 00:08 . >> 10 drwxr-xr-x 6 0 0 4096 >> 2-May-2006 16:11 .. >> 3052182 drwxrwxrwx 0 501 500 4096 >> 19-Jul-2006 17:50 00000000002e9296 >> 8234094 drwxrwxrwx 0 501 500 4096 >> 19-Jul-2006 17:50 00000000007da46e >> 13063783 drwxrwxrwx 0 501 500 4096 >> 19-Jul-2006 17:50 0000000000c75667 >> 7869995 drwxrwxrwx 0 501 500 4096 >> 22-Aug-2006 13:27 000000000078162b >> 3741473 drwxrwxrwx 0 501 500 4096 >> 22-Aug-2006 13:29 0000000000391721 >> 3351057 drwxrwxrwx 0 501 500 4096 >> 19-Jul-2006 17:50 0000000000332211 >> 7842503 drwxrwxrwx 0 501 500 4096 >> 19-Jul-2006 17:50 000000000077aac7 >> 2056493 drwxrwxrwx 0 501 500 4096 >> 5-Sep-2006 08:53 00000000001f612d >> 7861894 drwxrwxrwx 0 501 500 4096 >> 5-Sep-2006 08:53 000000000077f686 >> 1487817 drwxrwxrwx 0 501 500 4096 >> 5-Sep-2006 08:53 000000000016b3c9 >> 1702439 drwxrwxrwx 0 501 500 4096 >> 5-Sep-2006 08:53 000000000019fa27 >> >> debugfs: ls -l //orphan_dir:0002 >> 18 drwxr-xr-x 2 0 0 94208 >> 5-Jul-2006 17:13 . >> 10 drwxr-xr-x 6 0 0 4096 >> 2-May-2006 16:11 .. >> 4301446 -rw-r--r-- 0 503 500 0 >> 12-Aug-2006 10:40 000000000041a286 >> >> -----Original Message----- >> From: Sunil Mushran [mailto:Sunil.Mushran@oracle.com] >> Sent: Wednesday, September 20, 2006 12:32 PM >> To: Matthew Flusche >> Cc: Ocfs2-users@oss.oracle.com >> Subject: Re: [Ocfs2-users] ocfs2 - disk usage inconsistencies >> >> Did you remove some large files recently? If so, check the orphan_dir >> and truncate_log for all the slots. >> >> 1. Start debugfs: >> # debugfs.ocfs2 /dev/sdX >> >> 2. List system directory: >> > ls -l // >> >> 3. List files in all orphan_dir(s): >> > ls -l //orphan_dir:0000 >> >> If there are files, means some process in the cluster is still using >> that file. >> >> 4. stat all trancate_log(s): >> > stat //truncate_log:0000 >> >> I will be surprised if you see any bits here. If there are, do >> "sync;sync;sync;" on the >> appropriate node. >> >> 5. You can find the appropriate node by dumping the slotmap: >> > slotmap >> Find the slot-to-nodenum mapping. Do the sync on that node. >> >> For this and more, refer to the on-disk format support guide. >> >> >http://oss.oracle.com/projects/ocfs2/dist/documentation/03-disk_format.p> >> df >> >> Matthew Flusche wrote: >> >> >>> Hi all. >>> >>> I have a 50 GB OCFS2 file system. I'm currently using ~26GB of space>>> but df is reporting 43 GB used. Any ideas how to find out where the >>> missing 17GB is at? >>> >>> The file system was formatted with a 16K cluster & 4K block size. >>> >>> Thanks, >>> >>> Matt >>> >>> >>> >>> >------------------------------------------------------------------------> >> >> >>> _______________________________________________ >>> Ocfs2-users mailing list >>> Ocfs2-users@oss.oracle.com >>> http://oss.oracle.com/mailman/listinfo/ocfs2-users >>> >>> >>> >> _______________________________________________ >> Ocfs2-users mailing list >> Ocfs2-users@oss.oracle.com >> http://oss.oracle.com/mailman/listinfo/ocfs2-users >> >>_______________________________________________ Ocfs2-users mailing list Ocfs2-users@oss.oracle.com http://oss.oracle.com/mailman/listinfo/ocfs2-users
I have since formatted the new file system (I'm testing different block sizes). But here is the output from the original file system: [root@tul1tmapp1 ~]# echo "ls -l //" | debugfs.ocfs2 /dev/emcpowera debugfs.ocfs2 1.2.1 debugfs: 10 drwxr-xr-x 6 0 0 4096 2-May-2006 16:11 . 10 drwxr-xr-x 6 0 0 4096 2-May-2006 16:11 .. 11 -rw-r--r-- 1 0 0 0 2-May-2006 16:11 bad_blocks 12 -rw-r--r-- 1 0 0 835584 2-May-2006 16:11 global_inode_alloc 13 -rw-r--r-- 1 0 0 16384 2-May-2006 16:11 slot_map 14 -rw-r--r-- 1 0 0 1048576 2-May-2006 16:11 heartbeat 15 -rw-r--r-- 1 0 0 53687091200 2-May-2006 16:11 global_bitmap 16 drwxr-xr-x 2 0 0 774144 10-Sep-2006 00:08 orphan_dir:0000 17 drwxr-xr-x 2 0 0 4096 2-May-2006 16:11 orphan_dir:0001 18 drwxr-xr-x 2 0 0 94208 5-Jul-2006 17:13 orphan_dir:0002 19 drwxr-xr-x 2 0 0 4096 2-May-2006 16:11 orphan_dir:0003 20 -rw-r--r-- 1 0 0 12582912 2-May-2006 16:11 extent_alloc:0000 21 -rw-r--r-- 1 0 0 0 2-May-2006 16:11 extent_alloc:0001 22 -rw-r--r-- 1 0 0 0 2-May-2006 16:11 extent_alloc:0002 23 -rw-r--r-- 1 0 0 0 2-May-2006 16:11 extent_alloc:0003 24 -rw-r--r-- 1 0 0 3099590656 2-May-2006 16:11 inode_alloc:0000 25 -rw-r--r-- 1 0 0 1879048192 2-May-2006 16:11 inode_alloc:0001 26 -rw-r--r-- 1 0 0 3137339392 2-May-2006 16:11 inode_alloc:0002 27 -rw-r--r-- 1 0 0 0 2-May-2006 16:11 inode_alloc:0003 28 -rw-r--r-- 1 0 0 268435456 2-May-2006 16:11 journal:0000 29 -rw-r--r-- 1 0 0 268435456 2-May-2006 16:11 journal:0001 30 -rw-r--r-- 1 0 0 268435456 2-May-2006 16:11 journal:0002 31 -rw-r--r-- 1 0 0 268435456 2-May-2006 16:11 journal:0003 32 -rw-r--r-- 1 0 0 0 2-May-2006 16:11 local_alloc:0000 33 -rw-r--r-- 1 0 0 0 2-May-2006 16:11 local_alloc:0001 34 -rw-r--r-- 1 0 0 0 2-May-2006 16:11 local_alloc:0002 35 -rw-r--r-- 1 0 0 0 2-May-2006 16:11 local_alloc:0003 36 -rw-r--r-- 1 0 0 0 2-May-2006 16:11 truncate_log:0000 37 -rw-r--r-- 1 0 0 0 2-May-2006 16:11 truncate_log:0001 38 -rw-r--r-- 1 0 0 0 2-May-2006 16:11 truncate_log:0002 39 -rw-r--r-- 1 0 0 0 2-May-2006 16:11 truncate_log:0003 debugfs: -----Original Message----- From: Sunil Mushran [mailto:Sunil.Mushran@oracle.com] Sent: Monday, September 25, 2006 5:09 PM To: Matthew Flusche Cc: Ocfs2-users@oss.oracle.com Subject: Re: [Ocfs2-users] ocfs2 - disk usage inconsistencies Do: # echo "ls -l //" | debugfs.ocfs2 /dev/sdX This will list the sizes of the system files. Email me the info. Matthew Flusche wrote:> I created another 50 GB OCFS2 file system with the same parameters(16k> cluster 4k block) and copied the contents of the original file system. > My 26GB of data only takes up 38GB now (43 GB on the original file > system). After I delete all the contents of the new file system,there> is still 3.7 GB used. Any ideas? > > -----Original Message----- > From: ocfs2-users-bounces@oss.oracle.com > [mailto:ocfs2-users-bounces@oss.oracle.com] On Behalf Of MatthewFlusche> Sent: Sunday, September 24, 2006 3:06 PM > To: Sunil Mushran > Cc: Ocfs2-users@oss.oracle.com > Subject: RE: [Ocfs2-users] ocfs2 - disk usage inconsistencies > > I unmounted the file system from each node and ran the fsck.ocfs2 onit.> That cleaned up the orphan_dirs but I did not get my 17 GB of space > back. Any other suggestions? Am I going to have to > backup,format,restore to fix this? > > -----Original Message----- > From: Sunil Mushran [mailto:Sunil.Mushran@oracle.com] > Sent: Wednesday, September 20, 2006 2:31 PM > To: Matthew Flusche > Cc: Ocfs2-users@oss.oracle.com > Subject: Re: [Ocfs2-users] ocfs2 - disk usage inconsistencies > > Yes. > > Matthew Flusche wrote: > >> When I stat the only file listed in //orphan_dir:0002 it shows 0 >> clusters. There are only directories listed in //orphan_dir:0000 and >> none of the directories have contents. So my next courses of action >> (since I don't know what has these unlinked files opened) would be to >> stop every process accessing this file system? Possibly umount/mount >> the file system? would fsck.ocfs2 clean this up? >> >> -----Original Message----- >> From: Sunil Mushran [mailto:Sunil.Mushran@oracle.com] >> Sent: Wednesday, September 20, 2006 1:52 PM >> To: Matthew Flusche >> Cc: Ocfs2-users@oss.oracle.com >> Subject: Re: [Ocfs2-users] ocfs2 - disk usage inconsistencies >> >> Another node or that node itself. >> >> As far as the filesize goes, "ls -l" does not give the ondisk size. >> Do "stat <inodenum>" on the unlinked files and see the "Clusters". >> >> Matthew Flusche wrote: >> >> >>> There has been a lot of file system activity recently. >>> >>> I have files in orphan_dir:0000 and orphan_dir:0002. But that >>> > doesn't > >>> seem to account for the 17 GB missing. The truncate logs seemclean.>>> So having files in orphan_dir:0000 is telling me that the node in >>> > slot > >>> >>> >> 0 >> >> >>> deleted files and another node(s) still has the file open, correct? >>> >>> Matt >>> >>> debugfs: ls -l //orphan_dir:0000 >>> 16 drwxr-xr-x 13 0 0 774144 >>> 10-Sep-2006 00:08 . >>> 10 drwxr-xr-x 6 0 0 4096 >>> 2-May-2006 16:11 .. >>> 3052182 drwxrwxrwx 0 501 500 4096 >>> 19-Jul-2006 17:50 00000000002e9296 >>> 8234094 drwxrwxrwx 0 501 500 4096 >>> 19-Jul-2006 17:50 00000000007da46e >>> 13063783 drwxrwxrwx 0 501 500 4096 >>> 19-Jul-2006 17:50 0000000000c75667 >>> 7869995 drwxrwxrwx 0 501 500 4096 >>> 22-Aug-2006 13:27 000000000078162b >>> 3741473 drwxrwxrwx 0 501 500 4096 >>> 22-Aug-2006 13:29 0000000000391721 >>> 3351057 drwxrwxrwx 0 501 500 4096 >>> 19-Jul-2006 17:50 0000000000332211 >>> 7842503 drwxrwxrwx 0 501 500 4096 >>> 19-Jul-2006 17:50 000000000077aac7 >>> 2056493 drwxrwxrwx 0 501 500 4096 >>> 5-Sep-2006 08:53 00000000001f612d >>> 7861894 drwxrwxrwx 0 501 500 4096 >>> 5-Sep-2006 08:53 000000000077f686 >>> 1487817 drwxrwxrwx 0 501 500 4096 >>> 5-Sep-2006 08:53 000000000016b3c9 >>> 1702439 drwxrwxrwx 0 501 500 4096 >>> 5-Sep-2006 08:53 000000000019fa27 >>> >>> debugfs: ls -l //orphan_dir:0002 >>> 18 drwxr-xr-x 2 0 0 94208 >>> 5-Jul-2006 17:13 . >>> 10 drwxr-xr-x 6 0 0 4096 >>> 2-May-2006 16:11 .. >>> 4301446 -rw-r--r-- 0 503 500 0 >>> 12-Aug-2006 10:40 000000000041a286 >>> >>> -----Original Message----- >>> From: Sunil Mushran [mailto:Sunil.Mushran@oracle.com] >>> Sent: Wednesday, September 20, 2006 12:32 PM >>> To: Matthew Flusche >>> Cc: Ocfs2-users@oss.oracle.com >>> Subject: Re: [Ocfs2-users] ocfs2 - disk usage inconsistencies >>> >>> Did you remove some large files recently? If so, check theorphan_dir>>> and truncate_log for all the slots. >>> >>> 1. Start debugfs: >>> # debugfs.ocfs2 /dev/sdX >>> >>> 2. List system directory: >>> > ls -l // >>> >>> 3. List files in all orphan_dir(s): >>> > ls -l //orphan_dir:0000 >>> >>> If there are files, means some process in the cluster is still using>>> that file. >>> >>> 4. stat all trancate_log(s): >>> > stat //truncate_log:0000 >>> >>> I will be surprised if you see any bits here. If there are, do >>> "sync;sync;sync;" on the >>> appropriate node. >>> >>> 5. You can find the appropriate node by dumping the slotmap: >>> > slotmap >>> Find the slot-to-nodenum mapping. Do the sync on that node. >>> >>> For this and more, refer to the on-disk format support guide. >>> >>> >>> >http://oss.oracle.com/projects/ocfs2/dist/documentation/03-disk_format.p> >> >> >>> df >>> >>> Matthew Flusche wrote: >>> >>> >>> >>>> Hi all. >>>> >>>> I have a 50 GB OCFS2 file system. I'm currently using ~26GB ofspace>>>> > > >>>> but df is reporting 43 GB used. Any ideas how to find out where the>>>> missing 17GB is at? >>>> >>>> The file system was formatted with a 16K cluster & 4K block size. >>>> >>>> Thanks, >>>> >>>> Matt >>>> >>>> >>>> >>>> >>>> >------------------------------------------------------------------------> >> >> >>> >>> >>> >>>> _______________________________________________ >>>> Ocfs2-users mailing list >>>> Ocfs2-users@oss.oracle.com >>>> http://oss.oracle.com/mailman/listinfo/ocfs2-users >>>> >>>> >>>> >>>> >>> _______________________________________________ >>> Ocfs2-users mailing list >>> Ocfs2-users@oss.oracle.com >>> http://oss.oracle.com/mailman/listinfo/ocfs2-users >>> >>> >>> > > _______________________________________________ > Ocfs2-users mailing list > Ocfs2-users@oss.oracle.com > http://oss.oracle.com/mailman/listinfo/ocfs2-users > > _______________________________________________ > Ocfs2-users mailing list > Ocfs2-users@oss.oracle.com > http://oss.oracle.com/mailman/listinfo/ocfs2-users >