I have a 1.5TB disk that has several partitions. One of them is 900GB. Now I can only see 300GB. Where is the rest? Is there a command I can do to reach the rest of the data? Will scrub help? -- This message posted from opensolaris.org
On 06/30/11 08:50 PM, Orvar Korvar wrote:> I have a 1.5TB disk that has several partitions. One of them is 900GB. Now I can only see 300GB. Where is the rest? Is there a command I can do to reach the rest of the data? Will scrub help?Not much to go on - no one can answer this. How did you go about partitioning the disk? What does the fdisk partitioning look like (if its x86)? What does the VToC slice layout look like? What are you using each partition and slice for? What tells you that you can only see 300GB? -- Andrew
On Thu, Jun 30, 2011 at 11:40:53PM +0100, Andrew Gabriel wrote:> On 06/30/11 08:50 PM, Orvar Korvar wrote: >> I have a 1.5TB disk that has several partitions. One of them is 900GB. Now I can only see 300GB. Where is the rest? Is there a command I can do to reach the rest of the data? Will scrub help? > > Not much to go on - no one can answer this. > > How did you go about partitioning the disk? > What does the fdisk partitioning look like (if its x86)? > What does the VToC slice layout look like? > What are you using each partition and slice for? > What tells you that you can only see 300GB?Are you using 32-bit or 64-bit solaris? -- Dan. -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: application/pgp-signature Size: 194 bytes Desc: not available URL: <http://mail.opensolaris.org/pipermail/zfs-discuss/attachments/20110701/1700faf0/attachment.bin>
> On Thu, Jun 30, 2011 at 11:40:53PM +0100, Andrew Gabriel wrote: > > On 06/30/11 08:50 PM, Orvar Korvar wrote: > >> I have a 1.5TB disk that has several partitions. One of them is > >> 900GB. Now I can only see 300GB. Where is the rest? Is there a > >> command I can do to reach the rest of the data? Will scrub help? > > > > Not much to go on - no one can answer this. > > > > How did you go about partitioning the disk? > > What does the fdisk partitioning look like (if its x86)? > > What does the VToC slice layout look like? > > What are you using each partition and slice for? > > What tells you that you can only see 300GB? > > Are you using 32-bit or 64-bit solaris?IIRC Solaris x86-32 can''t even address 1,5TB, so it shouldn''t show up at all, or as a 1TB drive. If he sees 300GB, there might be some slight overhead and the fact that 1TB as reported by drive producers equals 0.9TiB as reported by the OS (1TB = 10^12 bytes, 1TiB = 2^40 bytes). The 1.5TB drive will be shown as a 1.35 drive or so. Vennlige hilsener / Best regards roy -- Roy Sigurd Karlsbakk (+47) 97542685 roy at karlsbakk.net http://blogg.karlsbakk.net/ -- I all pedagogikk er det essensielt at pensum presenteres intelligibelt. Det er et element?rt imperativ for alle pedagoger ? unng? eksessiv anvendelse av idiomer med fremmed opprinnelse. I de fleste tilfeller eksisterer adekvate og relevante synonymer p? norsk.
I am using 64bit S11E. Everything worked fine earlier. But now I suspect the disk is breaking down, it behaves weird. I have several partitions: 1) OpenSolaris b134 upgraded to S11E 2) WinXP 3) FAT32 4) ZFS storage pool of 900GB Earlier, everything was fine. But suddenly OpenSolaris does not work anymore. When I boot via GRUB, it gives an error message and halts. I have installed S11E on a new disk, and when I try to import the old rpool 1) then the computer reboots: http://opensolaris.org/jive/thread.jspa?messageID=517089񾏡 So there are some problems. My storage pool 4) is suddenly 300GB big and where is the data? I have one snapshot, or so. I have not deleted stuff. I suspect the disk is breaking down. How can I tell? I am scrubbing the disk now, but so far no errors (50% done). Can I examine the disk somehow? Format shows all four partitions. -- This message posted from opensolaris.org
The problem is more clearly stated here. Look, 700GB is gone (the correct number
is 620GB)!
First I do "zfs list" onto TempStorage/Backup which reports 800GB.
This is correct.
Then I do "df -h" which reports only 180GB, which is not correct. So,
it should be 800GB of data, but "df" reports only 180GB. This means
620GB is gone. Where is it? I know there is 620GB worth of data, which I can not
access. Where is my data, and how can I access it?
root at solaris:/mnt/TempStorage/Stuff# zfs list
NAME USED AVAIL REFER MOUNTPOINT
TempStorage 916G 45,1G 37,3G /mnt/TempStorage
TempStorage/Backup 799G 45,1G 177G /mnt/TempStorage/Backup
<-------- OBS! 800GB!
TempStorage/EmmasFolder 78,6G 45,1G 78,6G /mnt/TempStorage/EmmasFolder
TempStorage/Stuff 1,08G 45,1G 1,08G /mnt/TempStorage/Stuff
root at solaris:/mnt/TempStorage/Stuff# df -h
Filesystem Size Used Avail Use% Mounted on
TempStorage 83G 38G 46G 46% /mnt/TempStorage
TempStorage/Backup 223G 178G 46G 80% /mnt/TempStorage/Backup
<------ only 200GB!!!
TempStorage/EmmasFolder
124G 79G 46G 64% /mnt/TempStorage/EmmasFolder
TempStorage/Stuff 47G 1,1G 46G 3% /mnt/TempStorage/Stuff
--
This message posted from opensolaris.org
Fajar A. Nugraha
2011-Jul-04 10:45 UTC
[zfs-discuss] 700GB gone? "zfs list" and "df" differs!
On Mon, Jul 4, 2011 at 5:19 PM, Orvar Korvar <knatte_fnatte_tjatte at yahoo.com> wrote:> The problem is more clearly stated here. Look, 700GB is gone (the correct number is 620GB)!Somehow you remind me of the story "the boy who cried wolf" (Look, look! The wolf ate my disk space) :P> > First I do "zfs list" onto TempStorage/Backup which reports 800GB. This is correct. > > Then I do "df -h" which reports only 180GB, which is not correct. So, it should be 800GB of data, but "df" reports only 180GB. This means 620GB is gone. Where is it? I know there is 620GB worth of data, which I can not access. Where is my data, and how can I access it?The behaviour is perfectly normal.> > > > > root at solaris:/mnt/TempStorage/Stuff# zfs list > NAME ? ? ? ? ? ? ? ? ? ? ?USED ?AVAIL ?REFER ?MOUNTPOINT > TempStorage ? ? ? ? ? ? ? 916G ?45,1G ?37,3G ?/mnt/TempStorage > TempStorage/Backup ? ? ? ?799G ?45,1G ? 177G ?/mnt/TempStorage/Backup ? <-------- OBS! 800GB! > TempStorage/EmmasFolder ?78,6G ?45,1G ?78,6G ?/mnt/TempStorage/EmmasFolder > TempStorage/Stuff ? ? ? ?1,08G ?45,1G ?1,08G ?/mnt/TempStorage/Stuff > > > > root at solaris:/mnt/TempStorage/Stuff# df -h > Filesystem ? ? ? ? ? ?Size ?Used Avail Use% Mounted on > TempStorage ? ? ? ? ? ?83G ? 38G ? 46G ?46% /mnt/TempStorage > TempStorage/Backup ? ?223G ?178G ? 46G ?80% /mnt/TempStorage/Backup ? ?<------ only 200GB!!! > TempStorage/EmmasFolder > ? ? ? ? ? ? ? ? ? ? ?124G ? 79G ? 46G ?64% /mnt/TempStorage/EmmasFolder > TempStorage/Stuff ? ? ?47G ?1,1G ? 46G ? 3% /mnt/TempStorage/StuffI can''t find the reference from the back of my head, but the short version is: - in zfs, free space is shared (unless you do some fancy stuff like reservation) - "Avail", as reported by "df", will match "Avail", as reported by "zfs list". - "Used", as reported by "df", will match "Used", as reported by "zfs list". Well, close anyway. See http://hub.opensolaris.org/bin/view/Community+Group+zfs/faq/#HWhydoesdu1reportdifferentfilesizesforZFSandUFSWhydoesntthespaceconsumptionthatisreportedbythedfcommandandthezfslistcommandmatch - zfs will show a "fake" number in df''s "Size", to be roughly the sum of "Used" + "Avail" for that particular filesystem. "fake", as in this not the actual pool size. So in short, for filesystem/dataset in the same pool, df will show the same "Avail", but different "Used" and "Size". -- Fajar
Fajar A. Nugraha
2011-Jul-04 10:47 UTC
[zfs-discuss] 700GB gone? "zfs list" and "df" differs!
On Mon, Jul 4, 2011 at 5:45 PM, Fajar A. Nugraha <work at fajar.net> wrote:> - "Used", as reported by "df", will match "Used", as reported by "zfs > list".Sorry, it should be "Used", as reported by "df", will match "Refer", as reported by "zfs list". -- Fajar
Roy Sigurd Karlsbakk
2011-Jul-04 11:04 UTC
[zfs-discuss] 700GB gone? "zfs list" and "df" differs!
> NAME USED AVAIL REFER MOUNTPOINT > TempStorage 916G 45,1G 37,3G /mnt/TempStorage > TempStorage/Backup 799G 45,1G 177G /mnt/TempStorage/Backup <-------- OBS! 800GB!You probably have snapshots eating the remaining 620GB... Vennlige hilsener / Best regards roy -- Roy Sigurd Karlsbakk (+47) 97542685 roy at karlsbakk.net http://blogg.karlsbakk.net/ -- I all pedagogikk er det essensielt at pensum presenteres intelligibelt. Det er et element?rt imperativ for alle pedagoger ? unng? eksessiv anvendelse av idiomer med fremmed opprinnelse. I de fleste tilfeller eksisterer adekvate og relevante synonymer p? norsk.
PS. I do not have any snapshots:
root at frasse:~# zfs list
NAME USED AVAIL REFER MOUNTPOINT
TempStorage 916G 45,1G 37,3G /mnt/TempStorage
TempStorage/Backup 799G 45,1G 177G
/mnt/TempStorage/Backup
TempStorage/EmmasFolder 78,6G 45,1G 78,6G
/mnt/TempStorage/EmmasFolder
TempStorage/Stuff 1,08G 45,1G 1,08G
/mnt/TempStorage/Stuff
root at frasse:/mnt/TempStorage# df -h
Filesystem Size Used Avail Use% Mounted on
TempStorage 83G 38G 46G 46% /mnt/TempStorage
TempStorage/Backup 223G 178G 46G 80% /mnt/TempStorage/Backup
TempStorage/EmmasFolder
124G 79G 46G 64% /mnt/TempStorage/EmmasFolder
TempStorage/Stuff 47G 1,1G 46G 3% /mnt/TempStorage/Stuff
/dev/dsk/c8t5d0p3 98G 97G 1,6G 99% /mnt/Temporary
--
This message posted from opensolaris.org
On 4 Jul 2011, at 12:58, Orvar Korvar wrote:> PS. I do not have any snapshots: > > root at frasse:~# zfs list > NAME USED AVAIL REFER MOUNTPOINT > TempStorage 916G 45,1G 37,3G /mnt/TempStorage > TempStorage/Backup 799G 45,1G 177G /mnt/TempStorage/Backup > TempStorage/EmmasFolder 78,6G 45,1G 78,6G /mnt/TempStorage/EmmasFolder > TempStorage/Stuff 1,08G 45,1G 1,08G /mnt/TempStorage/StuffIn recent Solaris variants "zfs list" doesn''t show snapshots by default; you need to add "-t snapshot" (or "-t all") to see them. Chris
Roy Sigurd Karlsbakk
2011-Jul-04 13:02 UTC
[zfs-discuss] 700GB gone? "zfs list" and "df" differs!
try ''zfs list -t all'' roy ----- Original Message -----> PS. I do not have any snapshots: > > root at frasse:~# zfs list > NAME USED AVAIL REFER MOUNTPOINT > TempStorage 916G 45,1G 37,3G /mnt/TempStorage > TempStorage/Backup 799G 45,1G 177G /mnt/TempStorage/Backup > TempStorage/EmmasFolder 78,6G 45,1G 78,6G /mnt/TempStorage/EmmasFolder > TempStorage/Stuff 1,08G 45,1G 1,08G /mnt/TempStorage/Stuff > > > > root at frasse:/mnt/TempStorage# df -h > Filesystem Size Used Avail Use% Mounted on > TempStorage 83G 38G 46G 46% /mnt/TempStorage > TempStorage/Backup 223G 178G 46G 80% /mnt/TempStorage/Backup > TempStorage/EmmasFolder > 124G 79G 46G 64% /mnt/TempStorage/EmmasFolder > TempStorage/Stuff 47G 1,1G 46G 3% /mnt/TempStorage/Stuff > /dev/dsk/c8t5d0p3 98G 97G 1,6G 99% /mnt/Temporary > -- > This message posted from opensolaris.org > _______________________________________________ > zfs-discuss mailing list > zfs-discuss at opensolaris.org > http://mail.opensolaris.org/mailman/listinfo/zfs-discuss-- Vennlige hilsener / Best regards roy -- Roy Sigurd Karlsbakk (+47) 97542685 roy at karlsbakk.net http://blogg.karlsbakk.net/ -- I all pedagogikk er det essensielt at pensum presenteres intelligibelt. Det er et element?rt imperativ for alle pedagoger ? unng? eksessiv anvendelse av idiomer med fremmed opprinnelse. I de fleste tilfeller eksisterer adekvate og relevante synonymer p? norsk.
2011-07-04 15:04, Roy Sigurd Karlsbakk ?????:>> NAME USED AVAIL REFER MOUNTPOINT >> TempStorage 916G 45,1G 37,3G /mnt/TempStorage >> TempStorage/Backup 799G 45,1G 177G /mnt/TempStorage/Backup<-------- OBS! 800GB! > You probably have snapshots eating the remaining 620GB...I thought so too - df can lie a bit about used space, but not by such a margin in my experience. It would only report the live dataset, not its snapshots, though. Try running: # zfs list -tall -r TempStorage/Backup If you have some data you can''t access now, it is possibly removed (by "rm" or alike) and referred to in the snapshots, perhaps automatic (like zfs-autosnapshot service or the time slider service). If so, you can access the files under /mnt/TempStorage/Backup/.zfs/snapshots/SNAPSHOTNAME/your/data/path/file HTH, //Jim
2011-07-04 15:58, Orvar Korvar ?????:> PS. I do not have any snapshots:Depending on OS version and/or pool settings, they may not be shown by default as to not clobber the output. Try a direct request with "zfs list -t snapshot" or "-t all", or list the .zfs/snapshot directory under the filesystem dataset''s mountpoint - .zfs/ is always there, even if invisible due to settings. //Jim
Ok, it seems here is the missing data. Here is a snapshot called "stadar". Thank you. Problem solved. root at frasse:/mnt/TempStorage# zfs list -t all NAME USED AVAIL REFER MOUNTPOINT TempStorage 916G 45,1G 37,3G /mnt/TempStorage TempStorage/Backup 799G 45,1G 177G /mnt/TempStorage/Backup TempStorage/Backup at stadar 621G - 762G - TempStorage/EmmasFolder 78,6G 45,1G 78,6G /mnt/TempStorage/EmmasFolder TempStorage/Stuff 1,08G 45,1G 1,08G /mnt/TempStorage/Stuff ----- Original Message ---- From: Roy Sigurd Karlsbakk <roy at karlsbakk.net> To: Orvar Korvar <knatte_fnatte_tjatte at yahoo.com> Cc: zfs-discuss at opensolaris.org Sent: Mon, July 4, 2011 3:02:24 PM Subject: Re: [zfs-discuss] 700GB gone? "zfs list" and "df" differs! try ''zfs list -t all'' roy ----- Original Message -----> PS. I do not have any snapshots: > > root at frasse:~# zfs list > NAME USED AVAIL REFER MOUNTPOINT > TempStorage 916G 45,1G 37,3G /mnt/TempStorage > TempStorage/Backup 799G 45,1G 177G /mnt/TempStorage/Backup > TempStorage/EmmasFolder 78,6G 45,1G 78,6G /mnt/TempStorage/EmmasFolder > TempStorage/Stuff 1,08G 45,1G 1,08G /mnt/TempStorage/Stuff > > > > root at frasse:/mnt/TempStorage# df -h > Filesystem Size Used Avail Use% Mounted on > TempStorage 83G 38G 46G 46% /mnt/TempStorage > TempStorage/Backup 223G 178G 46G 80% /mnt/TempStorage/Backup > TempStorage/EmmasFolder > 124G 79G 46G 64% /mnt/TempStorage/EmmasFolder > TempStorage/Stuff 47G 1,1G 46G 3% /mnt/TempStorage/Stuff > /dev/dsk/c8t5d0p3 98G 97G 1,6G 99% /mnt/Temporary > -- > This message posted from opensolaris.org > _______________________________________________ > zfs-discuss mailing list > zfs-discuss at opensolaris.org > http://mail.opensolaris.org/mailman/listinfo/zfs-discuss-- Vennlige hilsener / Best regards roy -- Roy Sigurd Karlsbakk (+47) 97542685 roy at karlsbakk.net http://blogg.karlsbakk.net/ -- I all pedagogikk er det essensielt at pensum presenteres intelligibelt. Det er et element?rt imperativ for alle pedagoger ? unng? eksessiv anvendelse av idiomer med fremmed opprinnelse. I de fleste tilfeller eksisterer adekvate og relevante synonymer p? norsk.