Re: [zfs-discuss] 700GB gone? zfs list and df differs!
The problem is more clearly stated here. Look, 700GB is gone (the correct number is 620GB)! First I do zfs list onto TempStorage/Backup which reports 800GB. This is correct. Then I do df -h which reports only 180GB, which is not correct. So, it should be 800GB of data, but df reports only 180GB. This means 620GB is gone. Where is it? I know there is 620GB worth of data, which I can not access. Where is my data, and how can I access it? root@solaris:/mnt/TempStorage/Stuff# zfs list NAME USED AVAIL REFER MOUNTPOINT TempStorage 916G 45,1G 37,3G /mnt/TempStorage TempStorage/Backup799G 45,1G 177G /mnt/TempStorage/Backup OBS! 800GB! TempStorage/EmmasFolder 78,6G 45,1G 78,6G /mnt/TempStorage/EmmasFolder TempStorage/Stuff1,08G 45,1G 1,08G /mnt/TempStorage/Stuff root@solaris:/mnt/TempStorage/Stuff# df -h FilesystemSize Used Avail Use% Mounted on TempStorage83G 38G 46G 46% /mnt/TempStorage TempStorage/Backup223G 178G 46G 80% /mnt/TempStorage/Backup-- only 200GB!!! TempStorage/EmmasFolder 124G 79G 46G 64% /mnt/TempStorage/EmmasFolder TempStorage/Stuff 47G 1,1G 46G 3% /mnt/TempStorage/Stuff -- This message posted from opensolaris.org ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] 700GB gone? zfs list and df differs!
On Mon, Jul 4, 2011 at 5:19 PM, Orvar Korvar knatte_fnatte_tja...@yahoo.com wrote: The problem is more clearly stated here. Look, 700GB is gone (the correct number is 620GB)! Somehow you remind me of the story the boy who cried wolf (Look, look! The wolf ate my disk space) :P First I do zfs list onto TempStorage/Backup which reports 800GB. This is correct. Then I do df -h which reports only 180GB, which is not correct. So, it should be 800GB of data, but df reports only 180GB. This means 620GB is gone. Where is it? I know there is 620GB worth of data, which I can not access. Where is my data, and how can I access it? The behaviour is perfectly normal. root@solaris:/mnt/TempStorage/Stuff# zfs list NAME USED AVAIL REFER MOUNTPOINT TempStorage 916G 45,1G 37,3G /mnt/TempStorage TempStorage/Backup 799G 45,1G 177G /mnt/TempStorage/Backup OBS! 800GB! TempStorage/EmmasFolder 78,6G 45,1G 78,6G /mnt/TempStorage/EmmasFolder TempStorage/Stuff 1,08G 45,1G 1,08G /mnt/TempStorage/Stuff root@solaris:/mnt/TempStorage/Stuff# df -h Filesystem Size Used Avail Use% Mounted on TempStorage 83G 38G 46G 46% /mnt/TempStorage TempStorage/Backup 223G 178G 46G 80% /mnt/TempStorage/Backup -- only 200GB!!! TempStorage/EmmasFolder 124G 79G 46G 64% /mnt/TempStorage/EmmasFolder TempStorage/Stuff 47G 1,1G 46G 3% /mnt/TempStorage/Stuff I can't find the reference from the back of my head, but the short version is: - in zfs, free space is shared (unless you do some fancy stuff like reservation) - Avail, as reported by df, will match Avail, as reported by zfs list. - Used, as reported by df, will match Used, as reported by zfs list. Well, close anyway. See http://hub.opensolaris.org/bin/view/Community+Group+zfs/faq/#HWhydoesdu1reportdifferentfilesizesforZFSandUFSWhydoesntthespaceconsumptionthatisreportedbythedfcommandandthezfslistcommandmatch - zfs will show a fake number in df's Size, to be roughly the sum of Used + Avail for that particular filesystem. fake, as in this not the actual pool size. So in short, for filesystem/dataset in the same pool, df will show the same Avail, but different Used and Size. -- Fajar ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] 700GB gone? zfs list and df differs!
On Mon, Jul 4, 2011 at 5:45 PM, Fajar A. Nugraha w...@fajar.net wrote: - Used, as reported by df, will match Used, as reported by zfs list. Sorry, it should be Used, as reported by df, will match Refer, as reported by zfs list. -- Fajar ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] 700GB gone? zfs list and df differs!
NAME USED AVAIL REFER MOUNTPOINT TempStorage 916G 45,1G 37,3G /mnt/TempStorage TempStorage/Backup 799G 45,1G 177G /mnt/TempStorage/Backup OBS! 800GB! You probably have snapshots eating the remaining 620GB... Vennlige hilsener / Best regards roy -- Roy Sigurd Karlsbakk (+47) 97542685 r...@karlsbakk.net http://blogg.karlsbakk.net/ -- I all pedagogikk er det essensielt at pensum presenteres intelligibelt. Det er et elementært imperativ for alle pedagoger å unngå eksessiv anvendelse av idiomer med fremmed opprinnelse. I de fleste tilfeller eksisterer adekvate og relevante synonymer på norsk. ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] 700GB gone? zfs list and df differs!
PS. I do not have any snapshots: root@frasse:~# zfs list NAME USED AVAIL REFER MOUNTPOINT TempStorage916G 45,1G 37,3G /mnt/TempStorage TempStorage/Backup 799G 45,1G 177G /mnt/TempStorage/Backup TempStorage/EmmasFolder 78,6G 45,1G 78,6G /mnt/TempStorage/EmmasFolder TempStorage/Stuff 1,08G 45,1G 1,08G /mnt/TempStorage/Stuff root@frasse:/mnt/TempStorage# df -h FilesystemSize Used Avail Use% Mounted on TempStorage83G 38G 46G 46% /mnt/TempStorage TempStorage/Backup223G 178G 46G 80% /mnt/TempStorage/Backup TempStorage/EmmasFolder 124G 79G 46G 64% /mnt/TempStorage/EmmasFolder TempStorage/Stuff 47G 1,1G 46G 3% /mnt/TempStorage/Stuff /dev/dsk/c8t5d0p3 98G 97G 1,6G 99% /mnt/Temporary -- This message posted from opensolaris.org ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] 700GB gone? zfs list and df differs!
On 4 Jul 2011, at 12:58, Orvar Korvar wrote: PS. I do not have any snapshots: root@frasse:~# zfs list NAME USED AVAIL REFER MOUNTPOINT TempStorage916G 45,1G 37,3G /mnt/TempStorage TempStorage/Backup 799G 45,1G 177G /mnt/TempStorage/Backup TempStorage/EmmasFolder 78,6G 45,1G 78,6G /mnt/TempStorage/EmmasFolder TempStorage/Stuff 1,08G 45,1G 1,08G /mnt/TempStorage/Stuff In recent Solaris variants zfs list doesn't show snapshots by default; you need to add -t snapshot (or -t all) to see them. Chris ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] 700GB gone? zfs list and df differs!
try 'zfs list -t all' roy - Original Message - PS. I do not have any snapshots: root@frasse:~# zfs list NAME USED AVAIL REFER MOUNTPOINT TempStorage 916G 45,1G 37,3G /mnt/TempStorage TempStorage/Backup 799G 45,1G 177G /mnt/TempStorage/Backup TempStorage/EmmasFolder 78,6G 45,1G 78,6G /mnt/TempStorage/EmmasFolder TempStorage/Stuff 1,08G 45,1G 1,08G /mnt/TempStorage/Stuff root@frasse:/mnt/TempStorage# df -h Filesystem Size Used Avail Use% Mounted on TempStorage 83G 38G 46G 46% /mnt/TempStorage TempStorage/Backup 223G 178G 46G 80% /mnt/TempStorage/Backup TempStorage/EmmasFolder 124G 79G 46G 64% /mnt/TempStorage/EmmasFolder TempStorage/Stuff 47G 1,1G 46G 3% /mnt/TempStorage/Stuff /dev/dsk/c8t5d0p3 98G 97G 1,6G 99% /mnt/Temporary -- This message posted from opensolaris.org ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss -- Vennlige hilsener / Best regards roy -- Roy Sigurd Karlsbakk (+47) 97542685 r...@karlsbakk.net http://blogg.karlsbakk.net/ -- I all pedagogikk er det essensielt at pensum presenteres intelligibelt. Det er et elementært imperativ for alle pedagoger å unngå eksessiv anvendelse av idiomer med fremmed opprinnelse. I de fleste tilfeller eksisterer adekvate og relevante synonymer på norsk. ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] 700GB gone? zfs list and df differs!
2011-07-04 15:04, Roy Sigurd Karlsbakk пишет: NAME USED AVAIL REFER MOUNTPOINT TempStorage 916G 45,1G 37,3G /mnt/TempStorage TempStorage/Backup 799G 45,1G 177G /mnt/TempStorage/Backup OBS! 800GB! You probably have snapshots eating the remaining 620GB... I thought so too - df can lie a bit about used space, but not by such a margin in my experience. It would only report the live dataset, not its snapshots, though. Try running: # zfs list -tall -r TempStorage/Backup If you have some data you can't access now, it is possibly removed (by rm or alike) and referred to in the snapshots, perhaps automatic (like zfs-autosnapshot service or the time slider service). If so, you can access the files under /mnt/TempStorage/Backup/.zfs/snapshots/SNAPSHOTNAME/your/data/path/file HTH, //Jim ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] 700GB gone? zfs list and df differs!
2011-07-04 15:58, Orvar Korvar пишет: PS. I do not have any snapshots: Depending on OS version and/or pool settings, they may not be shown by default as to not clobber the output. Try a direct request with zfs list -t snapshot or -t all, or list the .zfs/snapshot directory under the filesystem dataset's mountpoint - .zfs/ is always there, even if invisible due to settings. //Jim ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] 700GB gone? zfs list and df differs!
Ok, it seems here is the missing data. Here is a snapshot called stadar. Thank you. Problem solved. root@frasse:/mnt/TempStorage# zfs list -t all NAME USED AVAIL REFER MOUNTPOINT TempStorage916G 45,1G 37,3G /mnt/TempStorage TempStorage/Backup 799G 45,1G 177G /mnt/TempStorage/Backup TempStorage/Backup@stadar 621G - 762G - TempStorage/EmmasFolder 78,6G 45,1G 78,6G /mnt/TempStorage/EmmasFolder TempStorage/Stuff 1,08G 45,1G 1,08G /mnt/TempStorage/Stuff - Original Message From: Roy Sigurd Karlsbakk r...@karlsbakk.net To: Orvar Korvar knatte_fnatte_tja...@yahoo.com Cc: zfs-discuss@opensolaris.org Sent: Mon, July 4, 2011 3:02:24 PM Subject: Re: [zfs-discuss] 700GB gone? zfs list and df differs! try 'zfs list -t all' roy - Original Message - PS. I do not have any snapshots: root@frasse:~# zfs list NAME USED AVAIL REFER MOUNTPOINT TempStorage 916G 45,1G 37,3G /mnt/TempStorage TempStorage/Backup 799G 45,1G 177G /mnt/TempStorage/Backup TempStorage/EmmasFolder 78,6G 45,1G 78,6G /mnt/TempStorage/EmmasFolder TempStorage/Stuff 1,08G 45,1G 1,08G /mnt/TempStorage/Stuff root@frasse:/mnt/TempStorage# df -h Filesystem Size Used Avail Use% Mounted on TempStorage 83G 38G 46G 46% /mnt/TempStorage TempStorage/Backup 223G 178G 46G 80% /mnt/TempStorage/Backup TempStorage/EmmasFolder 124G 79G 46G 64% /mnt/TempStorage/EmmasFolder TempStorage/Stuff 47G 1,1G 46G 3% /mnt/TempStorage/Stuff /dev/dsk/c8t5d0p3 98G 97G 1,6G 99% /mnt/Temporary -- This message posted from opensolaris.org ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss -- Vennlige hilsener / Best regards roy -- Roy Sigurd Karlsbakk (+47) 97542685 r...@karlsbakk.net http://blogg.karlsbakk.net/ -- I all pedagogikk er det essensielt at pensum presenteres intelligibelt. Det er et elementært imperativ for alle pedagoger å unngå eksessiv anvendelse av idiomer med fremmed opprinnelse. I de fleste tilfeller eksisterer adekvate og relevante synonymer på norsk. ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] 700GB gone?
On Thu, Jun 30, 2011 at 11:40:53PM +0100, Andrew Gabriel wrote: On 06/30/11 08:50 PM, Orvar Korvar wrote: I have a 1.5TB disk that has several partitions. One of them is 900GB. Now I can only see 300GB. Where is the rest? Is there a command I can do to reach the rest of the data? Will scrub help? Not much to go on - no one can answer this. How did you go about partitioning the disk? What does the fdisk partitioning look like (if its x86)? What does the VToC slice layout look like? What are you using each partition and slice for? What tells you that you can only see 300GB? Are you using 32-bit or 64-bit solaris? IIRC Solaris x86-32 can't even address 1,5TB, so it shouldn't show up at all, or as a 1TB drive. If he sees 300GB, there might be some slight overhead and the fact that 1TB as reported by drive producers equals 0.9TiB as reported by the OS (1TB = 10^12 bytes, 1TiB = 2^40 bytes). The 1.5TB drive will be shown as a 1.35 drive or so. Vennlige hilsener / Best regards roy -- Roy Sigurd Karlsbakk (+47) 97542685 r...@karlsbakk.net http://blogg.karlsbakk.net/ -- I all pedagogikk er det essensielt at pensum presenteres intelligibelt. Det er et elementært imperativ for alle pedagoger å unngå eksessiv anvendelse av idiomer med fremmed opprinnelse. I de fleste tilfeller eksisterer adekvate og relevante synonymer på norsk. ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] 700GB gone?
I am using 64bit S11E. Everything worked fine earlier. But now I suspect the disk is breaking down, it behaves weird. I have several partitions: 1) OpenSolaris b134 upgraded to S11E 2) WinXP 3) FAT32 4) ZFS storage pool of 900GB Earlier, everything was fine. But suddenly OpenSolaris does not work anymore. When I boot via GRUB, it gives an error message and halts. I have installed S11E on a new disk, and when I try to import the old rpool 1) then the computer reboots: http://opensolaris.org/jive/thread.jspa?messageID=517089#517089 So there are some problems. My storage pool 4) is suddenly 300GB big and where is the data? I have one snapshot, or so. I have not deleted stuff. I suspect the disk is breaking down. How can I tell? I am scrubbing the disk now, but so far no errors (50% done). Can I examine the disk somehow? Format shows all four partitions. -- This message posted from opensolaris.org ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
[zfs-discuss] 700GB gone?
I have a 1.5TB disk that has several partitions. One of them is 900GB. Now I can only see 300GB. Where is the rest? Is there a command I can do to reach the rest of the data? Will scrub help? -- This message posted from opensolaris.org ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] 700GB gone?
On 06/30/11 08:50 PM, Orvar Korvar wrote: I have a 1.5TB disk that has several partitions. One of them is 900GB. Now I can only see 300GB. Where is the rest? Is there a command I can do to reach the rest of the data? Will scrub help? Not much to go on - no one can answer this. How did you go about partitioning the disk? What does the fdisk partitioning look like (if its x86)? What does the VToC slice layout look like? What are you using each partition and slice for? What tells you that you can only see 300GB? -- Andrew ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] 700GB gone?
On Thu, Jun 30, 2011 at 11:40:53PM +0100, Andrew Gabriel wrote: On 06/30/11 08:50 PM, Orvar Korvar wrote: I have a 1.5TB disk that has several partitions. One of them is 900GB. Now I can only see 300GB. Where is the rest? Is there a command I can do to reach the rest of the data? Will scrub help? Not much to go on - no one can answer this. How did you go about partitioning the disk? What does the fdisk partitioning look like (if its x86)? What does the VToC slice layout look like? What are you using each partition and slice for? What tells you that you can only see 300GB? Are you using 32-bit or 64-bit solaris? -- Dan. pgpyX34G2Z94V.pgp Description: PGP signature ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss