Christian Rost
2007-Jan-17 14:30 UTC
[zfs-discuss] I only see 5.33TB of my 7.25TB zfs-pool. Why?
I''m using
SunOS cassandra 5.10 Generic_118833-33 sun4u sparc SUNW,Sun-Fire-V240
cassandra# zpool status
pool: tray30
state: ONLINE
scrub: none requested
config:
NAME STATE READ WRITE CKSUM
tray30 ONLINE 0 0 0
raidz2 ONLINE 0 0 0
c7t600A0B800026A68200006F6D45ACADFDd0 ONLINE 0 0 0
c7t600A0B800026A68200006F7C45ACB599d0 ONLINE 0 0 0
c7t600A0B800026A68200006F7F45ACB673d0 ONLINE 0 0 0
c7t600A0B800026A68200006F7045ACB0DBd0 ONLINE 0 0 0
c7t600A0B800026A68200006F7345ACB2DBd0 ONLINE 0 0 0
c7t600A0B800026A68200006F7645ACB3A1d0 ONLINE 0 0 0
c7t600A0B800026A68200006F7945ACB451d0 ONLINE 0 0 0
c7t600A0B800026A68200006F8245ACB7F3d0 ONLINE 0 0 0
raidz2 ONLINE 0 0 0
c7t600A0B8000119E8A0000147C45ACBBF2d0 ONLINE 0 0 0
c7t600A0B8000119E8A0000147E45ACBEFAd0 ONLINE 0 0 0
c7t600A0B8000119E8A0000148A45ACC5B6d0 ONLINE 0 0 0
c7t600A0B8000119E8A0000148045ACBFDCd0 ONLINE 0 0 0
c7t600A0B8000119E8A0000148245ACC090d0 ONLINE 0 0 0
c7t600A0B8000119E8A0000148445ACC166d0 ONLINE 0 0 0
c7t600A0B8000119E8A0000148645ACC2BCd0 ONLINE 0 0 0
c7t600A0B8000119E8A0000148845ACC43Ed0 ONLINE 0 0 0
errors: No known data errors
cassandra# zpool list
NAME SIZE USED AVAIL CAP HEALTH ALTROOT
tray30 7.25T 10.4G 7.24T 0% ONLINE -
cassandra# zfs list
NAME USED AVAIL REFER MOUNTPOINT
tray30 7.75G 5.33T 7.75G /tray30
Where is the rest of my poolspace?
I''m using 16 x 500 GB Disks with zraid2-layout.
I expected that available pool-size = available zfs-size.
But now i see 7.24T != 5.33T
Why?
I''m running default options on tray30.
Christian
This message posted from opensolaris.org
Tomas Ögren
2007-Jan-17 14:44 UTC
[zfs-discuss] I only see 5.33TB of my 7.25TB zfs-pool. Why?
On 17 January, 2007 - Christian Rost sent me these 2,4K bytes:> I''m using > SunOS cassandra 5.10 Generic_118833-33 sun4u sparc SUNW,Sun-Fire-V240 >[..]> cassandra# zpool list > NAME SIZE USED AVAIL CAP HEALTH ALTROOT > tray30 7.25T 10.4G 7.24T 0% ONLINE -The pool contains.. 16 * 500GB = 8000000000000 bytes =~ 7.27 TiB> cassandra# zfs list > NAME USED AVAIL REFER MOUNTPOINT > tray30 7.75G 5.33T 7.75G /tray30Of that, you can store data on 12 of them.. 12 * 500GB = 6000000000000 bytes =~ 5.45TiB> Where is the rest of my poolspace?4*500GB went to security/safety.> I''m using 16 x 500 GB Disks with zraid2-layout. > I expected that available pool-size = available zfs-size. > But now i see 7.24T != 5.33T > Why? > > I''m running default options on tray30. > > Christian/Tomas -- Tomas ?gren, stric at acc.umu.se, http://www.acc.umu.se/~stric/ |- Student at Computing Science, University of Ume? `- Sysadmin at {cs,acc}.umu.se
Robert Milkowski
2007-Jan-17 14:47 UTC
[zfs-discuss] I only see 5.33TB of my 7.25TB zfs-pool. Why?
Hello Christian,
Wednesday, January 17, 2007, 3:30:54 PM, you wrote:
CR> I''m using
CR> SunOS cassandra 5.10 Generic_118833-33 sun4u sparc SUNW,Sun-Fire-V240
CR> cassandra# zpool status
CR> pool: tray30
CR> state: ONLINE
CR> scrub: none requested
CR> config:
CR> NAME STATE READ WRITE
CKSUM
CR> tray30 ONLINE 0 0 0
CR> raidz2 ONLINE 0 0 0
CR> c7t600A0B800026A68200006F6D45ACADFDd0 ONLINE 0 0 0
CR> c7t600A0B800026A68200006F7C45ACB599d0 ONLINE 0 0 0
CR> c7t600A0B800026A68200006F7F45ACB673d0 ONLINE 0 0 0
CR> c7t600A0B800026A68200006F7045ACB0DBd0 ONLINE 0 0 0
CR> c7t600A0B800026A68200006F7345ACB2DBd0 ONLINE 0 0 0
CR> c7t600A0B800026A68200006F7645ACB3A1d0 ONLINE 0 0 0
CR> c7t600A0B800026A68200006F7945ACB451d0 ONLINE 0 0 0
CR> c7t600A0B800026A68200006F8245ACB7F3d0 ONLINE 0 0 0
CR> raidz2 ONLINE 0 0 0
CR> c7t600A0B8000119E8A0000147C45ACBBF2d0 ONLINE 0 0 0
CR> c7t600A0B8000119E8A0000147E45ACBEFAd0 ONLINE 0 0 0
CR> c7t600A0B8000119E8A0000148A45ACC5B6d0 ONLINE 0 0 0
CR> c7t600A0B8000119E8A0000148045ACBFDCd0 ONLINE 0 0 0
CR> c7t600A0B8000119E8A0000148245ACC090d0 ONLINE 0 0 0
CR> c7t600A0B8000119E8A0000148445ACC166d0 ONLINE 0 0 0
CR> c7t600A0B8000119E8A0000148645ACC2BCd0 ONLINE 0 0 0
CR> c7t600A0B8000119E8A0000148845ACC43Ed0 ONLINE 0 0 0
CR> errors: No known data errors
CR> cassandra# zpool list
CR> NAME SIZE USED AVAIL CAP HEALTH ALTROOT
CR> tray30 7.25T 10.4G 7.24T 0% ONLINE -
CR> cassandra# zfs list
CR> NAME USED AVAIL REFER MOUNTPOINT
CR> tray30 7.75G 5.33T 7.75G /tray30
CR> Where is the rest of my poolspace?
CR> I''m using 16 x 500 GB Disks with zraid2-layout.
CR> I expected that available pool-size = available zfs-size.
CR> But now i see 7.24T != 5.33T
CR> Why?
CR> I''m running default options on tray30.
zpool list shows entire space available for data and parity.
zfs list shows you only available space for data.
Now lets check it:
you''ve got 2 raidz2 groups each made of 8 disks.
It means you''ve got 6 disks space available in each group.
so: (6+6)*465GB = ~5.4TB
So it looks fine.
--
Best regards,
Robert mailto:rmilkowski at task.gda.pl
http://milek.blogspot.com
Christian Rost
2007-Jan-17 15:48 UTC
[zfs-discuss] Re: I only see 5.33TB of my 7.25TB zfs-pool. Why?
Now i got the point. Thank you :) Is it true that one group should contain less than 10 disks for performance-reasons? Or am i free to use 16 disks in one group without perfomance-drops? Christian This message posted from opensolaris.org
Robert Milkowski
2007-Jan-17 16:12 UTC
[zfs-discuss] Re: I only see 5.33TB of my 7.25TB zfs-pool. Why?
Hello Christian,
Wednesday, January 17, 2007, 4:48:00 PM, you wrote:
CR> Now i got the point.
CR> Thank you :)
CR> Is it true that one group should contain less than 10 disks for
performance-reasons?
CR> Or am i free to use 16 disks in one group without perfomance-drops?
Depends on workload.
But generally two groups will ba faster than one group.
--
Best regards,
Robert mailto:rmilkowski at task.gda.pl
http://milek.blogspot.com