Resilvering a disk in raidz2 ZFS is taking ages. Any ideas? I had replaced a
different disk this morning (da7) and it took only about 1 hour alltogether. Any
ideas? Or did I do something very wrong (tm)?
Best regards,
Holger
--------------------
8.2-STABLE FreeBSD 8.2-STABLE #12: Mon Apr 18 12:48:56 CEST 2011
# zpool status
pool: tank
state: DEGRADED
status: One or more devices is currently being resilvered. The pool will
continue to function, possibly in a degraded state.
action: Wait for the resilver to complete.
scrub: resilver in progress for 0h21m, 1.10% done, 32h19m to go
config:
NAME STATE READ WRITE CKSUM
tank DEGRADED 0 0 0
raidz2 DEGRADED 0 0 0
replacing DEGRADED 0 0 0
da0/old OFFLINE 0 0 0
da0 ONLINE 0 0 0 158M resilvered
da1 ONLINE 0 0 0
da2 ONLINE 0 0 0
da7 ONLINE 0 0 0
da3 ONLINE 0 0 0
da4 ONLINE 0 0 0
da5 ONLINE 0 0 0
da6 ONLINE 0 0 0
errors: No known data errors
-----------------
1 users Load 0.00 0.00 0.00 May 6 14:37
Mem:KB REAL VIRTUAL VN PAGER SWAP PAGER
Tot Share Tot Share Free in out in out
Act 119320 18980 1362144 25756 7648824 count
All 344920 23296 1075218k 57012 pages
Proc: Interrupts
r p d s w Csw Trp Sys Int Sof Flt cow 4765 total
76 9171 11 130 766 952 zfod atkbd0 1
ozfod ata0 irq14
0.7%Sys 0.3%Intr 0.0%User 0.0%Nice 99.0%Idle %ozfod 1 uhci0 16
| | | | | | | | | | | daefr uhci1 17
prcfr 1 twe0 irq24
7 dtbuf 1106 totfr 1999 cpu0: time
Namei Name-cache Dir-cache 206492 desvn react 763 isp0 256
Calls hits % hits % 3598 numvn pdwak 2 em0 irq257
12 11 92 1382 frevn pdpgs 1999 cpu1: time
intrn
Disks da0 da1 da2 da3 da4 da5 da6 328004 wire
KB/t 0.67 4.92 4.68 4.46 4.53 4.66 4.91 84728 act
tps 151 138 150 151 146 149 140 39788 inact
MB/s 0.10 0.66 0.69 0.66 0.65 0.68 0.67 1520 cache
%busy 101 41 44 42 41 40 39 7647296 free
60464 buf
--
Holger Kipp
Diplom-Mathematiker
Senior Consultant
[alogis]
Tel. : +49 30 436 58 114
Fax : +49 30 436 58 214
Mobil : +49 178 36 58 114
E-Mail : holger.kipp@alogis.com
alogis AG
Alt-Moabit 90 B
D- 10559 Berlin
Web: www.alogis.com<http://www.alogis.com>
alogis AG
Sitz/Registergericht: Berlin/AG Charlottenburg, HRB 71484
Vorstand: Arne Friedrichs, Joern Samuelson
Aufsichtsratsvorsitzender: Reinhard Mielke
Artem Belevich
2011-May-06 15:23 UTC
resilvering takes ages on 8.2 (amd64 from 18.04.2011)
On Fri, May 6, 2011 at 5:43 AM, Holger Kipp <Holger.Kipp@alogis.com> wrote:> Resilvering a disk in raidz2 ZFS is taking ages. Any ideas? I had replaced a different disk this morning (da7) and it took only about 1 hour alltogether. Any ideas? Or did I do something very wrong (tm)?Don't believe everything you see. On my pool I often see scrub time estimates of few hundred hours even though it always takes about 6 hours. Once ZFS is done thrashing disks while it scrubs metadata and starts doing bulk data transfer, estimates would eventually converge to a sensible value.> Disks ? da0 ? da1 ? da2 ? da3 ? da4 ? da5 ? da6 ? ?328004 wire > KB/t ? 0.67 ?4.92 ?4.68 ?4.46 ?4.53 ?4.66 ?4.91 ? ? 84728 act > tps ? ? 151 ? 138 ? 150 ? 151 ? 146 ? 149 ? 140 ? ? 39788 inact > MB/s ? 0.10 ?0.66 ?0.69 ?0.66 ?0.65 ?0.68 ?0.67 ? ? ?1520 cache > %busy ? 101 ? ?41 ? ?44 ? ?42 ? ?41 ? ?40 ? ?39 ? 7647296 freeYup. It does look like your pool is in "thrashing" stage -- lots of seeking. --Artem> > Best regards, > Holger > > -------------------- > > ?8.2-STABLE FreeBSD 8.2-STABLE #12: Mon Apr 18 12:48:56 CEST 2011 > > # zpool status > ?pool: tank > ?state: DEGRADED > status: One or more devices is currently being resilvered. ?The pool will > ? ? ? ?continue to function, possibly in a degraded state. > action: Wait for the resilver to complete. > ?scrub: resilver in progress for 0h21m, 1.10% done, 32h19m to go > config: > > ? ? ? ?NAME ? ? ? ? ? STATE ? ? READ WRITE CKSUM > ? ? ? ?tank ? ? ? ? ? DEGRADED ? ? 0 ? ? 0 ? ? 0 > ? ? ? ? ?raidz2 ? ? ? DEGRADED ? ? 0 ? ? 0 ? ? 0 > ? ? ? ? ? ?replacing ?DEGRADED ? ? 0 ? ? 0 ? ? 0 > ? ? ? ? ? ? ?da0/old ?OFFLINE ? ? ?0 ? ? 0 ? ? 0 > ? ? ? ? ? ? ?da0 ? ? ?ONLINE ? ? ? 0 ? ? 0 ? ? 0 ?158M resilvered > ? ? ? ? ? ?da1 ? ? ? ?ONLINE ? ? ? 0 ? ? 0 ? ? 0 > ? ? ? ? ? ?da2 ? ? ? ?ONLINE ? ? ? 0 ? ? 0 ? ? 0 > ? ? ? ? ? ?da7 ? ? ? ?ONLINE ? ? ? 0 ? ? 0 ? ? 0 > ? ? ? ? ? ?da3 ? ? ? ?ONLINE ? ? ? 0 ? ? 0 ? ? 0 > ? ? ? ? ? ?da4 ? ? ? ?ONLINE ? ? ? 0 ? ? 0 ? ? 0 > ? ? ? ? ? ?da5 ? ? ? ?ONLINE ? ? ? 0 ? ? 0 ? ? 0 > ? ? ? ? ? ?da6 ? ? ? ?ONLINE ? ? ? 0 ? ? 0 ? ? 0 > > errors: No known data errors > > > > ----------------- > ? ?1 users ? ?Load ?0.00 ?0.00 ?0.00 ? ? ? ? ? ? ? ? ?May ?6 14:37 > > Mem:KB ? ?REAL ? ? ? ? ? ?VIRTUAL ? ? ? ? ? ? ? ? ? ? ? VN PAGER ? SWAP PAGER > ? ? ? ?Tot ? Share ? ? ?Tot ? ?Share ? ?Free ? ? ? ? ? in ? out ? ? in ? out > Act ?119320 ? 18980 ?1362144 ? ?25756 7648824 ?count > All ?344920 ? 23296 1075218k ? ?57012 ? ? ? ? ?pages > Proc: ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ?Interrupts > ?r ? p ? d ? s ? w ? Csw ?Trp ?Sys ?Int ?Sof ?Flt ? ? ? ?cow ? ?4765 total > ? ? ? ? ? ? 76 ? ? ?9171 ? 11 ?130 ?766 ?952 ? ? ? ? ? ? zfod ? ? ? ?atkbd0 1 > ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ?ozfod ? ? ? ata0 irq14 > ?0.7%Sys ? 0.3%Intr ?0.0%User ?0.0%Nice 99.0%Idle ? ? ? ?%ozfod ? ? 1 uhci0 16 > | ? ?| ? ?| ? ?| ? ?| ? ?| ? ?| ? ?| ? ?| ? ?| ? ?| ? ? ? daefr ? ? ? uhci1 17 > ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ?prcfr ? ? 1 twe0 irq24 > ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? 7 dtbuf ? ? 1106 totfr ?1999 cpu0: time > Namei ? ? Name-cache ? Dir-cache ? ?206492 desvn ? ? ? ? ?react ? 763 isp0 256 > ? Calls ? ?hits ? % ? ?hits ? % ? ? ?3598 numvn ? ? ? ? ?pdwak ? ? 2 em0 irq257 > ? ? ?12 ? ? ?11 ?92 ? ? ? ? ? ? ? ? ?1382 frevn ? ? ? ? ?pdpgs ?1999 cpu1: time > ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ?intrn > Disks ? da0 ? da1 ? da2 ? da3 ? da4 ? da5 ? da6 ? ?328004 wire > KB/t ? 0.67 ?4.92 ?4.68 ?4.46 ?4.53 ?4.66 ?4.91 ? ? 84728 act > tps ? ? 151 ? 138 ? 150 ? 151 ? 146 ? 149 ? 140 ? ? 39788 inact > MB/s ? 0.10 ?0.66 ?0.69 ?0.66 ?0.65 ?0.68 ?0.67 ? ? ?1520 cache > %busy ? 101 ? ?41 ? ?44 ? ?42 ? ?41 ? ?40 ? ?39 ? 7647296 free > ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ?60464 buf > > > -- > > > Holger Kipp > Diplom-Mathematiker > Senior Consultant > > > ? ? ? ? ? ? ? ?[alogis] > > Tel. ? ?: ? ? ? +49 30 436 58 114 > Fax ? ? : ? ? ? +49 30 436 58 214 > Mobil ? : ? ? ? +49 178 36 58 114 > > E-Mail ?: ? ? ? holger.kipp@alogis.com > ? ? ? ? ? ? ? ?alogis AG > Alt-Moabit 90 B > D- 10559 Berlin > > Web: www.alogis.com<http://www.alogis.com> > > > > alogis AG > Sitz/Registergericht: Berlin/AG Charlottenburg, HRB 71484 > Vorstand: Arne Friedrichs, Joern Samuelson > Aufsichtsratsvorsitzender: Reinhard Mielke > > > _______________________________________________ > freebsd-stable@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" >