freebsd stable - Apr 2020 - make kernel ignore broken SATA disk

On Sun, Apr 12, 2020 at 06:38:10PM +0200, Stefan Bethke wrote:
> 
> 
> > Am 12.04.2020 um 18:31 schrieb Slawa Olhovchenkov <slw at
zxy.spb.ru>:
> > 
> > On Sun, Apr 12, 2020 at 06:24:09PM +0200, Stefan Bethke wrote:
> > 
> >> Am 12.04.2020 um 17:43 schrieb Slawa Olhovchenkov <slw at
zxy.spb.ru>:
> >>> 
> >>> On Sun, Apr 12, 2020 at 04:37:06PM +0200, Stefan Bethke wrote:
> >>> 
> >>>> I have a server I don't have physical access to right
now, which has a broken SATA disk that produces mostly errors (but not
entirely).
> >>>> 
> >>>> The disk has two partitions that are part of a zpool each.
I can't bring the system up with this disk being online, because ZFS is
trying its darndest to use it.
> >>>> 
> >>>> I already renamed the GPT partitions in the hope that ZFS
would not find them anymore, but it does.
> >>>> 
> >>>> I can't gpart destroy -f ada1 because "device
busy".
> >>>> 
> >>>> Is there a way, ideally in the loader, to tell the kernel
to ignore ada1 and/or ahcich5? Or can I force ZFS some other way to ignore the
disk? I do have a spare disk I can use to replace the failed one, but I
can't get the machine into a state where I could even issue the zpool
replace command.
> >>> 
> >>> `zpool offline pool device` if you have enoght redundancy?
> >> 
> >> I do, but the command doesn't return. Instead, I'm getting
loads of sata error message.
> > 
> > What you zpool configuration?
> 
> This is from the working system. The identifiers are slightly different,
but the structure is identical.
what about `zpool detach <pool> <device>` ?
> # zpool status
>   pool: data
>  state: ONLINE
> status: Some supported features are not enabled on the pool. The pool can
> 	still be used, but some features are unavailable.
> action: Enable all features using 'zpool upgrade'. Once this is
done,
> 	the pool may no longer be accessible by software that does not support
> 	the features. See zpool-features(7) for details.
>   scan: resilvered 176K in 0 days 00:01:28 with 0 errors on Sun May 26
21:24:54 2019
> config:
> 
> 	NAME              STATE     READ WRITE CKSUM
> 	data              ONLINE       0     0     0
> 	  mirror-0        ONLINE       0     0     0
> 	    gpt/ls0data   ONLINE       0     0     0
> 	    gpt/ls1data   ONLINE       0     0     0
> 	logs
> 	  gpt/data0log    ONLINE       0     0     0
> 	cache
> 	  gpt/data0cache  ONLINE       0     0     0
> 
> errors: No known data errors
> 
>   pool: ls-host
>  state: ONLINE
> status: Some supported features are not enabled on the pool. The pool can
> 	still be used, but some features are unavailable.
> action: Enable all features using 'zpool upgrade'. Once this is
done,
> 	the pool may no longer be accessible by software that does not support
> 	the features. See zpool-features(7) for details.
>   scan: scrub repaired 0 in 0 days 00:06:33 with 0 errors on Sun Apr 12
11:46:25 2020
> config:
> 
> 	NAME              STATE     READ WRITE CKSUM
> 	ls-host           ONLINE       0     0     0
> 	  mirror-0        ONLINE       0     0     0
> 	    gpt/ls0host   ONLINE       0     0     0
> 	    gpt/ls1host   ONLINE       0     0     0
> 	logs
> 	  gpt/host0log    ONLINE       0     0     0
> 	cache
> 	  gpt/host0cache  ONLINE       0     0     0
> 
> errors: No known data errors
> 
> 
> --
> Stefan Bethke <stb at lassitu.de>   Fon +49 151 14070811
>

Am 12.04.2020 um 19:03 schrieb Slawa Olhovchenkov <slw at
zxy.spb.ru>:
> 
> On Sun, Apr 12, 2020 at 06:38:10PM +0200, Stefan Bethke wrote:
> 
>> 
>> 
>>> Am 12.04.2020 um 18:31 schrieb Slawa Olhovchenkov <slw at
zxy.spb.ru>:
>>> 
>>> On Sun, Apr 12, 2020 at 06:24:09PM +0200, Stefan Bethke wrote:
>>> 
>>>> Am 12.04.2020 um 17:43 schrieb Slawa Olhovchenkov <slw at
zxy.spb.ru>:
>>>>> 
>>>>> On Sun, Apr 12, 2020 at 04:37:06PM +0200, Stefan Bethke
wrote:
>>>>> 
>>>>>> I have a server I don't have physical access to
right now, which has a broken SATA disk that produces mostly errors (but not
entirely).
>>>>>> 
>>>>>> The disk has two partitions that are part of a zpool
each. I can't bring the system up with this disk being online, because ZFS
is trying its darndest to use it.
>>>>>> 
>>>>>> I already renamed the GPT partitions in the hope that
ZFS would not find them anymore, but it does.
>>>>>> 
>>>>>> I can't gpart destroy -f ada1 because "device
busy".
>>>>>> 
>>>>>> Is there a way, ideally in the loader, to tell the
kernel to ignore ada1 and/or ahcich5? Or can I force ZFS some other way to
ignore the disk? I do have a spare disk I can use to replace the failed one, but
I can't get the machine into a state where I could even issue the zpool
replace command.
>>>>> 
>>>>> `zpool offline pool device` if you have enoght redundancy?
>>>> 
>>>> I do, but the command doesn't return. Instead, I'm
getting loads of sata error message.
>>> 
>>> What you zpool configuration?
>> 
>> This is from the working system. The identifiers are slightly
different, but the structure is identical.
> 
> what about `zpool detach <pool> <device>` ?
Now I can't boot into single user mode anymore, ZFS just waits forever, and
the kernel is printing an endless chain of SATA error messages.

I really need a way to remove the broken disk before ZFS tries to access it, or
a way to stop ZFS from try to access the disk.


Stefan

--
Stefan Bethke <stb at lassitu.de>   Fon +49 151 14070811

-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 529 bytes
Desc: Message signed with OpenPGP
URL:
<http://lists.freebsd.org/pipermail/freebsd-stable/attachments/20200412/9c481b58/attachment.sig>