Hi, I'm disturbed by a frequent hangup of my 10-STABLE boxes since this year. It seems occur during running the periodic daily scripts. I've narrowed which commit causes this problem. It seems r292895 causes it. I see many `Resource temporarily unavailable' message just before hangup occurs. Any idea? Sincerely, -- Hajimu UMEMOTO ume at mahoroba.org ume at FreeBSD.org http://www.mahoroba.org/~ume/
Some more information about your enviroment would be helpful:
1. What revision of stable/10 are you running?
2. What workloads are you running?
3. What's the output of procstat -k -k when this happens (assuming its
possible to run)?
4. What's the output of sysctl -a |grep vnode, usually and when this
happens?
Regards
Steve
On 02/02/2016 07:55, Hajimu UMEMOTO wrote:> Hi,
>
> I'm disturbed by a frequent hangup of my 10-STABLE boxes since this
> year. It seems occur during running the periodic daily scripts.
> I've narrowed which commit causes this problem. It seems r292895
> causes it. I see many `Resource temporarily unavailable' message just
> before hangup occurs.
> Any idea?
>
> Sincerely,
>
> --
> Hajimu UMEMOTO
> ume at mahoroba.org ume at FreeBSD.org
> http://www.mahoroba.org/~ume/
> _______________________________________________
> freebsd-stable at freebsd.org mailing list
> https://lists.freebsd.org/mailman/listinfo/freebsd-stable
> To unsubscribe, send any mail to "freebsd-stable-unsubscribe at
freebsd.org"
Le mar 2 f?v 16 ? 8:55:46 +0100, Hajimu UMEMOTO <ume at mahoroba.org> ?crivait?:> Hi,Hello,> I'm disturbed by a frequent hangup of my 10-STABLE boxes since this > year. It seems occur during running the periodic daily scripts. > I've narrowed which commit causes this problem. It seems r292895 > causes it. I see many `Resource temporarily unavailable' message just > before hangup occurs. > Any idea?Not exactly the same problem, but it is also occuring during periodic daily: <https://lists.freebsd.org/pipermail/freebsd-stable/2015-December/083810.html> and also: <https://lists.freebsd.org/pipermail/freebsd-stable/2015-December/083807.html> I'm also experiencing problems during daily periodic on a -STABLE box, but no kernel panics: the machine is frozen, and no login is possible, I have to hard reboot it. For the time being, I have commented out almost every entry in periodic.conf, and I'm trying to find the culprit. Regards, -- Th. Thomas. -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: application/pgp-signature Size: 949 bytes Desc: not available URL: <http://lists.freebsd.org/pipermail/freebsd-stable/attachments/20160202/2e030526/attachment.sig>
On 2016-Feb-02 16:55:46 +0900, Hajimu UMEMOTO <ume at mahoroba.org> wrote:>I'm disturbed by a frequent hangup of my 10-STABLE boxes since this >year. It seems occur during running the periodic daily scripts. >I've narrowed which commit causes this problem. It seems r292895 >causes it. I see many `Resource temporarily unavailable' message just >before hangup occurs. >Any idea?As others have said, you need to provide lots more detail on your configuration. That said, I'm seeing something potentially similar on a Google Compute Engine f1-micro instance (1 vCPU, 0.6GB RAM) that is running FreeBSD 10-stable/amd64 with ZFS but basically idle. (Yes, I realize that's very little RAM for ZFS but I previously had no problems with things like buildworld). There were no problems at r290231 but after I upgraded to r295005, I started seeing "out of swap" errors and hangs during the periodic daily runs. I'm not seeing this on 1GB instances - though they are all running UFS. Some experimentation suggested that just "find /" was enough to wedge my system. I did some experimenting and found that the following loader config was enough to prevent it hanging: vfs.zfs.arc_max="128M" vfs.zfs.arc_meta_limit="50M" vfs.zfs.arc_min="25M" (previously, I had no ZFS tuning at all). One odditity was that I would semi-regularly see: kernel: pid 67431 (ntpd), uid 0, was killed: out of swap space I haven't worked out why the OOM killer preferred ntpd to anything else - it didn't seem to be bigger. And I didn't see any signs that swap space was being consumed (though I haven't done a scientific examination). (Note that swap is on a raw partition). The behaviour is definitely a regression and my initial suspicion is ZFS, though I haven't identified any smoking gun. Unfortunately, GCE only offers read access to the console, so I can't use DDB to poke around after it wedges. -- Peter Jeremy -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 949 bytes Desc: not available URL: <http://lists.freebsd.org/pipermail/freebsd-stable/attachments/20160203/42b16daa/attachment.sig>