search for: rcu_sched

Hi all, I''ve had a report of a host starting to give this output: Oct 7 19:36:37 kernel: INFO: rcu_sched self-detected stall on CPU { 2} (t=273561 jiffies g=17919 c=17918 q=9688) Oct 7 19:36:37 kernel: sending NMI to all CPUs: Oct 7 19:36:37 kernel: xen: vector 0x2 is not implemented Kernel is 3.11.2. Xen is 4.2.3. I''ve seen various random reports of this, but never a follow up on what seem...

On Thu, May 4, 2023 at 10:27?AM Wenliang Wang <wangwenliang.1995 at bytedance.com> wrote: > > For multi-queue and large ring-size use case, the following error > occurred when free_unused_bufs: > rcu: INFO: rcu_sched self-detected stall on CPU. > > Fixes: 986a4f4d452d ("virtio_net: multiqueue support") > Signed-off-by: Wenliang Wang <wangwenliang.1995 at bytedance.com> > --- > v2: > -add need_resched check. > -apply same logic to sq. > v3: > -use cond_resched instead....

...2023 at 11:28:25AM +0800, Jason Wang wrote: > On Thu, May 4, 2023 at 10:27?AM Wenliang Wang > <wangwenliang.1995 at bytedance.com> wrote: > > > > For multi-queue and large ring-size use case, the following error > > occurred when free_unused_bufs: > > rcu: INFO: rcu_sched self-detected stall on CPU. > > > > Fixes: 986a4f4d452d ("virtio_net: multiqueue support") > > Signed-off-by: Wenliang Wang <wangwenliang.1995 at bytedance.com> > > --- > > v2: > > -add need_resched check. > > -apply same logic to sq. > &...

...yes, I would recommend removing it. did so, thanks Another thing I see: a process called "smbd-notifyd" causing ~100% load on one CPU core. I haven't touched the kernel yet, it's a 4.1.15-gentoo-r1 ... Should I disable notifying? I also have in dmesg: [ 9369.174819] INFO: rcu_sched self-detected stall on CPU { 0} (t=3660060 jiffies g=297669 c=297668 q=1663753) [ 9369.174824] Task dump for CPU 0: [ 9369.174825] smbd-notifyd R running task 14232 3051 3046 0x0000000c [ 9369.174829] ffffffff81e3d680 ffff88021fc03d68 ffffffff81079edc 0000000000000000 [ 9369.174831] fff...

..., at least not in a Xen context. I was wondering if anyone had any suggestions about what could be wrong. From everything I have read, there should be a stack trace included, but I am not seeing one. Thanks in advance, Ian. on Xen 4.1.2... Sep 6 13:04:07 davical kernel: [12008.080091] INFO: rcu_sched detected stall on CPU 1 (t=50460 jiffies) Sep 6 13:04:07 davical kernel: [12008.084081] sending NMI to all CPUs: Sep 6 13:04:07 davical kernel: [11806.576064] INFO: rcu_sched detected stalls on CPUs/tasks: { 1} (detected by 0, t=566314 jiffies) Sep 6 13:04:07 davical kernel: [75644.150936] INF...

Am 2018-06-15 um 15:16 schrieb Stefan G. Weichinger via samba: > Am 2018-06-15 um 14:44 schrieb Stefan G. Weichinger via samba: > >> on my way now ... glibc new, samba-4.5.16 for a start >> >> we now get: >> >> [2018/06/15 14:43:09.481113, 0] >> ../source3/winbindd/winbindd_group.c:45(fill_grent) >> Failed to find domain 'Unix Group'.

...cache KiB Swap: 4063228 total, 4033608 free, 29620 used. 177296 avail Mem PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND 2011 named 20 0 646880 64712 11924 S 100.3 8.8 128:53.76 named 9 root 20 0 0 0 0 S 0.3 0.0 0:37.72 rcu_sched 1188 root 20 0 567080 24216 5688 S 0.3 3.3 0:10.12 samba Doing a stack trace of the running process shows me a lot of samba_dlz activity: [root at dc01 ~]# pstack 2011 Thread 5 (Thread 0x7fac16291700 (LWP 2012)): #0 0x00007fac0f1ea48f in ldb_dn_explode () from /usr/local/samba/...

Hi all, I have 5 CentOS 7 virtual guests installed (all fully patched to latest release) and i have the following error in all of them: systemd-journald[7779]: File /run/log/journal/b4a41f4214ca44f898638301891a6f2e/system.journal corrupted or uncleanly shut down, renaming and replacing. ?? .. And I don't understand why. I have configured "Storage=volatile" in journald.conf ...

On Sat, 2023-04-29 at 23:47 +0800, Wenliang Wang wrote: > For multi-queue and large ring-size use case, the following error > occurred when free_unused_bufs: > rcu: INFO: rcu_sched self-detected stall on CPU. > > Signed-off-by: Wenliang Wang <wangwenliang.1995 at bytedance.com> Net next is currently closed, but this patch could arguably land on the net tree - assuming Micheal agrees. In that case you should include a suitable Fixes tag - reposting a new version...

On Thu, May 04, 2023 at 10:27:06AM +0800, Wenliang Wang wrote: > For multi-queue and large ring-size use case, the following error > occurred when free_unused_bufs: > rcu: INFO: rcu_sched self-detected stall on CPU. > > Fixes: 986a4f4d452d ("virtio_net: multiqueue support") > Signed-off-by: Wenliang Wang <wangwenliang.1995 at bytedance.com> Acked-by: Michael S. Tsirkin <mst at redhat.com> Probably a good idea for stable, too. > --- > v2: >...

https://bugs.freedesktop.org/show_bug.cgi?id=74485 Priority: medium Bug ID: 74485 Assignee: nouveau at lists.freedesktop.org Summary: [NVE6] system hangs with 3D applications Severity: normal Classification: Unclassified OS: Linux (All) Reporter: prg at cooco.de Hardware: x86-64 (AMD64)

...7fc8a9370910 R14: 000000000000000d R15: 000000000108b420 [ 84.593470] Code: 03 00 77 25 48 81 ff 00 00 01 00 76 05 0f b7 d7 ed c3 55 48 c7 c6 43 53 0a bd 48 89 e5 e8 19 ff ff ff b8 ff ff ff ff 5d c3 8b 07 <c3> 66 66 66 66 66 66 2e 0f 1f 84 00 00 00 00 00 48 81 fe ff ff [ 91.721133] INFO: rcu_sched self-detected stall on CPU [ 91.721137] 6-...: (15000 ticks this GP) idle=c15/140000000000001/0 softirq=603/603 fqs=7479 [ 91.721138] (t=15001 jiffies g=343 c=342 q=90238) [ 91.721139] Task dump for CPU 6: [ 91.721139] plymouthd R running task 0 227 1...

...untered during testing this patches (v9) with QEMU + xfstests. Some CPU stalls encountered while testing with crosvm instead of QEMU with xfstests (test generic/464) but no repro for QEMU, so the fault may be on the side of crosvm. The dump for the crosvm/xfstests stall: [ 2504.175276] rcu: INFO: rcu_sched detected stalls on CPUs/tasks: [ 2504.176681] rcu: 0-...!: (1 GPs behind) idle=9b2/1/0x4000000000000000 softirq=1089198/1089202 fqs=0 [ 2504.178270] rcu: 2-...!: (1 ticks this GP) idle=cfe/1/0x4000000000000002 softirq=1055108/1055110 fqs=0 [ 2504.179802] rcu: 3-...!: (1 GPs behind) id...

...untered during testing this patches (v9) with QEMU + xfstests. Some CPU stalls encountered while testing with crosvm instead of QEMU with xfstests (test generic/464) but no repro for QEMU, so the fault may be on the side of crosvm. The dump for the crosvm/xfstests stall: [ 2504.175276] rcu: INFO: rcu_sched detected stalls on CPUs/tasks: [ 2504.176681] rcu: 0-...!: (1 GPs behind) idle=9b2/1/0x4000000000000000 softirq=1089198/1089202 fqs=0 [ 2504.178270] rcu: 2-...!: (1 ticks this GP) idle=cfe/1/0x4000000000000002 softirq=1055108/1055110 fqs=0 [ 2504.179802] rcu: 3-...!: (1 GPs behind) id...

...28 total, 4033608 free, 29620 used. > 177296 avail Mem > > PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ > COMMAND 2011 named 20 0 646880 64712 11924 S 100.3 8.8 > 128:53.76 named 9 root 20 0 0 0 0 S 0.3 > 0.0 0:37.72 rcu_sched > 1188 root 20 0 567080 24216 5688 S 0.3 3.3 0:10.12 > samba > > > Doing a stack trace of the running process shows me a lot of samba_dlz > activity: > > [root at dc01 ~]# pstack 2011 > Thread 5 (Thread 0x7fac16291700 (LWP 2012)): > #0 0x00007fac0f...

...4.085992] [<ffffffff810d5c58>] ? do_munmap+0x2da/0x2f3 [354044.085996] [<ffffffff8104a6a5>] ? do_group_exit+0x74/0x9e [354044.086000] [<ffffffff8104a6de>] ? sys_exit_group+0xf/0xf [354044.086004] [<ffffffff81355452>] ? system_call_fastpath+0x16/0x1b [354047.219103] INFO: rcu_sched detected stall on CPU 5 (t=15039 jiffies) [354047.224054] INFO: rcu_sched detected stalls on CPUs/tasks: { 5} (detected by 1, t=15039 jiffies) [354047.224054] sending NMI to all CPUs: [354047.224054] BUG: unable to handle kernel paging request at ffffffffff5fb310 [354047.224054] IP: [<fffffff...

...0.0.0.0-255.255.255.255} % nft flush set t s3 % nft add element t s3 {10.0.0.0-255.255.255.255} % nft -f file [oops] Code is: kernel 04ba724 [PATCH] netfilter: nfnetlink: extended ACK reporting nft 5de112c [PATCH] include: Remove datatype_register() [Wed Jul 12 12:47:45 2017] INFO: rcu_sched self-detected stall on CPU [Wed Jul 12 12:47:45 2017] 0-...: (5249 ticks this GP) idle=dca/140000000000001/0 softirq=2845/2845 fqs=2623 [Wed Jul 12 12:47:45 2017] (t=5251 jiffies g=1649 c=1648 q=99) [Wed Jul 12 12:47:45 2017] NMI backtrace for cpu 0 [Wed Jul 12 12:47:45 2017] CPU: 0 PID:...

...9620 used. > > 177296 avail Mem > > > > PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ > > COMMAND 2011 named 20 0 646880 64712 11924 S 100.3 8.8 > > 128:53.76 named 9 root 20 0 0 0 0 S 0.3 > > 0.0 0:37.72 rcu_sched > > 1188 root 20 0 567080 24216 5688 S 0.3 3.3 0:10.12 > > samba > > > > > > Doing a stack trace of the running process shows me a lot of samba_dlz > > activity: > > > > [root at dc01 ~]# pstack 2011 > > Thread 5 (Thread 0x7fac1...

...with > xfstests > (test generic/464) but no repro for QEMU, so the fault may be on the side of > crosvm. yes, looks like crosvm related as we did not see any of this in my and your testing with Qemu. > > > The dump for the crosvm/xfstests stall: > [ 2504.175276] rcu: INFO: rcu_sched detected stalls on CPUs/tasks: > [ 2504.176681] rcu: 0-...!: (1 GPs behind) idle=9b2/1/0x4000000000000000 > softirq=1089198/1089202 fqs=0 > [ 2504.178270] rcu: 2-...!: (1 ticks this GP) > idle=cfe/1/0x4000000000000002 softirq=1055108/1055110 fqs=0 > [ 2504.179802] rcu: 3-...

...he test will abort, core dump, and cause two problems, 1) the migrated page will be faulted back to system memory in order to write it to the core dump. This triggers lockdep_assert_held(&walk.mm->mmap_sem) in walk_page_range(). 2) Then after a delay, I get: [ 137.852986] rcu: INFO: rcu_sched self-detected stall on CPU [ 137.858594] rcu: 0-....: (26000 ticks this GP) idle=69e/1/0x4000000000000002 softirq=34555/34555 fqs=6497 [ 137.868439] (t=26007 jiffies g=14653 q=271) [ 137.872711] NMI backtrace for cpu 0 [ 137.876205] CPU: 0 PID: 6228 Comm: hmm-tests Not tainted 5.6.0-rc6+ #2 [...