search for: swapper

I see this ocasionally on one of my CentOS 6.3 x64 systems: Oct 18 03:10:52 backup kernel: swapper: page allocation failure. order:1, mode:0x20 Oct 18 03:10:52 backup kernel: Pid: 0, comm: swapper Not tainted 2.6.32-279.9.1.el6.x86_64 #1 Oct 18 03:10:52 backup kernel: Call Trace: Oct 18 03:10:52 backup kernel: <IRQ> [<ffffffff8112789f>] ? __alloc_pages_nodemask+0x77f/0x940 Oct 18 03...

Never saw this email....Did anyone get it?? anyone know how to fix this?thanks again. From: KM <info4km at yahoo.com> To: CentOS mailing list <centos at centos.org> Sent: Monday, August 7, 2017 11:26 AM Subject: Re: [CentOS] BUG: soft lockup - CPU#0 stuck for 36s! [swapper/0:0] All,This happens on all of our CentOS 7 VMs.? but as stated in the email trail, the file softlockup_thresh does not exist.? Should it be added?? What is the best way to get rid of this behavior. Thanks in advance and sorry if I missed something along the way.KM From: correomm <co...

I just updated my quad-processor X64 machine (AMD Phenom(tm) II X4 945 Processor) to the latest CentOS 5 xen kernel (2.6.18-371.4.1.el5xen) and I am getting occasional "BUG: soft lockup - CPU#n stuck for X s! [swapper:0]" messages. I did some net searching, and found some bugzilla reports (https://bugzilla.redhat.com/show_bug.cgi?id=649519 and http://bugs.centos.org/view.php?id=4488), but neither are shown as resolved. The machine *seems* to be running alright (it is not hanging or anything). Is this someth...

...id of this behavior. Thanks in advance and sorry if I missed something along the way.KM From: correomm <correomm at gmail.com> To: CentOS mailing list <centos at centos.org> Sent: Thursday, August 18, 2016 1:55 PM Subject: Re: [CentOS] BUG: soft lockup - CPU#0 stuck for 36s! [swapper/0:0] Yes, I tried it, but does not exists: vmguest # cat /proc/sys/kernel/softlockup_thresh cat: /proc/sys/kernel/softlockup_thresh: No such file or directory On Thu, Aug 18, 2016 at 2:06 PM, Carlos A. Carnero Delgado < carloscarnero at gmail.com> wrote: > 2016-08-18 12:39 GMT-04:00...

...[ 44.047358] Booting Node 0 Processor 3 APIC 0x6 [ 44.061201] ------------[ cut here ]------------ [ 44.065186] kernel BUG at kernel/hrtimer.c:1259! [ 44.065186] invalid opcode: 0000 [#1] SMP [ 44.065186] CPU 3 [ 44.065186] Modules linked in: [ 44.065186] [ 44.065186] Pid: 0, comm: swapper/3 Not tainted 3.5.0-xen-evtchn+ #50 Xen HVM domU [ 44.065186] RIP: 0010:[<ffffffff8105682e>] [<ffffffff8105682e>] hrtimer_interrupt+0x24/0x1a5 [ 44.065186] RSP: 0000:ffff88000f463de8 EFLAGS: 00010046 [ 44.065186] RAX: ffffffff8105680a RBX: ffff88000f46e640 RCX: 00000000fffffffa...

...ll need to see if I still get the CPU lock up messages on my VM. I hope this helps.KM From: correomm <correomm at gmail.com> To: CentOS mailing list <centos at centos.org> Sent: Thursday, August 18, 2016 1:50 PM Subject: Re: [CentOS] BUG: soft lockup - CPU#0 stuck for 36s! [swapper/0:0] Yes, I tried it, but does not exists: vmguest # cat /proc/sys/kernel/softlockup_thresh cat: /proc/sys/kernel/softlockup_thresh: No such file or directory On Thu, Aug 18, 2016 at 2:06 PM, Carlos A. Carnero Delgado < carloscarnero at gmail.com> wrote: > 2016-08-18 12:39 GMT-04:00...

...UPTIME: 6 days, 11:39:33 LOAD AVERAGE: 548.07, 542.95, 434.99 TASKS: 2721 NODENAME: monolith RELEASE: 2.6.9-67.0.20.ELxenU VERSION: #1 SMP Thu Jun 26 08:36:44 EDT 2008 MACHINE: x86_64 (2194 Mhz) MEMORY: 10 GB PANIC: "" PID: 0 COMMAND: "swapper" TASK: ffffffff80322b40 (1 of 6) [THREAD_INFO: ffffffff80426000] CPU: 0 STATE: TASK_RUNNING WARNING: panic task not found crash> bt PID: 0 TASK: ffffffff80322b40 CPU: 0 COMMAND: "swapper" #0 [ffffffff80427ec0] schedule at ffffffff80294d9a #1 [...

...[296]: inactive '/dev/fedora-foo1/swap' [2.00 GiB] inherit systemd-fsck[662]: /dev/mapper/fedora--foo1-root: clean, 22215/486720 files, 222526/1944576 blocks BUG: sleeping function called from invalid context at kernel/locking/mutex.c:586 in_atomic(): 1, irqs_disabled(): 1, pid: 0, name: swapper/1 2 locks held by swapper/1/0: #0: (&(&vblk->vq_lock)->rlock){-.-...}, at: [<ffffffffa0039042>] virtblk_done+0x42/0xe0 [virtio_blk] #1: (&(&bitmap->counts.lock)->rlock){-.....}, at: [<ffffffff81633718>] bitmap_endwrite+0x68/0x240 irq event stamp: 3351...

...[296]: inactive '/dev/fedora-foo1/swap' [2.00 GiB] inherit systemd-fsck[662]: /dev/mapper/fedora--foo1-root: clean, 22215/486720 files, 222526/1944576 blocks BUG: sleeping function called from invalid context at kernel/locking/mutex.c:586 in_atomic(): 1, irqs_disabled(): 1, pid: 0, name: swapper/1 2 locks held by swapper/1/0: #0: (&(&vblk->vq_lock)->rlock){-.-...}, at: [<ffffffffa0039042>] virtblk_done+0x42/0xe0 [virtio_blk] #1: (&(&bitmap->counts.lock)->rlock){-.....}, at: [<ffffffff81633718>] bitmap_endwrite+0x68/0x240 irq event stamp: 3351...

2016-08-18 12:39 GMT-04:00 correomm <correomm at gmail.com>: > This bug is reported only on the VM's with CentOS 7 running on on VMware > ESXi 5.1. > The vSphere performance graph shows high CPU consume and disk activity only > on VM's with CentOS 7. Sometimes I can not connect remotely with ssh > (timeout error). > I'm also seeing those errors in several

On Mon, 2017-08-07 at 15:26 +0000, KM wrote: > All,This happens on all of our CentOS 7 VMs.? but as stated in the > email trail, the file softlockup_thresh does not exist.? Should it be > added?? What is the best way to get rid of this behavior. > Thanks in advance and sorry if I missed something along the way.KM Yes, I see this behavior as well. Never have found a solution - other

On 24 April 2018 at 17:16, <m.roth at 5-cent.us> wrote: > Adam Tauno Williams wrote: >> On Mon, 2017-08-07 at 15:26 +0000, KM wrote: >>> All,This happens on all of our CentOS 7 VMs. but as stated in the >>> email trail, the file softlockup_thresh does not exist. Should it be >>> added? What is the best way to get rid of this behavior. >>>

> 2016-08-18 12:39 GMT-04:00 correomm <correomm at gmail.com>: > >> This bug is reported only on the VM's with CentOS 7 running on on VMware >> ESXi 5.1. >> The vSphere performance graph shows high CPU consume and disk activity only >> on VM's with CentOS 7. Sometimes I can not connect remotely with ssh >> (timeout error). >> > I'm

...}, 0x40000000) Full splat: [ 162.337073] ================================ [ 162.338055] WARNING: inconsistent lock state [ 162.339017] 4.16.0-rc2 #1 Not tainted [ 162.339797] -------------------------------- [ 162.340725] inconsistent {HARDIRQ-ON-W} -> {IN-HARDIRQ-R} usage. [ 162.342030] swapper/0/0 [HC1[1]:SC0[0]:HE0:SE1] takes: [ 162.343061] (&journal->j_state_lock){+?++}, at: [<000000003b9c3e4b>] jbd2_trans_will_send_data_barrier+0x44/0xc8 [ 162.353187] {HARDIRQ-ON-W} state was registered at: [ 162.354433] lock_acquire+0x48/0x68 [ 162.358640] _raw_write_lock+0x3c/0...

...}, 0x40000000) Full splat: [ 162.337073] ================================ [ 162.338055] WARNING: inconsistent lock state [ 162.339017] 4.16.0-rc2 #1 Not tainted [ 162.339797] -------------------------------- [ 162.340725] inconsistent {HARDIRQ-ON-W} -> {IN-HARDIRQ-R} usage. [ 162.342030] swapper/0/0 [HC1[1]:SC0[0]:HE0:SE1] takes: [ 162.343061] (&journal->j_state_lock){+?++}, at: [<000000003b9c3e4b>] jbd2_trans_will_send_data_barrier+0x44/0xc8 [ 162.353187] {HARDIRQ-ON-W} state was registered at: [ 162.354433] lock_acquire+0x48/0x68 [ 162.358640] _raw_write_lock+0x3c/0...

...d Xen 4.0.1 to 4.1, and have yet to shake the issue. The following is an output of the error. This is usually repeated several times. There is plenty of RAM available, usually 1GB+ is used in buffers/cache, but ~1GB of swap is also available should it be needed. Its worth noting that the "swapper" portion is usually a random process. I''ve seen it say "mingetty", "rsyslog" amongst others. However "swapper" is the most common. [488054.896037] swapper: page allocation failure. order:0, mode:0x20 [488054.896056] Pid: 0, comm: swapper Not tainted 2....

Adam Tauno Williams wrote: > On Mon, 2017-08-07 at 15:26 +0000, KM wrote: >> All,This happens on all of our CentOS 7 VMs.? but as stated in the >> email trail, the file softlockup_thresh does not exist.? Should it be >> added?? What is the best way to get rid of this behavior. >> Thanks in advance and sorry if I missed something along the way.KM > > Yes, I see this

...0 (root) count: 1 Directory: /var/spool/abrt/ccpp-2016-08-16-15:10:52-458 Reported: https://retrace.fedoraproject.org/faf/reports/bthash/d5f5d4f75b200eeab2f83c8340a37c5d507e29a3 id e6955aa621a0d296d4cdd05421523885e85a179b reason: BUG: soft lockup - CPU#0 stuck for 36s! [swapper/0:0] time: Tue 09 Aug 2016 04:46:33 PM CLT cmdline: BOOT_IMAGE=/vmlinuz-3.10.0-327.28.2.el7.x86_64 root=/dev/mapper/centos_vmguest-root ro crashkernel=auto rd.lvm.lv=centos_vmguest/root rd.lvm.lv=centos_vmguest/swap rhgb quiet LANG=en_US.UTF-8 package: kernel uid:...

.../fedora-foo1/swap' [2.00 GiB] inherit > systemd-fsck[662]: /dev/mapper/fedora--foo1-root: clean, 22215/486720 > files, 222526/1944576 blocks > BUG: sleeping function called from invalid context at > kernel/locking/mutex.c:586 > in_atomic(): 1, irqs_disabled(): 1, pid: 0, name: swapper/1 > 2 locks held by swapper/1/0: > #0: (&(&vblk->vq_lock)->rlock){-.-...}, at: [<ffffffffa0039042>] > virtblk_done+0x42/0xe0 [virtio_blk] > #1: (&(&bitmap->counts.lock)->rlock){-.....}, at: > [<ffffffff81633718>] bitmap_endwrite+0x68/0x2...

...o console=hvc0 rootflags=barrier=0 crashkernel=auto SYSFONT=latarcyrheb-sun16 LANG=en_US.UTF-8 KEYTABLE=us earlyprintk=xen (early) KERNEL supported cpus: (early) Intel GenuineIntel (early) AMD AuthenticAMD (early) Centaur CentaurHauls (early) 1 multicall(s) failed: cpu 0 (early) Pid: 0, comm: swapper Not tainted 2.6.32-696.18.7.el6.x86_64 #1 (early) Call Trace: (early) [<ffffffff81004843>] ? xen_mc_flush+0x1c3/0x250 (early) [<ffffffff81006b9e>] ? xen_extend_mmu_update+0xde/0x1b0 (early) [<ffffffff81006fcd>] ? xen_set_pmd_hyper+0x9d/0xc0 (early) [<ffffffff81c5e8ac>] ?...