Jeffrey W. Baker
2006-May-19 07:36 UTC
[Lustre-discuss] Instant death with SLES 9, 1.2.6, nvidia?
On Wed, 2005-08-10 at 17:23 -0700, Jeffrey W. Baker wrote:> I have one particular client machine running the kernel from SLES 9 SP2, > which contains Lustre 1.2.6, and for whatever reason I can trivially > crash this client by simply running bonnie++ on the lustre filesystem. > The machine has 1GB of memory. The lockup comes less than a minute into > the rewrite portion of bonnie, which is causing about 25MB/sec in both > directions. > > The machine experiences allocation failures, then deadlocks.More testing seems to indicate that the dl2k driver cannot deal with low-memory situations. I replaced the DL2000 in this machine with a Yukon and now it works fine. -jwb
Jeffrey W. Baker
2006-May-19 07:36 UTC
[Lustre-discuss] Instant death with SLES 9, 1.2.6, nvidia?
On Wed, 2005-08-10 at 17:23 -0700, Jeffrey W. Baker wrote:> The workstation in question has an Nvidia graphics card, but the > deadlock occurs whether nvidia.ko is loaded or not. However I do note > the presence of nvidia in the call stack below.Nevermind that theory. The same result happens even if the nvidia module has not been loaded since boot, and the same is true regarding vmware''s modules. -jwb
Jeffrey W. Baker
2006-May-19 07:36 UTC
[Lustre-discuss] Instant death with SLES 9, 1.2.6, nvidia?
I have one particular client machine running the kernel from SLES 9 SP2,
which contains Lustre 1.2.6, and for whatever reason I can trivially
crash this client by simply running bonnie++ on the lustre filesystem.
The machine has 1GB of memory. The lockup comes less than a minute into
the rewrite portion of bonnie, which is causing about 25MB/sec in both
directions.
The machine experiences allocation failures, then deadlocks.
The workstation in question has an Nvidia graphics card, but the
deadlock occurs whether nvidia.ko is loaded or not. However I do note
the presence of nvidia in the call stack below.
Regards,
jwb
Aug 10 16:53:39 toonses kernel: portals: module not supported by Novell, setting
U taint flag.
Aug 10 16:53:39 toonses kernel: ksocknal: module not supported by Novell,
setting U taint flag.
Aug 10 16:53:39 toonses kernel: Lustre:
7677:0:(/usr/src/packages/BUILD/kernel-default-2.6.5/modules-2.6.5/lustre-lite/sources/portals/knals/socknal/socknal.c:1633:ksocknal_module_init())
maximum lustre stack 8
091
Aug 10 16:53:39 toonses kernel: Lustre:
7677:0:(/usr/src/packages/BUILD/kernel-default-2.6.5/modules-2.6.5/lustre-lite/sources/portals/knals/socknal/socknal.c:130:ksocknal_init())
maximum lustre stack 8188
Aug 10 16:53:39 toonses kernel: Lustre:
7677:0:(/usr/src/packages/BUILD/kernel-default-2.6.5/modules-2.6.5/lustre-lite/sources/portals/libcfs/lib-init.c:257:lib_init())
maximum lustre stack 8192
Aug 10 16:53:39 toonses kernel: Lustre: Routing socket NAL loaded (Routing
disabled, initial mem 0)
Aug 10 16:53:39 toonses kernel: lvfs: module not supported by Novell, setting U
taint flag.
Aug 10 16:53:39 toonses kernel: obdclass: module not supported by Novell,
setting U taint flag.
Aug 10 16:53:39 toonses kernel: Lustre: OBD class driver Build Version:
1.2.6.suse.2-19700101000000-PRISTINE-.usr.src.packages.BUILD.kernel-default-2.6.5.linux-2.6.5-2.6.5-7.193-default,
info@clusterfs.com
Aug 10 16:53:39 toonses kernel: ptlrpc: module not supported by Novell, setting
U taint flag.
Aug 10 16:53:39 toonses kernel: osc: module not supported by Novell, setting U
taint flag.
Aug 10 16:53:39 toonses kernel: lov: module not supported by Novell, setting U
taint flag.
Aug 10 16:53:39 toonses kernel: mdc: module not supported by Novell, setting U
taint flag.
Aug 10 16:53:39 toonses kernel: llite: module not supported by Novell, setting U
taint flag.
Aug 10 16:53:39 toonses kernel: Lustre: Lustre Lite Client File System;
info@clusterfs.com
Aug 10 16:55:33 toonses kernel: ksocknald_00: page allocation failure. order:0,
mode:0x20
Aug 10 16:55:33 toonses kernel:
Aug 10 16:55:33 toonses kernel: Call Trace:<IRQ>
<ffffffff8015f7ba>{__alloc_pages+778}
<ffffffff8015f861>{__get_free_pages+33}
Aug 10 16:55:33 toonses kernel:
<ffffffff801625cb>{cache_alloc_refill+555}
<ffffffff80116364>{timer_interrupt+484}
Aug 10 16:55:33 toonses kernel: <ffffffff80162913>{__kmalloc+83}
<ffffffff802c7ca1>{alloc_skb+81}
Aug 10 16:55:33 toonses kernel:
<ffffffffa015d637>{:dl2k:rio_interrupt+839}
<ffffffff8011328f>{handle_IRQ_event+47}
Aug 10 16:55:33 toonses kernel: <ffffffff80113353>{do_IRQ+147}
<ffffffff801108fd>{ret_from_intr+0}
Aug 10 16:55:33 toonses kernel: <EOI>
<ffffffff802cb8b8>{dev_queue_xmit+232}
<ffffffff802e70db>{ip_dst_output+123}
Aug 10 16:55:33 toonses kernel:
<ffffffff802e8f96>{ip_queue_xmit+1158}
<ffffffff802e467e>{ip_rcv+1022}
Aug 10 16:55:33 toonses kernel:
<ffffffff802cb0c9>{netif_receive_skb+409}
<ffffffff802cb14a>{netif_receive_skb+538}
Aug 10 16:55:33 toonses kernel:
<ffffffff802cb21a>{process_backlog+138}
<ffffffff802f7d76>{tcp_transmit_skb+1462}
Aug 10 16:55:33 toonses kernel:
<ffffffff802f67df>{tcp_rcv_established+1711}
<ffffffff802fd765>{tcp_v4_do_rcv+53}
Aug 10 16:55:33 toonses kernel:
<ffffffff802c4ee9>{__release_sock+41}
<ffffffff802c4ef9>{__release_sock+57}
Aug 10 16:55:33 toonses kernel: <ffffffff802c52a6>{release_sock+38}
<ffffffff802ee417>{tcp_recvmsg+1943}
Aug 10 16:55:33 toonses kernel: <ffffffff8030b2b3>{inet_recvmsg+51}
<ffffffff802c2a4a>{sock_recvmsg+330}
Aug 10 16:55:33 toonses kernel:
<ffffffff80130c68>{__wake_up_common+56}
<ffffffffa0708be1>{:ksocknal:ksocknal_recv_pages+257}
Aug 10 16:55:33 toonses kernel:
<ffffffffa06eb2a2>{:portals:lib_recv+130}
<ffffffffa06f0335>{:portals:parse_put+1301}
Aug 10 16:55:33 toonses kernel:
<ffffffff80135aa0>{autoremove_wake_function+0}
<ffffffffa06f2a90>{:portals:lib_finalize+1568}
Aug 10 16:55:33 toonses kernel:
<ffffffffa0707838>{:ksocknal:ksocknal_recv_kiov+376}
Aug 10 16:55:33 toonses kernel:
<ffffffffa070ae9e>{:ksocknal:ksocknal_receive+366}
Aug 10 16:55:33 toonses kernel:
<ffffffffa070b0b8>{:ksocknal:ksocknal_process_receive+200}
Aug 10 16:55:33 toonses kernel:
<ffffffffa070aff2>{:ksocknal:ksocknal_process_receive+2}
Aug 10 16:55:33 toonses kernel:
<ffffffffa070d45c>{:ksocknal:ksocknal_scheduler+284}
Aug 10 16:55:33 toonses kernel:
<ffffffff80135aa0>{autoremove_wake_function+0}
<ffffffff80135aa0>{autoremove_wake_function+0}
Aug 10 16:55:33 toonses kernel:
<ffffffffa06e1780>{:portals:kportal_daemonize+0}
<ffffffff80110d6f>{child_rip+8}
Aug 10 16:55:33 toonses kernel:
<ffffffffa06e1780>{:portals:kportal_daemonize+0}
<ffffffffa070d340>{:ksocknal:ksocknal_scheduler+0}
Aug 10 16:55:33 toonses kernel: <ffffffff80110d67>{child_rip+0}
Aug 10 16:55:33 toonses kernel: eth1: receive_packet: Unable to re-allocate Rx
skbuff.#223
Aug 10 16:55:33 toonses kernel: ksocknald_00: page allocation failure. order:0,
mode:0x20
Aug 10 16:55:33 toonses kernel:
Aug 10 16:55:33 toonses kernel: Call Trace:<IRQ>
<ffffffff8015f7ba>{__alloc_pages+778}
<ffffffff8015f861>{__get_free_pages+33}
Aug 10 16:55:33 toonses kernel:
<ffffffff801625cb>{cache_alloc_refill+555}
<ffffffff80162913>{__kmalloc+83}
Aug 10 16:55:33 toonses kernel: <ffffffff802c7ca1>{alloc_skb+81}
<ffffffffa015d637>{:dl2k:rio_interrupt+839}
Aug 10 16:55:33 toonses kernel:
<ffffffff8011328f>{handle_IRQ_event+47}
<ffffffff80113353>{do_IRQ+147}
Aug 10 16:55:33 toonses kernel: <ffffffff801108fd>{ret_from_intr+0}
<EOI> <ffffffff802cb8b8>{dev_queue_xmit+232}
Aug 10 16:55:33 toonses kernel:
<ffffffff802e70db>{ip_dst_output+123}
<ffffffff802e8f96>{ip_queue_xmit+1158}
Aug 10 16:55:33 toonses kernel: <ffffffff802e467e>{ip_rcv+1022}
<ffffffff802cb0c9>{netif_receive_skb+409}
Aug 10 16:55:33 toonses kernel:
<ffffffff802cb14a>{netif_receive_skb+538}
<ffffffff802cb21a>{process_backlog+138}
Aug 10 16:55:33 toonses kernel:
<ffffffff802f7d76>{tcp_transmit_skb+1462}
<ffffffff802f67df>{tcp_rcv_established+1711}
Aug 10 16:55:33 toonses kernel:
<ffffffff802fd765>{tcp_v4_do_rcv+53}
<ffffffff802c4ee9>{__release_sock+41}
Aug 10 16:55:33 toonses kernel:
<ffffffff802c4ef9>{__release_sock+57}
<ffffffff802c52a6>{release_sock+38}
Aug 10 16:55:33 toonses kernel:
<ffffffff802ee417>{tcp_recvmsg+1943}
<ffffffff8030b2b3>{inet_recvmsg+51}
Aug 10 16:55:33 toonses kernel:
<ffffffff802c2a4a>{sock_recvmsg+330}
<ffffffff80130c68>{__wake_up_common+56}
Aug 10 16:55:33 toonses kernel:
<ffffffffa0708be1>{:ksocknal:ksocknal_recv_pages+257}
Aug 10 16:55:33 toonses kernel:
<ffffffffa06eb2a2>{:portals:lib_recv+130}
<ffffffffa06f0335>{:portals:parse_put+1301}
Aug 10 16:55:33 toonses kernel:
<ffffffff80135aa0>{autoremove_wake_function+0}
<ffffffffa06f2a90>{:portals:lib_finalize+1568}
Aug 10 16:55:33 toonses kernel:
<ffffffffa0707838>{:ksocknal:ksocknal_recv_kiov+376}
Aug 10 16:55:33 toonses kernel:
<ffffffffa070ae9e>{:ksocknal:ksocknal_receive+366}
Aug 10 16:55:33 toonses kernel:
<ffffffffa070b0b8>{:ksocknal:ksocknal_process_receive+200}
Aug 10 16:55:33 toonses kernel:
<ffffffffa070aff2>{:ksocknal:ksocknal_process_receive+2}
Aug 10 16:55:33 toonses kernel:
<ffffffffa070d45c>{:ksocknal:ksocknal_scheduler+284}
Aug 10 16:55:33 toonses kernel:
<ffffffff80135aa0>{autoremove_wake_function+0}
<ffffffff80135aa0>{autoremove_wake_function+0}
Aug 10 16:55:33 toonses kernel:
<ffffffffa06e1780>{:portals:kportal_daemonize+0}
<ffffffff80110d6f>{child_rip+8}
Aug 10 16:55:33 toonses kernel:
<ffffffffa06e1780>{:portals:kportal_daemonize+0}
<ffffffffa070d340>{:ksocknal:ksocknal_scheduler+0}
Aug 10 16:55:33 toonses kernel: <ffffffff80110d67>{child_rip+0}
Aug 10 16:55:33 toonses kernel: eth1: receive_packet: Unable to re-allocate Rx
skbuff.#223
Aug 10 16:55:33 toonses kernel: ksocknald_00: page allocation failure. order:0,
mode:0x20
Aug 10 16:55:33 toonses kernel:
Aug 10 16:55:33 toonses kernel: Call
Trace:<ffffffff8015f7ba>{__alloc_pages+778}
<ffffffff8015f861>{__get_free_pages+33}
Aug 10 16:55:33 toonses kernel:
<ffffffff801625cb>{cache_alloc_refill+555}
<ffffffff8016296b>{kmem_cache_alloc+43}
Aug 10 16:55:33 toonses kernel: <ffffffff802c7c7c>{alloc_skb+44}
<ffffffff802f8273>{tcp_send_ack+51}
Aug 10 16:55:33 toonses kernel:
<ffffffff802f67df>{tcp_rcv_established+1711}
<ffffffff802fd765>{tcp_v4_do_rcv+53}
Aug 10 16:55:33 toonses kernel:
<ffffffff802c4ee9>{__release_sock+41}
<ffffffff802c4ef9>{__release_sock+57}
Aug 10 16:55:33 toonses kernel: <ffffffff802c52a6>{release_sock+38}
<ffffffff802ee417>{tcp_recvmsg+1943}
Aug 10 16:55:33 toonses kernel: <ffffffff8030b2b3>{inet_recvmsg+51}
<ffffffff802c2a4a>{sock_recvmsg+330}
Aug 10 16:55:33 toonses kernel:
<ffffffff80130c68>{__wake_up_common+56}
<ffffffffa0708be1>{:ksocknal:ksocknal_recv_pages+257}
Aug 10 16:55:33 toonses kernel:
<ffffffffa06eb2a2>{:portals:lib_recv+130}
<ffffffffa06f0335>{:portals:parse_put+1301}
Aug 10 16:55:33 toonses kernel:
<ffffffff80135aa0>{autoremove_wake_function+0}
<ffffffffa06f2a90>{:portals:lib_finalize+1568}
Aug 10 16:55:33 toonses kernel:
<ffffffffa0707838>{:ksocknal:ksocknal_recv_kiov+376}
Aug 10 16:55:33 toonses kernel:
<ffffffffa070ae9e>{:ksocknal:ksocknal_receive+366}
Aug 10 16:55:33 toonses kernel:
<ffffffffa070b0b8>{:ksocknal:ksocknal_process_receive+200}
Aug 10 16:55:33 toonses kernel:
<ffffffffa070aff2>{:ksocknal:ksocknal_process_receive+2}
Aug 10 16:55:33 toonses kernel:
<ffffffffa070d45c>{:ksocknal:ksocknal_scheduler+284}
Aug 10 16:55:33 toonses kernel:
<ffffffff80135aa0>{autoremove_wake_function+0}
<ffffffff80135aa0>{autoremove_wake_function+0}
Aug 10 16:55:33 toonses kernel:
<ffffffffa06e1780>{:portals:kportal_daemonize+0}
<ffffffff80110d6f>{child_rip+8}
Aug 10 16:55:33 toonses kernel:
<ffffffffa06e1780>{:portals:kportal_daemonize+0}
<ffffffffa070d340>{:ksocknal:ksocknal_scheduler+0}
Aug 10 16:55:33 toonses kernel: <ffffffff80110d67>{child_rip+0}
Aug 10 16:55:33 toonses kernel: ksocknald_00: page allocation failure. order:0,
mode:0x20
Aug 10 16:55:33 toonses kernel:
Aug 10 16:55:33 toonses kernel: Call Trace:<IRQ>
<ffffffff8015f7ba>{__alloc_pages+778}
<ffffffff8015f861>{__get_free_pages+33}
Aug 10 16:55:33 toonses kernel:
<ffffffff801625cb>{cache_alloc_refill+555}
<ffffffffa04ac5fc>{:nvidia:nv_kern_isr+85}
Aug 10 16:55:33 toonses kernel:
<ffffffff8016296b>{kmem_cache_alloc+43}
<ffffffff802c7c7c>{alloc_skb+44}
Aug 10 16:55:33 toonses kernel:
<ffffffffa015d637>{:dl2k:rio_interrupt+839}
<ffffffff8011328f>{handle_IRQ_event+47}
Aug 10 16:55:33 toonses kernel: <ffffffff80113353>{do_IRQ+147}
<ffffffff801108fd>{ret_from_intr+0}
Aug 10 16:55:33 toonses kernel: <EOI>
<ffffffff80162974>{kmem_cache_alloc+52}
<ffffffff802c7c7c>{alloc_skb+44}
Aug 10 16:55:33 toonses kernel: <ffffffff802f8273>{tcp_send_ack+51}
<ffffffff802f67df>{tcp_rcv_established+1711}
Aug 10 16:55:33 toonses kernel:
<ffffffff802fd765>{tcp_v4_do_rcv+53}
<ffffffff802c4ee9>{__release_sock+41}
Aug 10 16:55:33 toonses kernel:
<ffffffff802c4ef9>{__release_sock+57}
<ffffffff802c52a6>{release_sock+38}
Aug 10 16:55:33 toonses kernel:
<ffffffff802ee417>{tcp_recvmsg+1943}
<ffffffff8030b2b3>{inet_recvmsg+51}
Aug 10 16:55:33 toonses kernel:
<ffffffff802c2a4a>{sock_recvmsg+330}
<ffffffff80130c68>{__wake_up_common+56}
Aug 10 16:55:33 toonses kernel:
<ffffffffa0708be1>{:ksocknal:ksocknal_recv_pages+257}
Aug 10 16:55:33 toonses kernel:
<ffffffffa06eb2a2>{:portals:lib_recv+130}
<ffffffffa06f0335>{:portals:parse_put+1301}
Aug 10 16:55:33 toonses kernel:
<ffffffff80135aa0>{autoremove_wake_function+0}
<ffffffffa06f2a90>{:portals:lib_finalize+1568}
Aug 10 16:55:33 toonses kernel:
<ffffffffa0707838>{:ksocknal:ksocknal_recv_kiov+376}
Aug 10 16:55:33 toonses kernel:
<ffffffffa070ae9e>{:ksocknal:ksocknal_receive+366}
Aug 10 16:55:33 toonses kernel:
<ffffffffa070b0b8>{:ksocknal:ksocknal_process_receive+200}
Aug 10 16:55:33 toonses kernel:
<ffffffffa070aff2>{:ksocknal:ksocknal_process_receive+2}
Aug 10 16:55:33 toonses kernel:
<ffffffffa070d45c>{:ksocknal:ksocknal_scheduler+284}
Aug 10 16:55:33 toonses kernel:
<ffffffff80135aa0>{autoremove_wake_function+0}
<ffffffff80135aa0>{autoremove_wake_function+0}
Aug 10 16:55:33 toonses kernel:
<ffffffffa06e1780>{:portals:kportal_daemonize+0}
<ffffffff80110d6f>{child_rip+8}
Aug 10 16:55:33 toonses kernel:
<ffffffffa06e1780>{:portals:kportal_daemonize+0}
<ffffffffa070d340>{:ksocknal:ksocknal_scheduler+0}
Aug 10 16:55:33 toonses kernel: <ffffffff80110d67>{child_rip+0}
Aug 10 16:55:33 toonses kernel: eth1: receive_packet: Unable to re-allocate Rx
skbuff.#223
Aug 10 16:55:33 toonses kernel: ksocknald_00: page allocation failure. order:0,
mode:0x20
Aug 10 16:55:33 toonses kernel:
Aug 10 16:55:33 toonses kernel: Call Trace:<IRQ>
<ffffffff8015f7ba>{__alloc_pages+778}
<ffffffff8015f861>{__get_free_pages+33}
Aug 10 16:55:33 toonses kernel:
<ffffffff801625cb>{cache_alloc_refill+555}
<ffffffff80162913>{__kmalloc+83}
Aug 10 16:55:33 toonses kernel: <ffffffff802c7ca1>{alloc_skb+81}
<ffffffffa015d637>{:dl2k:rio_interrupt+839}
Aug 10 16:55:33 toonses kernel:
<ffffffff8011328f>{handle_IRQ_event+47}
<ffffffff80113353>{do_IRQ+147}
Aug 10 16:55:33 toonses kernel: <ffffffff801108fd>{ret_from_intr+0}
<EOI> <ffffffffa02a606b>{:nvidia:_nv002166rm+39}
Aug 10 16:55:33 toonses kernel:
<ffffffffa015cbef>{:dl2k:start_xmit+415}
<ffffffffa015cb2e>{:dl2k:start_xmit+222}
Aug 10 16:55:33 toonses kernel:
<ffffffff802da081>{qdisc_restart+97}
<ffffffffa02a606b>{:nvidia:_nv002166rm+39}
Aug 10 16:55:33 toonses kernel:
<ffffffff802cb8af>{dev_queue_xmit+223}
<ffffffff802e969a>{ip_finish_output+378}
Aug 10 16:55:33 toonses kernel: <ffffffff802e9888>{ip_output+200}
<ffffffff802e7099>{ip_dst_output+57}
Aug 10 16:55:33 toonses kernel:
<ffffffff802e8f96>{ip_queue_xmit+1158}
<ffffffffa03dad98>{:nvidia:_nv004528rm+28}
Aug 10 16:55:33 toonses kernel:
<ffffffffa03da4e2>{:nvidia:_nv004371rm+124}
<ffffffffa02b8b69>{:nvidia:rm_enable_interrupts+67}
Aug 10 16:55:33 toonses kernel: <ffffffff80218cbe>{csum_partial+78}
<ffffffff802f7d76>{tcp_transmit_skb+1462}
Aug 10 16:55:33 toonses kernel:
<ffffffff802f67df>{tcp_rcv_established+1711}
<ffffffff802fd765>{tcp_v4_do_rcv+53}
Aug 10 16:55:33 toonses kernel:
<ffffffff802c4ee9>{__release_sock+41}
<ffffffff802c4ef9>{__release_sock+57}
Aug 10 16:55:33 toonses kernel: <ffffffff802c52a6>{release_sock+38}
<ffffffff802ee417>{tcp_recvmsg+1943}
Aug 10 16:55:33 toonses kernel: <ffffffff8030b2b3>{inet_recvmsg+51}
<ffffffff802c2a4a>{sock_recvmsg+330}
Aug 10 16:55:33 toonses kernel:
<ffffffff80130c68>{__wake_up_common+56}
<ffffffffa0708be1>{:ksocknal:ksocknal_recv_pages+257}
Aug 10 16:55:33 toonses kernel:
<ffffffffa06eb2a2>{:portals:lib_recv+130}
<ffffffffa06f0335>{:portals:parse_put+1301}
Aug 10 16:55:33 toonses kernel:
<ffffffff80135aa0>{autoremove_wake_function+0}
<ffffffffa06f2a90>{:portals:lib_finalize+1568}
Aug 10 16:55:33 toonses kernel:
<ffffffffa0707838>{:ksocknal:ksocknal_recv_kiov+376}
Aug 10 16:55:33 toonses kernel:
<ffffffffa070ae9e>{:ksocknal:ksocknal_receive+366}
Aug 10 16:55:33 toonses kernel:
<ffffffffa070b0b8>{:ksocknal:ksocknal_process_receive+200}
Aug 10 16:55:33 toonses kernel:
<ffffffffa070aff2>{:ksocknal:ksocknal_process_receive+2}
Aug 10 16:55:33 toonses kernel:
<ffffffffa070d45c>{:ksocknal:ksocknal_scheduler+284}
Aug 10 16:55:33 toonses kernel:
<ffffffff80135aa0>{autoremove_wake_function+0}
<ffffffff80135aa0>{autoremove_wake_function+0}
Aug 10 16:55:33 toonses kernel:
<ffffffffa06e1780>{:portals:kportal_daemonize+0}
<ffffffff80110d6f>{child_rip+8}
Aug 10 16:55:33 toonses kernel:
<ffffffffa06e1780>{:portals:kportal_daemonize+0}
<ffffffffa070d340>{:ksocknal:ksocknal_scheduler+0}
Aug 10 16:55:33 toonses kernel: <ffffffff80110d67>{child_rip+0}
Aug 10 16:55:33 toonses kernel: eth1: receive_packet: Unable to re-allocate Rx
skbuff.#223
Aug 10 16:55:33 toonses kernel: ksocknald_00: page allocation failure. order:0,
mode:0x20
Aug 10 16:55:33 toonses kernel:
Aug 10 16:55:33 toonses kernel: Call Trace:<IRQ>
<ffffffff8015f7ba>{__alloc_pages+778}
<ffffffff8015f861>{__get_free_pages+33}
Aug 10 16:55:33 toonses kernel:
<ffffffff801625cb>{cache_alloc_refill+555}
<ffffffff80162913>{__kmalloc+83}
Aug 10 16:55:33 toonses kernel: <ffffffff802c7ca1>{alloc_skb+81}
<ffffffffa015d637>{:dl2k:rio_interrupt+839}
Aug 10 16:55:33 toonses kernel:
<ffffffff8011328f>{handle_IRQ_event+47}
<ffffffff80113353>{do_IRQ+147}
Aug 10 16:55:33 toonses kernel: <ffffffff801108fd>{ret_from_intr+0}
<EOI> <ffffffffa02a606b>{:nvidia:_nv002166rm+39}
Aug 10 16:55:33 toonses kernel:
<ffffffffa015cbef>{:dl2k:start_xmit+415}
<ffffffffa015cb2e>{:dl2k:start_xmit+222}
Aug 10 16:55:33 toonses kernel:
<ffffffff802da081>{qdisc_restart+97}
<ffffffffa02a606b>{:nvidia:_nv002166rm+39}
Aug 10 16:55:33 toonses kernel:
<ffffffff802cb8af>{dev_queue_xmit+223}
<ffffffff802e969a>{ip_finish_output+378}
Aug 10 16:55:33 toonses kernel: <ffffffff802e9888>{ip_output+200}
<ffffffff802e7099>{ip_dst_output+57}
Aug 10 16:55:33 toonses kernel:
<ffffffff802e8f96>{ip_queue_xmit+1158}
<ffffffffa03dad98>{:nvidia:_nv004528rm+28}
Aug 10 16:55:33 toonses kernel:
<ffffffffa03da4e2>{:nvidia:_nv004371rm+124}
<ffffffffa02b8b69>{:nvidia:rm_enable_interrupts+67}
Aug 10 16:55:33 toonses kernel: <ffffffff80218cbe>{csum_partial+78}
<ffffffff802f7d76>{tcp_transmit_skb+1462}
Aug 10 16:55:33 toonses kernel:
<ffffffff802f67df>{tcp_rcv_established+1711}
<ffffffff802fd765>{tcp_v4_do_rcv+53}
Aug 10 16:55:33 toonses kernel:
<ffffffff802c4ee9>{__release_sock+41}
<ffffffff802c4ef9>{__release_sock+57}
Aug 10 16:55:33 toonses kernel: <ffffffff802c52a6>{release_sock+38}
<ffffffff802ee417>{tcp_recvmsg+1943}
Aug 10 16:55:33 toonses kernel: <ffffffff8030b2b3>{inet_recvmsg+51}
<ffffffff802c2a4a>{sock_recvmsg+330}
Aug 10 16:55:33 toonses kernel:
<ffffffff80130c68>{__wake_up_common+56}
<ffffffffa0708be1>{:ksocknal:ksocknal_recv_pages+257}
Aug 10 16:55:33 toonses kernel:
<ffffffffa06eb2a2>{:portals:lib_recv+130}
<ffffffffa06f0335>{:portals:parse_put+1301}
Aug 10 16:55:33 toonses kernel:
<ffffffff80135aa0>{autoremove_wake_function+0}
<ffffffffa06f2a90>{:portals:lib_finalize+1568}
Aug 10 16:55:33 toonses kernel:
<ffffffffa0707838>{:ksocknal:ksocknal_recv_kiov+376}
Aug 10 16:55:33 toonses kernel:
<ffffffffa070ae9e>{:ksocknal:ksocknal_receive+366}
Aug 10 16:55:33 toonses kernel:
<ffffffffa070b0b8>{:ksocknal:ksocknal_process_receive+200}
Aug 10 16:55:33 toonses kernel:
<ffffffffa070aff2>{:ksocknal:ksocknal_process_receive+2}
Aug 10 16:55:33 toonses kernel:
<ffffffffa070d45c>{:ksocknal:ksocknal_scheduler+284}
Aug 10 16:55:33 toonses kernel:
<ffffffff80135aa0>{autoremove_wake_function+0}
<ffffffff80135aa0>{autoremove_wake_function+0}
Aug 10 16:55:33 toonses kernel:
<ffffffffa06e1780>{:portals:kportal_daemonize+0}
<ffffffff80110d6f>{child_rip+8}
Aug 10 16:55:33 toonses kernel:
<ffffffffa06e1780>{:portals:kportal_daemonize+0}
<ffffffffa070d340>{:ksocknal:ksocknal_scheduler+0}
Aug 10 16:55:33 toonses kernel: <ffffffff80110d67>{child_rip+0}
Aug 10 16:55:33 toonses kernel: eth1: receive_packet: Unable to re-allocate Rx
skbuff.#223
Aug 10 16:55:33 toonses kernel: ksocknald_00: page allocation failure. order:0,
mode:0x20
Aug 10 16:55:33 toonses kernel:
Aug 10 16:55:33 toonses kernel: Call Trace:<IRQ>
<ffffffff8015f7ba>{__alloc_pages+778}
<ffffffff8015f861>{__get_free_pages+33}
Aug 10 16:55:33 toonses kernel:
<ffffffff801625cb>{cache_alloc_refill+555}
<ffffffff80162913>{__kmalloc+83}
Aug 10 16:55:33 toonses kernel: <ffffffff802c7ca1>{alloc_skb+81}
<ffffffffa015d637>{:dl2k:rio_interrupt+839}
Aug 10 16:55:33 toonses kernel:
<ffffffff8011328f>{handle_IRQ_event+47}
<ffffffff80113353>{do_IRQ+147}
Aug 10 16:55:33 toonses kernel: <ffffffff801108fd>{ret_from_intr+0}
<EOI> <ffffffffa02a606b>{:nvidia:_nv002166rm+39}
Aug 10 16:55:33 toonses kernel:
<ffffffffa015cbef>{:dl2k:start_xmit+415}
<ffffffffa015cb2e>{:dl2k:start_xmit+222}
Aug 10 16:55:33 toonses kernel:
<ffffffff802da081>{qdisc_restart+97}
<ffffffffa02a606b>{:nvidia:_nv002166rm+39}
Aug 10 16:55:33 toonses kernel:
<ffffffff802cb8af>{dev_queue_xmit+223}
<ffffffff802e969a>{ip_finish_output+378}
Aug 10 16:55:33 toonses kernel: <ffffffff802e9888>{ip_output+200}
<ffffffff802e7099>{ip_dst_output+57}
Aug 10 16:55:33 toonses kernel:
<ffffffff802e8f96>{ip_queue_xmit+1158}
<ffffffffa03dad98>{:nvidia:_nv004528rm+28}
Aug 10 16:55:33 toonses kernel:
<ffffffffa03da4e2>{:nvidia:_nv004371rm+124}
<ffffffffa02b8b69>{:nvidia:rm_enable_interrupts+67}
Aug 10 16:55:33 toonses kernel: <ffffffff80218cbe>{csum_partial+78}
<ffffffff802f7d76>{tcp_transmit_skb+1462}
Aug 10 16:55:33 toonses kernel:
<ffffffff802f67df>{tcp_rcv_established+1711}
<ffffffff802fd765>{tcp_v4_do_rcv+53}
Aug 10 16:55:33 toonses kernel:
<ffffffff802c4ee9>{__release_sock+41}
<ffffffff802c4ef9>{__release_sock+57}
Aug 10 16:55:33 toonses kernel: <ffffffff802c52a6>{release_sock+38}
<ffffffff802ee417>{tcp_recvmsg+1943}
Aug 10 16:55:33 toonses kernel: <ffffffff8030b2b3>{inet_recvmsg+51}
<ffffffff802c2a4a>{sock_recvmsg+330}
Aug 10 16:55:33 toonses kernel:
<ffffffff80130c68>{__wake_up_common+56}
<ffffffffa0708be1>{:ksocknal:ksocknal_recv_pages+257}
Aug 10 16:55:33 toonses kernel:
<ffffffffa06eb2a2>{:portals:lib_recv+130}
<ffffffffa06f0335>{:portals:parse_put+1301}
Aug 10 16:55:33 toonses kernel:
<ffffffff80135aa0>{autoremove_wake_function+0}
<ffffffffa06f2a90>{:portals:lib_finalize+1568}
Aug 10 16:55:33 toonses kernel:
<ffffffffa0707838>{:ksocknal:ksocknal_recv_kiov+376}
Aug 10 16:55:33 toonses kernel:
<ffffffffa070ae9e>{:ksocknal:ksocknal_receive+366}
Aug 10 16:55:33 toonses kernel:
<ffffffffa070b0b8>{:ksocknal:ksocknal_process_receive+200}
Aug 10 16:55:33 toonses kernel:
<ffffffffa070aff2>{:ksocknal:ksocknal_process_receive+2}
Aug 10 16:55:33 toonses kernel:
<ffffffffa070d45c>{:ksocknal:ksocknal_scheduler+284}
Aug 10 16:55:33 toonses kernel:
<ffffffff80135aa0>{autoremove_wake_function+0}
<ffffffff80135aa0>{autoremove_wake_function+0}
Aug 10 16:55:33 toonses kernel:
<ffffffffa06e1780>{:portals:kportal_daemonize+0}
<ffffffff80110d6f>{child_rip+8}
Aug 10 16:55:33 toonses kernel:
<ffffffffa06e1780>{:portals:kportal_daemonize+0}
<ffffffffa070d340>{:ksocknal:ksocknal_scheduler+0}
Aug 10 16:55:33 toonses kernel: <ffffffff80110d67>{child_rip+0}
Aug 10 16:55:33 toonses kernel: eth1: receive_packet: Unable to re-allocate Rx
skbuff.#223
Aug 10 16:55:33 toonses kernel: ksocknald_00: page allocation failure. order:0,
mode:0x20
Aug 10 16:55:33 toonses kernel:
Aug 10 16:55:33 toonses kernel: Call Trace:<IRQ>
<ffffffff8015f7ba>{__alloc_pages+778}
<ffffffff8015f861>{__get_free_pages+33}
Aug 10 16:55:33 toonses kernel:
<ffffffff801625cb>{cache_alloc_refill+555}
<ffffffff80162913>{__kmalloc+83}
Aug 10 16:55:33 toonses kernel: <ffffffff802c7ca1>{alloc_skb+81}
<ffffffffa015d637>{:dl2k:rio_interrupt+839}
Aug 10 16:55:33 toonses kernel:
<ffffffff8011328f>{handle_IRQ_event+47}
<ffffffff80113353>{do_IRQ+147}
Aug 10 16:55:33 toonses kernel: <ffffffff801108fd>{ret_from_intr+0}
<EOI> <ffffffffa02a606b>{:nvidia:_nv002166rm+39}
Aug 10 16:55:33 toonses kernel:
<ffffffffa015cb90>{:dl2k:start_xmit+320}
<ffffffffa015cb2e>{:dl2k:start_xmit+222}
Aug 10 16:55:33 toonses kernel:
<ffffffff802da081>{qdisc_restart+97}
<ffffffffa02a606b>{:nvidia:_nv002166rm+39}
Aug 10 16:55:33 toonses kernel:
<ffffffff802cb8af>{dev_queue_xmit+223}
<ffffffff802e969a>{ip_finish_output+378}
Aug 10 16:55:33 toonses kernel: <ffffffff802e9888>{ip_output+200}
<ffffffff802e7099>{ip_dst_output+57}
Aug 10 16:55:33 toonses kernel:
<ffffffff802e8f96>{ip_queue_xmit+1158}
<ffffffffa03dad98>{:nvidia:_nv004528rm+28}
Aug 10 16:55:33 toonses kernel:
<ffffffffa03da4e2>{:nvidia:_nv004371rm+124}
<ffffffffa02b8b69>{:nvidia:rm_enable_interrupts+67}
Aug 10 16:55:33 toonses kernel:
<ffffffff8021904f>{csum_partial+991}
<ffffffff802f7d76>{tcp_transmit_skb+1462}
Aug 10 16:55:33 toonses kernel:
<ffffffff802f6550>{tcp_rcv_established+1056}
<ffffffff802fd765>{tcp_v4_do_rcv+53}
Aug 10 16:55:33 toonses kernel:
<ffffffff802c4ee9>{__release_sock+41}
<ffffffff802c4ef9>{__release_sock+57}
Aug 10 16:55:33 toonses kernel: <ffffffff802c52a6>{release_sock+38}
<ffffffff802ee417>{tcp_recvmsg+1943}
Aug 10 16:55:33 toonses kernel: <ffffffff8030b2b3>{inet_recvmsg+51}
<ffffffff802c2a4a>{sock_recvmsg+330}
Aug 10 16:55:33 toonses kernel:
<ffffffff80130c68>{__wake_up_common+56}
<ffffffffa0708be1>{:ksocknal:ksocknal_recv_pages+257}
Aug 10 16:55:33 toonses kernel:
<ffffffffa06eb2a2>{:portals:lib_recv+130}
<ffffffffa06f0335>{:portals:parse_put+1301}
Aug 10 16:55:33 toonses kernel:
<ffffffff80135aa0>{autoremove_wake_function+0}
<ffffffffa06f2a90>{:portals:lib_finalize+1568}
Aug 10 16:55:33 toonses kernel:
<ffffffffa0707838>{:ksocknal:ksocknal_recv_kiov+376}
Aug 10 16:55:33 toonses kernel:
<ffffffffa070ae9e>{:ksocknal:ksocknal_receive+366}
Aug 10 16:55:33 toonses kernel:
<ffffffffa070b0b8>{:ksocknal:ksocknal_process_receive+200}
Aug 10 16:55:33 toonses kernel:
<ffffffffa070aff2>{:ksocknal:ksocknal_process_receive+2}
Aug 10 16:55:33 toonses kernel:
<ffffffffa070d45c>{:ksocknal:ksocknal_scheduler+284}
Aug 10 16:55:33 toonses kernel:
<ffffffff80135aa0>{autoremove_wake_function+0}
<ffffffff80135aa0>{autoremove_wake_function+0}
Aug 10 16:55:33 toonses kernel:
<ffffffffa06e1780>{:portals:kportal_daemonize+0}
<ffffffff80110d6f>{child_rip+8}
Aug 10 16:55:33 toonses kernel:
<ffffffffa06e1780>{:portals:kportal_daemonize+0}
<ffffffffa070d340>{:ksocknal:ksocknal_scheduler+0}
Aug 10 16:55:33 toonses kernel: <ffffffff80110d67>{child_rip+0}
Aug 10 16:55:33 toonses kernel: eth1: receive_packet: Unable to re-allocate Rx
skbuff.#224
Aug 10 16:55:33 toonses kernel: ksocknald_00: page allocation failure. order:0,
mode:0x20
Aug 10 16:55:33 toonses kernel:
Aug 10 16:55:33 toonses kernel: Call Trace:<IRQ>
<ffffffff8015f7ba>{__alloc_pages+778}
<ffffffff8015f861>{__get_free_pages+33}
Aug 10 16:55:33 toonses kernel:
<ffffffff801625cb>{cache_alloc_refill+555}
<ffffffff80162913>{__kmalloc+83}
Aug 10 16:55:33 toonses kernel: <ffffffff802c7ca1>{alloc_skb+81}
<ffffffffa015d637>{:dl2k:rio_interrupt+839}
Aug 10 16:55:33 toonses kernel:
<ffffffff8011328f>{handle_IRQ_event+47}
<ffffffff80113353>{do_IRQ+147}
Aug 10 16:55:33 toonses kernel: <ffffffff801108fd>{ret_from_intr+0}
<EOI> <ffffffffa02a606b>{:nvidia:_nv002166rm+39}
Aug 10 16:55:33 toonses kernel:
<ffffffffa015cb90>{:dl2k:start_xmit+320}
<ffffffffa015cb2e>{:dl2k:start_xmit+222}
Aug 10 16:55:33 toonses kernel:
<ffffffff802da081>{qdisc_restart+97}
<ffffffffa02a606b>{:nvidia:_nv002166rm+39}
Aug 10 16:55:33 toonses kernel:
<ffffffff802cb8af>{dev_queue_xmit+223}
<ffffffff802e969a>{ip_finish_output+378}
Aug 10 16:55:33 toonses kernel: <ffffffff802e9888>{ip_output+200}
<ffffffff802e7099>{ip_dst_output+57}
Aug 10 16:55:33 toonses kernel:
<ffffffff802e8f96>{ip_queue_xmit+1158}
<ffffffffa03dad98>{:nvidia:_nv004528rm+28}
Aug 10 16:55:33 toonses kernel:
<ffffffffa03da4e2>{:nvidia:_nv004371rm+124}
<ffffffffa02b8b69>{:nvidia:rm_enable_interrupts+67}
Aug 10 16:55:33 toonses kernel:
<ffffffff8021904f>{csum_partial+991}
<ffffffff802f7d76>{tcp_transmit_skb+1462}
Aug 10 16:55:33 toonses kernel:
<ffffffff802f6550>{tcp_rcv_established+1056}
<ffffffff802fd765>{tcp_v4_do_rcv+53}
Aug 10 16:55:33 toonses kernel:
<ffffffff802c4ee9>{__release_sock+41}
<ffffffff802c4ef9>{__release_sock+57}
Aug 10 16:55:33 toonses kernel: <ffffffff802c52a6>{release_sock+38}
<ffffffff802ee417>{tcp_recvmsg+1943}
Aug 10 16:55:33 toonses kernel: <ffffffff8030b2b3>{inet_recvmsg+51}
<ffffffff802c2a4a>{sock_recvmsg+330}
Aug 10 16:55:33 toonses kernel:
<ffffffff80130c68>{__wake_up_common+56}
<ffffffffa0708be1>{:ksocknal:ksocknal_recv_pages+257}
Aug 10 16:55:33 toonses kernel:
<ffffffffa06eb2a2>{:portals:lib_recv+130}
<ffffffffa06f0335>{:portals:parse_put+1301}
Aug 10 16:55:33 toonses kernel:
<ffffffff80135aa0>{autoremove_wake_function+0}
<ffffffffa06f2a90>{:portals:lib_finalize+1568}
Aug 10 16:55:33 toonses kernel:
<ffffffffa0707838>{:ksocknal:ksocknal_recv_kiov+376}
Aug 10 16:55:33 toonses kernel:
<ffffffffa070ae9e>{:ksocknal:ksocknal_receive+366}
Aug 10 16:55:33 toonses kernel:
<ffffffffa070b0b8>{:ksocknal:ksocknal_process_receive+200}
Aug 10 16:55:33 toonses kernel:
<ffffffffa070aff2>{:ksocknal:ksocknal_process_receive+2}
Aug 10 16:55:33 toonses kernel:
<ffffffffa070d45c>{:ksocknal:ksocknal_scheduler+284}
Aug 10 16:55:33 toonses kernel:
<ffffffff80135aa0>{autoremove_wake_function+0}
<ffffffff80135aa0>{autoremove_wake_function+0}
Aug 10 16:55:33 toonses kernel:
<ffffffffa06e1780>{:portals:kportal_daemonize+0}
<ffffffff80110d6f>{child_rip+8}
Aug 10 16:55:33 toonses kernel:
<ffffffffa06e1780>{:portals:kportal_daemonize+0}
<ffffffffa070d340>{:ksocknal:ksocknal_scheduler+0}
Aug 10 16:55:33 toonses kernel: <ffffffff80110d67>{child_rip+0}
Aug 10 16:55:33 toonses kernel: eth1: receive_packet: Unable to re-allocate Rx
skbuff.#224
Aug 10 16:55:33 toonses kernel: ksocknald_00: page allocation failure. order:0,
mode:0x20
Aug 10 16:55:33 toonses kernel:
Aug 10 16:55:33 toonses kernel: Call Trace:<IRQ>
<ffffffff8015f7ba>{__alloc_pages+778}
<ffffffff8015f861>{__get_free_pages+33}
Aug 10 16:55:33 toonses kernel:
<ffffffff801625cb>{cache_alloc_refill+555}
<ffffffff80162913>{__kmalloc+83}
Aug 10 16:55:33 toonses kernel: <ffffffff802c7ca1>{alloc_skb+81}
<ffffffffa015d637>{:dl2k:rio_interrupt+839}
Aug 10 16:55:33 toonses kernel:
<ffffffff8011328f>{handle_IRQ_event+47}
<ffffffff80113353>{do_IRQ+147}
Aug 10 16:55:33 toonses kernel: <ffffffff801108fd>{ret_from_intr+0}
<EOI> <ffffffffa02a606b>{:nvidia:_nv002166rm+39}
Aug 10 16:55:33 toonses kernel:
<ffffffffa015cb87>{:dl2k:start_xmit+311}
<ffffffffa015cb2e>{:dl2k:start_xmit+222}
Aug 10 16:55:33 toonses kernel:
<ffffffff802da081>{qdisc_restart+97}
<ffffffffa02a606b>{:nvidia:_nv002166rm+39}
Aug 10 16:55:33 toonses kernel:
<ffffffff802cb8af>{dev_queue_xmit+223}
<ffffffff802e969a>{ip_finish_output+378}
Aug 10 16:55:33 toonses kernel: <ffffffff802e9888>{ip_output+200}
<ffffffff802e7099>{ip_dst_output+57}
Aug 10 16:55:33 toonses kernel:
<ffffffff802e8f96>{ip_queue_xmit+1158}
<ffffffffa03dad98>{:nvidia:_nv004528rm+28}
Aug 10 16:55:33 toonses kernel:
<ffffffffa03da4e2>{:nvidia:_nv004371rm+124}
<ffffffffa02b8b69>{:nvidia:rm_enable_interrupts+67}
Aug 10 16:55:33 toonses kernel:
<ffffffff80219028>{csum_partial+952}
<ffffffff802f7d76>{tcp_transmit_skb+1462}
Aug 10 16:55:33 toonses kernel:
<ffffffff802f67df>{tcp_rcv_established+1711}
<ffffffff802fd765>{tcp_v4_do_rcv+53}
Aug 10 16:55:33 toonses kernel:
<ffffffff802c4ee9>{__release_sock+41}
<ffffffff802c4ef9>{__release_sock+57}
Aug 10 16:55:33 toonses kernel: <ffffffff802c52a6>{release_sock+38}
<ffffffff802ee417>{tcp_recvmsg+1943}
Aug 10 16:55:33 toonses kernel: <ffffffff8030b2b3>{inet_recvmsg+51}
<ffffffff802c2a4a>{sock_recvmsg+330}
Aug 10 16:55:33 toonses kernel:
<ffffffff80130c68>{__wake_up_common+56}
<ffffffffa0708be1>{:ksocknal:ksocknal_recv_pages+257}
Aug 10 16:55:33 toonses kernel:
<ffffffffa06eb2a2>{:portals:lib_recv+130}
<ffffffffa06f0335>{:portals:parse_put+1301}
Aug 10 16:55:33 toonses kernel:
<ffffffff80135aa0>{autoremove_wake_function+0}
<ffffffffa06f2a90>{:portals:lib_finalize+1568}
Aug 10 16:55:33 toonses kernel:
<ffffffffa0707838>{:ksocknal:ksocknal_recv_kiov+376}
Aug 10 16:55:33 toonses kernel:
<ffffffffa070ae9e>{:ksocknal:ksocknal_receive+366}
Aug 10 16:55:33 toonses kernel:
<ffffffffa070b0b8>{:ksocknal:ksocknal_process_receive+200}
Aug 10 16:55:33 toonses kernel:
<ffffffffa070aff2>{:ksocknal:ksocknal_process_receive+2}
Aug 10 16:55:33 toonses kernel:
<ffffffffa070d45c>{:ksocknal:ksocknal_scheduler+284}
Aug 10 16:55:33 toonses kernel:
<ffffffff80135aa0>{autoremove_wake_function+0}
<ffffffff80135aa0>{autoremove_wake_function+0}
Aug 10 16:55:33 toonses kernel:
<ffffffffa06e1780>{:portals:kportal_daemonize+0}
<ffffffff80110d6f>{child_rip+8}
Aug 10 16:55:33 toonses kernel:
<ffffffffa06e1780>{:portals:kportal_daemonize+0}
<ffffffffa070d340>{:ksocknal:ksocknal_scheduler+0}
Aug 10 16:55:33 toonses kernel: <ffffffff80110d67>{child_rip+0}
Aug 10 16:55:33 toonses kernel: eth1: receive_packet: Unable to re-allocate Rx
skbuff.#224
Aug 10 16:55:33 toonses kernel: eth1: receive_packet: Unable to re-allocate Rx
skbuff.#224
Aug 10 16:55:39 toonses kernel: printk: 1 messages suppressed.
Aug 10 16:55:39 toonses kernel: ksocknald_00: page allocation failure. order:0,
mode:0x20
Aug 10 16:55:39 toonses kernel:
Aug 10 16:55:39 toonses kernel: Call Trace:<IRQ>
<ffffffff8015f7ba>{__alloc_pages+778}
<ffffffff80116364>{timer_interrupt+484}
Aug 10 16:55:39 toonses kernel:
<ffffffff8015f861>{__get_free_pages+33}
<ffffffff801625cb>{cache_alloc_refill+555}
Aug 10 16:55:39 toonses kernel: <ffffffff80113382>{do_IRQ+194}
<ffffffff80162913>{__kmalloc+83}
Aug 10 16:55:39 toonses kernel: <ffffffff802c7ca1>{alloc_skb+81}
<ffffffffa015d637>{:dl2k:rio_interrupt+839}
Aug 10 16:55:39 toonses kernel:
<ffffffff8011328f>{handle_IRQ_event+47}
<ffffffff80113353>{do_IRQ+147}
Aug 10 16:55:39 toonses kernel: <ffffffff801108fd>{ret_from_intr+0}
<EOI> <ffffffff802c72d3>{kfree_skbmem+19}
Aug 10 16:55:39 toonses kernel: <ffffffff802c72c9>{kfree_skbmem+9}
<ffffffff802ca289>{net_tx_action+105}
Aug 10 16:55:39 toonses kernel: <ffffffff8013a603>{__do_softirq+83}
<ffffffff8013a695>{do_softirq+53}
Aug 10 16:55:39 toonses kernel:
<ffffffff802f5110>{__tcp_checksum_complete_user+16}
Aug 10 16:55:39 toonses kernel:
<ffffffff802f63c6>{tcp_rcv_established+662}
<ffffffff802fd765>{tcp_v4_do_rcv+53}
Aug 10 16:55:39 toonses kernel:
<ffffffff802c4ee9>{__release_sock+41}
<ffffffff802c4ef9>{__release_sock+57}
Aug 10 16:55:39 toonses kernel: <ffffffff802c52a6>{release_sock+38}
<ffffffff802ee417>{tcp_recvmsg+1943}
Aug 10 16:55:39 toonses kernel: <ffffffff8030b2b3>{inet_recvmsg+51}
<ffffffff802c2a4a>{sock_recvmsg+330}
Aug 10 16:55:39 toonses kernel:
<ffffffffa06ea108>{:portals:lib_me_unlink+312}
<ffffffff80135aa0>{autoremove_wake_function+0}
Aug 10 16:55:39 toonses kernel:
<ffffffff80135aa0>{autoremove_wake_function+0}
<ffffffffa06e9618>{:portals:lib_md_unlink+888}
Aug 10 16:55:39 toonses kernel:
<ffffffffa07079ff>{:ksocknal:ksocknal_recv_iov+271}
Aug 10 16:55:39 toonses kernel:
<ffffffffa070ae94>{:ksocknal:ksocknal_receive+356}
Aug 10 16:55:39 toonses kernel: <ffffffff801331a7>{thread_return+0}
<ffffffffa070b0b8>{:ksocknal:ksocknal_process_receive+200}
Aug 10 16:55:39 toonses kernel:
<ffffffffa070d45c>{:ksocknal:ksocknal_scheduler+284}
Aug 10 16:55:39 toonses kernel:
<ffffffff80135aa0>{autoremove_wake_function+0}
<ffffffff80135aa0>{autoremove_wake_function+0}
Aug 10 16:55:39 toonses kernel:
<ffffffffa06e1780>{:portals:kportal_daemonize+0}
<ffffffff80110d6f>{child_rip+8}
Aug 10 16:55:39 toonses kernel:
<ffffffffa06e1780>{:portals:kportal_daemonize+0}
<ffffffffa070d340>{:ksocknal:ksocknal_scheduler+0}
Aug 10 16:55:39 toonses kernel: <ffffffff80110d67>{child_rip+0}
Aug 10 16:55:39 toonses kernel: eth1: receive_packet: Unable to re-allocate Rx
skbuff.#151
Aug 10 16:55:39 toonses kernel: eth1: receive_packet: Unable to re-allocate Rx
skbuff.#151
Aug 10 16:55:39 toonses kernel: eth1: receive_packet: Unable to re-allocate Rx
skbuff.#220