Jean-Luc Dupont
2012-Aug-30 14:34 UTC
Kernel Panic on 9.0 and 9.1 with carp on BCE network interface
Hello,
We are using Freebsd 9.0 on dell poweredge servers with broadcom (bce)
integrated interfaces and intel pci-x cards.
This server is used as gateway/firewall (IPFW) with several VLANs and each
interface and carp for redundancy with another identical server.
We encounter a kernel panic and reboot when some users connect to an external
FTP (just after
accepting the password).
We upgraded to 9.1-prerelease and 9.1-stable, without any change, still same
systematic panic.
Here is the backtrace :
cpuid = 3
KDB: stack backtrace:
#0 0xffffffff808342b6 at kdb_backtrace+0x66
#1 0xffffffff807fe40d at panic+0x1cd
#2 0xffffffff80a21c6f at ufs_dirbad+0x4f
#3 0xffffffff80a2334a at ufs_lookup_ino+0x68a
#4 0xffffffff8088077f at vfs_cache_lookup+0xff
#5 0xffffffff80b3b380 at VOP_LOOKUP_APV+0x40
#6 0xffffffff80887e94 at lookup+0x464
#7 0xffffffff80888fa9 at namei+0x4e9
#8 0xffffffff808a307b at vn_open_cred+0x3bb
#9 0xffffffff808a2117 at kern_openat+0x1e7
#10 0xffffffff80ad1fa6 at amd64_syscall+0x546
#11 0xffffffff80abd967 at Xfast_syscall+0xf7
Uptime: 6m4s
(kgdb) #0 doadump (textdump=Variable "textdump" is not available.
) at /usr/src/sys/kern/kern_shutdown.c:271
#1 0xffffffff807fdf02 in kern_reboot (howto=260)
at /usr/src/sys/kern/kern_shutdown.c:448
#2 0xffffffff807fe3e3 in panic (fmt=0x104 <Address 0x104 out of bounds>)
at /usr/src/sys/kern/kern_shutdown.c:636
#3 0xffffffff80a21c6f in ufs_dirbad (ip=Variable "ip" is not
available.
)
at /usr/src/sys/ufs/ufs/ufs_lookup.c:773
#4 0xffffffff80a2334a in ufs_lookup_ino (vdp=0xfffffe00b0aee5a0,
vpp=0xffffff834bb30a10, cnp=0xffffff834bb30a38, dd_ino=0x0)
at /usr/src/sys/ufs/ufs/ufs_lookup.c:393
#5 0xffffffff8088077f in vfs_cache_lookup (ap=Variable "ap" is not
available.
) at vnode_if.h:80
#6 0xffffffff80b3b380 in VOP_LOOKUP_APV (vop=0xffffffff8104e960,
a=0xffffff834bb306f0) at vnode_if.c:123
#7 0xffffffff80887e94 in lookup (ndp=0xffffff834bb309d0) at vnode_if.h:54
#8 0xffffffff80888fa9 in namei (ndp=0xffffff834bb309d0)
at /usr/src/sys/kern/vfs_lookup.c:297
#9 0xffffffff808a307b in vn_open_cred (ndp=0xffffff834bb309d0,
flagp=0xffffff834bb309cc, cmode=0, vn_open_flags=Variable
"vn_open_flags" is not available.
)
at /usr/src/sys/kern/vfs_vnops.c:195
#10 0xffffffff808a2117 in kern_openat (td=0xfffffe000ff75470, fd=-100,
path=0x809ff80c0 <Address 0x809ff80c0 out of bounds>,
pathseg=UIO_USERSPACE, flags=1, mode=Variable "mode" is not
available.
)
at /usr/src/sys/kern/vfs_syscalls.c:1132
#11 0xffffffff80ad1fa6 in amd64_syscall (td=0xfffffe000ff75470, traced=0)
at subr_syscall.c:135
#12 0xffffffff80abd967 in Xfast_syscall ()
at /usr/src/sys/amd64/amd64/exception.S:387
#13 0x0000000801e5366c in ?? ()
Previous frame inner to this frame (corrupt stack?)
(kgdb)
We have the coredump and the kernel.debug, if there is anything we can do to
help you identifying the origin of this issue.
Thank you very much
Jean-Luc Dupont
2012-Aug-30 14:40 UTC
Kernel Panic on 9.0 and 9.1 with carp on BCE network interface
Sorry, it seems that I didn't put the right backtrace :
#0 doadump (textdump=Variable "textdump" is not available.
) at /usr/src/sys/kern/kern_shutdown.c:271
271 dumpsys(&dumper);
(kgdb) #0 doadump (textdump=Variable "textdump" is not available.
) at /usr/src/sys/kern/kern_shutdown.c:271
#1 0xffffffff807fdf02 in kern_reboot (howto=260)
at /usr/src/sys/kern/kern_shutdown.c:448
#2 0xffffffff807fe3e3 in panic (fmt=0x104 <Address 0x104 out of bounds>)
at /usr/src/sys/kern/kern_shutdown.c:636
#3 0xffffffff80ad2700 in trap_fatal (frame=0xc, eva=Variable "eva" is
not available.
)
at /usr/src/sys/amd64/amd64/trap.c:857
#4 0xffffffff80ad2a3d in trap_pfault (frame=0xffffff82e97a3500, usermode=0)
at /usr/src/sys/amd64/amd64/trap.c:773
#5 0xffffffff80ad305e in trap (frame=0xffffff82e97a3500)
at /usr/src/sys/amd64/amd64/trap.c:456
#6 0xffffffff80abd67f in calltrap ()
at /usr/src/sys/amd64/amd64/exception.S:228
#7 0xffffffff8085f597 in m_copym (m=0x0, off0=1500, len=1480, wait=1)
at /usr/src/sys/kern/uipc_mbuf.c:542
#8 0xffffffff8092f2c8 in ip_fragment (ip=0xfffffe00970e0580,
m_frag=0xffffff82e97a3728, mtu=Variable "mtu" is not available.
) at /usr/src/sys/netinet/ip_output.c:822
#9 0xffffffff8092fc17 in ip_output (m=0xfffffe00970e0500, opt=Variable
"opt" is not available.
)
at /usr/src/sys/netinet/ip_output.c:653
#10 0xffffffff80928713 in ip_forward (m=0xfffffe00970e0500, srcrt=Variable
"srcrt" is not available.
)
at /usr/src/sys/netinet/ip_input.c:1494
#11 0xffffffff80929dc8 in ip_input (m=0xfffffe00970e0500)
at /usr/src/sys/netinet/ip_input.c:702
#12 0xffffffff808bfe17 in netisr_dispatch_src (proto=56, source=Variable
"source" is not available.
)
at /usr/src/sys/net/netisr.c:1013
#13 0xffffffff808b6d8c in ether_demux (ifp=0xfffffe0011056000,
m=0xfffffe00970e0500) at /usr/src/sys/net/if_ethersubr.c:940
#14 0xffffffff808b7054 in ether_nh_input (m=Variable "m" is not
available.
)
at /usr/src/sys/net/if_ethersubr.c:759
#15 0xffffffff808bfe17 in netisr_dispatch_src (proto=504, source=Variable
"source" is not available.
)
at /usr/src/sys/net/netisr.c:1013
#16 0xffffffff808b6caf in ether_demux (ifp=0xfffffe0003b54000,
m=0xfffffe00970e0500) at /usr/src/sys/net/if_ethersubr.c:849
#17 0xffffffff808b7054 in ether_nh_input (m=Variable "m" is not
available.
)
at /usr/src/sys/net/if_ethersubr.c:759
#18 0xffffffff808bfe17 in netisr_dispatch_src (proto=504, source=Variable
"source" is not available.
)
at /usr/src/sys/net/netisr.c:1013
#19 0xffffffff8040048a in bce_intr (xsc=Variable "xsc" is not
available.
)
at /usr/src/sys/dev/bce/if_bce.c:6578
#20 0xffffffff807d39e4 in intr_event_execute_handlers (p=Variable "p"
is not available.
)
at /usr/src/sys/kern/kern_intr.c:1260
#21 0xffffffff807d5176 in ithread_loop (arg=0xfffffe0003e50000)
at /usr/src/sys/kern/kern_intr.c:1273
#22 0xffffffff807d0b0f in fork_exit (
callout=0xffffffff807d50d0 <ithread_loop>, arg=0xfffffe0003e50000,
frame=0xffffff82e97a3c40) at /usr/src/sys/kern/kern_fork.c:992
#23 0xffffffff80abdbae in fork_trampoline ()
at /usr/src/sys/amd64/amd64/exception.S:602
> From: jl.dupont@outlook.com
> To: freebsd-stable@freebsd.org
> Date: Thu, 30 Aug 2012 14:33:20 +0000
> Subject: Kernel Panic on 9.0 and 9.1 with carp on BCE network interface
>
> Hello,
>
> We are using Freebsd 9.0 on dell poweredge servers with broadcom (bce)
integrated interfaces and intel pci-x cards.
>
> This server is used as gateway/firewall (IPFW) with several VLANs and each
interface and carp for redundancy with another identical server.
>
> We encounter a kernel panic and reboot when some users connect to an
external FTP (just after
> accepting the password).
>
> We upgraded to 9.1-prerelease and 9.1-stable, without any change, still
same systematic panic.
>
> Here is the backtrace :
>
> cpuid = 3
> KDB: stack backtrace:
> #0 0xffffffff808342b6 at kdb_backtrace+0x66
> #1 0xffffffff807fe40d at panic+0x1cd
> #2 0xffffffff80a21c6f at ufs_dirbad+0x4f
> #3 0xffffffff80a2334a at ufs_lookup_ino+0x68a
> #4 0xffffffff8088077f at vfs_cache_lookup+0xff
> #5 0xffffffff80b3b380 at VOP_LOOKUP_APV+0x40
> #6 0xffffffff80887e94 at lookup+0x464
> #7 0xffffffff80888fa9 at namei+0x4e9
> #8 0xffffffff808a307b at vn_open_cred+0x3bb
> #9 0xffffffff808a2117 at kern_openat+0x1e7
> #10 0xffffffff80ad1fa6 at amd64_syscall+0x546
> #11 0xffffffff80abd967 at Xfast_syscall+0xf7
> Uptime: 6m4s
>
> (kgdb) #0 doadump (textdump=Variable "textdump" is not
available.
> ) at /usr/src/sys/kern/kern_shutdown.c:271
> #1 0xffffffff807fdf02 in kern_reboot (howto=260)
> at /usr/src/sys/kern/kern_shutdown.c:448
> #2 0xffffffff807fe3e3 in panic (fmt=0x104 <Address 0x104 out of
bounds>)
> at /usr/src/sys/kern/kern_shutdown.c:636
> #3 0xffffffff80a21c6f in ufs_dirbad (ip=Variable "ip" is not
available.
> )
> at /usr/src/sys/ufs/ufs/ufs_lookup.c:773
> #4 0xffffffff80a2334a in ufs_lookup_ino (vdp=0xfffffe00b0aee5a0,
> vpp=0xffffff834bb30a10, cnp=0xffffff834bb30a38, dd_ino=0x0)
> at /usr/src/sys/ufs/ufs/ufs_lookup.c:393
> #5 0xffffffff8088077f in vfs_cache_lookup (ap=Variable "ap" is
not available.
> ) at vnode_if.h:80
> #6 0xffffffff80b3b380 in VOP_LOOKUP_APV (vop=0xffffffff8104e960,
> a=0xffffff834bb306f0) at vnode_if.c:123
> #7 0xffffffff80887e94 in lookup (ndp=0xffffff834bb309d0) at vnode_if.h:54
> #8 0xffffffff80888fa9 in namei (ndp=0xffffff834bb309d0)
> at /usr/src/sys/kern/vfs_lookup.c:297
> #9 0xffffffff808a307b in vn_open_cred (ndp=0xffffff834bb309d0,
> flagp=0xffffff834bb309cc, cmode=0, vn_open_flags=Variable
"vn_open_flags" is not available.
> )
> at /usr/src/sys/kern/vfs_vnops.c:195
> #10 0xffffffff808a2117 in kern_openat (td=0xfffffe000ff75470, fd=-100,
> path=0x809ff80c0 <Address 0x809ff80c0 out of bounds>,
> pathseg=UIO_USERSPACE, flags=1, mode=Variable "mode" is not
available.
> )
> at /usr/src/sys/kern/vfs_syscalls.c:1132
> #11 0xffffffff80ad1fa6 in amd64_syscall (td=0xfffffe000ff75470, traced=0)
> at subr_syscall.c:135
> #12 0xffffffff80abd967 in Xfast_syscall ()
> at /usr/src/sys/amd64/amd64/exception.S:387
> #13 0x0000000801e5366c in ?? ()
> Previous frame inner to this frame (corrupt stack?)
> (kgdb)
>
>
> We have the coredump and the kernel.debug, if there is anything we can do
to help you identifying the origin of this issue.
>
> Thank you very much
>
>
>
>
> _______________________________________________
> freebsd-stable@freebsd.org mailing list
> http://lists.freebsd.org/mailman/listinfo/freebsd-stable
> To unsubscribe, send any mail to
"freebsd-stable-unsubscribe@freebsd.org"