thr3ads.net - freebsd stable - panic: Fatal trap 12: page fault while in kernel mode [Feb 2005]

If this information is useful, please help other people find it:
Share via:

Rong-En Fan

2005-Feb-15 06:58 UTC

panic: Fatal trap 12: page fault while in kernel mode

Hello,

This is a 5.3-RELEASE-p5/amd64 on IBM X236 (EM64T) with 2GB RAM
and a LSI 21320 rmpt(4) running at 160MB/s with a hardware
RAID (da0, da1). HTT is enabled. When I run benchmark/blogbench on
/da0/ I can *reproduce* this panic again and again:
(I'm getting a dump now, let me fsck first)
kernel conf & dmesg (boot -v) are at
  http://rafan.infor.org/tmp/236/

any suggestions are welcome. :)

Fatal trap 12: page fault while in kernel mode
cpuid = 2; apic id = 06
fault virtual address   = 0x88
fault code              = supervisor read, page not present
instruction pointer     = 0x8:0xffffffff80235b0b
stack pointer           = 0x10:0xffffffffb1bd5a50
frame pointer           = 0x10:0xffffffffb1bd5a70
code segment            = base 0x0, limit 0xfffff, type 0x1b
                        = DPL 0, pres 1, long 1, def32 0, gran 1
processor eflags        = interrupt enabled, resume, IOPL = 0
current process         = 96 (pagedaemon)
[thread 100114]
Stopped at      thread_fini+0xab:       subl    0x88(%ebx),%eax
db> trace
thread_fini() at thread_fini+0xab
zone_drain() at zone_drain+0x22d
zone_foreach() at zone_foreach+0x76
uma_reclaim() at uma_reclaim+0x15
vm_pageout_scan() at vm_pageout_scan+0x170
vm_pageout() at vm_pageout+0x38e
fork_exit() at fork_exit+0xaa
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffffffb1bd5d00, rbp = 0 ---
db> ps
  pid   proc     uarea   uid  ppid  pgrp  flag   stat  wmesg    wchan  cmd
  615 ffffff00603348b8 ffffffffb43b5000    0   568   615 000c082
(threaded)  blogbench
   thread 0xffffff001e7ef000 ksegrp 0xffffff007b1fb4d0 [RUNQ]
   thread 0xffffff000881fa40 ksegrp 0xffffff007b1fb4d0 [SLPQ biord
0xffffffff99d19c40][SLP]
   thread 0xffffff001c25d520 ksegrp 0xffffff007b1fb4d0 [SLPQ biord
0xffffffff99d37640][SLP]
   thread 0xffffff000881fcd0 ksegrp 0xffffff007b1fb4d0 [RUNQ]
   thread 0xffffff001ffa27b0 ksegrp 0xffffff007b1fb4d0 [RUNQ]
   thread 0xffffff001b755520 ksegrp 0xffffff007b1fb4d0 [SLPQ biord
0xffffffff9a373640][SLP]
   thread 0xffffff0070700a40 ksegrp 0xffffff007b1fb4d0 [SLPQ biord
0xffffffff9a2d8b40][SLP]
   thread 0xffffff002c333cd0 ksegrp 0xffffff007b1fb4d0 [SLPQ biord
0xffffffff99f1c140][SLP]
   thread 0xffffff00462e0520 ksegrp 0xffffff007b1fb4d0 [SLPQ biord
0xffffffff9a104e40][SLP]
   thread 0xffffff0011002a40 ksegrp 0xffffff007b1fb4d0 [SLPQ ufs
0xffffff0059594c80][SLP]
   thread 0xffffff006310f7b0 ksegrp 0xffffff007b1fb4d0 [SLPQ biord
0xffffffff9a237740][SLP]
   thread 0xffffff003c731520 ksegrp 0xffffff007b1fb4d0 [SLPQ ufs
0xffffff00087c1500][SLP]
   thread 0xffffff0033c33290 ksegrp 0xffffff007b1fb4d0 [SLPQ biord
0xffffffff99ee8e40][SLP]
   thread 0xffffff00635a7290 ksegrp 0xffffff007b1fb4d0 [SLPQ biord
0xffffffff99d86840][SLP]
   thread 0xffffff006ff7ccd0 ksegrp 0xffffff007b1fb4d0 [RUNQ]
   thread 0xffffff000881f520 ksegrp 0xffffff007b1fb4d0 [SLPQ biord
0xffffffff99fbb440][SLP]
   thread 0xffffff006eff2520 ksegrp 0xffffff007b1fb4d0 [SLPQ biord
0xffffffff99a01640][SLP]
   thread 0xffffff004d176520 ksegrp 0xffffff007b1fb4d0 [SLPQ biord
0xffffffff9a069140][SLP]
   thread 0xffffff0048ded520 ksegrp 0xffffff007b1fb4d0 [SLPQ biord
0xffffffff99f9c540][SLP]
   thread 0xffffff003689f7b0 ksegrp 0xffffff007b1fb4d0 [SLPQ biord
0xffffffff99d7c940][SLP]
   thread 0xffffff0052446cd0 ksegrp 0xffffff007b1fb4d0 [SLPQ biord
0xffffffff99f22d40][SLP]
   thread 0xffffff006eff2000 ksegrp 0xffffff007b1fb4d0 [SLPQ biord
0xffffffff99a6c140][SLP]
   thread 0xffffff0054121cd0 ksegrp 0xffffff007b1fb4d0 [SLPQ ufs
0xffffff0059112500][SLP]
   thread 0xffffff00492bc000 ksegrp 0xffffff007b1fb4d0 [SLPQ biord
0xffffffff9a315440][SLP]
   thread 0xffffff003289ba40 ksegrp 0xffffff007b1fb4d0 [SLPQ biord
0xffffffff99ff1d40][SLP]
   thread 0xffffff0055b3ea40 ksegrp 0xffffff007b1fb4d0 [SLPQ biord
0xffffffff99fe2140][SLP]
   thread 0xffffff0055b3e000 ksegrp 0xffffff007b1fb4d0 [SLPQ biord
0xffffffff999d1340][SLP]
   thread 0xffffff003689f290 ksegrp 0xffffff007b1fb4d0 [SLPQ biord
0xffffffff9a2bc040][SLP]
   thread 0xffffff000881f000 ksegrp 0xffffff007b1fb4d0 [SLPQ biord
0xffffffff99bc8440][SLP]
   thread 0xffffff006ff7c000 ksegrp 0xffffff007b1fb4d0 [SLPQ biord
0xffffffff99c2ed40][SLP]
   thread 0xffffff003289b000 ksegrp 0xffffff007b1fb4d0 [SLPQ biord
0xffffffff9a0c0a40][SLP]
   thread 0xffffff003c731a40 ksegrp 0xffffff007b1fb4d0 [SLPQ biord
0xffffffff99c9ec40][SLP]
   thread 0xffffff0009f50cd0 ksegrp 0xffffff007b1fb4d0 [SLPQ biord
0xffffffff99b1c240][SLP]
   thread 0xffffff000dbd5cd0 ksegrp 0xffffff007b1fb4d0 [SLPQ biord
0xffffffff9a1fff40][SLP]
   thread 0xffffff003c9bdcd0 ksegrp 0xffffff007b1fb4d0 [SLPQ biord
0xffffffff99d06440][SLP]
   thread 0xffffff003c9bd7b0 ksegrp 0xffffff007b1fb4d0 [SLPQ biord
0xffffffff9a202c40][SLP]
   thread 0xffffff006ac1ba40 ksegrp 0xffffff007b1fb4d0 [SLPQ biord
0xffffffff9a30c740][SLP]
   thread 0xffffff00342f4290 ksegrp 0xffffff007b1fb4d0 [SLPQ biord
0xffffffff9a00ee40][SLP]
   thread 0xffffff004819d290 ksegrp 0xffffff007b1fb4d0 [SLPQ biord
0xffffffff99dc3440][SLP]
   thread 0xffffff005cd927b0 ksegrp 0xffffff007b1fb4d0 [SLPQ biord
0xffffffff99b6ed40][SLP]
   thread 0xffffff00462e0290 ksegrp 0xffffff007b1fb4d0 [SLPQ biord
0xffffffff9a25ff40][SLP]
   thread 0xffffff0033047290 ksegrp 0xffffff007b1fb4d0 [SLPQ biord
0xffffffff9a2d1040][SLP]
   thread 0xffffff00312cf520 ksegrp 0xffffff007b1fb4d0 [SLPQ biord
0xffffffff9a13e440][SLP]
   thread 0xffffff00640bf000 ksegrp 0xffffff007b1fb4d0 [SLPQ biord
0xffffffff9a1dfb40][SLP]
   thread 0xffffff003289b7b0 ksegrp 0xffffff007b1fb4d0 [SLPQ biord
0xffffffff9a144440][SLP]
   thread 0xffffff0060817a40 ksegrp 0xffffff007b1fb4d0 [SLPQ biord
0xffffffff999c3840][SLP]
   thread 0xffffff00083a8520 ksegrp 0xffffff007b1fb4d0 [SLPQ ufs
0xffffff005dbd5140][SLP]
   thread 0xffffff0049a4ccd0 ksegrp 0xffffff007b1fb4d0 [SLPQ biord
0xffffffff99ac3740][SLP]
   thread 0xffffff0025fc4520 ksegrp 0xffffff007b1fb4d0 [SLPQ biord
0xffffffff99e8d040][SLP]
   thread 0xffffff002a956000 ksegrp 0xffffff007b1fb4d0 [SLPQ biord
0xffffffff99af9740][SLP]
   thread 0xffffff007821f520 ksegrp 0xffffff007b1fb4d0 [SLPQ ufs
0xffffff005b19ec80][SLP]
   thread 0xffffff0039650000 ksegrp 0xffffff007b1fb4d0 [SLPQ ufs
0xffffff005b19ec80][SLP]
   thread 0xffffff00635a7000 ksegrp 0xffffff007b1fb4d0 [SLPQ biord
0xffffffff9a376940][SLP]
   thread 0xffffff006ac1b290 ksegrp 0xffffff007b7b7b00 [SLPQ
ksesigwait 0xffffff0060334a68][SLP]
  568 ffffff0062a255d0 ffffffffb426a000    0   567   568 0004002 [SLPQ
pause 0xffffff0062a25640][SLP] csh
  567 ffffff005fc94000 ffffffffb43c1000    0     1   567 0004102 [SLPQ
wait 0xffffff005fc94000][SLP] login
  566 ffffff0060a3a5d0 ffffffffb43b9000    0     1   566 0004002 [SLPQ
ttyin 0xffffff007b348410][SLP] getty
  565 ffffff0062a26ba0 ffffffffb4271000    0     1   565 0004002 [SLPQ
ttyin 0xffffff007b348810][SLP] getty
  564 ffffff0062a792e8 ffffffffb434a000    0     1   564 0004002 [SLPQ
ttyin 0xffffff007b348c10][SLP] getty
  563 ffffff00609bbba0 ffffffffb43c0000    0     1   563 0004002 [SLPQ
ttyin 0xffffff007af69010][SLP] getty
  562 ffffff00609bb5d0 ffffffffb43be000    0     1   562 0004002 [SLPQ
ttyin 0xffffff007af69410][SLP] getty
  561 ffffff007b2b7ba0 ffffffffb4195000    0     1   561 0004002 [SLPQ
ttyin 0xffffff0000a35810][SLP] getty
  560 ffffff0062bc0000 ffffffffb419b000    0     1   560 0004002 [SLPQ
ttyin 0xffffff007af2c810][SLP] getty
  555 ffffff0060a3aba0 ffffffffb43bb000    0     1   555 0000000 [SLPQ
select 0xffffffff8052fb70][SLP] inetd
  526 ffffff00600fc000 ffffffffb443e000    0     1   525 0000000 [SLPQ
select 0xffffffff8052fb70][SLP] snmpd
  507 ffffff006013d8b8 ffffffffb4446000    0     1   507 0000000 [SLPQ
nanslp 0xffffffff80527440][SLP] cron
  495 ffffff0062a628b8 ffffffffb4266000   25     1   495 0000100 [SLPQ
pause 0xffffff0062a62928][SLP] sendmail
  491 ffffff0060334000 ffffffffb4358000    0     1   491 0000100 [SLPQ
select 0xffffffff8052fb70][SLP] sendmail
  485 ffffff00602132e8 ffffffffb4354000    0     1   485 0000100 [SLPQ
select 0xffffffff8052fb70][SLP] sshd
  471 ffffff007b295ba0 ffffffffb414f000    0     1   471 0000000 [SLPQ
select 0xffffffff8052fb70][SLP] ntpd
  435 ffffff0062a625d0 ffffffffb4265000    0   429   429 0000100 [SLPQ
select 0xffffffff8052fb70][SLP] rpc.lockd
  429 ffffff007b2b72e8 ffffffffb4192000    0     1   429 0000000 [SLPQ
select 0xffffffff8052fb70][SLP] rpc.lockd
  424 ffffff0062c085d0 ffffffffb4201000    0     1   424 0000000 [SLPQ
select 0xffffffff8052fb70][SLP] rpc.statd
  418 ffffff0062a5d8b8 ffffffffb4261000    0   414   414 0000000 [SLPQ
- 0xffffff000d749800][SLP] nfsd
  417 ffffff007b2da2e8 ffffffffb4197000    0   414   414 0000000 [SLPQ
- 0xffffff000dc11c00][SLP] nfsd
  416 ffffff0062c08ba0 ffffffffb4203000    0   414   414 0000000 [SLPQ
- 0xffffff0062b0e400][SLP] nfsd
  415 ffffff0062a5dba0 ffffffffb4262000    0   414   414 0000000 [SLPQ
- 0xffffff000dc11a00][SLP] nfsd
  414 ffffff007b2952e8 ffffffffb414c000    0     1   414 0000000 [SLPQ
accept 0xffffff00617596d6][SLP] nfsd
  406 ffffff007b2b78b8 ffffffffb4194000    0     1   406 0000000 [SLPQ
select 0xffffffff8052fb70][SLP] mountd
  354 ffffff007b2daba0 ffffffffb419a000    0     1   354 0000000 [SLPQ
select 0xffffffff8052fb70][SLP] rpcbind
  341 ffffff0062a622e8 ffffffffb4264000    0     1   341 0000000 [SLPQ
select 0xffffffff8052fb70][SLP] syslogd
  321 ffffff0062a26000 ffffffffb426d000    0     1   321 0000000 [SLPQ
select 0xffffffff8052fb70][SLP] devd
  245 ffffff0062bc0ba0 ffffffffb41f9000    0     1   245 0000000 [SLPQ
pause 0xffffff0062bc0c10][SLP] adjkerntz
  106 ffffff007b2da000 ffffffffb4196000    0     0     0 0000204 [SLPQ
- 0xffffffffb4173c0c][SLP] schedcpu
  105 ffffff007b796000 ffffffffb1b8b000    0     0     0 0000204 [SLPQ
- 0xffffffff805344d8][SLP] nfsiod 3
  104 ffffff007b7962e8 ffffffffb1b8c000    0     0     0 0000204 [SLPQ
- 0xffffffff805344d0][SLP] nfsiod 2
  103 ffffff007b7965d0 ffffffffb1b8d000    0     0     0 0000204 [SLPQ
- 0xffffffff805344c8][SLP] nfsiod 1
  102 ffffff007b7968b8 ffffffffb1b8e000    0     0     0 0000204 [SLPQ
- 0xffffffff805344c0][SLP] nfsiod 0
  101 ffffff007b796ba0 ffffffffb1b8f000    0     0     0 0000204 [SLPQ
syncer 0xffffffff80527120][SLP] syncer
  100 ffffff007b7d8000 ffffffffb1b90000    0     0     0 0000204 [SLPQ
vlruwt 0xffffff007b7d8000][SLP] vnlru
   99 ffffff007b7d82e8 ffffffffb1b91000    0     0     0 0000204 [SLPQ
wdrain 0xffffffff805304e8][SLP] bufdaemon
   98 ffffff007b7d85d0 ffffffffb1b92000    0     0     0 000020c [SLPQ
pgzero 0xffffffff8053ce74][SLP] pagezero
   97 ffffff007b7d88b8 ffffffffb1b93000    0     0     0 0000204 [SLPQ
psleep 0xffffffff8053cedc][SLP] vmdaemon
   96 ffffff007b7d8ba0 ffffffffb1b94000    0     0     0 0000204 [CPU
2] pagedaemon
   95 ffffff007b7bd000 ffffffffb1bef000    0     0     0 0000204
[IWAIT] swi0: sio
    9 ffffff007b7bd2e8 ffffffffb1bf0000    0     0     0 0000204 [SLPQ
actask 0xffffffff8051a000][SLP] acpi_task2
    8 ffffff007b7bd5d0 ffffffffb1bf1000    0     0     0 0000204 [SLPQ
actask 0xffffffff8051a000][SLP] acpi_task1
    7 ffffff007b7bd8b8 ffffffffb1bf2000    0     0     0 0000204 [SLPQ
actask 0xffffffff8051a000][SLP] acpi_task0
   94 ffffff007b7bdba0 ffffffffb1bf3000    0     0     0 0000204
[IWAIT] swi6: acpitaskq
    6 ffffff007b7472e8 ffffffffb1b23000    0     0     0 0000204 [SLPQ
- 0xffffff00009d1100][SLP] kqueue taskq
   93 ffffff007b7475d0 ffffffffb1b24000    0     0     0 0000204 [IWAIT] swi6:+
    5 ffffff007b7478b8 ffffffffb1b25000    0     0     0 0000204 [SLPQ
- 0xffffff00009d1280][SLP] thread taskq
   92 ffffff007b747ba0 ffffffffb1b26000    0     0     0 0000204 [IWAIT] swi6:+
   91 ffffff007b775000 ffffffffb1b27000    0     0     0 0000204
[IWAIT] swi6: task queue
   90 ffffff007b7752e8 ffffffffb1b28000    0     0     0 0000204
[IWAIT] swi3: cambio
   89 ffffff007b7755d0 ffffffffb1b29000    0     0     0 0000204
[IWAIT] swi2: camnet
   88 ffffff007b7758b8 ffffffffb1b2a000    0     0     0 0000204 [SLPQ
- 0xffffffff8051a720][SLP] yarrow
    4 ffffff007b775ba0 ffffffffb1b2b000    0     0     0 0000204 [CPU 0] g_down
    3 ffffff007b7f9000 ffffffffb1b86000    0     0     0 0000204 [CPU 3] g_up
    2 ffffff007b7f92e8 ffffffffb1b87000    0     0     0 0000204 [SLPQ
- 0xffffffff8051e490][SLP] g_event
   87 ffffff007b7f95d0 ffffffffb1b88000    0     0     0 0000204
[IWAIT] swi1: net
   86 ffffff007b7f98b8 ffffffffb1b89000    0     0     0 0000204
[IWAIT] swi4: vm
   85 ffffff007b7f9ba0 ffffffffb1b8a000    0     0     0 000020c
[RUNQ] swi5: clock sio
   84 ffffff007b7518b8 ffffffffb1ada000    0     0     0 0000204 [IWAIT] irq23:
   83 ffffff007b751ba0 ffffffffb1adb000    0     0     0 0000204 [IWAIT] irq22:
   82 ffffff007b761000 ffffffffb1adc000    0     0     0 0000204 [IWAIT] irq21:
   81 ffffff007b7612e8 ffffffffb1add000    0     0     0 0000204 [IWAIT] irq20:
   80 ffffff007b7615d0 ffffffffb1ade000    0     0     0 0000204 [IWAIT] irq19:
   79 ffffff007b7618b8 ffffffffb1adf000    0     0     0 0000204 [IWAIT] irq18:
   78 ffffff007b761ba0 ffffffffb1ae0000    0     0     0 0000204 [IWAIT] irq17:
   77 ffffff007b763000 ffffffffb1ae1000    0     0     0 0000204
[RUNQ] irq16: bge0 bge1
   76 ffffff007b7632e8 ffffffffb1b1e000    0     0     0 0000204
[IWAIT] irq15: ata1
   75 ffffff007b7635d0 ffffffffb1b1f000    0     0     0 0000204
[IWAIT] irq14: ata0
   74 ffffff007b7638b8 ffffffffb1b20000    0     0     0 0000204 [IWAIT] irq13:
   73 ffffff007b763ba0 ffffffffb1b21000    0     0     0 0000204 [IWAIT] irq12:
   72 ffffff007b747000 ffffffffb1b22000    0     0     0 0000204 [IWAIT] irq11:
   71 ffffff007b7d62e8 ffffffffb1a92000    0     0     0 0000204 [IWAIT] irq10:
   70 ffffff007b7d65d0 ffffffffb1a93000    0     0     0 0000204
[IWAIT] irq9: acpi0
   69 ffffff007b7d68b8 ffffffffb1a94000    0     0     0 0000204
[IWAIT] irq8: rtc
   68 ffffff007b7d6ba0 ffffffffb1a95000    0     0     0 0000204 [IWAIT] irq7:
   67 ffffff007b74e000 ffffffffb1a96000    0     0     0 0000204 [IWAIT] irq6:
   66 ffffff007b74e2e8 ffffffffb1a97000    0     0     0 0000204 [IWAIT] irq5:
   65 ffffff007b74e5d0 ffffffffb1a98000    0     0     0 0000204
[IWAIT] irq4: sio0
   64 ffffff007b74e8b8 ffffffffb1ad5000    0     0     0 0000204
[IWAIT] irq3: sio1
   63 ffffff007b74eba0 ffffffffb1ad6000    0     0     0 0000204
[IWAIT] irq0: clk
   62 ffffff007b751000 ffffffffb1ad7000    0     0     0 0000204
[IWAIT] irq1: atkbd0
   61 ffffff007b7512e8 ffffffffb1ad8000    0     0     0 0000204 [IWAIT] irq47:
   60 ffffff007b7515d0 ffffffffb1ad9000    0     0     0 0000204 [IWAIT] irq46:
   59 ffffff007b770000 ffffffffb1a4b000    0     0     0 0000204 [IWAIT] irq45:
   58 ffffff007b7702e8 ffffffffb1a4c000    0     0     0 0000204 [IWAIT] irq44:
   57 ffffff007b7705d0 ffffffffb1a4d000    0     0     0 0000204 [IWAIT] irq43:
   56 ffffff007b7708b8 ffffffffb1a4e000    0     0     0 0000204 [IWAIT] irq42:
   55 ffffff007b770ba0 ffffffffb1a4f000    0     0     0 0000204 [IWAIT] irq41:
   54 ffffff007b771000 ffffffffb1a50000    0     0     0 0000204 [IWAIT] irq40:
   53 ffffff007b7712e8 ffffffffb1a8d000    0     0     0 0000204 [IWAIT] irq39:
   52 ffffff007b7715d0 ffffffffb1a8e000    0     0     0 0000204
[IWAIT] irq38: ips0
   51 ffffff007b7718b8 ffffffffb1a8f000    0     0     0 0000204 [IWAIT] irq37:
   50 ffffff007b771ba0 ffffffffb1a90000    0     0     0 0000204 [IWAIT] irq36:
   49 ffffff007b7d6000 ffffffffb1a91000    0     0     0 0000204 [IWAIT] irq35:
   48 ffffff007b780000 ffffffffb1a05000    0     0     0 0000204 [IWAIT] irq34:
   47 ffffff007b7802e8 ffffffffb1a06000    0     0     0 0000204 [IWAIT] irq33:
   46 ffffff007b7805d0 ffffffffb1a07000    0     0     0 0000204 [IWAIT] irq32:
   45 ffffff007b7808b8 ffffffffb1a08000    0     0     0 0000204 [IWAIT] irq31:
   44 ffffff007b780ba0 ffffffffb1a09000    0     0     0 0000204 [IWAIT] irq30:
   43 ffffff007b783000 ffffffffb1a46000    0     0     0 0000204 [IWAIT] irq29:
   42 ffffff007b7832e8 ffffffffb1a47000    0     0     0 0000204 [IWAIT] irq28:
   41 ffffff007b7835d0 ffffffffb1a48000    0     0     0 0000204 [IWAIT] irq27:
   40 ffffff007b7838b8 ffffffffb1a49000    0     0     0 0000204 [IWAIT] irq26:
   39 ffffff007b783ba0 ffffffffb1a4a000    0     0     0 0000204 [IWAIT] irq25:
   38 ffffff007b7662e8 ffffffffb19c0000    0     0     0 0000204 [IWAIT] irq24:
   37 ffffff007b7665d0 ffffffffb19c1000    0     0     0 0000204 [IWAIT] irq71:
   36 ffffff007b7668b8 ffffffffb19c2000    0     0     0 0000204 [IWAIT] irq70:
   35 ffffff007b766ba0 ffffffffb19c3000    0     0     0 0000204 [IWAIT] irq69:
   34 ffffff007b7b5000 ffffffffb1a00000    0     0     0 0000204 [IWAIT] irq68:
   33 ffffff007b7b52e8 ffffffffb1a01000    0     0     0 0000204 [IWAIT] irq67:
   32 ffffff007b7b55d0 ffffffffb1a02000    0     0     0 0000204 [IWAIT] irq66:
   31 ffffff007b7b58b8 ffffffffb1a03000    0     0     0 0000204 [IWAIT] irq65:
   30 ffffff007b7b5ba0 ffffffffb1a04000    0     0     0 0000204 [IWAIT] irq64:
   29 ffffff007b7dc8b8 ffffffffb199a000    0     0     0 0000204 [IWAIT] irq63:
   28 ffffff007b7dcba0 ffffffffb199b000    0     0     0 0000204 [IWAIT] irq62:
   27 ffffff007b784000 ffffffffb199c000    0     0     0 0000204 [IWAIT] irq61:
   26 ffffff007b7842e8 ffffffffb19bb000    0     0     0 0000204 [IWAIT] irq60:
   25 ffffff007b7845d0 ffffffffb19bc000    0     0     0 0000204 [IWAIT] irq59:
   24 ffffff007b7848b8 ffffffffb19bd000    0     0     0 0000204 [IWAIT] irq58:
   23 ffffff007b784ba0 ffffffffb19be000    0     0     0 0000204 [IWAIT] irq57:
   22 ffffff007b766000 ffffffffb19bf000    0     0     0 0000204 [IWAIT] irq56:
   21 ffffff007b7d42e8 ffffffffb1975000    0     0     0 0000204 [IWAIT] irq55:
   20 ffffff007b7d45d0 ffffffffb1976000    0     0     0 0000204 [IWAIT] irq54:
   19 ffffff007b7d48b8 ffffffffb1995000    0     0     0 0000204
[IWAIT] irq53: mpt1
   18 ffffff007b7d4ba0 ffffffffb1996000    0     0     0 0000204 [CPU
1] irq52: mpt0
   17 ffffff007b7dc000 ffffffffb1997000    0     0     0 0000204 [IWAIT] irq51:
   16 ffffff007b7dc2e8 ffffffffb1998000    0     0     0 0000204 [IWAIT] irq50:
   15 ffffff007b7dc5d0 ffffffffb1999000    0     0     0 0000204 [IWAIT] irq49:
   14 ffffff007b76d000 ffffffffb1933000    0     0     0 0000204 [IWAIT] irq48:
   13 ffffff007b76d2e8 ffffffffb1970000    0     0     0 000020c [Can
run] idle: cpu0
   12 ffffff007b76d5d0 ffffffffb1971000    0     0     0 000020c [Can
run] idle: cpu1
   11 ffffff007b76d8b8 ffffffffb1972000    0     0     0 000020c [Can
run] idle: cpu2
   10 ffffff007b76dba0 ffffffffb1973000    0     0     0 000020c [Can
run] idle: cpu3
    1 ffffff007b7d4000 ffffffffb1974000    0     0     1 0004200 [SLPQ
wait 0xffffff007b7d4000][SLP] init
    0 ffffffff8051e580 ffffffff805f5000    0     0     0 0000200 [SLPQ
sched 0xffffffff8051e580][SLP] swapper

Regards,
Rong-En Fan

Rong-En Fan

2005-Feb-15 11:13 UTC

head link

panic: Fatal trap 12: page fault while in kernel mode

Hello,

This is a 5.3-RELEASE-p5/amd64 on IBM X236 (EM64T) with 2GB RAM
and a LSI 21320 rmpt(4) running at 160MB/s with a hardware
RAID (da0, da1). HTT is enabled. When I run benchmark/blogbench on
/da0/ I can *reproduce* this panic again and again:
(I'm getting a dump now, let me fsck first)
kernel conf & dmesg (boot -v) are at
 http://rafan.infor.org/tmp/236/

any suggestions are welcome. :)

Fatal trap 12: page fault while in kernel mode
cpuid = 2; apic id = 06
fault virtual address   = 0x88
fault code              = supervisor read, page not present
instruction pointer     = 0x8:0xffffffff80235b0b
stack pointer           = 0x10:0xffffffffb1bd5a50
frame pointer           = 0x10:0xffffffffb1bd5a70
code segment            = base 0x0, limit 0xfffff, type 0x1b
                       = DPL 0, pres 1, long 1, def32 0, gran 1
processor eflags        = interrupt enabled, resume, IOPL = 0
current process         = 96 (pagedaemon)
[thread 100114]
Stopped at      thread_fini+0xab:       subl    0x88(%ebx),%eax
db> trace
thread_fini() at thread_fini+0xab
zone_drain() at zone_drain+0x22d
zone_foreach() at zone_foreach+0x76
uma_reclaim() at uma_reclaim+0x15
vm_pageout_scan() at vm_pageout_scan+0x170
vm_pageout() at vm_pageout+0x38e
fork_exit() at fork_exit+0xaa
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffffffb1bd5d00, rbp = 0 ---
db> ps
 pid   proc     uarea   uid  ppid  pgrp  flag   stat  wmesg    wchan  cmd
 615 ffffff00603348b8 ffffffffb43b5000    0   568   615 000c082
(threaded)  blogbench
  thread 0xffffff001e7ef000 ksegrp 0xffffff007b1fb4d0 [RUNQ]
  thread 0xffffff000881fa40 ksegrp 0xffffff007b1fb4d0 [SLPQ biord
0xffffffff99d19c40][SLP]
  thread 0xffffff001c25d520 ksegrp 0xffffff007b1fb4d0 [SLPQ biord
0xffffffff99d37640][SLP]
  thread 0xffffff000881fcd0 ksegrp 0xffffff007b1fb4d0 [RUNQ]
  thread 0xffffff001ffa27b0 ksegrp 0xffffff007b1fb4d0 [RUNQ]
  thread 0xffffff001b755520 ksegrp 0xffffff007b1fb4d0 [SLPQ biord
0xffffffff9a373640][SLP]
  thread 0xffffff0070700a40 ksegrp 0xffffff007b1fb4d0 [SLPQ biord
0xffffffff9a2d8b40][SLP]
  thread 0xffffff002c333cd0 ksegrp 0xffffff007b1fb4d0 [SLPQ biord
0xffffffff99f1c140][SLP]
  thread 0xffffff00462e0520 ksegrp 0xffffff007b1fb4d0 [SLPQ biord
0xffffffff9a104e40][SLP]
  thread 0xffffff0011002a40 ksegrp 0xffffff007b1fb4d0 [SLPQ ufs
0xffffff0059594c80][SLP]
  thread 0xffffff006310f7b0 ksegrp 0xffffff007b1fb4d0 [SLPQ biord
0xffffffff9a237740][SLP]
  thread 0xffffff003c731520 ksegrp 0xffffff007b1fb4d0 [SLPQ ufs
0xffffff00087c1500][SLP]
  thread 0xffffff0033c33290 ksegrp 0xffffff007b1fb4d0 [SLPQ biord
0xffffffff99ee8e40][SLP]
  thread 0xffffff00635a7290 ksegrp 0xffffff007b1fb4d0 [SLPQ biord
0xffffffff99d86840][SLP]
  thread 0xffffff006ff7ccd0 ksegrp 0xffffff007b1fb4d0 [RUNQ]
  thread 0xffffff000881f520 ksegrp 0xffffff007b1fb4d0 [SLPQ biord
0xffffffff99fbb440][SLP]
  thread 0xffffff006eff2520 ksegrp 0xffffff007b1fb4d0 [SLPQ biord
0xffffffff99a01640][SLP]
  thread 0xffffff004d176520 ksegrp 0xffffff007b1fb4d0 [SLPQ biord
0xffffffff9a069140][SLP]
  thread 0xffffff0048ded520 ksegrp 0xffffff007b1fb4d0 [SLPQ biord
0xffffffff99f9c540][SLP]
  thread 0xffffff003689f7b0 ksegrp 0xffffff007b1fb4d0 [SLPQ biord
0xffffffff99d7c940][SLP]
  thread 0xffffff0052446cd0 ksegrp 0xffffff007b1fb4d0 [SLPQ biord
0xffffffff99f22d40][SLP]
  thread 0xffffff006eff2000 ksegrp 0xffffff007b1fb4d0 [SLPQ biord
0xffffffff99a6c140][SLP]
  thread 0xffffff0054121cd0 ksegrp 0xffffff007b1fb4d0 [SLPQ ufs
0xffffff0059112500][SLP]
  thread 0xffffff00492bc000 ksegrp 0xffffff007b1fb4d0 [SLPQ biord
0xffffffff9a315440][SLP]
  thread 0xffffff003289ba40 ksegrp 0xffffff007b1fb4d0 [SLPQ biord
0xffffffff99ff1d40][SLP]
  thread 0xffffff0055b3ea40 ksegrp 0xffffff007b1fb4d0 [SLPQ biord
0xffffffff99fe2140][SLP]
  thread 0xffffff0055b3e000 ksegrp 0xffffff007b1fb4d0 [SLPQ biord
0xffffffff999d1340][SLP]
  thread 0xffffff003689f290 ksegrp 0xffffff007b1fb4d0 [SLPQ biord
0xffffffff9a2bc040][SLP]
  thread 0xffffff000881f000 ksegrp 0xffffff007b1fb4d0 [SLPQ biord
0xffffffff99bc8440][SLP]
  thread 0xffffff006ff7c000 ksegrp 0xffffff007b1fb4d0 [SLPQ biord
0xffffffff99c2ed40][SLP]
  thread 0xffffff003289b000 ksegrp 0xffffff007b1fb4d0 [SLPQ biord
0xffffffff9a0c0a40][SLP]
  thread 0xffffff003c731a40 ksegrp 0xffffff007b1fb4d0 [SLPQ biord
0xffffffff99c9ec40][SLP]
  thread 0xffffff0009f50cd0 ksegrp 0xffffff007b1fb4d0 [SLPQ biord
0xffffffff99b1c240][SLP]
  thread 0xffffff000dbd5cd0 ksegrp 0xffffff007b1fb4d0 [SLPQ biord
0xffffffff9a1fff40][SLP]
  thread 0xffffff003c9bdcd0 ksegrp 0xffffff007b1fb4d0 [SLPQ biord
0xffffffff99d06440][SLP]
  thread 0xffffff003c9bd7b0 ksegrp 0xffffff007b1fb4d0 [SLPQ biord
0xffffffff9a202c40][SLP]
  thread 0xffffff006ac1ba40 ksegrp 0xffffff007b1fb4d0 [SLPQ biord
0xffffffff9a30c740][SLP]
  thread 0xffffff00342f4290 ksegrp 0xffffff007b1fb4d0 [SLPQ biord
0xffffffff9a00ee40][SLP]
  thread 0xffffff004819d290 ksegrp 0xffffff007b1fb4d0 [SLPQ biord
0xffffffff99dc3440][SLP]
  thread 0xffffff005cd927b0 ksegrp 0xffffff007b1fb4d0 [SLPQ biord
0xffffffff99b6ed40][SLP]
  thread 0xffffff00462e0290 ksegrp 0xffffff007b1fb4d0 [SLPQ biord
0xffffffff9a25ff40][SLP]
  thread 0xffffff0033047290 ksegrp 0xffffff007b1fb4d0 [SLPQ biord
0xffffffff9a2d1040][SLP]
  thread 0xffffff00312cf520 ksegrp 0xffffff007b1fb4d0 [SLPQ biord
0xffffffff9a13e440][SLP]
  thread 0xffffff00640bf000 ksegrp 0xffffff007b1fb4d0 [SLPQ biord
0xffffffff9a1dfb40][SLP]
  thread 0xffffff003289b7b0 ksegrp 0xffffff007b1fb4d0 [SLPQ biord
0xffffffff9a144440][SLP]
  thread 0xffffff0060817a40 ksegrp 0xffffff007b1fb4d0 [SLPQ biord
0xffffffff999c3840][SLP]
  thread 0xffffff00083a8520 ksegrp 0xffffff007b1fb4d0 [SLPQ ufs
0xffffff005dbd5140][SLP]
  thread 0xffffff0049a4ccd0 ksegrp 0xffffff007b1fb4d0 [SLPQ biord
0xffffffff99ac3740][SLP]
  thread 0xffffff0025fc4520 ksegrp 0xffffff007b1fb4d0 [SLPQ biord
0xffffffff99e8d040][SLP]
  thread 0xffffff002a956000 ksegrp 0xffffff007b1fb4d0 [SLPQ biord
0xffffffff99af9740][SLP]
  thread 0xffffff007821f520 ksegrp 0xffffff007b1fb4d0 [SLPQ ufs
0xffffff005b19ec80][SLP]
  thread 0xffffff0039650000 ksegrp 0xffffff007b1fb4d0 [SLPQ ufs
0xffffff005b19ec80][SLP]
  thread 0xffffff00635a7000 ksegrp 0xffffff007b1fb4d0 [SLPQ biord
0xffffffff9a376940][SLP]
  thread 0xffffff006ac1b290 ksegrp 0xffffff007b7b7b00 [SLPQ
ksesigwait 0xffffff0060334a68][SLP]
 568 ffffff0062a255d0 ffffffffb426a000    0   567   568 0004002 [SLPQ
pause 0xffffff0062a25640][SLP] csh
 567 ffffff005fc94000 ffffffffb43c1000    0     1   567 0004102 [SLPQ
wait 0xffffff005fc94000][SLP] login
 566 ffffff0060a3a5d0 ffffffffb43b9000    0     1   566 0004002 [SLPQ
ttyin 0xffffff007b348410][SLP] getty
 565 ffffff0062a26ba0 ffffffffb4271000    0     1   565 0004002 [SLPQ
ttyin 0xffffff007b348810][SLP] getty
 564 ffffff0062a792e8 ffffffffb434a000    0     1   564 0004002 [SLPQ
ttyin 0xffffff007b348c10][SLP] getty
 563 ffffff00609bbba0 ffffffffb43c0000    0     1   563 0004002 [SLPQ
ttyin 0xffffff007af69010][SLP] getty
 562 ffffff00609bb5d0 ffffffffb43be000    0     1   562 0004002 [SLPQ
ttyin 0xffffff007af69410][SLP] getty
 561 ffffff007b2b7ba0 ffffffffb4195000    0     1   561 0004002 [SLPQ
ttyin 0xffffff0000a35810][SLP] getty
 560 ffffff0062bc0000 ffffffffb419b000    0     1   560 0004002 [SLPQ
ttyin 0xffffff007af2c810][SLP] getty
 555 ffffff0060a3aba0 ffffffffb43bb000    0     1   555 0000000 [SLPQ
select 0xffffffff8052fb70][SLP] inetd
 526 ffffff00600fc000 ffffffffb443e000    0     1   525 0000000 [SLPQ
select 0xffffffff8052fb70][SLP] snmpd
 507 ffffff006013d8b8 ffffffffb4446000    0     1   507 0000000 [SLPQ
nanslp 0xffffffff80527440][SLP] cron
 495 ffffff0062a628b8 ffffffffb4266000   25     1   495 0000100 [SLPQ
pause 0xffffff0062a62928][SLP] sendmail
 491 ffffff0060334000 ffffffffb4358000    0     1   491 0000100 [SLPQ
select 0xffffffff8052fb70][SLP] sendmail
 485 ffffff00602132e8 ffffffffb4354000    0     1   485 0000100 [SLPQ
select 0xffffffff8052fb70][SLP] sshd
 471 ffffff007b295ba0 ffffffffb414f000    0     1   471 0000000 [SLPQ
select 0xffffffff8052fb70][SLP] ntpd
 435 ffffff0062a625d0 ffffffffb4265000    0   429   429 0000100 [SLPQ
select 0xffffffff8052fb70][SLP] rpc.lockd
 429 ffffff007b2b72e8 ffffffffb4192000    0     1   429 0000000 [SLPQ
select 0xffffffff8052fb70][SLP] rpc.lockd
 424 ffffff0062c085d0 ffffffffb4201000    0     1   424 0000000 [SLPQ
select 0xffffffff8052fb70][SLP] rpc.statd
 418 ffffff0062a5d8b8 ffffffffb4261000    0   414   414 0000000 [SLPQ
- 0xffffff000d749800][SLP] nfsd
 417 ffffff007b2da2e8 ffffffffb4197000    0   414   414 0000000 [SLPQ
- 0xffffff000dc11c00][SLP] nfsd
 416 ffffff0062c08ba0 ffffffffb4203000    0   414   414 0000000 [SLPQ
- 0xffffff0062b0e400][SLP] nfsd
 415 ffffff0062a5dba0 ffffffffb4262000    0   414   414 0000000 [SLPQ
- 0xffffff000dc11a00][SLP] nfsd
 414 ffffff007b2952e8 ffffffffb414c000    0     1   414 0000000 [SLPQ
accept 0xffffff00617596d6][SLP] nfsd
 406 ffffff007b2b78b8 ffffffffb4194000    0     1   406 0000000 [SLPQ
select 0xffffffff8052fb70][SLP] mountd
 354 ffffff007b2daba0 ffffffffb419a000    0     1   354 0000000 [SLPQ
select 0xffffffff8052fb70][SLP] rpcbind
 341 ffffff0062a622e8 ffffffffb4264000    0     1   341 0000000 [SLPQ
select 0xffffffff8052fb70][SLP] syslogd
 321 ffffff0062a26000 ffffffffb426d000    0     1   321 0000000 [SLPQ
select 0xffffffff8052fb70][SLP] devd
 245 ffffff0062bc0ba0 ffffffffb41f9000    0     1   245 0000000 [SLPQ
pause 0xffffff0062bc0c10][SLP] adjkerntz
 106 ffffff007b2da000 ffffffffb4196000    0     0     0 0000204 [SLPQ
- 0xffffffffb4173c0c][SLP] schedcpu
 105 ffffff007b796000 ffffffffb1b8b000    0     0     0 0000204 [SLPQ
- 0xffffffff805344d8][SLP] nfsiod 3
 104 ffffff007b7962e8 ffffffffb1b8c000    0     0     0 0000204 [SLPQ
- 0xffffffff805344d0][SLP] nfsiod 2
 103 ffffff007b7965d0 ffffffffb1b8d000    0     0     0 0000204 [SLPQ
- 0xffffffff805344c8][SLP] nfsiod 1
 102 ffffff007b7968b8 ffffffffb1b8e000    0     0     0 0000204 [SLPQ
- 0xffffffff805344c0][SLP] nfsiod 0
 101 ffffff007b796ba0 ffffffffb1b8f000    0     0     0 0000204 [SLPQ
syncer 0xffffffff80527120][SLP] syncer
 100 ffffff007b7d8000 ffffffffb1b90000    0     0     0 0000204 [SLPQ
vlruwt 0xffffff007b7d8000][SLP] vnlru
  99 ffffff007b7d82e8 ffffffffb1b91000    0     0     0 0000204 [SLPQ
wdrain 0xffffffff805304e8][SLP] bufdaemon
  98 ffffff007b7d85d0 ffffffffb1b92000    0     0     0 000020c [SLPQ
pgzero 0xffffffff8053ce74][SLP] pagezero
  97 ffffff007b7d88b8 ffffffffb1b93000    0     0     0 0000204 [SLPQ
psleep 0xffffffff8053cedc][SLP] vmdaemon
  96 ffffff007b7d8ba0 ffffffffb1b94000    0     0     0 0000204 [CPU
2] pagedaemon
  95 ffffff007b7bd000 ffffffffb1bef000    0     0     0 0000204
[IWAIT] swi0: sio
   9 ffffff007b7bd2e8 ffffffffb1bf0000    0     0     0 0000204 [SLPQ
actask 0xffffffff8051a000][SLP] acpi_task2
   8 ffffff007b7bd5d0 ffffffffb1bf1000    0     0     0 0000204 [SLPQ
actask 0xffffffff8051a000][SLP] acpi_task1
   7 ffffff007b7bd8b8 ffffffffb1bf2000    0     0     0 0000204 [SLPQ
actask 0xffffffff8051a000][SLP] acpi_task0
  94 ffffff007b7bdba0 ffffffffb1bf3000    0     0     0 0000204
[IWAIT] swi6: acpitaskq
   6 ffffff007b7472e8 ffffffffb1b23000    0     0     0 0000204 [SLPQ
- 0xffffff00009d1100][SLP] kqueue taskq
  93 ffffff007b7475d0 ffffffffb1b24000    0     0     0 0000204 [IWAIT] swi6:+
   5 ffffff007b7478b8 ffffffffb1b25000    0     0     0 0000204 [SLPQ
- 0xffffff00009d1280][SLP] thread taskq
  92 ffffff007b747ba0 ffffffffb1b26000    0     0     0 0000204 [IWAIT] swi6:+
  91 ffffff007b775000 ffffffffb1b27000    0     0     0 0000204
[IWAIT] swi6: task queue
  90 ffffff007b7752e8 ffffffffb1b28000    0     0     0 0000204
[IWAIT] swi3: cambio
  89 ffffff007b7755d0 ffffffffb1b29000    0     0     0 0000204
[IWAIT] swi2: camnet
  88 ffffff007b7758b8 ffffffffb1b2a000    0     0     0 0000204 [SLPQ
- 0xffffffff8051a720][SLP] yarrow
   4 ffffff007b775ba0 ffffffffb1b2b000    0     0     0 0000204 [CPU 0] g_down
   3 ffffff007b7f9000 ffffffffb1b86000    0     0     0 0000204 [CPU 3] g_up
   2 ffffff007b7f92e8 ffffffffb1b87000    0     0     0 0000204 [SLPQ
- 0xffffffff8051e490][SLP] g_event
  87 ffffff007b7f95d0 ffffffffb1b88000    0     0     0 0000204
[IWAIT] swi1: net
  86 ffffff007b7f98b8 ffffffffb1b89000    0     0     0 0000204
[IWAIT] swi4: vm
  85 ffffff007b7f9ba0 ffffffffb1b8a000    0     0     0 000020c
[RUNQ] swi5: clock sio
  84 ffffff007b7518b8 ffffffffb1ada000    0     0     0 0000204 [IWAIT] irq23:
  83 ffffff007b751ba0 ffffffffb1adb000    0     0     0 0000204 [IWAIT] irq22:
  82 ffffff007b761000 ffffffffb1adc000    0     0     0 0000204 [IWAIT] irq21:
  81 ffffff007b7612e8 ffffffffb1add000    0     0     0 0000204 [IWAIT] irq20:
  80 ffffff007b7615d0 ffffffffb1ade000    0     0     0 0000204 [IWAIT] irq19:
  79 ffffff007b7618b8 ffffffffb1adf000    0     0     0 0000204 [IWAIT] irq18:
  78 ffffff007b761ba0 ffffffffb1ae0000    0     0     0 0000204 [IWAIT] irq17:
  77 ffffff007b763000 ffffffffb1ae1000    0     0     0 0000204
[RUNQ] irq16: bge0 bge1
  76 ffffff007b7632e8 ffffffffb1b1e000    0     0     0 0000204
[IWAIT] irq15: ata1
  75 ffffff007b7635d0 ffffffffb1b1f000    0     0     0 0000204
[IWAIT] irq14: ata0
  74 ffffff007b7638b8 ffffffffb1b20000    0     0     0 0000204 [IWAIT] irq13:
  73 ffffff007b763ba0 ffffffffb1b21000    0     0     0 0000204 [IWAIT] irq12:
  72 ffffff007b747000 ffffffffb1b22000    0     0     0 0000204 [IWAIT] irq11:
  71 ffffff007b7d62e8 ffffffffb1a92000    0     0     0 0000204 [IWAIT] irq10:
  70 ffffff007b7d65d0 ffffffffb1a93000    0     0     0 0000204
[IWAIT] irq9: acpi0
  69 ffffff007b7d68b8 ffffffffb1a94000    0     0     0 0000204
[IWAIT] irq8: rtc
  68 ffffff007b7d6ba0 ffffffffb1a95000    0     0     0 0000204 [IWAIT] irq7:
  67 ffffff007b74e000 ffffffffb1a96000    0     0     0 0000204 [IWAIT] irq6:
  66 ffffff007b74e2e8 ffffffffb1a97000    0     0     0 0000204 [IWAIT] irq5:
  65 ffffff007b74e5d0 ffffffffb1a98000    0     0     0 0000204
[IWAIT] irq4: sio0
  64 ffffff007b74e8b8 ffffffffb1ad5000    0     0     0 0000204
[IWAIT] irq3: sio1
  63 ffffff007b74eba0 ffffffffb1ad6000    0     0     0 0000204
[IWAIT] irq0: clk
  62 ffffff007b751000 ffffffffb1ad7000    0     0     0 0000204
[IWAIT] irq1: atkbd0
  61 ffffff007b7512e8 ffffffffb1ad8000    0     0     0 0000204 [IWAIT] irq47:
  60 ffffff007b7515d0 ffffffffb1ad9000    0     0     0 0000204 [IWAIT] irq46:
  59 ffffff007b770000 ffffffffb1a4b000    0     0     0 0000204 [IWAIT] irq45:
  58 ffffff007b7702e8 ffffffffb1a4c000    0     0     0 0000204 [IWAIT] irq44:
  57 ffffff007b7705d0 ffffffffb1a4d000    0     0     0 0000204 [IWAIT] irq43:
  56 ffffff007b7708b8 ffffffffb1a4e000    0     0     0 0000204 [IWAIT] irq42:
  55 ffffff007b770ba0 ffffffffb1a4f000    0     0     0 0000204 [IWAIT] irq41:
  54 ffffff007b771000 ffffffffb1a50000    0     0     0 0000204 [IWAIT] irq40:
  53 ffffff007b7712e8 ffffffffb1a8d000    0     0     0 0000204 [IWAIT] irq39:
  52 ffffff007b7715d0 ffffffffb1a8e000    0     0     0 0000204
[IWAIT] irq38: ips0
  51 ffffff007b7718b8 ffffffffb1a8f000    0     0     0 0000204 [IWAIT] irq37:
  50 ffffff007b771ba0 ffffffffb1a90000    0     0     0 0000204 [IWAIT] irq36:
  49 ffffff007b7d6000 ffffffffb1a91000    0     0     0 0000204 [IWAIT] irq35:
  48 ffffff007b780000 ffffffffb1a05000    0     0     0 0000204 [IWAIT] irq34:
  47 ffffff007b7802e8 ffffffffb1a06000    0     0     0 0000204 [IWAIT] irq33:
  46 ffffff007b7805d0 ffffffffb1a07000    0     0     0 0000204 [IWAIT] irq32:
  45 ffffff007b7808b8 ffffffffb1a08000    0     0     0 0000204 [IWAIT] irq31:
  44 ffffff007b780ba0 ffffffffb1a09000    0     0     0 0000204 [IWAIT] irq30:
  43 ffffff007b783000 ffffffffb1a46000    0     0     0 0000204 [IWAIT] irq29:
  42 ffffff007b7832e8 ffffffffb1a47000    0     0     0 0000204 [IWAIT] irq28:
  41 ffffff007b7835d0 ffffffffb1a48000    0     0     0 0000204 [IWAIT] irq27:
  40 ffffff007b7838b8 ffffffffb1a49000    0     0     0 0000204 [IWAIT] irq26:
  39 ffffff007b783ba0 ffffffffb1a4a000    0     0     0 0000204 [IWAIT] irq25:
  38 ffffff007b7662e8 ffffffffb19c0000    0     0     0 0000204 [IWAIT] irq24:
  37 ffffff007b7665d0 ffffffffb19c1000    0     0     0 0000204 [IWAIT] irq71:
  36 ffffff007b7668b8 ffffffffb19c2000    0     0     0 0000204 [IWAIT] irq70:
  35 ffffff007b766ba0 ffffffffb19c3000    0     0     0 0000204 [IWAIT] irq69:
  34 ffffff007b7b5000 ffffffffb1a00000    0     0     0 0000204 [IWAIT] irq68:
  33 ffffff007b7b52e8 ffffffffb1a01000    0     0     0 0000204 [IWAIT] irq67:
  32 ffffff007b7b55d0 ffffffffb1a02000    0     0     0 0000204 [IWAIT] irq66:
  31 ffffff007b7b58b8 ffffffffb1a03000    0     0     0 0000204 [IWAIT] irq65:
  30 ffffff007b7b5ba0 ffffffffb1a04000    0     0     0 0000204 [IWAIT] irq64:
  29 ffffff007b7dc8b8 ffffffffb199a000    0     0     0 0000204 [IWAIT] irq63:
  28 ffffff007b7dcba0 ffffffffb199b000    0     0     0 0000204 [IWAIT] irq62:
  27 ffffff007b784000 ffffffffb199c000    0     0     0 0000204 [IWAIT] irq61:
  26 ffffff007b7842e8 ffffffffb19bb000    0     0     0 0000204 [IWAIT] irq60:
  25 ffffff007b7845d0 ffffffffb19bc000    0     0     0 0000204 [IWAIT] irq59:
  24 ffffff007b7848b8 ffffffffb19bd000    0     0     0 0000204 [IWAIT] irq58:
  23 ffffff007b784ba0 ffffffffb19be000    0     0     0 0000204 [IWAIT] irq57:
  22 ffffff007b766000 ffffffffb19bf000    0     0     0 0000204 [IWAIT] irq56:
  21 ffffff007b7d42e8 ffffffffb1975000    0     0     0 0000204 [IWAIT] irq55:
  20 ffffff007b7d45d0 ffffffffb1976000    0     0     0 0000204 [IWAIT] irq54:
  19 ffffff007b7d48b8 ffffffffb1995000    0     0     0 0000204
[IWAIT] irq53: mpt1
  18 ffffff007b7d4ba0 ffffffffb1996000    0     0     0 0000204 [CPU
1] irq52: mpt0
  17 ffffff007b7dc000 ffffffffb1997000    0     0     0 0000204 [IWAIT] irq51:
  16 ffffff007b7dc2e8 ffffffffb1998000    0     0     0 0000204 [IWAIT] irq50:
  15 ffffff007b7dc5d0 ffffffffb1999000    0     0     0 0000204 [IWAIT] irq49:
  14 ffffff007b76d000 ffffffffb1933000    0     0     0 0000204 [IWAIT] irq48:
  13 ffffff007b76d2e8 ffffffffb1970000    0     0     0 000020c [Can
run] idle: cpu0
  12 ffffff007b76d5d0 ffffffffb1971000    0     0     0 000020c [Can
run] idle: cpu1
  11 ffffff007b76d8b8 ffffffffb1972000    0     0     0 000020c [Can
run] idle: cpu2
  10 ffffff007b76dba0 ffffffffb1973000    0     0     0 000020c [Can
run] idle: cpu3
   1 ffffff007b7d4000 ffffffffb1974000    0     0     1 0004200 [SLPQ
wait 0xffffff007b7d4000][SLP] init
   0 ffffffff8051e580 ffffffff805f5000    0     0     0 0000200 [SLPQ
sched 0xffffffff8051e580][SLP] swapper

Regards,
Rong-En Fan

freebsd stable - Feb 2005 - panic: Fatal trap 12: page fault while in kernel mode

panic: Fatal trap 12: page fault while in kernel mode

panic: Fatal trap 12: page fault while in kernel mode