thr3ads.net - asterisk users - [asterisk-users] Asterisk 1.4.x segfaulting daily [Dec 2011]

If this information is useful, please help other people find it:
Share via:

Paulo Santos

2011-Dec-14 12:56 UTC

[asterisk-users] Asterisk 1.4.x segfaulting daily

Hello list,

An Asterisk installation that was doing fine suddenly stared segfaulting 
a couple of times per day. I enabled all the logging and debugging to 
try to find a pattern but there was too much information to see exactly 
where it broke. So I enabled core dump and did backtraces and all of 
them seem to break on ast_setstate, setting the state to AST_STATE_DOWN. 
That's pretty much the only thing I can make of it, don't even know if 
that's correct.

Does anyone have any ideas on why this is happening? The backtrace is 
attached.

P.S.: I've switched the whole hardware already, including the BRI card 
(B400P, OpenVox). Also tried different versions of Asterisk, Dahdi and 
mISDN. I'm stuck with 1.4 Asterisk branch and mISDN v1.


Best regards,
Paulo Santos
-------------- next part --------------
Core was generated by `/usr/sbin/asterisk'.
Program terminated with signal 11, Segmentation fault.
[New process 21726]
[New process 24376]
[New process 24375]
[New process 24374]
[New process 24371]
[New process 24344]
[New process 23560]
[New process 22868]
[New process 22329]
[New process 22327]
[New process 22325]
[New process 22324]
[New process 22323]
[New process 22322]
[New process 22321]
[New process 22320]
[New process 22319]
[New process 22318]
[New process 22317]
[New process 22316]
[New process 22315]
[New process 22259]
[New process 22208]
[New process 22203]
[New process 22185]
[New process 22184]
[New process 22160]
[New process 21515]
[New process 21725]
[New process 21687]
[New process 21686]
[New process 21685]
[New process 21681]
[New process 21659]
[New process 21658]
[New process 21648]
[New process 21647]
[New process 21609]
[New process 21594]
[New process 21542]
[New process 21540]
[New process 21516]
#0  0x080851ee in ast_setstate (chan=0xb3401c00, state=AST_STATE_DOWN) at
/usr/src/asterisk-1.4.42/include/asterisk/strings.h:37
37		return (!s || (*s == '\0'));
#0  0x080851ee in ast_setstate (chan=0xb3401c00, state=AST_STATE_DOWN) at
/usr/src/asterisk-1.4.42/include/asterisk/strings.h:37
	name =
"mISDN/4\000u1111\000??77?\020\000@?\b(@?H0?f\211q?\020\000@?\b(@?\000\000@??e?\b(@?X\b@?h0?\203\225a?P[
3] \000\000\000\000\000"
#1  0xb561975d in release_chan (ch=0xb3400858, bc=0x88e8f5c) at
chan_misdn.c:3750
	ast = (struct ast_channel *) 0xb3401c00
#2  0xb5622275 in cb_events (event=EVENT_CLEANUP, bc=0x88e8f5c, user_data=0x0)
at chan_misdn.c:4845
	msn_valid = -1287644160
	held_ch = <value optimized out>
	ch = (struct chan_list *) 0xb3400858
	__PRETTY_FUNCTION__ = "cb_events"
#3  0xb5632d9f in handle_cr (stack=0x88e82d8, frm=<value optimized out>)
at misdn/isdn_lib.c:1684
	channel = 255
	bc = (struct misdn_bchannel *) 0x88e8f5c
	dummybc = {send_lock = 0xb67feff4, dummy = -1260570753, nt = -1260572104, pri =
-1234083825, port = -1260572068, b_stid = -1260571776,
  layer_id = -1260570753, layer = -1234274741, need_disconnect = -1233129484,
need_release = -1260572068, need_release_complete = -1260571776,
  dec = -1260571832, l3_id = -1234111388, pid = -1260572068, ces = -1251638304,
restart_channel = -1260570700, channel = -1260571776,
  channel_preselected = 0, in_use = -1260571908, last_used = {tv_sec = 1023,
tv_usec = -72515583}, cw = -1260571776, addr = -1260571776,
  bframe = 0xb4dd3380 "handle_frm: frm->addr:42000303
frm->prim:3f182\n", bframe_len = -1260571776, time_usec = -1260571729,
  astbuf = 0xb4dd377f, misdnbuf = 0xb4dd3380, te_choose_channel = -1260570753,
early_bconnect = 0, dtmf = 0, send_dtmf = 0,
  need_more_infos = 0, sending_complete = 0, nodsp = 1635021600, nojitter = 0,
dnumplan = NUMPLAN_UNKNOWN, rnumplan = 1308622848,
  onumplan = NUMPLAN_UNKNOWN, cpnnumplan = NUMPLAN_UNINITIALIZED,
progress_coding = 824193585, progress_location = 942881334,
  progress_indicator = 3617594, fac_in = {Function = Fac_GetSupportedServices, u
= {Listen = {NotificationMask = 21}, Suspend = {
        CallIdentity =
"\025\000\000\000\000\000\000\000????\000\000\000"}, Resume = {
        CallIdentity =
"\025\000\000\000\000\000\000\000????\000\000\000"}, CFActivate =
{Handle = 21, Procedure = 0, BasicService = 0,
        ServedUserNumber = "????\000\000\000\000?e?\001\000\000",
ForwardedToNumber = "@?77?\000\000\000\000?a?\0203?",
        ForwardedToSubaddress = "\000\004\000\000?ze?<7?@?77?"},
CFDeactivate = {Handle = 21, Procedure = 0, BasicService = 0,
        ServedUserNumber = "????\000\000\000\000?e?\001\000\000"},
CFInterrogateParameters = {Handle = 21, Procedure = 0, BasicService = 0,
        ServedUserNumber = "????\000\000\000\000?e?\001\000\000"},
CFInterrogateNumbers = {Handle = 21}, CDeflection = {
        PresentationAllowed = 21, DeflectedToNumber =
"\000\000\000\000\000\000????\000\000\000\000?",
        DeflectedToSubaddress =
"e?\001\000\000\000@?77?\000\000\000\000?"}, AOCDchu =
{chargeNotAvailable = 21, freeOfCharge = 0,
        recordedUnits = 0, typeOfChargingInfo = -1, billingId = 0}, AOCDcur =
{chargeNotAvailable = 21, freeOfCharge = 0,
        currency = "\000\000\000\000????\000\000", currencyAmount =
-1251629616, multiplier = 1, typeOfChargingInfo = -1233131200,
        billingId = 0}}}, fac_out = {Function = Fac_GetSupportedServices, u =
{Listen = {NotificationMask = 0}, Suspend = {
        CallIdentity = "\000\000\000\000\0203?\0203?\0207?"}, Resume =
{CallIdentity = "\000\000\000\000\0203?\0203?\0207?"},
      CFActivate = {Handle = 0, Procedure = 13072, BasicService = 46301,
ServedUserNumber = "\0203?\0207?3nw??77?",
        ForwardedToNumber = "Idx:2 stack->cch",
ForwardedToSubaddress = "?77?\003\000\000\000\004\000\000\000H3?"},
CFDeactivate = {
        Handle = 0, Procedure = 13072, BasicService = 46301, ServedUserNumber =
"\0203?\0207?3nw??77?"}, CFInterrogateParameters = {
        Handle = 0, Procedure = 13072, BasicService = 46301, ServedUserNumber =
"\0203?\0207?3nw??77?"}, CFInterrogateNumbers = {
        Handle = 0}, CDeflection = {PresentationAllowed = 0, DeflectedToNumber =
"\000\000\0203?\0203?\0207?3n",
        DeflectedToSubaddress = "w??77?Idx:2 stac"}, AOCDchu =
{chargeNotAvailable = 0, freeOfCharge = 0, recordedUnits = -1260571888,
        typeOfChargingInfo = -1260571888, billingId = -1260570864}, AOCDcur =
{chargeNotAvailable = 0, freeOfCharge = 0,
        currency = "\0203?\0203?\0207?, currencyAmount = -1233686989,
multiplier = -1233129484, typeOfChargingInfo = 980968521,
        billingId = 1953701938}}}, AOCDtype = 3060733218, AOCD = {currency =
{chargeNotAvailable = 14208, freeOfCharge = 46301,
      currency = "\b\000\000\000?e?\003\000", currencyAmount = 4,
multiplier = -1260570728, typeOfChargingInfo = -1251903534,
      billingId = -1260571776}, chargingUnit = {chargeNotAvailable = 14208,
freeOfCharge = 46301, recordedUnits = 8,
      typeOfChargingInfo = -1251629616, billingId = 3}}, evq = 1024, crypt =
-1251638304, curprx = -1260570708, curptx = -1233123456,
  crypt_key = "t4?d?2103?\2003?\2007?\200\a\200?\000\000\000\000handle_frm:
frm->addr:42000303
frm->prim:3f182\n\000;+?\b??\017`q???\b;+?\bKvn??77???\b??d?3?\205?\023\bp5???\b\000\000\000\000\2344?h\000\000\000\001\200??b??\b??\b??\b??\b;+?\b??\b;+?\b",
'\0' <repeats 20 times>, "b*"..., crypt_state = -1,
active = 0, upset = -72515583, generate_tone = 134217728, tone_cnt = 0,
  bc_state = 146243847, next_bc_state = 146243847, conf_id = -1234072719, holded
= 146243860, stack_holder = 0, pres = -1233129484,
  screen = -1233131200, capability = 0, law = -1234072719, rate = -1260571428,
mode = 146243847, user1 = 146243860, urate = -1234274741,
  hdlc = -1233129484, 
  display =
"??\a\201?\b?002\200??M~?\230\001\200??\000\000\000\026\000\000\000\a\201?\b\000\000\000\000|5?\030?8*?\b\227\000\000\000\000\000\000\000(5??\020\b??\bi\000\000\000\205?\023\b?q?\000\000\000",
  msn =
"\000\000\000\000\000\000\000\000\002A?\2169q?T<?\001\000\000\000\201\000\000\000\001\000\000",
  oad =
"\000\000\000\0002011?7r??77??q?\000\000\000\000t5?\215\201p?",
  rad = "\004A?\f??T<??q?\f??\002\000\000\000\001\000\000\000\n=?",
  dad =
"?\200p?p<?\222?c?\002\000\000\000\023\000\000\000\022\000\000\000??ddn?",
  cad = "?77???c?\023\000\000\000?;?\227|n?????c?\023\000\000", 
  orig_dad =
"\000\000\000\000\210\203n???\200\a\200????\020\021\000\000????",
  keypad =
"\210\203n?\024;?\000\000\000\000\002\000\000\000q\000\000\000\001\200??\200\a\200?",
  info_dad = "0;?\200\a\200?@\000\000\000?200?\200\a\200?p<?",
'\0' <repeats 16 times>,
"????\006\000\000\000\221?c?\217?c?\000\000\000\000??",
  infos_pending =
"\000\000\000\000????\035\000\000\000??c???c?\000\000\000\000,A?",
'\0' <repeats 20 times>,
"\n\000\000\000.;?\000\000\000\000\000\000\000",
  uu = '\0' <repeats 36 times>, "
Hs??Y\205\b?S\205\b?\bu:~d?Ks??000\000\000?05\bv
s??=\000\000\004\000\000\000v\002\000\000?77?\200\a\200?%\000\000\000??\"\025o?\200\a\200?r\000\000\000????77?(7?k$s?\200\a\200??q???\024%~?\221%~??\2169q?D>?%\000\000\000?a\000\000\001\000\000\000\000\000\000\000\024;?\001\000\000\000?77??q?\000\000\000\000d7?\215\201p??\f??D>?`Nq??..,
uulen = 31,
  cause = -1234273129, out_cause = -1260569168, ec_enable = -1251758190,
ec_deftaps = -1233129484, channel_found = 31, orig = -1260569140,
  txgain = 857758544, rxgain = -1241505699, next = 0xb5632c6b}
	bc = <value optimized out>
#4  0xb5634439 in handle_frm (msg=0x8900a88) at misdn/isdn_lib.c:2678
	dummybc = {send_lock = 0xb67feff4, dummy = -1260567825, nt = -1260569176, pri =
-1234083825, port = -1260569140, b_stid = -1260568848,
  layer_id = -1260567825, layer = -1234274741, need_disconnect = -1233129484,
need_release = -1260569140, need_release_complete = -1260568848,
  dec = -1260568904, l3_id = -1234111388, pid = -1260569140, ces = -1251637364,
restart_channel = -1260567780, channel = -1260568848,
  channel_preselected = 0, in_use = -1260568980, last_used = {tv_sec = 1023,
tv_usec = -72515583}, cw = -1260568848, addr = -1260568848,
  bframe = 0xb4dd3ef0 "MGMT: SSTATUS: L1_DEACTIVATED \n", bframe_len =
-1260568848, time_usec = -1260568817, astbuf = 0xb4dd42ef,
  misdnbuf = 0xb4dd3ef0, te_choose_channel = -1260567825, early_bconnect = 0,
dtmf = 0, send_dtmf = 0, need_more_infos = 0,
  sending_complete = 0, nodsp = -1251643208, nojitter = 0, dnumplan =
NUMPLAN_UNKNOWN, rnumplan = -1275068416, onumplan = NUMPLAN_UNKNOWN,
  cpnnumplan = NUMPLAN_UNINITIALIZED, progress_coding = -72515583,
progress_location = 1095254850, progress_indicator = 1646279246, fac_in = {
    Function = Fac_GetSupportedServices, u = {Listen = {NotificationMask =
1413693728}, Suspend = {CallIdentity = " ACT Con???? pid"},
      Resume = {CallIdentity = " ACT Con???? pid"}, CFActivate =
{Handle = 1413693728, Procedure = 17184, BasicService = 28271,
        ServedUserNumber = "???? pid:329\n\000m:", ForwardedToNumber =
"@?77?\000\000\000\000th addr:",
        ForwardedToSubaddress = "55020280 din@?77?"}, CFDeactivate =
{Handle = 1413693728, Procedure = 17184, BasicService = 28271,
        ServedUserNumber = "???? pid:329\n\000m:"},
CFInterrogateParameters = {Handle = 1413693728, Procedure = 17184, BasicService
= 28271,
        ServedUserNumber = "???? pid:329\n\000m:"},
CFInterrogateNumbers = {Handle = 1413693728}, CDeflection = {PresentationAllowed
= 16672,
        DeflectedToNumber = "CT Con???? pid:3", DeflectedToSubaddress
= "29\n\000m:@?77?\000\000\000\000th"}, AOCDchu = {
        chargeNotAvailable = 16672, freeOfCharge = 21571, recordedUnits =
1852785440, typeOfChargingInfo = -1, billingId = 1684631584},
      AOCDcur = {chargeNotAvailable = 16672, freeOfCharge = 21571, currency =
" Con???? pi", currencyAmount = 959591226,
        multiplier = 980221962, typeOfChargingInfo = -1233131200, billingId =
0}}}, fac_out = {Function = Fac_GetSupportedServices, u = {
      Listen = {NotificationMask = 1717986918}, Suspend = {CallIdentity =
"ffff\n\000?\b\220>?f\211q?"}, Resume = {
        CallIdentity = "ffff\n\000?\b\220>?f\211q?"}, CFActivate =
{Handle = 1717986918, Procedure = 10, BasicService = 2231,
        ServedUserNumber = "\220>?f\211q?\000\000\000\000?u?\b",
ForwardedToNumber = "\230u?\b????\220K??u?\b",
        ForwardedToSubaddress =
"?77?\003\000\000\000\003\000\000\000?>?"}, CFDeactivate = {Handle
= 1717986918, Procedure = 10,
        BasicService = 2231, ServedUserNumber =
"\220>?f\211q?\000\000\000\000?u?\b"}, CFInterrogateParameters =
{Handle = 1717986918,
        Procedure = 10, BasicService = 2231, ServedUserNumber =
"\220>?f\211q?\000\000\000\000?u?\b"}, CFInterrogateNumbers = {
        Handle = 1717986918}, CDeflection = {PresentationAllowed = 26214,
DeflectedToNumber = "ff\n\000?\b\220>?f\211q?\000",
        DeflectedToSubaddress = "\000\000?u?\b\230u?\b????\220K"},
AOCDchu = {chargeNotAvailable = 26214, freeOfCharge = 26214,
        recordedUnits = 146210826, typeOfChargingInfo = -1260568944, billingId =
-1234073242}, AOCDcur = {chargeNotAvailable = 26214,
        freeOfCharge = 26214, currency = "\n\000?\b\220>?f\211q",
currencyAmount = 0, multiplier = 146240928, typeOfChargingInfo = 146240920,
        billingId = -1}}}, AOCDtype = 3060733218, AOCD = {currency =
{chargeNotAvailable = 17136, freeOfCharge = 46301,
      currency = "\b\000\000\000?e?\003\000", currencyAmount = 3,
multiplier = -1260567800, typeOfChargingInfo = -1251903534,
      billingId = -1260568848}, chargingUnit = {chargeNotAvailable = 17136,
freeOfCharge = 46301, recordedUnits = 8,
      typeOfChargingInfo = -1251629616, billingId = 3}}, evq = 1024, crypt =
-1251637364, curprx = -1260567780, curptx = -1260568548,
  crypt_key = "\tMs?\003\000\000\000u:~???\006\000\000\000\b??MGMT:
SSTATUS: L1_DEACTIVATED \n\000\n\000?\000\004\000\000?pe?lC?481 len 0 from
a@??@C?0280, diGot empty
Msg..\n\000t.\n\000`q?\230??\200\a\200??200?Kvn??77?\230??\200\a\200?\204@?d?230??????q\213q?\000\000\000\0008@?q\000\000\000\001\200??,
crypt_state = 116905, active = 0, upset = 146504784, generate_tone = 146232224,
tone_cnt = 0,
  bc_state = BCHAN_CLEANED, next_bc_state = 3034398720, conf_id = -1233129484,
holded = -1260568408, stack_holder = -1233686989,
  pres = -1233129484, screen = -1260568244, capability = -1233957623, law = 3,
rate = -1233241483, mode = -1260568408, user1 = 17,
  urate = 802128802, hdlc = -1234089132, 
  display =
"?\001????77??200?T@?\017`q?x@?\200\a\200??200?Kvn??77?x@?\200\a\200?dA?d?@????A?\200\a\200?\000\000\000\000\030A?",
msn =
"q\000\000\000\001\200??\a\200?\200\a\200?\200\a\200?\200\a\200?\231\a\200??200?",
  oad = "\200\a\200?2011", '\0' <repeats 23 times>, rad
= "\000\000\000\000?\201\000\000???77?xA?3nw??77?\034B?",
  dad = "\tMs?2011u:~?xA?\000\000\000\000?q??\203?", cad =
"\000\000\000\000?77?\020A??77??A?3nw??77?\\B?",
  orig_dad = "\tMs?\003\000\000\000u:~??A?4B?d?Kq???", keypad =
"\200B??77??200?dA?\017`q?\210A?\200\a\200??200?",
  info_dad =
"Kvn??77?\210A?\200\a\200?tB?d?210A?????\200\a\200?\000\000\000\000(B?q\000\000\000\001\200??\a\200?\200\a\200?",
infos_pending =
"\200\a\200?\200\a\200?\231\a\200??200?\200\a\200??200?", '\0'
<repeats 28 times>, "?\201\000\000\000\000\000\000\000\000\000",
  uu = '\0' <repeats 25 times>,
"\020\000\000????\000\000\000\000?00\000\000\000?\203?\000\000\000\000?\203?\000\000\000\000\204@\032\000???Y\205\b@?77?\000\000\000\000\000\000\000\000?77?\001\000\000\000\2169q?\204B?
Hs??Y\205\b?S\205\b?\b\000\000\000\000?Ks??q??05\b?\000\000\000\000\000\000\001\000\000\000v\002\000\000?77?\020\000\000\000?\n\220\b\000\000\000\000XC????\212\b\230\002\213\b\020\000\000\000?77???k$s?\203?033C\020\000\000\000\000\000\000\000\024%~?\221%~"...,
uulen = 0, cause = 0, out_cause = -1252065985,
  ec_enable = -1233123456, ec_deftaps = 10, channel_found = -1251971708, orig =
-1251629616, txgain = 143657660, rxgain = 143657608,
  next = 0xb563436b}
	bc = <value optimized out>
	ret = <value optimized out>
	frm = (iframe_t *) 0x8900abc
	stack = (struct misdn_stack *) 0x88e82d8
#5  0xb56357fd in manager_isdn_handler (frm=0x8900abc, msg=0x8900a88) at
misdn/isdn_lib.c:3763
	unhandled_bmsg_count = 400
#6  0xb56361d4 in misdn_lib_isdn_event_catcher (arg=0x88b0208) at
misdn/isdn_lib.c:3117
	msg = (msg_t *) 0x8900a88
	frm = (iframe_t *) 0x8900abc
	zero_frm = 0
	fff_frm = 0
	midev = 21
#7  0xb77124c0 in start_thread () from /lib/i686/cmov/libpthread.so.0
No symbol table info available.
#8  0xb678884e in clone () from /lib/i686/cmov/libc.so.6
No symbol table info available.

Thread 42 (process 21516):
#0  0xb7738424 in __kernel_vsyscall ()
#1  0xb677dfa7 in poll () from /lib/i686/cmov/libc.so.6
#2  0x0806bd71 in listener (unused=0x0) at asterisk.c:1031
#3  0x0810911b in dummy_start (data=0x885a4c8) at utils.c:856
#4  0xb77124c0 in start_thread () from /lib/i686/cmov/libpthread.so.0
#5  0xb678884e in clone () from /lib/i686/cmov/libc.so.6

Thread 41 (process 21540):
#0  0xb7738424 in __kernel_vsyscall ()
#1  0xb677dfa7 in poll () from /lib/i686/cmov/libc.so.6
#2  0x080bb652 in accept_thread (ignore=0x0) at manager.c:2570
#3  0x0810911b in dummy_start (data=0x885e390) at utils.c:856
#4  0xb77124c0 in start_thread () from /lib/i686/cmov/libpthread.so.0
#5  0xb678884e in clone () from /lib/i686/cmov/libc.so.6

Thread 40 (process 21542):
#0  0xb7738424 in __kernel_vsyscall ()
#1  0xb7716025 in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib/i686/cmov/libpthread.so.0
#2  0x0809c97e in do_devstate_changes (data=0x0) at
/usr/src/asterisk-1.4.42/include/asterisk/lock.h:804
#3  0x0810911b in dummy_start (data=0x885eb30) at utils.c:856
#4  0xb77124c0 in start_thread () from /lib/i686/cmov/libpthread.so.0
#5  0xb678884e in clone () from /lib/i686/cmov/libc.so.6

Thread 39 (process 21594):
#0  0xb7738424 in __kernel_vsyscall ()
#1  0xb677dfa7 in poll () from /lib/i686/cmov/libc.so.6
#2  0xb61a8ae2 in shaun_of_the_dead (data=0x0) at res_agi.c:2299
#3  0x0810911b in dummy_start (data=0x8862ea0) at utils.c:856
#4  0xb77124c0 in start_thread () from /lib/i686/cmov/libpthread.so.0
#5  0xb678884e in clone () from /lib/i686/cmov/libc.so.6

Thread 38 (process 21609):
#0  0xb7738424 in __kernel_vsyscall ()
#1  0xb677e1e4 in ppoll () from /lib/i686/cmov/libc.so.6
#2  0x080d8135 in ast_poll2 (pArray=0x0, n_fds=0, tv=0x0) at poll.c:275
#3  0xb614f7ee in do_parking_thread (ignore=0x0) at res_features.c:2970
#4  0x0810911b in dummy_start (data=0x8867880) at utils.c:856
#5  0xb77124c0 in start_thread () from /lib/i686/cmov/libpthread.so.0
#6  0xb678884e in clone () from /lib/i686/cmov/libc.so.6

Thread 37 (process 21647):
#0  0xb7738424 in __kernel_vsyscall ()
#1  0xb677dfa7 in poll () from /lib/i686/cmov/libc.so.6
#2  0xb5edcc35 in sound_thread (arg=0x88747a0) at chan_oss.c:625
#3  0x0810911b in dummy_start (data=0x88720d8) at utils.c:856
#4  0xb77124c0 in start_thread () from /lib/i686/cmov/libpthread.so.0
#5  0xb678884e in clone () from /lib/i686/cmov/libc.so.6

Thread 36 (process 21648):
#0  0xb7738424 in __kernel_vsyscall ()
#1  0xb677dfa7 in poll () from /lib/i686/cmov/libc.so.6
#2  0xb5edcc35 in sound_thread (arg=0x8874e58) at chan_oss.c:625
#3  0x0810911b in dummy_start (data=0x8874618) at utils.c:856
#4  0xb77124c0 in start_thread () from /lib/i686/cmov/libpthread.so.0
#5  0xb678884e in clone () from /lib/i686/cmov/libc.so.6

Thread 35 (process 21658):
#0  0xb7738424 in __kernel_vsyscall ()
#1  0xb6780bf1 in select () from /lib/i686/cmov/libc.so.6
#2  0xb5d1d719 in ooSocketSelect () from
/usr/lib/asterisk/modules/chan_ooh323.so
#3  0xb5d0ab9b in ooMonitorChannels () from
/usr/lib/asterisk/modules/chan_ooh323.so
#4  0xb5e097c7 in ooh323c_stack_thread () from
/usr/lib/asterisk/modules/chan_ooh323.so
#5  0x0810911b in dummy_start (data=0x88794b8) at utils.c:856
#6  0xb77124c0 in start_thread () from /lib/i686/cmov/libpthread.so.0
#7  0xb678884e in clone () from /lib/i686/cmov/libc.so.6

Thread 34 (process 21659):
#0  0xb7738424 in __kernel_vsyscall ()
#1  0xb677dfa7 in poll () from /lib/i686/cmov/libc.so.6
#2  0x080b3164 in ast_io_wait (ioc=0x8869f00, howlong=1000) at io.c:266
#3  0xb5cfac61 in ?? () from /usr/lib/asterisk/modules/chan_ooh323.so
#4  0x08869f00 in ?? ()
#5  0x000003e8 in ?? ()
#6  0x0000000c in ?? ()
#7  0x088794c8 in ?? ()
#8  0x088799e8 in ?? ()
#9  0xb5e2661c in __dso_handle () from /usr/lib/asterisk/modules/chan_ooh323.so
#10 0xb5e26920 in __dso_handle () from /usr/lib/asterisk/modules/chan_ooh323.so
#11 0xb5c83348 in ?? ()
#12 0xb5e0b49b in ?? () from /usr/lib/asterisk/modules/chan_ooh323.so
#13 0xb5e0b483 in ?? () from /usr/lib/asterisk/modules/chan_ooh323.so
#14 0xb5e0b471 in ?? () from /usr/lib/asterisk/modules/chan_ooh323.so
#15 0x00000000 in ?? ()

Thread 33 (process 21681):
#0  0xb7738424 in __kernel_vsyscall ()
#1  0xb677dfa7 in poll () from /lib/i686/cmov/libc.so.6
#2  0x080b3164 in ast_io_wait (ioc=0x8880ff8, howlong=1000) at io.c:266
#3  0xb5bd088c in do_monitor (data=0x0) at chan_mgcp.c:3517
#4  0x0810911b in dummy_start (data=0x8881048) at utils.c:856
#5  0xb77124c0 in start_thread () from /lib/i686/cmov/libpthread.so.0
#6  0xb678884e in clone () from /lib/i686/cmov/libc.so.6

Thread 32 (process 21685):
#0  0xb7738424 in __kernel_vsyscall ()
#1  0xb677dfa7 in poll () from /lib/i686/cmov/libc.so.6
#2  0x080b3164 in ast_io_wait (ioc=0x8885370, howlong=1000) at io.c:266
#3  0xb5b5281b in network_thread (ignore=0x0) at pbx_dundi.c:2162
#4  0x0810911b in dummy_start (data=0x8882c40) at utils.c:856
#5  0xb77124c0 in start_thread () from /lib/i686/cmov/libpthread.so.0
#6  0xb678884e in clone () from /lib/i686/cmov/libc.so.6

Thread 31 (process 21686):
#0  0xb7738424 in __kernel_vsyscall ()
#1  0xb6744036 in nanosleep () from /lib/i686/cmov/libc.so.6
#2  0xb6743e4f in sleep () from /lib/i686/cmov/libc.so.6
#3  0xb5b58604 in process_precache (ign=0x0) at pbx_dundi.c:2240
#4  0x0810911b in dummy_start (data=0x887d318) at utils.c:856
#5  0xb77124c0 in start_thread () from /lib/i686/cmov/libpthread.so.0
#6  0xb678884e in clone () from /lib/i686/cmov/libc.so.6

Thread 30 (process 21687):
#0  0xb7738424 in __kernel_vsyscall ()
#1  0xb6744036 in nanosleep () from /lib/i686/cmov/libc.so.6
#2  0xb6743e4f in sleep () from /lib/i686/cmov/libc.so.6
#3  0xb5b50bb2 in process_clearcache (ignore=0x0) at pbx_dundi.c:2203
#4  0x0810911b in dummy_start (data=0x8887a08) at utils.c:856
#5  0xb77124c0 in start_thread () from /lib/i686/cmov/libpthread.so.0
#6  0xb678884e in clone () from /lib/i686/cmov/libc.so.6

Thread 29 (process 21725):
#0  0xb7738424 in __kernel_vsyscall ()
#1  0xb77183b5 in sem_wait@@GLIBC_2.1 () from /lib/i686/cmov/libpthread.so.0
#2  0xb5634e53 in manager_event_handler (arg=0x88b0208) at misdn/isdn_lib.c:3937
#3  0xb77124c0 in start_thread () from /lib/i686/cmov/libpthread.so.0
#4  0xb678884e in clone () from /lib/i686/cmov/libc.so.6

Thread 28 (process 21515):
#0  0xb7738424 in __kernel_vsyscall ()
#1  0xb677dfa7 in poll () from /lib/i686/cmov/libc.so.6
#2  0x0806b5a9 in monitor_sig_flags (unused=0x0) at asterisk.c:2722
#3  0x080700c8 in main (argc=1, argv=0xbfc93914) at asterisk.c:3348

Thread 27 (process 22160):
#0  0xb7738424 in __kernel_vsyscall ()
#1  0xb677dfa7 in poll () from /lib/i686/cmov/libc.so.6
#2  0x080b3164 in ast_io_wait (ioc=0x8907328, howlong=1000) at io.c:266
#3  0xb43e401b in do_monitor (data=0x0) at chan_sip.c:17737
#4  0x0810911b in dummy_start (data=0x890d9b0) at utils.c:856
#5  0xb77124c0 in start_thread () from /lib/i686/cmov/libpthread.so.0
#6  0xb678884e in clone () from /lib/i686/cmov/libc.so.6

Thread 26 (process 22184):
#0  0xb7738424 in __kernel_vsyscall ()
#1  0xb77192c8 in accept () from /lib/i686/cmov/libpthread.so.0
#2  0xb4345146 in accept_thread (ignore=0x0) at chan_skinny.c:4624
#3  0x0810911b in dummy_start (data=0x890d2e0) at utils.c:856
#4  0xb77124c0 in start_thread () from /lib/i686/cmov/libpthread.so.0
#5  0xb678884e in clone () from /lib/i686/cmov/libc.so.6

Thread 25 (process 22185):
#0  0xb7738424 in __kernel_vsyscall ()
#1  0xb677dfa7 in poll () from /lib/i686/cmov/libc.so.6
#2  0x080b3164 in ast_io_wait (ioc=0x89214f8, howlong=1000) at io.c:266
#3  0xb4342942 in do_monitor (data=0x0) at chan_skinny.c:4688
#4  0x0810911b in dummy_start (data=0x890c278) at utils.c:856
#5  0xb77124c0 in start_thread () from /lib/i686/cmov/libpthread.so.0
#6  0xb678884e in clone () from /lib/i686/cmov/libc.so.6

Thread 24 (process 22203):
#0  0xb7738424 in __kernel_vsyscall ()
#1  0xb677dfa7 in poll () from /lib/i686/cmov/libc.so.6
#2  0xb4240961 in do_monitor (data=0x0) at chan_dahdi.c:7841
#3  0x0810911b in dummy_start (data=0x8908f88) at utils.c:856
#4  0xb77124c0 in start_thread () from /lib/i686/cmov/libpthread.so.0
#5  0xb678884e in clone () from /lib/i686/cmov/libc.so.6

Thread 23 (process 22208):
#0  0xb7738424 in __kernel_vsyscall ()
#1  0xb7716025 in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib/i686/cmov/libpthread.so.0
#2  0xb417b88f in device_state_thread (data=0x0) at
/usr/src/asterisk-1.4.42/include/asterisk/lock.h:804
#3  0x0810911b in dummy_start (data=0x8907840) at utils.c:856
#4  0xb77124c0 in start_thread () from /lib/i686/cmov/libpthread.so.0
#5  0xb678884e in clone () from /lib/i686/cmov/libc.so.6

Thread 22 (process 22259):
#0  0xb7738424 in __kernel_vsyscall ()
#1  0xb677dfa7 in poll () from /lib/i686/cmov/libc.so.6
#2  0xb40f216d in do_monitor (data=0x0) at chan_phone.c:1067
#3  0x0810911b in dummy_start (data=0x8930ad8) at utils.c:856
#4  0xb77124c0 in start_thread () from /lib/i686/cmov/libpthread.so.0
#5  0xb678884e in clone () from /lib/i686/cmov/libc.so.6

Thread 21 (process 22315):
#0  0xb7738424 in __kernel_vsyscall ()
#1  0xb7716025 in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib/i686/cmov/libpthread.so.0
#2  0xb3b68ee5 in iax2_process_thread (data=0x8b64160) at
/usr/src/asterisk-1.4.42/include/asterisk/lock.h:804
#3  0x0810911b in dummy_start (data=0x8b63c60) at utils.c:856
#4  0xb77124c0 in start_thread () from /lib/i686/cmov/libpthread.so.0
#5  0xb678884e in clone () from /lib/i686/cmov/libc.so.6

Thread 20 (process 22316):
#0  0xb7738424 in __kernel_vsyscall ()
#1  0xb7716025 in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib/i686/cmov/libpthread.so.0
#2  0xb3b68ee5 in iax2_process_thread (data=0x8b65268) at
/usr/src/asterisk-1.4.42/include/asterisk/lock.h:804
#3  0x0810911b in dummy_start (data=0x8b63e50) at utils.c:856
#4  0xb77124c0 in start_thread () from /lib/i686/cmov/libpthread.so.0
#5  0xb678884e in clone () from /lib/i686/cmov/libc.so.6

Thread 19 (process 22317):
#0  0xb7738424 in __kernel_vsyscall ()
#1  0xb7716025 in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib/i686/cmov/libpthread.so.0
#2  0xb3b68ee5 in iax2_process_thread (data=0x8b66370) at
/usr/src/asterisk-1.4.42/include/asterisk/lock.h:804
#3  0x0810911b in dummy_start (data=0x8b63f58) at utils.c:856
#4  0xb77124c0 in start_thread () from /lib/i686/cmov/libpthread.so.0
#5  0xb678884e in clone () from /lib/i686/cmov/libc.so.6

Thread 18 (process 22318):
#0  0xb7738424 in __kernel_vsyscall ()
#1  0xb7716025 in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib/i686/cmov/libpthread.so.0
#2  0xb3b68ee5 in iax2_process_thread (data=0x8b67478) at
/usr/src/asterisk-1.4.42/include/asterisk/lock.h:804
#3  0x0810911b in dummy_start (data=0x8b64128) at utils.c:856
#4  0xb77124c0 in start_thread () from /lib/i686/cmov/libpthread.so.0
#5  0xb678884e in clone () from /lib/i686/cmov/libc.so.6

Thread 17 (process 22319):
#0  0xb7738424 in __kernel_vsyscall ()
#1  0xb7716025 in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib/i686/cmov/libpthread.so.0
#2  0xb3b68ee5 in iax2_process_thread (data=0xb6000520) at
/usr/src/asterisk-1.4.42/include/asterisk/lock.h:804
#3  0x0810911b in dummy_start (data=0xb6000468) at utils.c:856
#4  0xb77124c0 in start_thread () from /lib/i686/cmov/libpthread.so.0
#5  0xb678884e in clone () from /lib/i686/cmov/libc.so.6

Thread 16 (process 22320):
#0  0xb7738424 in __kernel_vsyscall ()
#1  0xb7716025 in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib/i686/cmov/libpthread.so.0
#2  0xb3b68ee5 in iax2_process_thread (data=0xb6001730) at
/usr/src/asterisk-1.4.42/include/asterisk/lock.h:804
#3  0x0810911b in dummy_start (data=0xb6001678) at utils.c:856
#4  0xb77124c0 in start_thread () from /lib/i686/cmov/libpthread.so.0
#5  0xb678884e in clone () from /lib/i686/cmov/libc.so.6

Thread 15 (process 22321):
#0  0xb7738424 in __kernel_vsyscall ()
#1  0xb7716025 in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib/i686/cmov/libpthread.so.0
#2  0xb3b68ee5 in iax2_process_thread (data=0xb6002940) at
/usr/src/asterisk-1.4.42/include/asterisk/lock.h:804
#3  0x0810911b in dummy_start (data=0xb6000468) at utils.c:856
#4  0xb77124c0 in start_thread () from /lib/i686/cmov/libpthread.so.0
#5  0xb678884e in clone () from /lib/i686/cmov/libc.so.6

Thread 14 (process 22322):
#0  0xb7738424 in __kernel_vsyscall ()
#1  0xb7716025 in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib/i686/cmov/libpthread.so.0
#2  0xb3b68ee5 in iax2_process_thread (data=0xb6003b50) at
/usr/src/asterisk-1.4.42/include/asterisk/lock.h:804
#3  0x0810911b in dummy_start (data=0xb6002888) at utils.c:856
#4  0xb77124c0 in start_thread () from /lib/i686/cmov/libpthread.so.0
#5  0xb678884e in clone () from /lib/i686/cmov/libc.so.6

Thread 13 (process 22323):
#0  0xb7738424 in __kernel_vsyscall ()
#1  0xb7716025 in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib/i686/cmov/libpthread.so.0
#2  0xb3b68ee5 in iax2_process_thread (data=0xb6004d60) at
/usr/src/asterisk-1.4.42/include/asterisk/lock.h:804
#3  0x0810911b in dummy_start (data=0xb6001678) at utils.c:856
#4  0xb77124c0 in start_thread () from /lib/i686/cmov/libpthread.so.0
#5  0xb678884e in clone () from /lib/i686/cmov/libc.so.6

Thread 12 (process 22324):
#0  0xb7738424 in __kernel_vsyscall ()
#1  0xb7716025 in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib/i686/cmov/libpthread.so.0
#2  0xb3b68ee5 in iax2_process_thread (data=0xb6005f70) at
/usr/src/asterisk-1.4.42/include/asterisk/lock.h:804
#3  0x0810911b in dummy_start (data=0xb6003a98) at utils.c:856
#4  0xb77124c0 in start_thread () from /lib/i686/cmov/libpthread.so.0
#5  0xb678884e in clone () from /lib/i686/cmov/libc.so.6

Thread 11 (process 22325):
#0  0xb7738424 in __kernel_vsyscall ()
#1  0xb7716025 in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib/i686/cmov/libpthread.so.0
#2  0xb3b3e5c2 in sched_thread (ignore=0x0) at
/usr/src/asterisk-1.4.42/include/asterisk/lock.h:804
#3  0x0810911b in dummy_start (data=0xb6000468) at utils.c:856
#4  0xb77124c0 in start_thread () from /lib/i686/cmov/libpthread.so.0
#5  0xb678884e in clone () from /lib/i686/cmov/libc.so.6

Thread 10 (process 22327):
#0  0xb7738424 in __kernel_vsyscall ()
#1  0xb677dfa7 in poll () from /lib/i686/cmov/libc.so.6
#2  0x080b3164 in ast_io_wait (ioc=0x8b62578, howlong=-1) at io.c:266
#3  0xb3b49c54 in network_thread (ignore=0x0) at chan_iax2.c:10626
#4  0x0810911b in dummy_start (data=0xb6004ca8) at utils.c:856
#5  0xb77124c0 in start_thread () from /lib/i686/cmov/libpthread.so.0
#6  0xb678884e in clone () from /lib/i686/cmov/libc.so.6

Thread 9 (process 22329):
#0  0xb7738424 in __kernel_vsyscall ()
#1  0xb77198a6 in nanosleep () from /lib/i686/cmov/libpthread.so.0
#2  0xb37dbd2e in scan_thread (unused=0x0) at pbx_spool.c:462
#3  0x0810911b in dummy_start (data=0xb60073e0) at utils.c:856
#4  0xb77124c0 in start_thread () from /lib/i686/cmov/libpthread.so.0
#5  0xb678884e in clone () from /lib/i686/cmov/libc.so.6

Thread 8 (process 22868):
#0  0xb7738424 in __kernel_vsyscall ()
#1  0xb677dfa7 in poll () from /lib/i686/cmov/libc.so.6
#2  0x080c5cbf in do_message (s=0xb3767344) at manager.c:2415
#3  0x080c5fb7 in session_do (data=0x8b76260) at manager.c:2493
#4  0x0810911b in dummy_start (data=0x8b888c8) at utils.c:856
#5  0xb77124c0 in start_thread () from /lib/i686/cmov/libpthread.so.0
#6  0xb678884e in clone () from /lib/i686/cmov/libc.so.6

Thread 7 (process 23560):
#0  0xb7738424 in __kernel_vsyscall ()
#1  0xb7716025 in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib/i686/cmov/libpthread.so.0
#2  0x08074a31 in autoservice_run (ign=0x0) at
/usr/src/asterisk-1.4.42/include/asterisk/lock.h:804
#3  0x0810911b in dummy_start (data=0x8b733a0) at utils.c:856
#4  0xb77124c0 in start_thread () from /lib/i686/cmov/libpthread.so.0
#5  0xb678884e in clone () from /lib/i686/cmov/libc.so.6

Thread 6 (process 24344):
#0  0xb7738424 in __kernel_vsyscall ()
#1  0xb677dfa7 in poll () from /lib/i686/cmov/libc.so.6
#2  0x080883cb in ast_waitfor_nandfds (c=0xb36fc9a0, n=2, fds=0x0, nfds=0,
exception=0x0, outfd=0x0, ms=0xb36fc9b4) at channel.c:1946
#3  0x0808e80d in ast_channel_bridge (c0=0xb606e4a0, c1=0x8b75428,
config=0xb36fdd40, fo=0xb36fccc4, rc=0xb36fccc0) at channel.c:2008
#4  0xb61546c5 in ast_bridge_call (chan=0xb606e4a0, peer=0x8b75428,
config=0xb36fdd40) at res_features.c:2281
#5  0xb4058fda in dial_exec_full (chan=0xb606e4a0, data=0xb36fff28,
peerflags=0xb36fdec4, continue_exec=0x0) at app_dial.c:1894
#6  0xb405b9d6 in dial_exec (chan=0xb606e4a0, data=0xb36fff28) at
app_dial.c:1942
#7  0x080d39ad in pbx_extension_helper (c=0xb606e4a0, con=<value optimized
out>, context=0xb606e620 "Ext_21", exten=0xb606e670
"0253504000",
    priority=3, label=0x0, callerid=0x8b72348 "0229871197",
action=E_SPAWN) at pbx.c:550
#8  0x080d4a31 in __ast_pbx_run (c=0xb606e4a0) at pbx.c:2367
#9  0x080d672e in pbx_thread (data=0xb606e4a0) at pbx.c:2688
#10 0x0810911b in dummy_start (data=0xb60119b0) at utils.c:856
#11 0xb77124c0 in start_thread () from /lib/i686/cmov/libpthread.so.0
#12 0xb678884e in clone () from /lib/i686/cmov/libc.so.6

Thread 5 (process 24371):
#0  0xb7738424 in __kernel_vsyscall ()
#1  0xb677dfa7 in poll () from /lib/i686/cmov/libc.so.6
#2  0x080883cb in ast_waitfor_nandfds (c=0xb36c09a0, n=2, fds=0x0, nfds=0,
exception=0x0, outfd=0x0, ms=0xb36c09b4) at channel.c:1946
#3  0x0808e80d in ast_channel_bridge (c0=0x8b7a6b8, c1=0x8b6a648,
config=0xb36c1d40, fo=0xb36c0cc4, rc=0xb36c0cc0) at channel.c:2008
#4  0xb61546c5 in ast_bridge_call (chan=0x8b7a6b8, peer=0x8b6a648,
config=0xb36c1d40) at res_features.c:2281
#5  0xb4058fda in dial_exec_full (chan=0x8b7a6b8, data=0xb36c3f28,
peerflags=0xb36c1ec4, continue_exec=0x0) at app_dial.c:1894
#6  0xb405b9d6 in dial_exec (chan=0x8b7a6b8, data=0xb36c3f28) at app_dial.c:1942
#7  0x080d39ad in pbx_extension_helper (c=0x8b7a6b8, con=<value optimized
out>, context=0x8b7a838 "Ext_12", exten=0x8b7a888
"0229998510",
    priority=8, label=0x0, callerid=0x8b7b3b0 "0229871197",
action=E_SPAWN) at pbx.c:550
#8  0x080d4a31 in __ast_pbx_run (c=0x8b7a6b8) at pbx.c:2367
#9  0x080d672e in pbx_thread (data=0x8b7a6b8) at pbx.c:2688
#10 0x0810911b in dummy_start (data=0x8b6dde0) at utils.c:856
#11 0xb77124c0 in start_thread () from /lib/i686/cmov/libpthread.so.0
#12 0xb678884e in clone () from /lib/i686/cmov/libc.so.6

Thread 4 (process 24374):
#0  0xb7738424 in __kernel_vsyscall ()
#1  0xb677dfa7 in poll () from /lib/i686/cmov/libc.so.6
#2  0x080883cb in ast_waitfor_nandfds (c=0xb3558f14, n=2, fds=0x0, nfds=0,
exception=0x0, outfd=0x0, ms=0xb3559e94) at channel.c:1946
#3  0x0808884f in ast_waitfor_n (c=0xb3558f14, n=2, ms=0xb3559e94) at
channel.c:2008
#4  0xb40576d2 in dial_exec_full (chan=0x8b88080, data=0xb355bf28,
peerflags=0xb3559ec4, continue_exec=0x0) at app_dial.c:485
#5  0xb405b9d6 in dial_exec (chan=0x8b88080, data=0xb355bf28) at app_dial.c:1942
#6  0x080d39ad in pbx_extension_helper (c=0x8b88080, con=<value optimized
out>, context=0x8b88200 "Ext_16", exten=0x8b88250
"0213472328",
    priority=3, label=0x0, callerid=0x8bb88a0 "0229871197",
action=E_SPAWN) at pbx.c:550
#7  0x080d4a31 in __ast_pbx_run (c=0x8b88080) at pbx.c:2367
#8  0x080d672e in pbx_thread (data=0x8b88080) at pbx.c:2688
#9  0x0810911b in dummy_start (data=0x8b73418) at utils.c:856
#10 0xb77124c0 in start_thread () from /lib/i686/cmov/libpthread.so.0
#11 0xb678884e in clone () from /lib/i686/cmov/libc.so.6

Thread 3 (process 24375):
#0  0xb7738424 in __kernel_vsyscall ()
#1  0xb677dfa7 in poll () from /lib/i686/cmov/libc.so.6
#2  0x080883cb in ast_waitfor_nandfds (c=0xb3594f14, n=2, fds=0x0, nfds=0,
exception=0x0, outfd=0x0, ms=0xb3595e94) at channel.c:1946
#3  0x0808884f in ast_waitfor_n (c=0xb3594f14, n=2, ms=0xb3595e94) at
channel.c:2008
#4  0xb40576d2 in dial_exec_full (chan=0x8b6c5e8, data=0xb3597f28,
peerflags=0xb3595ec4, continue_exec=0x0) at app_dial.c:485
#5  0xb405b9d6 in dial_exec (chan=0x8b6c5e8, data=0xb3597f28) at app_dial.c:1942
#6  0x080d39ad in pbx_extension_helper (c=0x8b6c5e8, con=<value optimized
out>, context=0x8b6c768 "Ext_13", exten=0x8b6c7b8
"0229866940",
    priority=8, label=0x0, callerid=0x8b727f8 "0229871197",
action=E_SPAWN) at pbx.c:550
#7  0x080d4a31 in __ast_pbx_run (c=0x8b6c5e8) at pbx.c:2367
#8  0x080d672e in pbx_thread (data=0x8b6c5e8) at pbx.c:2688
#9  0x0810911b in dummy_start (data=0x8b6daa8) at utils.c:856
#10 0xb77124c0 in start_thread () from /lib/i686/cmov/libpthread.so.0
#11 0xb678884e in clone () from /lib/i686/cmov/libc.so.6

Thread 2 (process 24376):
#0  0xb7738424 in __kernel_vsyscall ()
#1  0xb67783cb in write () from /lib/i686/cmov/libc.so.6
#2  0xb6711eac in _IO_file_write () from /lib/i686/cmov/libc.so.6
#3  0xb6713027 in _IO_do_write () from /lib/i686/cmov/libc.so.6
#4  0xb67128ca in _IO_file_sync () from /lib/i686/cmov/libc.so.6
#5  0xb6706899 in fflush () from /lib/i686/cmov/libc.so.6
#6  0xb409cda6 in csv_log (cdr=0xb3401cd8) at cdr_csv.c:308
#7  0x0807f24e in post_cdr (cdr=0xb3401cd8) at cdr.c:1060
#8  0x0807f397 in ast_cdr_detach (cdr=0xb3401cd8) at cdr.c:1257
#9  0x080817d8 in ast_cdr_reset (cdr=0x8b70228, _flags=0xb360deb8) at cdr.c:1080
#10 0x080c97da in pbx_builtin_resetcdr (chan=0x8bb83c8, data=0xb360ff28) at
pbx.c:5592
#11 0x080d39ad in pbx_extension_helper (c=0x8bb83c8, con=<value optimized
out>, context=0x8bb8548 "chan-unavailable", exten=0x8bb8598
"s",
    priority=1, label=0x0, callerid=0x8b77df0 "0229871197",
action=E_SPAWN) at pbx.c:550
#12 0x080d4a31 in __ast_pbx_run (c=0x8bb83c8) at pbx.c:2367
#13 0x080d672e in pbx_thread (data=0x8bb83c8) at pbx.c:2688
#14 0x0810911b in dummy_start (data=0xb3402560) at utils.c:856
#15 0xb77124c0 in start_thread () from /lib/i686/cmov/libpthread.so.0
#16 0xb678884e in clone () from /lib/i686/cmov/libc.so.6

Thread 1 (process 21726):
#0  0x080851ee in ast_setstate (chan=0xb3401c00, state=AST_STATE_DOWN) at
/usr/src/asterisk-1.4.42/include/asterisk/strings.h:37
#1  0xb561975d in release_chan (ch=0xb3400858, bc=0x88e8f5c) at
chan_misdn.c:3750
#2  0xb5622275 in cb_events (event=EVENT_CLEANUP, bc=0x88e8f5c, user_data=0x0)
at chan_misdn.c:4845
#3  0xb5632d9f in handle_cr (stack=0x88e82d8, frm=<value optimized out>)
at misdn/isdn_lib.c:1684
#4  0xb5634439 in handle_frm (msg=0x8900a88) at misdn/isdn_lib.c:2678
#5  0xb56357fd in manager_isdn_handler (frm=0x8900abc, msg=0x8900a88) at
misdn/isdn_lib.c:3763
#6  0xb56361d4 in misdn_lib_isdn_event_catcher (arg=0x88b0208) at
misdn/isdn_lib.c:3117
#7  0xb77124c0 in start_thread () from /lib/i686/cmov/libpthread.so.0
#8  0xb678884e in clone () from /lib/i686/cmov/libc.so.6

Steve Davies

2011-Dec-14 13:22 UTC

head link

[asterisk-users] Asterisk 1.4.x segfaulting daily

On 14 December 2011 12:56, Paulo Santos <paulo.r.santos at sapo.pt>
wrote:> Hello list,
>
> An Asterisk installation that was doing fine suddenly stared segfaulting a
> couple of times per day. I enabled all the logging and debugging to try to
> find a pattern but there was too much information to see exactly where it
> broke. So I enabled core dump and did backtraces and all of them seem to
> break on ast_setstate, setting the state to AST_STATE_DOWN. That's
pretty
> much the only thing I can make of it, don't even know if that's
correct.
>
> Does anyone have any ideas on why this is happening? The backtrace is
> attached.
>
> P.S.: I've switched the whole hardware already, including the BRI card
> (B400P, OpenVox). Also tried different versions of Asterisk, Dahdi and
> mISDN. I'm stuck with 1.4 Asterisk branch and mISDN v1.
>
If I was guessing, I'd say that the channel structure that is being
modified by the ast_setstate() call is incomplete, and contains some
garbage pointers.

If I was guessing further, I'd say that the callerID pointers are the
most likely candidate - Does the issue happen when a caller-id
withheld call is hung-up? hung-up before being answered perhaps?

You'd need to add some debug reporting into ast_setstate() to know for sure.

Just my 2p - 1.4.42 is an old version, so the chance of a solid answer
is fairly low.

Steve

Patrick Lists

2011-Dec-14 13:58 UTC

head link

[asterisk-users] Asterisk 1.4.x segfaulting daily

On 14-12-11 13:56, Paulo Santos wrote:> Hello list,
>
> An Asterisk installation that was doing fine suddenly stared segfaulting
> a couple of times per day. I enabled all the logging and debugging to
> try to find a pattern but there was too much information to see exactly
> where it broke. So I enabled core dump and did backtraces and all of
> them seem to break on ast_setstate, setting the state to AST_STATE_DOWN.
> That's pretty much the only thing I can make of it, don't even know
if
> that's correct.
>
> Does anyone have any ideas on why this is happening? The backtrace is
> attached.
>
> P.S.: I've switched the whole hardware already, including the BRI card
> (B400P, OpenVox). Also tried different versions of Asterisk, Dahdi and
> mISDN. I'm stuck with 1.4 Asterisk branch and mISDN v1.
If the suggestion from Steve Davies doesn't work out for you then my 
suggestion would be to try out the latest DAHDI & libpri with the latest 
Asterisk 1.8 because those versions have built-in support for the 4x BRI 
HFC chipset which can be found on the Digium b410p and the Openvox 
B400P. This way you no longer need mISDN V1 and have recent versions 
with tons of bugs fixed.

Here are instructions from Openvox:
http://wiki.openvox.cn/index.php/OpenVox_B400P_User_Manual_for_dahdi

Please note that in the instructions they use older versions. I would 
use the latest DAHDI, libpri (don't forget this one) and asterisk 1.8 
available here: https://www.asterisk.org/downloads

Regards,
Patrick

asterisk users - Dec 2011 - Asterisk 1.4.x segfaulting daily

[asterisk-users] Asterisk 1.4.x segfaulting daily

[asterisk-users] Asterisk 1.4.x segfaulting daily

[asterisk-users] Asterisk 1.4.x segfaulting daily