Douglas Garstang
2007-Jan-03 15:26 UTC
[asterisk-users] Asterisk Core Dump in app_queue - Anyone seen?
Anyone seen this? It ocurred on a 'reload app_queue.so' command. Asterisk version is 1.2.9.1. Tried again, but it was not immediately reproducable. Doug. (gdb) bt #0 reload_queues () at app_queue.c:3339 #1 0xb778a7a8 in reload () at app_queue.c:4012 #2 0x0805bb44 in ast_module_reload (name=0x8137cc7 "app_queue.so") at loader.c:257 #3 0x08092b3f in handle_reload (fd=33, argc=2, argv=0xbddfa470) at cli.c:147 #4 0x0809283e in ast_cli_command (fd=33, s=0x6d6f7250 <Address 0x6d6f7250 out of bounds>) at cli.c:1364 #5 0x080aef0f in action_command (s=0x81ead18, m=0xbddfaac0) at manager.c:927 #6 0x080b3ee4 in process_message (s=0x81ead18, m=0xbddfaac0) at manager.c:1305 #7 0x080b2ac5 in session_do (data=0x81ead18) at manager.c:1401 #8 0xb7f15ed8 in pthread_start_thread () from /lib/libpthread.so.0 #9 0xb7e147ea in clone () from /lib/libc.so.6 (gdb) bt full #0 reload_queues () at app_queue.c:3339 q = (struct ast_call_queue *) 0x81adca8 ql = (struct ast_call_queue *) 0xbddfaec0 qn = (struct ast_call_queue *) 0xb7dc03b3 cfg = (struct ast_config *) 0x81aca30 cat = 0x81507e0 "mcao_QMain" tmp = 0x6d6f7250 <Address 0x6d6f7250 out of bounds> var = (struct ast_variable *) 0x811e340 prev = (struct member *) 0x8101b79 cur = (struct member *) 0x2854554f newm = (struct member *) 0x0 new = 0 general_val = 0x2854554f <Address 0x2854554f out of bounds> interface = '\0' <repeats 79 times> penalty = 900 #1 0xb778a7a8 in reload () at app_queue.c:4012 No locals. #2 0x0805bb44 in ast_module_reload (name=0x8137cc7 "app_queue.so") at loader.c:257 m = (struct module *) 0x81f3b10 reloaded = 2 oldversion = 863401873 reload = (int (*)(void)) 0xb778a7a0 <reload> #3 0x08092b3f in handle_reload (fd=33, argc=2, argv=0xbddfa470) at cli.c:147 x = 1 res = 1836020304 #4 0x0809283e in ast_cli_command (fd=33, s=0x6d6f7250 <Address 0x6d6f7250 out of bounds>) at cli.c:1364 argv = {0x8137cc0 "reload", 0x8137cc7 "app_queue.so", 0x0, 0x8227d68 " ;\"\b????: 2007-01-03 15:17:39.165755\r\n", 0xbddfa49c "h???????h}\"\bh}\"\b&", 0xb7dc3fea "?\234\211<$????\213]?\213u?\213}?\211?]?????U\211?\203?(\211]?\211u?\211}???C??\201??\237\n", 0xb7e6fa00 "", 0x8227d68 " ;\"\b????: 2007-01-03 15:17:39.165755\r\n", 0xb7e6dff4 "\034?\020", 0x26 <Address 0x26 out of bounds>, 0x27 <Address 0x27 out of bounds>, 0xbddfa568 "\200", 0xb7dbc0ef "\213U\b\213\002\205?u\b\213\205p???\211\002?D\a?", 0x8227d68 " ;\"\b????: 2007-01-03 15:17:39.165755\r\n", 0x8227d68 " ;\"\b????: 2007-01-03 15:17:39.165755\r\n", 0x26 <Address 0x26 out of bounds>, 0x8227d68 " ;\"\b????: 2007-01-03 15:17:39.165755\r\n", 0x0, 0x26 <Address 0x26 out of bounds>, 0xfbad8000 <Address 0xfbad8000 out of bounds>, 0x8227d68 " ;\"\b????: 2007-01-03 15:17:39.165755\r\n", 0x8227d68 " ;\"\b????: 2007-01-03 15:17:39.165755\r\n", 0x8227d68 " ;\"\b????: 2007-01-03 15:17:39.165755\r\n", 0x8227d68 " ;\"\b????: 2007-01-03 15:17:39.165755\r\n", 0x8227d8e "", 0x8227dcc " ", 0x8227d68 " ;\"\b????: 2007-01-03 15:17:39.165755\r\n", 0x8227dcc " ", 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0xbddfa544 "????\020\234 \bh???????", 0xb7000000 <Address 0xb7000000 out of bounds>, 0x0, 0xbddfa544 "????\020\234 \bh???????", 0xb7e6dff4 "\034?\020", 0x0, 0xb7e6da00 "", 0x0, 0xb7f1a756 "\201?\236H", 0xb7f1eff4 "t?", 0xb7e6fa00 "", 0xb7e6fa00 "", 0xbddfa54c "h???????", 0xb7f170eb "??\213\203p???;(r\022\213\203????;(s\b\213\203??????\213\203????\213", 0xb7e6fa10 "", 0x8209c10 "?\017\025\b??\035\b: 2007-01-03 15:17:39.165755\r\n", 0xb7e6fa00 "", 0xb7e6dff4 "\034?\020", 0xb7e6dff4 "\034?\020", 0x8209c10 "?\017\025\b??\035\b: 2007-01-03 15:17:39.165755\r\n", 0xbddfa568 "\200", 0xb7dc3fea "?\234\211<$????\213]?\213u?\213}?\211?]?????U\211?\203?(\211]?\211u?\211}???C??\201??\237\n", 0xb7e6fa00 "", 0x8209c10 "?\017\025\b??\035\b: 2007-01-03 15:17:39.165755\r\n", 0x21 <Address 0x21 out of bounds>, 0x21 <Address 0x21 out of bounds>, 0x81ead18 "\017", 0x80 <Address 0x80 out of bounds>, 0x8091ffb "\213\\$\030\203?\034??\004$\004"} e = (struct ast_cli_entry *) 0x81197a0 x = 2 dup = 0x8137cc0 "reload" tws = 0 #5 0x080aef0f in action_command (s=0x81ead18, m=0xbddfaac0) at manager.c:927 No locals. #6 0x080b3ee4 in process_message (s=0x81ead18, m=0xbddfaac0) at manager.c:1305 ret = 0 eqe = (struct eventqent *) 0x0 action = "Command", '\0' <repeats 72 times> tmp = (struct manager_action *) 0x8144818 idText = "ActionID: 2007-01-03 15:17:39.165755\r\n", '\0' <repeats 217 times> iabuf = "216.187.141.250" #7 0x080b2ac5 in session_do (data=0x81ead18) at manager.c:1401 m = {hdrcount = 3, headers = {"Action: Command\000\n", '\0' <repeats 238 times>, "Command: reload app_queue.so\000\n", '\0' <repeats 225 times>, "ActionID: 2007-01-03 15:17:39.165755\000\n", '\0' <repeats 217 times>, "\000\n", '\0' <repeats 253 times>, '\0' <repeats 255 times> <repeats 76 times>}} iabuf = '\0' <repeats 15 times> res = 1836020304 ---Type <return> to continue, or q <return> to quit--- #8 0xb7f15ed8 in pthread_start_thread () from /lib/libpthread.so.0 No symbol table info available. #9 0xb7e147ea in clone () from /lib/libc.so.6 No symbol table info available.
Douglas Garstang
2007-Jan-03 23:59 UTC
[asterisk-users] Asterisk Core Dump in app_queue - Anyone seen?
Bugger. :( -----Original Message----- From: Douglas Garstang Sent: Wed 1/3/2007 3:27 PM To: Asterisk Users Mailing List - Non-Commercial Discussion Cc: Subject: [asterisk-users] Asterisk Core Dump in app_queue - Anyone seen? Anyone seen this? It ocurred on a 'reload app_queue.so' command. Asterisk version is 1.2.9.1. Tried again, but it was not immediately reproducable. Doug. (gdb) bt #0 reload_queues () at app_queue.c:3339 #1 0xb778a7a8 in reload () at app_queue.c:4012 #2 0x0805bb44 in ast_module_reload (name=0x8137cc7 "app_queue.so") at loader.c:257 #3 0x08092b3f in handle_reload (fd=33, argc=2, argv=0xbddfa470) at cli.c:147 #4 0x0809283e in ast_cli_command (fd=33, s=0x6d6f7250 <Address 0x6d6f7250 out of bounds>) at cli.c:1364 #5 0x080aef0f in action_command (s=0x81ead18, m=0xbddfaac0) at manager.c:927 #6 0x080b3ee4 in process_message (s=0x81ead18, m=0xbddfaac0) at manager.c:1305 #7 0x080b2ac5 in session_do (data=0x81ead18) at manager.c:1401 #8 0xb7f15ed8 in pthread_start_thread () from /lib/libpthread.so.0 #9 0xb7e147ea in clone () from /lib/libc.so.6 (gdb) bt full #0 reload_queues () at app_queue.c:3339 q = (struct ast_call_queue *) 0x81adca8 ql = (struct ast_call_queue *) 0xbddfaec0 qn = (struct ast_call_queue *) 0xb7dc03b3 cfg = (struct ast_config *) 0x81aca30 cat = 0x81507e0 "mcao_QMain" tmp = 0x6d6f7250 <Address 0x6d6f7250 out of bounds> var = (struct ast_variable *) 0x811e340 prev = (struct member *) 0x8101b79 cur = (struct member *) 0x2854554f newm = (struct member *) 0x0 new = 0 general_val = 0x2854554f <Address 0x2854554f out of bounds> interface = '\0' <repeats 79 times> penalty = 900 #1 0xb778a7a8 in reload () at app_queue.c:4012 No locals. #2 0x0805bb44 in ast_module_reload (name=0x8137cc7 "app_queue.so") at loader.c:257 m = (struct module *) 0x81f3b10 reloaded = 2 oldversion = 863401873 reload = (int (*)(void)) 0xb778a7a0 <reload> #3 0x08092b3f in handle_reload (fd=33, argc=2, argv=0xbddfa470) at cli.c:147 x = 1 res = 1836020304 #4 0x0809283e in ast_cli_command (fd=33, s=0x6d6f7250 <Address 0x6d6f7250 out of bounds>) at cli.c:1364 argv = {0x8137cc0 "reload", 0x8137cc7 "app_queue.so", 0x0, 0x8227d68 " ;\"\b????: 2007-01-03 15:17:39.165755\r\n", 0xbddfa49c "h???????h}\"\bh}\"\b&", 0xb7dc3fea "?\234\211<$????\213]?\213u?\213}?\211?]?????U\211?\203?(\211]?\211u?\211}???C??\201??\237\n", 0xb7e6fa00 "", 0x8227d68 " ;\"\b????: 2007-01-03 15:17:39.165755\r\n", 0xb7e6dff4 "\034?\020", 0x26 <Address 0x26 out of bounds>, 0x27 <Address 0x27 out of bounds>, 0xbddfa568 "\200", 0xb7dbc0ef "\213U\b\213\002\205?u\b\213\205p???\211\002?D\a?", 0x8227d68 " ;\"\b????: 2007-01-03 15:17:39.165755\r\n", 0x8227d68 " ;\"\b????: 2007-01-03 15:17:39.165755\r\n", 0x26 <Address 0x26 out of bounds>, 0x8227d68 " ;\"\b????: 2007-01-03 15:17:39.165755\r\n", 0x0, 0x26 <Address 0x26 out of bounds>, 0xfbad8000 <Address 0xfbad8000 out of bounds>, 0x8227d68 " ;\"\b????: 2007-01-03 15:17:39.165755\r\n", 0x8227d68 " ;\"\b????: 2007-01-03 15:17:39.165755\r\n", 0x8227d68 " ;\"\b????: 2007-01-03 15:17:39.165755\r\n", 0x8227d68 " ;\"\b????: 2007-01-03 15:17:39.165755\r\n", 0x8227d8e "", 0x8227dcc " ", 0x8227d68 " ;\"\b????: 2007-01-03 15:17:39.165755\r\n", 0x8227dcc " ", 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0xbddfa544 "????\020\234 \bh???????", 0xb7000000 <Address 0xb7000000 out of bounds>, 0x0, 0xbddfa544 "????\020\234 \bh???????", 0xb7e6dff4 "\034?\020", 0x0, 0xb7e6da00 "", 0x0, 0xb7f1a756 "\201?\236H", 0xb7f1eff4 "t?", 0xb7e6fa00 "", 0xb7e6fa00 "", 0xbddfa54c "h???????", 0xb7f170eb "??\213\203p???;(r\022\213\203????;(s\b\213\203??????\213\203????\213", 0xb7e6fa10 "", 0x8209c10 "?\017\025\b??\035\b: 2007-01-03 15:17:39.165755\r\n", 0xb7e6fa00 "", 0xb7e6dff4 "\034?\020", 0xb7e6dff4 "\034?\020", 0x8209c10 "?\017\025\b??\035\b: 2007-01-03 15:17:39.165755\r\n", 0xbddfa568 "\200", 0xb7dc3fea "?\234\211<$????\213]?\213u?\213}?\211?]?????U\211?\203?(\211]?\211u?\211}???C??\201??\237\n", 0xb7e6fa00 "", 0x8209c10 "?\017\025\b??\035\b: 2007-01-03 15:17:39.165755\r\n", 0x21 <Address 0x21 out of bounds>, 0x21 <Address 0x21 out of bounds>, 0x81ead18 "\017", 0x80 <Address 0x80 out of bounds>, 0x8091ffb "\213\\$\030\203?\034??\004$\004"} e = (struct ast_cli_entry *) 0x81197a0 x = 2 dup = 0x8137cc0 "reload" tws = 0 #5 0x080aef0f in action_command (s=0x81ead18, m=0xbddfaac0) at manager.c:927 No locals. #6 0x080b3ee4 in process_message (s=0x81ead18, m=0xbddfaac0) at manager.c:1305 ret = 0 eqe = (struct eventqent *) 0x0 action = "Command", '\0' <repeats 72 times> tmp = (struct manager_action *) 0x8144818 idText = "ActionID: 2007-01-03 15:17:39.165755\r\n", '\0' <repeats 217 times> iabuf = "216.187.141.250" #7 0x080b2ac5 in session_do (data=0x81ead18) at manager.c:1401 m = {hdrcount = 3, headers = {"Action: Command\000\n", '\0' <repeats 238 times>, "Command: reload app_queue.so\000\n", '\0' <repeats 225 times>, "ActionID: 2007-01-03 15:17:39.165755\000\n", '\0' <repeats 217 times>, "\000\n", '\0' <repeats 253 times>, '\0' <repeats 255 times> <repeats 76 times>}} iabuf = '\0' <repeats 15 times> res = 1836020304 ---Type <return> to continue, or q <return> to quit--- #8 0xb7f15ed8 in pthread_start_thread () from /lib/libpthread.so.0 No symbol table info available. #9 0xb7e147ea in clone () from /lib/libc.so.6 No symbol table info available. _______________________________________________ --Bandwidth and Colocation provided by Easynews.com -- asterisk-users mailing list To UNSUBSCRIBE or update options visit: http://lists.digium.com/mailman/listinfo/asterisk-users
Richard Lyman
2007-Jan-04 09:49 UTC
[asterisk-users] Asterisk Core Dump in app_queue - Anyone seen?
Douglas Garstang wrote *snipped> cat = 0x81507e0 "mcao_QMain" > tmp = 0x6d6f7250 <Address 0x6d6f7250 out of bounds> >*snipped a quick run through of of app_queue.c (my copy) for anything directly dealing with a reload shows tmp in use for realtime later a reference for convert to dashes from uunderscores i would do a quick test of a queue name without underscores
Douglas Garstang
2007-Jan-04 10:24 UTC
[asterisk-users] Asterisk Core Dump in app_queue - Anyone seen?
Richard, We have underscores all over the place in our config files, including others in queues.conf. I don't think that's the murder weapon. I think, in general, queues are one of Asterisks biggest features, and also one of it's shakiest. The reload, which is run from a script, caused a reload on 3 servers that are supposed to be redundant, and each crapped it's pants in a slightly different manner. The first stopped processing all queue calls (ie calls would lockup), the second core dumped, and the third seemed ok until you did another 'reload app_queue.so' where it would tell you that the previous reload was not finished yet. Someone made a post yesterday about doing 200 queues on Asterisk. I don't envy what he is about to endure. Doug.> -----Original Message----- > From: Richard Lyman [mailto:pchammer@dynx.net] > Sent: Thursday, January 04, 2007 9:45 AM > To: Asterisk Users Mailing List - Non-Commercial Discussion > Subject: Re: [asterisk-users] Asterisk Core Dump in app_queue - Anyone > seen? > > > Douglas Garstang wrote > *snipped > > cat = 0x81507e0 "mcao_QMain" > > tmp = 0x6d6f7250 <Address 0x6d6f7250 out of bounds> > > > *snipped > > a quick run through of of app_queue.c (my copy) for anything directly > dealing with a reload > > shows tmp in use for realtime > later a reference for convert to dashes from uunderscores > > i would do a quick test of a queue name without underscores > > _______________________________________________ > --Bandwidth and Colocation provided by Easynews.com -- > > asterisk-users mailing list > To UNSUBSCRIBE or update options visit: > http://lists.digium.com/mailman/listinfo/asterisk-users >