Hi, I am having some problems mentioned below, the box is in production live environment with traffic around 30 - 100 calls. I am running T/E410P in a Dual P4 xeon with HT disabled. I am using zaptel 0.9.0 and asterisk stable 1 release. There is no gui, just mysql, perl (small script) and asterisk. System runs very smoothly if the calls are around 40-50 and comes one by one , however sometimes at immediate load of around 30 more calls ... I get the following processes in the ps -ax, and asterisk starts droping the calls, irq misses rise and console shows lot of pri errors (which donot occur in a smooth load of around 50 calls). Can someone explain why this happens .. however these get cleared once the channels are handled. 20992 pts/3 S 0:01 zttool 21412 ? S 0:00 asterisk 21413 ? R 0:00 asterisk 21418 ? S 0:00 asterisk 21419 ? S 0:00 asterisk 21420 ? S 0:00 asterisk 21421 ? S 0:00 asterisk 21422 ? S 0:00 asterisk 21423 ? S 0:00 asterisk 21424 ? S 0:00 asterisk 21425 ? S 0:00 asterisk 21426 ? S 0:00 asterisk 21427 ? S 0:00 asterisk 21429 ? S 0:00 asterisk 21430 ? S 0:00 asterisk 21431 ? S 0:00 asterisk 21432 ? S 0:00 asterisk 21433 ? S 0:00 asterisk 21434 ? S 0:00 asterisk 21435 ? S 0:00 asterisk 21436 ? S 0:00 asterisk 21437 ? S 0:00 asterisk 21438 ? S 0:00 asterisk 21439 ? S 0:00 asterisk 21440 ? S 0:00 asterisk 21441 ? S 0:00 asterisk 21442 ? S 0:00 asterisk 21443 ? S 0:00 asterisk 21444 ? S 0:00 asterisk 21445 ? S 0:00 asterisk 21446 ? S 0:00 asterisk 21447 ? S 0:00 asterisk 21448 ? S 0:00 asterisk 21449 ? S 0:00 asterisk 21451 ? S 0:00 asterisk 21452 ? S 0:00 asterisk 21453 ? S 0:00 asterisk 21454 ? S 0:00 asterisk 21455 ? S 0:00 asterisk 21456 ? S 0:00 asterisk 21457 ? S 0:00 asterisk 21458 ? S 0:00 asterisk 21459 pts/2 R 0:00 ps -ax 21460 ? S 0:00 asterisk Further I am also getting Mar 22 01:33:09 WARNING[114696]: chan_zap.c:5970 zt_pri_error: PRI: !! Got I-frame while link state 2 Mar 22 01:33:09 WARNING[114696]: chan_zap.c:5970 zt_pri_error: PRI: !! Got I-frame while link state 2 Mar 22 01:33:09 WARNING[114696]: chan_zap.c:5970 zt_pri_error: PRI: !! Got I-frame while link state 2 Mar 22 01:33:09 WARNING[114696]: chan_zap.c:5970 zt_pri_error: PRI: !! Got I-frame while link state 2 Mar 22 01:33:09 WARNING[114696]: chan_zap.c:5970 zt_pri_error: PRI: !! Got I-frame while link state 2 Mar 22 01:33:09 WARNING[114696]: chan_zap.c:5970 zt_pri_error: PRI: !! Got S-frame while link down Mar 22 01:33:09 WARNING[114696]: chan_zap.c:5970 zt_pri_error: PRI: !! Got S-frame while link down == D-Channel on span 1 up and certain IRQ misses like around 270 after an operation of 2-3 hours. Further when I load the T/E410p card I get this error ... Mar 22 00:33:48 VoiceOne kernel: TE410P: Launching card: 0 Mar 22 00:33:48 VoiceOne kernel: TE410P: Setting up global serial parameters Mar 22 00:33:48 VoiceOne kernel: TE410P: Timing from source 0 Mar 22 00:33:48 VoiceOne kernel: Found a Wildcard: Wildcard TE410P-Xilinx Mar 22 00:33:48 VoiceOne kernel: Registered tone zone 0 (United States / North America) Mar 22 00:33:48 VoiceOne kernel: TE410P: Span 1 configured for CCS/HDB3/CRC4 Mar 22 00:33:48 VoiceOne kernel: SPAN 1: Primary Sync Source Mar 22 00:33:48 VoiceOne kernel: Uhhuh. NMI received for unknown reason 20. Mar 22 00:33:48 VoiceOne kernel: Dazed and confused, but trying to continue Mar 22 00:33:48 VoiceOne kernel: Do you have a strange power saving mode enabled? Mar 22 00:33:48 VoiceOne kernel: TE410P: Span 2 configured for CCS/HDB3/CRC4 Mar 22 00:33:48 VoiceOne kernel: TE410P: Span 3 configured for CCS/HDB3/CRC4 Mar 22 00:33:48 VoiceOne kernel: TE410P: Span 4 configured for CCS/HDB3/CRC4 I have another card and above also come with that. I look forward for resolution on these issues with some suggestions to improve the stability. Coz otherwise system is not stable to be sold to client. Regards Azher Amin ------------------------------- http://www.consulttech.com.pk
Hello Azher- I have a similar setup in hardware, ie: TE410P running on dual-xeon system, however I'm running IVR only. I start getting the I-frame errors above about 80 simultaneous calls. I do not get IRQ misses at all. Also I do not get the startup error messages. The errors I get the most under load are the frame retransmission messages in /var/log/asterisk/messages. Do you get those as well? Since you are getting IRQ misses, you may have some basic problem, ie: something keeping the zaptel driver from getting around to servicing the TE410 interrupts. I think that they have to be serviced without fail every 1 msec, or errors start occurring. Which kernel are you running? What does your Perl script do? Did you try disabling mysql logging to lower the disk load? Maybe the disk driver is interfering with the zaptel driver interrupts. Regards Scott Scott M. Stingel Emerging Voice Technology Inc. Palo Alto, California and London, England Email: scott "at " evtmedia.com URL: www.evtmedia.com>-----Original Message----- >From: asterisk-users-admin@lists.digium.com >[mailto:asterisk-users-admin@lists.digium.com] On Behalf Of Azher Amin >Sent: Sunday, March 21, 2004 3:41 PM >To: asterisk-users@lists.digium.com >Subject: [Asterisk-Users] PRI issues with TE410P > >Hi, > >I am having some problems mentioned below, the box is in >production live >environment with traffic around 30 - 100 calls. > >I am running T/E410P in a Dual P4 xeon with HT disabled. I am using >zaptel 0.9.0 and asterisk stable 1 release. There is no gui, >just mysql, >perl (small script) and asterisk. > >System runs very smoothly if the calls are around 40-50 and >comes one by >one , however sometimes at immediate load of around 30 more calls ... I >get the following processes in the ps -ax, and asterisk starts droping >the calls, irq misses rise and console shows lot of pri errors (which >donot occur in a smooth load of around 50 calls). > >Can someone explain why this happens .. however these get cleared once >the channels are handled. > >20992 pts/3 S 0:01 zttool >21412 ? S 0:00 asterisk >21413 ? R 0:00 asterisk >21418 ? S 0:00 asterisk >21419 ? S 0:00 asterisk >21420 ? S 0:00 asterisk >21421 ? S 0:00 asterisk >21422 ? S 0:00 asterisk >21423 ? S 0:00 asterisk >21424 ? S 0:00 asterisk >21425 ? S 0:00 asterisk >21426 ? S 0:00 asterisk >21427 ? S 0:00 asterisk >21429 ? S 0:00 asterisk >21430 ? S 0:00 asterisk >21431 ? S 0:00 asterisk >21432 ? S 0:00 asterisk >21433 ? S 0:00 asterisk >21434 ? S 0:00 asterisk >21435 ? S 0:00 asterisk >21436 ? S 0:00 asterisk >21437 ? S 0:00 asterisk >21438 ? S 0:00 asterisk >21439 ? S 0:00 asterisk >21440 ? S 0:00 asterisk >21441 ? S 0:00 asterisk >21442 ? S 0:00 asterisk >21443 ? S 0:00 asterisk >21444 ? S 0:00 asterisk >21445 ? S 0:00 asterisk >21446 ? S 0:00 asterisk >21447 ? S 0:00 asterisk >21448 ? S 0:00 asterisk >21449 ? S 0:00 asterisk >21451 ? S 0:00 asterisk >21452 ? S 0:00 asterisk >21453 ? S 0:00 asterisk >21454 ? S 0:00 asterisk >21455 ? S 0:00 asterisk >21456 ? S 0:00 asterisk >21457 ? S 0:00 asterisk >21458 ? S 0:00 asterisk >21459 pts/2 R 0:00 ps -ax >21460 ? S 0:00 asterisk > > > >Further I am also getting > >Mar 22 01:33:09 WARNING[114696]: chan_zap.c:5970 zt_pri_error: PRI: !! >Got I-frame while link state 2 >Mar 22 01:33:09 WARNING[114696]: chan_zap.c:5970 zt_pri_error: PRI: !! >Got I-frame while link state 2 >Mar 22 01:33:09 WARNING[114696]: chan_zap.c:5970 zt_pri_error: PRI: !! >Got I-frame while link state 2 >Mar 22 01:33:09 WARNING[114696]: chan_zap.c:5970 zt_pri_error: PRI: !! >Got I-frame while link state 2 >Mar 22 01:33:09 WARNING[114696]: chan_zap.c:5970 zt_pri_error: PRI: !! >Got I-frame while link state 2 >Mar 22 01:33:09 WARNING[114696]: chan_zap.c:5970 zt_pri_error: PRI: !! >Got S-frame while link down >Mar 22 01:33:09 WARNING[114696]: chan_zap.c:5970 zt_pri_error: PRI: !! >Got S-frame while link down > == D-Channel on span 1 up > >and certain IRQ misses like around 270 after an operation of 2-3 hours. > >Further when I load the T/E410p card I get this error ... > >Mar 22 00:33:48 VoiceOne kernel: TE410P: Launching card: 0 >Mar 22 00:33:48 VoiceOne kernel: TE410P: Setting up global serial >parameters >Mar 22 00:33:48 VoiceOne kernel: TE410P: Timing from source 0 >Mar 22 00:33:48 VoiceOne kernel: Found a Wildcard: Wildcard >TE410P-Xilinx >Mar 22 00:33:48 VoiceOne kernel: Registered tone zone 0 >(United States / >North America) >Mar 22 00:33:48 VoiceOne kernel: TE410P: Span 1 configured for >CCS/HDB3/CRC4 >Mar 22 00:33:48 VoiceOne kernel: SPAN 1: Primary Sync Source >Mar 22 00:33:48 VoiceOne kernel: Uhhuh. NMI received for unknown reason >20. >Mar 22 00:33:48 VoiceOne kernel: Dazed and confused, but trying to >continue >Mar 22 00:33:48 VoiceOne kernel: Do you have a strange power >saving mode >enabled? >Mar 22 00:33:48 VoiceOne kernel: TE410P: Span 2 configured for >CCS/HDB3/CRC4 >Mar 22 00:33:48 VoiceOne kernel: TE410P: Span 3 configured for >CCS/HDB3/CRC4 >Mar 22 00:33:48 VoiceOne kernel: TE410P: Span 4 configured for >CCS/HDB3/CRC4 > >I have another card and above also come with that. > >I look forward for resolution on these issues with some suggestions to >improve the stability. Coz otherwise system is not stable to be sold to >client. > >Regards >Azher Amin >------------------------------- >http://www.consulttech.com.pk > > > > >_______________________________________________ >Asterisk-Users mailing list >Asterisk-Users@lists.digium.com >http://lists.digium.com/mailman/listinfo/asterisk-users >To UNSUBSCRIBE or update options visit: > http://lists.digium.com/mailman/listinfo/asterisk-users > >
Hi everyone, I have the problem not exactly like this one but here is the whole story... I have installed everything about 3-4 months ago and it worked fine for some time. After a while I noticed that calls drop from time to time, and after few weeks of troubleshooting I asked Digium support to check my installation. Michael Wood from Digium logged in and checked everything, he played a little with source and found that the card is missing interrupts from time to time. After that, together with Mark Spencer who looked at my site also, he decided that I have to send TE410P back because it is bad one, and that I will receive a new one. They were prompt, I have received the new one in few days time, and installed it. The problem is again the same and I have just reported it again to Digium support today. Calls drop from time to time, people are frustrated and therefore I can not put the card in production. The other problem is that I might have few customers very interested in Asterisk and I don't know what to say to them!?!? I hope someone from Digium is reading this mailing list and I hope that our posts can help them to solve these problems. Tomica Crnek --------------------------------------- tel: +385 1 6690200 dir: +385 1 6690250 gsm: +385 98 227655 SPAN d.o.o., Turinina 3, 10000 Zagreb, Croatia> -----Original Message----- > From: asterisk-users-admin@lists.digium.com > [mailto:asterisk-users-admin@lists.digium.com] On Behalf Of Azher Amin > Sent: Monday, March 22, 2004 7:46 PM > To: asterisk-users@lists.digium.com > Subject: RE: [Asterisk-Users] RE:PRI issues with TE410P > > Dear Scott, > > Thnx for the details. I will talk with Mark on these issues today. > > Regards > Azher > ------------------------------- > http://www.consulttech.com.pk > > > -----Original Message----- > From: asterisk-users-admin@lists.digium.com > [mailto:asterisk-users-admin@lists.digium.com] On Behalf Of > Scott Stingel > Sent: Monday, March 22, 2004 11:29 PM > To: asterisk-users@lists.digium.com > Subject: [Asterisk-Users] RE:PRI issues with TE410P > > Hi Azher- > > I experience many of the same problems, especially the frame > retransmissions, which cause channel hangups from time to > time. These channel hangups clear themselves after a few > minutes normally but do interfere with calls. > > I'm not the expert on Linux internals, so I'm not sure what > can be done to improve things. If you have a SCSI disk > instead of an ide, you could try it instead, in case the IDE > interrupts are blocking the servicing of the TE410P. Of > course you can also take steps to minimize the ETH0 > interrupts during operation as well. > > Finally, I believe there are deficiencies in the zaptel > driver in that it does not handle overrun and underrun errors > correctly. I'm not certain of this, but it appeared that way > to a programmer that I had look at the driver. Mark Spencer > at Digium has expressed interest in looking at this problem, > but has not thus far. > > You might report the problems to Digium customer service, and > tell them that the PRI problems are preventing you from > buying additional TE410p boards, > etc. Maybe if enough of us report the problems we'll get some > attention. > Be sure to copy sales (Greg Vance) on everything (gvance@digium.com) > > Sorry I don't have the magic answer. > > Regards > Scott > > Scott M. Stingel > Emerging Voice Technology Inc. > Palo Alto, California and London, England > > Email: scott@evtmedia.com > URL: www.evtmedia.com > > > > -----Original Message----- > From: asterisk-users-admin@lists.digium.com > [mailto:asterisk-users-admin@lists.digium.com] On Behalf Of Azher Amin > Sent: Monday, March 22, 2004 9:03 AM > To: asterisk-users@lists.digium.com > Subject: RE: [Asterisk-Users] PRI issues with TE410P > > > Dear Scott, > > I am using kernel 2.4.25. RedHat Linux 9.0. libpri-0.5.2, > zaptel-0.9.0, and asterisk from CVS of 20th March. > > About the IRQ misses, may be I am wrong, but from below, CPU0 > has lot load from t4xxp, ide0 and eth0. Is it possible that > we can keep the ide0 and eth0 to cpu1 ? and just let the cpu0 > handle t4xxp ? Any suggestion ?? > > CPU0 CPU1 > 0: 2295 8857853 IO-APIC-edge timer > 1: 2 0 IO-APIC-edge keyboard > 2: 0 0 XT-PIC cascade > 14: 98854 0 IO-APIC-edge ide0 > 15: 5 5 IO-APIC-edge ide1 > 22: 91359 0 IO-APIC-level eth0 > 28: 88531746 50053 IO-APIC-level t4xxp > NMI: 0 0 > LOC: 8860069 8860067 > ERR: 0 > MIS: 0 > > Also on load, I am getting lot frame retransmissions. I have > attached the messages file, plz take a look at that as well > for some suggestions. > > I don't care about Frame retransmissions as far as my PRI's > stays stable and the users don't get dropped :( > > Regards > Azher > ------------------------------- > http://www.consulttech.com.pk > > > -----Original Message----- > From: asterisk-users-admin@lists.digium.com > [mailto:asterisk-users-admin@lists.digium.com] On Behalf Of > Scott Stingel > Sent: Sunday, March 21, 2004 9:16 PM > To: asterisk-users@lists.digium.com > Subject: RE: [Asterisk-Users] PRI issues with TE410P > > Hello Azher- > > I have a similar setup in hardware, ie: TE410P running on > dual-xeon system, however I'm running IVR only. I start > getting the I-frame errors above about 80 simultaneous calls. > I do not get IRQ misses at all. Also I do not get the > startup error messages. The errors I get the most under load > are the frame retransmission messages in > /var/log/asterisk/messages. Do you get those as well? > > Since you are getting IRQ misses, you may have some basic problem, ie: > something keeping the zaptel driver from getting around to > servicing the TE410 interrupts. I think that they have to be > serviced without fail every > 1 msec, or errors start occurring. > > Which kernel are you running? > What does your Perl script do? > Did you try disabling mysql logging to lower the disk load? > Maybe the disk driver is interfering with the zaptel driver > interrupts. > > Regards > Scott > > > Scott M. Stingel > Emerging Voice Technology Inc. > Palo Alto, California and London, England > > Email: scott "at " evtmedia.com > URL: www.evtmedia.com > > > > >-----Original Message----- > >From: asterisk-users-admin@lists.digium.com > >[mailto:asterisk-users-admin@lists.digium.com] On Behalf Of > Azher Amin > >Sent: Sunday, March 21, 2004 3:41 PM > >To: asterisk-users@lists.digium.com > >Subject: [Asterisk-Users] PRI issues with TE410P > > > >Hi, > > > >I am having some problems mentioned below, the box is in production > >live environment with traffic around 30 - 100 calls. > > > >I am running T/E410P in a Dual P4 xeon with HT disabled. I am using > >zaptel 0.9.0 and asterisk stable 1 release. There is no gui, just > >mysql, perl (small script) and asterisk. > > > >System runs very smoothly if the calls are around 40-50 and > comes one > >by one , however sometimes at immediate load of around 30 more calls > >... I get the following processes in the ps -ax, and asterisk starts > >droping the calls, irq misses rise and console shows lot of > pri errors > >(which donot occur in a smooth load of around 50 calls). > > > >Can someone explain why this happens .. however these get > cleared once > >the channels are handled. > > > >20992 pts/3 S 0:01 zttool > >21412 ? S 0:00 asterisk > >21413 ? R 0:00 asterisk > >21418 ? S 0:00 asterisk > >21419 ? S 0:00 asterisk > >21420 ? S 0:00 asterisk > >21421 ? S 0:00 asterisk > >21422 ? S 0:00 asterisk > >21423 ? S 0:00 asterisk > >21424 ? S 0:00 asterisk > >21425 ? S 0:00 asterisk > >21426 ? S 0:00 asterisk > >21427 ? S 0:00 asterisk > >21429 ? S 0:00 asterisk > >21430 ? S 0:00 asterisk > >21431 ? S 0:00 asterisk > >21432 ? S 0:00 asterisk > >21433 ? S 0:00 asterisk > >21434 ? S 0:00 asterisk > >21435 ? S 0:00 asterisk > >21436 ? S 0:00 asterisk > >21437 ? S 0:00 asterisk > >21438 ? S 0:00 asterisk > >21439 ? S 0:00 asterisk > >21440 ? S 0:00 asterisk > >21441 ? S 0:00 asterisk > >21442 ? S 0:00 asterisk > >21443 ? S 0:00 asterisk > >21444 ? S 0:00 asterisk > >21445 ? S 0:00 asterisk > >21446 ? S 0:00 asterisk > >21447 ? S 0:00 asterisk > >21448 ? S 0:00 asterisk > >21449 ? S 0:00 asterisk > >21451 ? S 0:00 asterisk > >21452 ? S 0:00 asterisk > >21453 ? S 0:00 asterisk > >21454 ? S 0:00 asterisk > >21455 ? S 0:00 asterisk > >21456 ? S 0:00 asterisk > >21457 ? S 0:00 asterisk > >21458 ? S 0:00 asterisk > >21459 pts/2 R 0:00 ps -ax > >21460 ? S 0:00 asterisk > > > > > > > >Further I am also getting > > > >Mar 22 01:33:09 WARNING[114696]: chan_zap.c:5970 > zt_pri_error: PRI: !! > >Got I-frame while link state 2 > >Mar 22 01:33:09 WARNING[114696]: chan_zap.c:5970 > zt_pri_error: PRI: !! > >Got I-frame while link state 2 > >Mar 22 01:33:09 WARNING[114696]: chan_zap.c:5970 > zt_pri_error: PRI: !! > >Got I-frame while link state 2 > >Mar 22 01:33:09 WARNING[114696]: chan_zap.c:5970 > zt_pri_error: PRI: !! > >Got I-frame while link state 2 > >Mar 22 01:33:09 WARNING[114696]: chan_zap.c:5970 > zt_pri_error: PRI: !! > >Got I-frame while link state 2 > >Mar 22 01:33:09 WARNING[114696]: chan_zap.c:5970 > zt_pri_error: PRI: !! > >Got S-frame while link down > >Mar 22 01:33:09 WARNING[114696]: chan_zap.c:5970 > zt_pri_error: PRI: !! > >Got S-frame while link down > > == D-Channel on span 1 up > > > >and certain IRQ misses like around 270 after an operation of > 2-3 hours. > > > >Further when I load the T/E410p card I get this error ... > > > >Mar 22 00:33:48 VoiceOne kernel: TE410P: Launching card: 0 Mar 22 > >00:33:48 VoiceOne kernel: TE410P: Setting up global serial > parameters > >Mar 22 00:33:48 VoiceOne kernel: TE410P: Timing from source 0 Mar 22 > >00:33:48 VoiceOne kernel: Found a Wildcard: Wildcard > TE410P-Xilinx Mar > >22 00:33:48 VoiceOne kernel: Registered tone zone 0 (United States / > >North America) Mar 22 00:33:48 VoiceOne kernel: TE410P: Span 1 > >configured for > >CCS/HDB3/CRC4 > >Mar 22 00:33:48 VoiceOne kernel: SPAN 1: Primary Sync Source Mar 22 > >00:33:48 VoiceOne kernel: Uhhuh. NMI received for unknown reason 20. > >Mar 22 00:33:48 VoiceOne kernel: Dazed and confused, but trying to > >continue Mar 22 00:33:48 VoiceOne kernel: Do you have a > strange power > >saving mode enabled? > >Mar 22 00:33:48 VoiceOne kernel: TE410P: Span 2 configured for > >CCS/HDB3/CRC4 > >Mar 22 00:33:48 VoiceOne kernel: TE410P: Span 3 configured for > >CCS/HDB3/CRC4 > >Mar 22 00:33:48 VoiceOne kernel: TE410P: Span 4 configured for > >CCS/HDB3/CRC4 > > > >I have another card and above also come with that. > > > >I look forward for resolution on these issues with some > suggestions to > >improve the stability. Coz otherwise system is not stable to > be sold to > >client. > > > >Regards > >Azher Amin > >------------------------------- > >http://www.consulttech.com.pk > > > > > > > > > >_______________________________________________ > >Asterisk-Users mailing list > >Asterisk-Users@lists.digium.com > >http://lists.digium.com/mailman/listinfo/asterisk-users > >To UNSUBSCRIBE or update options visit: > > http://lists.digium.com/mailman/listinfo/asterisk-users > > > > > > _______________________________________________ > Asterisk-Users mailing list > Asterisk-Users@lists.digium.com > http://lists.digium.com/mailman/listinfo/asterisk-users > To UNSUBSCRIBE or update options visit: > http://lists.digium.com/mailman/listinfo/asterisk-users > > > _______________________________________________ > Asterisk-Users mailing list > Asterisk-Users@lists.digium.com > http://lists.digium.com/mailman/listinfo/asterisk-users > To UNSUBSCRIBE or update options visit: > http://lists.digium.com/mailman/listinfo/asterisk-users > > > > _______________________________________________ > Asterisk-Users mailing list > Asterisk-Users@lists.digium.com > http://lists.digium.com/mailman/listinfo/asterisk-users > To UNSUBSCRIBE or update options visit: > http://lists.digium.com/mailman/listinfo/asterisk-users > >
Dear
i have found the same problem last sunday in my * box and freeze itself.
My Box is Pentium 4 HT with 2 CPU and i see it in /proc/interrupts
-----------------
CPU0 CPU1 CPU2 CPU3
0: 13088533 0 0 0 IO-APIC-edge timer
1: 6 0 0 0 IO-APIC-edge keyboard
2: 0 0 0 0 XT-PIC cascade
8: 1 0 0 0 IO-APIC-edge rtc
12: 12 0 0 0 IO-APIC-edge PS/2 Mouse
14: 2146897 0 1 0 IO-APIC-edge ide0
15: 118 0 1 0 IO-APIC-edge ide1
16: 0 0 0 0 IO-APIC-level usb-uhci
18: 0 0 0 0 IO-APIC-level usb-uhci
19: 0 0 0 0 IO-APIC-level usb-uhci
28: 118357 0 0 0 IO-APIC-level eth0
48: 130880536 0 0 0 IO-APIC-level t4xxp
NMI: 0 0 0 0
LOC: 13088959 13088958 13088958 13088958
ERR: 0
MIS: 0
--------------------------------------------------------
What we think about?
Thanks in advance
Dimitri
On Sunday 21 March 2004 15:40, Azher Amin wrote:> Hi,
>
> I am having some problems mentioned below, the box is in production live
> environment with traffic around 30 - 100 calls.
>
> I am running T/E410P in a Dual P4 xeon with HT disabled. I am using
> zaptel 0.9.0 and asterisk stable 1 release. There is no gui, just mysql,
> perl (small script) and asterisk.
>
> System runs very smoothly if the calls are around 40-50 and comes one by
> one , however sometimes at immediate load of around 30 more calls ... I
> get the following processes in the ps -ax, and asterisk starts droping
> the calls, irq misses rise and console shows lot of pri errors (which
> donot occur in a smooth load of around 50 calls).
>
> Can someone explain why this happens .. however these get cleared once
> the channels are handled.
>
> 20992 pts/3 S 0:01 zttool
> 21412 ? S 0:00 asterisk
> 21413 ? R 0:00 asterisk
> 21418 ? S 0:00 asterisk
> 21419 ? S 0:00 asterisk
> 21420 ? S 0:00 asterisk
> 21421 ? S 0:00 asterisk
> 21422 ? S 0:00 asterisk
> 21423 ? S 0:00 asterisk
> 21424 ? S 0:00 asterisk
> 21425 ? S 0:00 asterisk
> 21426 ? S 0:00 asterisk
> 21427 ? S 0:00 asterisk
> 21429 ? S 0:00 asterisk
> 21430 ? S 0:00 asterisk
> 21431 ? S 0:00 asterisk
> 21432 ? S 0:00 asterisk
> 21433 ? S 0:00 asterisk
> 21434 ? S 0:00 asterisk
> 21435 ? S 0:00 asterisk
> 21436 ? S 0:00 asterisk
> 21437 ? S 0:00 asterisk
> 21438 ? S 0:00 asterisk
> 21439 ? S 0:00 asterisk
> 21440 ? S 0:00 asterisk
> 21441 ? S 0:00 asterisk
> 21442 ? S 0:00 asterisk
> 21443 ? S 0:00 asterisk
> 21444 ? S 0:00 asterisk
> 21445 ? S 0:00 asterisk
> 21446 ? S 0:00 asterisk
> 21447 ? S 0:00 asterisk
> 21448 ? S 0:00 asterisk
> 21449 ? S 0:00 asterisk
> 21451 ? S 0:00 asterisk
> 21452 ? S 0:00 asterisk
> 21453 ? S 0:00 asterisk
> 21454 ? S 0:00 asterisk
> 21455 ? S 0:00 asterisk
> 21456 ? S 0:00 asterisk
> 21457 ? S 0:00 asterisk
> 21458 ? S 0:00 asterisk
> 21459 pts/2 R 0:00 ps -ax
> 21460 ? S 0:00 asterisk
>
>
>
> Further I am also getting
>
> Mar 22 01:33:09 WARNING[114696]: chan_zap.c:5970 zt_pri_error: PRI: !!
> Got I-frame while link state 2
> Mar 22 01:33:09 WARNING[114696]: chan_zap.c:5970 zt_pri_error: PRI: !!
> Got I-frame while link state 2
> Mar 22 01:33:09 WARNING[114696]: chan_zap.c:5970 zt_pri_error: PRI: !!
> Got I-frame while link state 2
> Mar 22 01:33:09 WARNING[114696]: chan_zap.c:5970 zt_pri_error: PRI: !!
> Got I-frame while link state 2
> Mar 22 01:33:09 WARNING[114696]: chan_zap.c:5970 zt_pri_error: PRI: !!
> Got I-frame while link state 2
> Mar 22 01:33:09 WARNING[114696]: chan_zap.c:5970 zt_pri_error: PRI: !!
> Got S-frame while link down
> Mar 22 01:33:09 WARNING[114696]: chan_zap.c:5970 zt_pri_error: PRI: !!
> Got S-frame while link down
> == D-Channel on span 1 up
>
> and certain IRQ misses like around 270 after an operation of 2-3 hours.
>
> Further when I load the T/E410p card I get this error ...
>
> Mar 22 00:33:48 VoiceOne kernel: TE410P: Launching card: 0
> Mar 22 00:33:48 VoiceOne kernel: TE410P: Setting up global serial
> parameters
> Mar 22 00:33:48 VoiceOne kernel: TE410P: Timing from source 0
> Mar 22 00:33:48 VoiceOne kernel: Found a Wildcard: Wildcard
> TE410P-Xilinx
> Mar 22 00:33:48 VoiceOne kernel: Registered tone zone 0 (United States /
> North America)
> Mar 22 00:33:48 VoiceOne kernel: TE410P: Span 1 configured for
> CCS/HDB3/CRC4
> Mar 22 00:33:48 VoiceOne kernel: SPAN 1: Primary Sync Source
> Mar 22 00:33:48 VoiceOne kernel: Uhhuh. NMI received for unknown reason
> 20.
> Mar 22 00:33:48 VoiceOne kernel: Dazed and confused, but trying to
> continue
> Mar 22 00:33:48 VoiceOne kernel: Do you have a strange power saving mode
> enabled?
> Mar 22 00:33:48 VoiceOne kernel: TE410P: Span 2 configured for
> CCS/HDB3/CRC4
> Mar 22 00:33:48 VoiceOne kernel: TE410P: Span 3 configured for
> CCS/HDB3/CRC4
> Mar 22 00:33:48 VoiceOne kernel: TE410P: Span 4 configured for
> CCS/HDB3/CRC4
>
> I have another card and above also come with that.
>
> I look forward for resolution on these issues with some suggestions to
> improve the stability. Coz otherwise system is not stable to be sold to
> client.
>
> Regards
> Azher Amin
> -------------------------------
> http://www.consulttech.com.pk
>
>
>
>
> _______________________________________________
> Asterisk-Users mailing list
> Asterisk-Users@lists.digium.com
> http://lists.digium.com/mailman/listinfo/asterisk-users
> To UNSUBSCRIBE or update options visit:
> http://lists.digium.com/mailman/listinfo/asterisk-users
Dear,
Are you using Redhat9.0, coz I discussed about this yesterday with mike
in Digium, and he said that this is normal with Redhat (due to its SMP
handling problems), further he suggested to shift either to redhat 8 or
debian. You can try debian or gentoo.
I will try gentoo tomorrow and will see this behavior again.
Regards
Azher
-----Original Message-----
From: asterisk-users-admin@lists.digium.com
[mailto:asterisk-users-admin@lists.digium.com] On Behalf Of reseaux
Sent: Wednesday, March 24, 2004 2:32 AM
To: asterisk-users@lists.digium.com
Subject: Re: [Asterisk-Users] PRI issues with TE410P
Dear
i have found the same problem last sunday in my * box and freeze
itself.
My Box is Pentium 4 HT with 2 CPU and i see it in /proc/interrupts
-----------------
CPU0 CPU1 CPU2 CPU3
0: 13088533 0 0 0 IO-APIC-edge timer
1: 6 0 0 0 IO-APIC-edge
keyboard
2: 0 0 0 0 XT-PIC
cascade
8: 1 0 0 0 IO-APIC-edge rtc
12: 12 0 0 0 IO-APIC-edge PS/2
Mouse
14: 2146897 0 1 0 IO-APIC-edge ide0
15: 118 0 1 0 IO-APIC-edge ide1
16: 0 0 0 0 IO-APIC-level
usb-uhci
18: 0 0 0 0 IO-APIC-level
usb-uhci
19: 0 0 0 0 IO-APIC-level
usb-uhci
28: 118357 0 0 0 IO-APIC-level eth0
48: 130880536 0 0 0 IO-APIC-level t4xxp
NMI: 0 0 0 0
LOC: 13088959 13088958 13088958 13088958
ERR: 0
MIS: 0
--------------------------------------------------------
What we think about?
Thanks in advance
Dimitri
On Sunday 21 March 2004 15:40, Azher Amin wrote:> Hi,
>
> I am having some problems mentioned below, the box is in production
live> environment with traffic around 30 - 100 calls.
>
> I am running T/E410P in a Dual P4 xeon with HT disabled. I am using
> zaptel 0.9.0 and asterisk stable 1 release. There is no gui, just
mysql,> perl (small script) and asterisk.
>
> System runs very smoothly if the calls are around 40-50 and comes one
by> one , however sometimes at immediate load of around 30 more calls ...
I> get the following processes in the ps -ax, and asterisk starts droping
> the calls, irq misses rise and console shows lot of pri errors (which
> donot occur in a smooth load of around 50 calls).
>
> Can someone explain why this happens .. however these get cleared once
> the channels are handled.
>
> 20992 pts/3 S 0:01 zttool
> 21412 ? S 0:00 asterisk
> 21413 ? R 0:00 asterisk
> 21418 ? S 0:00 asterisk
> 21419 ? S 0:00 asterisk
> 21420 ? S 0:00 asterisk
> 21421 ? S 0:00 asterisk
> 21422 ? S 0:00 asterisk
> 21423 ? S 0:00 asterisk
> 21424 ? S 0:00 asterisk
> 21425 ? S 0:00 asterisk
> 21426 ? S 0:00 asterisk
> 21427 ? S 0:00 asterisk
> 21429 ? S 0:00 asterisk
> 21430 ? S 0:00 asterisk
> 21431 ? S 0:00 asterisk
> 21432 ? S 0:00 asterisk
> 21433 ? S 0:00 asterisk
> 21434 ? S 0:00 asterisk
> 21435 ? S 0:00 asterisk
> 21436 ? S 0:00 asterisk
> 21437 ? S 0:00 asterisk
> 21438 ? S 0:00 asterisk
> 21439 ? S 0:00 asterisk
> 21440 ? S 0:00 asterisk
> 21441 ? S 0:00 asterisk
> 21442 ? S 0:00 asterisk
> 21443 ? S 0:00 asterisk
> 21444 ? S 0:00 asterisk
> 21445 ? S 0:00 asterisk
> 21446 ? S 0:00 asterisk
> 21447 ? S 0:00 asterisk
> 21448 ? S 0:00 asterisk
> 21449 ? S 0:00 asterisk
> 21451 ? S 0:00 asterisk
> 21452 ? S 0:00 asterisk
> 21453 ? S 0:00 asterisk
> 21454 ? S 0:00 asterisk
> 21455 ? S 0:00 asterisk
> 21456 ? S 0:00 asterisk
> 21457 ? S 0:00 asterisk
> 21458 ? S 0:00 asterisk
> 21459 pts/2 R 0:00 ps -ax
> 21460 ? S 0:00 asterisk
>
>
>
> Further I am also getting
>
> Mar 22 01:33:09 WARNING[114696]: chan_zap.c:5970 zt_pri_error: PRI: !!
> Got I-frame while link state 2
> Mar 22 01:33:09 WARNING[114696]: chan_zap.c:5970 zt_pri_error: PRI: !!
> Got I-frame while link state 2
> Mar 22 01:33:09 WARNING[114696]: chan_zap.c:5970 zt_pri_error: PRI: !!
> Got I-frame while link state 2
> Mar 22 01:33:09 WARNING[114696]: chan_zap.c:5970 zt_pri_error: PRI: !!
> Got I-frame while link state 2
> Mar 22 01:33:09 WARNING[114696]: chan_zap.c:5970 zt_pri_error: PRI: !!
> Got I-frame while link state 2
> Mar 22 01:33:09 WARNING[114696]: chan_zap.c:5970 zt_pri_error: PRI: !!
> Got S-frame while link down
> Mar 22 01:33:09 WARNING[114696]: chan_zap.c:5970 zt_pri_error: PRI: !!
> Got S-frame while link down
> == D-Channel on span 1 up
>
> and certain IRQ misses like around 270 after an operation of 2-3
hours.>
> Further when I load the T/E410p card I get this error ...
>
> Mar 22 00:33:48 VoiceOne kernel: TE410P: Launching card: 0
> Mar 22 00:33:48 VoiceOne kernel: TE410P: Setting up global serial
> parameters
> Mar 22 00:33:48 VoiceOne kernel: TE410P: Timing from source 0
> Mar 22 00:33:48 VoiceOne kernel: Found a Wildcard: Wildcard
> TE410P-Xilinx
> Mar 22 00:33:48 VoiceOne kernel: Registered tone zone 0 (United States
/> North America)
> Mar 22 00:33:48 VoiceOne kernel: TE410P: Span 1 configured for
> CCS/HDB3/CRC4
> Mar 22 00:33:48 VoiceOne kernel: SPAN 1: Primary Sync Source
> Mar 22 00:33:48 VoiceOne kernel: Uhhuh. NMI received for unknown
reason> 20.
> Mar 22 00:33:48 VoiceOne kernel: Dazed and confused, but trying to
> continue
> Mar 22 00:33:48 VoiceOne kernel: Do you have a strange power saving
mode> enabled?
> Mar 22 00:33:48 VoiceOne kernel: TE410P: Span 2 configured for
> CCS/HDB3/CRC4
> Mar 22 00:33:48 VoiceOne kernel: TE410P: Span 3 configured for
> CCS/HDB3/CRC4
> Mar 22 00:33:48 VoiceOne kernel: TE410P: Span 4 configured for
> CCS/HDB3/CRC4
>
> I have another card and above also come with that.
>
> I look forward for resolution on these issues with some suggestions to
> improve the stability. Coz otherwise system is not stable to be sold
to> client.
>
> Regards
> Azher Amin
> -------------------------------
> http://www.consulttech.com.pk
>
>
>
>
> _______________________________________________
> Asterisk-Users mailing list
> Asterisk-Users@lists.digium.com
> http://lists.digium.com/mailman/listinfo/asterisk-users
> To UNSUBSCRIBE or update options visit:
> http://lists.digium.com/mailman/listinfo/asterisk-users
_______________________________________________
Asterisk-Users mailing list
Asterisk-Users@lists.digium.com
http://lists.digium.com/mailman/listinfo/asterisk-users
To UNSUBSCRIBE or update options visit:
http://lists.digium.com/mailman/listinfo/asterisk-users
Hi Azher,> They advertised on TeleVision and then we had a rush of > calls landing on the system (about 30 calls in 1-2 secs and 60 in 3-4 > seconds time).this sounds like a high number of _simultaneous_ call attempts for a PRI connected system to support. Your comments about a gradual load increase presenting no problem would seem to back this fact up. On most Public Telephone Switches (in the UK) it is advised that no more than 5 call attempts per second should be attempted via PRI if you seek stability. (Above 5 calls attempts per second "Network Congestion" messages can be sometimes be observed on a protocol analyser. These congestion messages can prove fatal for certain applications such as high quality video conferences via hardware that aggregates multiple B channels.) It should be remembered that PRI connections are based upon subscriber signalling specifications and that "spiky" mass call events are traditionally hosted on platforms that are connected via SS7 signalling. I know of similar stability problems with Dialogic and Acculab ISDN connected systems where mass call events, in excess of 5 call attempts per second, have proved too much of a spike for the Public Switch. In certain switch architectures concentrator equipment can also be adversely affected by this kind of deployment which can cause disruption for many customers (not just the one running the PRI IVR platform). On slower CPU systems (< 800 MHz) I have noticed occasional Euro ISDN PRI signalling problems if a high percentage of the 30 channels on an E100P are busy with simultaneous outbound/inbound calls and glare occurs. On the protocol analyser trace it was evident that some messages via the D channel from the Public Switch went unacknowledged by the Asterisk system. If you encounter this problem a quick work around is to split the channels of your single PRI into two trunks to stop the contention between inbound and outbound telephony traffic. (E.g. g1 for incoming and g2 for outgoing calls) I have yet to flex a TE410P with significant traffic levels as all my busy systems are using E100P cards but I have just finished commissioning a TE410P system (with help from Rob Boardman - thanks) in Munich that will be stress tested over the next two weeks; I hope to have news on stability when the tests are completed. HTH Darren -- Comgate (UK) Telco>Internet<Broadcast To: <asterisk-users@lists.digium.com> Subject: RE: [Asterisk-Users] PRI issues with TE410P From: "Azher Amin" <azher@consulttech.com.pk> Date: Thu, 25 Mar 2004 09:09:18 +0500 Hi Tan, I have already turned off the HT from the BIOS (while it was enabled, asterisk was not even stable with 2 pri's). Further I am using the same kernel (2.4.25) with SMP enabled, that u mentioned in your email. Basically I think Scott is right in his emails, that libpri's and zaptel driver for t4xxp are not really optimized and they really need tunings in case when there is certain increase in number of calls .... Also I cannot afford to get a system higher than the current specs. Yesterday I had the same situation, I gave the IVR solution using te410p to a company. They advertised on TeleVision and then we had a rush of calls landing on the system (about 30 calls in 1-2 secs and 60 in 3-4 seconds time). What I have observed is: 1. Asterisk is stable upto 2 PRI's ... no call drops no errors. 2. As soon as I plug in the 3rd pri (3rd pri is confirmed stable), it starts dropping the calls current landing as well as the previous stable landed calls. All calls get dropped and PRIs' start syncing / unsyncing. 3. On the other hand I have also a dialogic server with 4 pri's in it, and it was a rock solid ... going to full 120 calls ... btw: server is just P3 700Mhz, and I have not noticed a single dropped call. 4. My configurations were checked by Mike (@ digium) ... and according to him all things are fine, zaptel,zapata,extensions.conf ... Thus when there is a smooth and gradual load of upto 3 pri's system will remain stable, and when there is an instant call load it becomes shaky. Also I will request those who have successfully done similar setup, to post/advise their linux flavor (and updates), asterisk configurations, kernel configuration, other system tweakings. I want Mark from Digium to take special interest in solving and recommendation on these issues, coz I have confirmed orders of 3 te410p boards and one e100p (for which I mailed to Greg as well), but now I am feeling reluctant to face the client. Regards Azher Amin ------------------------------- http://www.consulttech.com.pk -----Original Message----- From: asterisk-users-admin@lists.digium.com [mailto:asterisk-users-admin@lists.digium.com] On Behalf Of tan@yointernet.com Sent: Wednesday, March 24, 2004 5:03 PM To: asterisk-users@lists.digium.com Subject: RE: [Asterisk-Users] PRI issues with TE410P Before going to gentoo or another version of linux, try the following: 1) turn hyperthreading off in the BIOS. It's probably called something like "virtual cpus". 2) Use a vanilla kernel from kernel.org e.g. 2.4.25. We used to have times when the system would just hang. Using a non-redhat kernel seems to have resolved that. We also use Gentoo, but I warn you that it is not the easiest flavour to set up! Hope that helps. Tan Telappliant.com Voiptalk.org