whois wes
2006-Jul-06 09:51 UTC
[asterisk-users] Phones cutting out.....again - PLEASE HELP!!!
Hate to drag this one back up, but....it's happening again. Overview of architecture: Dell poweredge 2850, running fedora core 4, asterisk 1.2.7.1, zaptel 1.2.5, and sangoma wanpipe 2.3.4 drivers. T1 interface card is the sangoma a104d with onboard echo can. Server is located in our data center and connected directly to our cisco 6513 core switch, so we have almost zero latency. The office having the issues is located several miles away and is connected via a 10Mbit fiber pipe, also low latency. Ping times between remote office and here are well under 10ms. T1's are robbed-bit, E&M wink signalling <--- (this may be cause, but want your input). Server load is averaging around 20%, plenty of memory, disk space, and bandwidth available. No QOS running on network. ulaw is the primary codec. Server is stable, and there are no extraneous services running, save mysql and httpd. Even running a processor intensive query doesn't trigger the droputs, they happen randomly. Phones are a mix of Eyebeam 1.5.5 and Eyebeam 1.10 3010n. Both types of phones are experiencing cutting out of the signal, mainly in the Rx stream, but occassional in the Tx stream as well. The cutting out was NOT occurring last night, and the phone server is being rebooted nightly. Nothing has changed AT ALL, and the problem has started occurring again. If I don't do ANYTHING at all today, there is a 50% chance that this will NOT occur tomorrow. In other words, SOMETHING is causing our phones to drop out, but whatever changes I make seem to have no effect. The problem will start and stop seeminly at it's own whim. --- Things I have tried: 1. changed from ulaw to gsm as primary codec - no change 2. disabled hardware echo can on A104D - no change 3. moved from asterisk 1.2.4 to 1.2.7.1, recompiled both several times - no change 4. have played with gain settings a bit, doesn't seem to make much difference --- At this point, i am nearing the end of my rope - i have rebuilt this machine three times now, and have recompiled the system at least a dozen times. We have gone from Digium hardware to Sangoma harware and back again. I have changed every conceivable setting on the phones to no avail. The problem will randomly disappear, only to come back a few days later. I can make a change, it seems to have an effect, then we're back to the same old thing again. I am in dire need of ANY help anyone can offer, this has been going on in some form for almost three months. Thanks for reading, Wes
Andrew Kirch
2006-Jul-06 10:04 UTC
[asterisk-users] Phones cutting out.....again - PLEASE HELP!!!
> -----Original Message----- > Thanks for reading, > > Wes > _______________________________________________Please reply with the output of the following: lspci -vv lspci -vv | grep IRQ lspci cat /proc/interrupts Thank you. Andrew
Dan Austin
2006-Jul-06 10:27 UTC
[asterisk-users] Phones cutting out.....again - PLEASE HELP!!!
<snip> Server load is averaging around 20%, plenty of memory, disk space, and bandwidth available. No QOS running on network. ulaw is the primary codec. Server is stable, and there are no extraneous services running, save mysql and httpd. Even running a processor intensive query doesn't trigger the droputs, they happen randomly. <snip> You mention that the remote office is fiber connected, but don't identify what equipment is used to at the ends of the fiber. How many people are in the remote office, what is their work process/habits, do they also use this circuit for internet access? The key to my questions is that I suspect you do need at least a minimal QoS implimentation. A quick check on the circuit utilization when the issue occurs can confirm this, or eliminate it. Dan
whois wes
2006-Jul-06 10:28 UTC
[asterisk-users] Phones cutting out.....again - PLEASE HELP!!!
Here ya go:
lspci -vv
-----------------------------------------------------------------------------------------------------------
00:00.0 Host bridge: Intel Corporation E7520 Memory Controller Hub (rev 09)
Subsystem: Dell: Unknown device 016d
Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+
Stepping- SERR+ FastB2B-
Status: Cap+ 66Mhz- UDF- FastB2B+ ParErr- DEVSEL=fast >TAbort-
<TAbort- <MAbort- >SERR- <PERR-
Latency: 0
Capabilities: [40] Vendor Specific Information
00:02.0 PCI bridge: Intel Corporation E7525/E7520/E7320 PCI Express
Port A (rev 09) (prog-if 00 [Normal decode])
Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+
Stepping- SERR- FastB2B-
Status: Cap+ 66Mhz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort-
<TAbort- <MAbort- >SERR- <PERR-
Latency: 0, Cache Line Size 10
Bus: primary=00, secondary=01, subordinate=03, sec-latency=0
Memory behind bridge: dfd00000-dfffffff
Prefetchable memory behind bridge: 00000000d8000000-00000000d8000000
Secondary status: 66Mhz- FastB2B- ParErr- DEVSEL=fast >TAbort-
<TAbort- <MAbort+ <SERR+ <PERR-
BridgeCtl: Parity+ SERR+ NoISA+ VGA- MAbort- >Reset- FastB2B-
Capabilities: [50] Power Management version 2
Flags: PMEClk- DSI+ D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
Status: D0 PME-Enable- DSel=0 DScale=0 PME-
Capabilities: [58] Message Signalled Interrupts: 64bit- Queue=0/1 Enable-
Address: fee00000 Data: 0000
Capabilities: [64] Express Root Port (Slot-) IRQ 0
Device: Supported: MaxPayload 256 bytes, PhantFunc 0, ExtTag-
Device: Latency L0s <64ns, L1 <1us
Device: Errors: Correctable+ Non-Fatal+ Fatal+ Unsupported-
Device: RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
Device: MaxPayload 256 bytes, MaxReadReq 128 bytes
Link: Supported Speed 2.5Gb/s, Width x8, ASPM L0s, Port 2
Link: Latency L0s <4us, L1 unlimited
Link: ASPM Disabled RCB 64 bytes CommClk- ExtSynch-
Link: Speed 2.5Gb/s, Width x8
Root: Correctable- Non-Fatal- Fatal- PME-
00:04.0 PCI bridge: Intel Corporation E7525/E7520 PCI Express Port B
(rev 09) (prog-if 00 [Normal decode])
Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+
Stepping- SERR- FastB2B-
Status: Cap+ 66Mhz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort-
<TAbort- <MAbort- >SERR- <PERR-
Latency: 0, Cache Line Size 10
Bus: primary=00, secondary=04, subordinate=04, sec-latency=0
Secondary status: 66Mhz- FastB2B- ParErr- DEVSEL=fast >TAbort-
<TAbort- <MAbort+ <SERR- <PERR-
BridgeCtl: Parity+ SERR+ NoISA+ VGA- MAbort- >Reset- FastB2B-
Capabilities: [50] Power Management version 2
Flags: PMEClk- DSI+ D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
Status: D0 PME-Enable- DSel=0 DScale=0 PME-
Capabilities: [58] Message Signalled Interrupts: 64bit- Queue=0/1 Enable-
Address: fee00000 Data: 0000
Capabilities: [64] Express Root Port (Slot-) IRQ 0
Device: Supported: MaxPayload 256 bytes, PhantFunc 0, ExtTag-
Device: Latency L0s <64ns, L1 <1us
Device: Errors: Correctable+ Non-Fatal+ Fatal+ Unsupported-
Device: RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
Device: MaxPayload 128 bytes, MaxReadReq 128 bytes
Link: Supported Speed 2.5Gb/s, Width x8, ASPM L0s, Port 4
Link: Latency L0s <4us, L1 unlimited
Link: ASPM Disabled RCB 64 bytes Disabled CommClk- ExtSynch-
Link: Speed 2.5Gb/s, Width x8
Root: Correctable- Non-Fatal- Fatal- PME-
00:05.0 PCI bridge: Intel Corporation E7520 PCI Express Port B1 (rev
09) (prog-if 00 [Normal decode])
Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+
Stepping- SERR- FastB2B-
Status: Cap+ 66Mhz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort-
<TAbort- <MAbort- >SERR- <PERR-
Latency: 0, Cache Line Size 10
Bus: primary=00, secondary=05, subordinate=07, sec-latency=0
I/O behind bridge: 0000e000-0000efff
Memory behind bridge: dfa00000-dfcfffff
Secondary status: 66Mhz- FastB2B- ParErr- DEVSEL=fast >TAbort-
<TAbort- <MAbort+ <SERR+ <PERR-
BridgeCtl: Parity+ SERR+ NoISA+ VGA- MAbort- >Reset- FastB2B-
Capabilities: [50] Power Management version 2
Flags: PMEClk- DSI+ D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
Status: D0 PME-Enable- DSel=0 DScale=0 PME-
Capabilities: [58] Message Signalled Interrupts: 64bit- Queue=0/1 Enable-
Address: fee00000 Data: 0000
Capabilities: [64] Express Root Port (Slot-) IRQ 0
Device: Supported: MaxPayload 256 bytes, PhantFunc 0, ExtTag-
Device: Latency L0s <64ns, L1 <1us
Device: Errors: Correctable+ Non-Fatal+ Fatal+ Unsupported-
Device: RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
Device: MaxPayload 256 bytes, MaxReadReq 128 bytes
Link: Supported Speed 2.5Gb/s, Width x4, ASPM L0s, Port 5
Link: Latency L0s <4us, L1 unlimited
Link: ASPM Disabled RCB 64 bytes CommClk- ExtSynch-
Link: Speed 2.5Gb/s, Width x4
Root: Correctable- Non-Fatal- Fatal- PME-
00:06.0 PCI bridge: Intel Corporation E7520 PCI Express Port C (rev
09) (prog-if 00 [Normal decode])
Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+
Stepping- SERR- FastB2B-
Status: Cap+ 66Mhz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort-
<TAbort- <MAbort- >SERR- <PERR-
Latency: 0, Cache Line Size 10
Bus: primary=00, secondary=08, subordinate=0a, sec-latency=0
Memory behind bridge: df700000-df9fffff
Secondary status: 66Mhz- FastB2B- ParErr- DEVSEL=fast >TAbort-
<TAbort- <MAbort+ <SERR+ <PERR-
BridgeCtl: Parity+ SERR+ NoISA+ VGA- MAbort- >Reset- FastB2B-
Capabilities: [50] Power Management version 2
Flags: PMEClk- DSI+ D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
Status: D0 PME-Enable- DSel=0 DScale=0 PME-
Capabilities: [58] Message Signalled Interrupts: 64bit- Queue=0/1 Enable-
Address: fee00000 Data: 0000
Capabilities: [64] Express Root Port (Slot-) IRQ 0
Device: Supported: MaxPayload 256 bytes, PhantFunc 0, ExtTag-
Device: Latency L0s <64ns, L1 <1us
Device: Errors: Correctable+ Non-Fatal+ Fatal+ Unsupported-
Device: RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
Device: MaxPayload 256 bytes, MaxReadReq 128 bytes
Link: Supported Speed 2.5Gb/s, Width x8, ASPM L0s, Port 6
Link: Latency L0s <4us, L1 unlimited
Link: ASPM Disabled RCB 64 bytes CommClk- ExtSynch-
Link: Speed 2.5Gb/s, Width x8
Root: Correctable- Non-Fatal- Fatal- PME-
00:1e.0 PCI bridge: Intel Corporation 82801 PCI Bridge (rev c2)
(prog-if 00 [Normal decode])
Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+
Stepping- SERR+ FastB2B-
Status: Cap- 66Mhz- UDF- FastB2B+ ParErr- DEVSEL=fast >TAbort-
<TAbort- <MAbort- >SERR- <PERR-
Latency: 0
Bus: primary=00, secondary=0b, subordinate=0b, sec-latency=32
I/O behind bridge: 0000d000-0000dfff
Memory behind bridge: df500000-df6fffff
Prefetchable memory behind bridge: d0000000-d7ffffff
Secondary status: 66Mhz- FastB2B+ ParErr- DEVSEL=medium >TAbort-
<TAbort- <MAbort+ <SERR- <PERR-
BridgeCtl: Parity+ SERR+ NoISA- VGA+ MAbort- >Reset- FastB2B-
00:1f.0 ISA bridge: Intel Corporation 82801EB/ER (ICH5/ICH5R) LPC
Interface Bridge (rev 02)
Control: I/O+ Mem+ BusMaster+ SpecCycle+ MemWINV- VGASnoop- ParErr+
Stepping- SERR+ FastB2B-
Status: Cap- 66Mhz- UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort-
<TAbort- <MAbort- >SERR- <PERR-
Latency: 0
00:1f.1 IDE interface: Intel Corporation 82801EB/ER (ICH5/ICH5R) IDE
Controller (rev 02) (prog-if 8a [Master SecP PriP])
Subsystem: Dell: Unknown device 016d
Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr-
Stepping- SERR- FastB2B-
Status: Cap- 66Mhz- UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort-
<TAbort- <MAbort- >SERR- <PERR-
Latency: 0
Interrupt: pin A routed to IRQ 0
Region 0: I/O ports at <unassigned>
Region 1: I/O ports at <unassigned>
Region 2: I/O ports at <unassigned>
Region 3: I/O ports at <unassigned>
Region 4: I/O ports at fc00 [size=16]
Region 5: Memory at d8100000 (32-bit, non-prefetchable) [size=1K]
01:00.0 PCI bridge: Intel Corporation 80332 [Dobson] I/O processor
(rev 06) (prog-if 00 [Normal decode])
Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+
Stepping- SERR- FastB2B-
Status: Cap+ 66Mhz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort-
<TAbort- <MAbort- >SERR- <PERR-
Latency: 0, Cache Line Size 10
Bus: primary=01, secondary=02, subordinate=02, sec-latency=64
Memory behind bridge: dfe00000-dfffffff
Prefetchable memory behind bridge: 00000000d8000000-00000000d8000000
Secondary status: 66Mhz+ FastB2B+ ParErr- DEVSEL=medium >TAbort-
<TAbort- <MAbort+ <SERR- <PERR-
BridgeCtl: Parity+ SERR+ NoISA+ VGA- MAbort- >Reset- FastB2B-
Capabilities: [44] Express PCI/PCI-X Bridge IRQ 0
Device: Supported: MaxPayload 256 bytes, PhantFunc 0, ExtTag-
Device: Latency L0s <64ns, L1 <1us
Device: AtnBtn- AtnInd- PwrInd-
Device: Errors: Correctable+ Non-Fatal+ Fatal+ Unsupported-
Device: RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
Device: MaxPayload 256 bytes, MaxReadReq 512 bytes
Link: Supported Speed 2.5Gb/s, Width x8, ASPM L0s, Port 0
Link: Latency L0s unlimited, L1 unlimited
Link: ASPM Disabled CommClk- ExtSynch-
Link: Speed 2.5Gb/s, Width x8
Capabilities: [5c] Message Signalled Interrupts: 64bit+ Queue=0/0 Enable-
Address: 0000000000000000 Data: 0000
Capabilities: [6c] Power Management version 2
Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
Status: D0 PME-Enable- DSel=0 DScale=0 PME-
Capabilities: [d8] PCI-X bridge device.
Secondary Status: 64bit+, 133MHz+, SCD-, USC-, SCO-, SRD- Freq=3
Status: Bus=1 Dev=0 Func=0 64bit- 133MHz- SCD- USC-, SCO-, SRD-
: Upstream: Capacity=65535, Commitment Limit=65535
: Downstream: Capacity=65535, Commitment Limit=65535
01:00.2 PCI bridge: Intel Corporation 80332 [Dobson] I/O processor
(rev 06) (prog-if 00 [Normal decode])
Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+
Stepping- SERR- FastB2B-
Status: Cap+ 66Mhz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort-
<TAbort- <MAbort- >SERR- <PERR-
Latency: 0, Cache Line Size 10
Bus: primary=01, secondary=03, subordinate=03, sec-latency=64
Secondary status: 66Mhz+ FastB2B+ ParErr- DEVSEL=medium >TAbort-
<TAbort- <MAbort+ <SERR- <PERR-
BridgeCtl: Parity+ SERR+ NoISA+ VGA- MAbort- >Reset- FastB2B-
Capabilities: [44] Express PCI/PCI-X Bridge IRQ 0
Device: Supported: MaxPayload 256 bytes, PhantFunc 0, ExtTag-
Device: Latency L0s <64ns, L1 <1us
Device: AtnBtn- AtnInd- PwrInd-
Device: Errors: Correctable+ Non-Fatal+ Fatal+ Unsupported-
Device: RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
Device: MaxPayload 256 bytes, MaxReadReq 512 bytes
Link: Supported Speed 2.5Gb/s, Width x8, ASPM L0s, Port 0
Link: Latency L0s unlimited, L1 unlimited
Link: ASPM Disabled CommClk- ExtSynch-
Link: Speed 2.5Gb/s, Width x8
Capabilities: [5c] Message Signalled Interrupts: 64bit+ Queue=0/0 Enable-
Address: 0000000000000000 Data: 0000
Capabilities: [6c] Power Management version 2
Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
Status: D0 PME-Enable- DSel=0 DScale=0 PME-
Capabilities: [d8] PCI-X bridge device.
Secondary Status: 64bit+, 133MHz+, SCD-, USC-, SCO-, SRD- Freq=3
Status: Bus=1 Dev=0 Func=2 64bit- 133MHz- SCD- USC-, SCO-, SRD-
: Upstream: Capacity=65535, Commitment Limit=65535
: Downstream: Capacity=65535, Commitment Limit=65535
02:0e.0 RAID bus controller: Dell PowerEdge Expandable RAID controller
4 (rev 06)
Subsystem: Dell PowerEdge Expandable RAID Controller 4e/Di
Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV+ VGASnoop- ParErr-
Stepping+ SERR+ FastB2B-
Status: Cap+ 66Mhz+ UDF- FastB2B- ParErr- DEVSEL=medium >TAbort-
<TAbort- <MAbort- >SERR- <PERR-
Latency: 64 (32000ns min), Cache Line Size 10
Interrupt: pin A routed to IRQ 209
Region 0: Memory at d80f0000 (32-bit, prefetchable) [size=64K]
Region 2: Memory at dfec0000 (32-bit, non-prefetchable) [size=256K]
Expansion ROM at dff00000 [disabled] [size=128K]
Capabilities: [c0] Power Management version 2
Flags: PMEClk- DSI- D1+ D2- AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot-,D3cold-)
Status: D0 PME-Enable- DSel=0 DScale=0 PME-
Capabilities: [d0] Message Signalled Interrupts: 64bit+ Queue=0/1 Enable-
Address: 0000000000000000 Data: 0000
Capabilities: [e0] PCI-X non-bridge device.
Command: DPERE- ERO- RBC=0 OST=3
Status: Bus=2 Dev=14 Func=0 64bit+ 133MHz+ SCD- USC-, DC=bridge,
DMMRBC=1, DMOST=3, DMCRS=1, RSCEM-
05:00.0 PCI bridge: Intel Corporation 6700PXH PCI Express-to-PCI
Bridge A (rev 09) (prog-if 00 [Normal decode])
Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+
Stepping- SERR- FastB2B-
Status: Cap+ 66Mhz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort-
<TAbort- <MAbort- >SERR- <PERR-
Latency: 0, Cache Line Size 10
Bus: primary=05, secondary=06, subordinate=06, sec-latency=32
I/O behind bridge: 0000e000-0000efff
Memory behind bridge: dfb00000-dfcfffff
Secondary status: 66Mhz+ FastB2B+ ParErr- DEVSEL=medium >TAbort-
<TAbort- <MAbort+ <SERR- <PERR-
BridgeCtl: Parity+ SERR+ NoISA+ VGA- MAbort- >Reset- FastB2B-
Capabilities: [44] Express PCI/PCI-X Bridge IRQ 0
Device: Supported: MaxPayload 256 bytes, PhantFunc 0, ExtTag-
Device: Latency L0s <64ns, L1 <1us
Device: AtnBtn- AtnInd- PwrInd-
Device: Errors: Correctable+ Non-Fatal+ Fatal+ Unsupported-
Device: RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
Device: MaxPayload 256 bytes, MaxReadReq 512 bytes
Link: Supported Speed 2.5Gb/s, Width x8, ASPM L0s, Port 0
Link: Latency L0s unlimited, L1 unlimited
Link: ASPM Disabled CommClk- ExtSynch-
Link: Speed 2.5Gb/s, Width x8
Capabilities: [5c] Message Signalled Interrupts: 64bit+ Queue=0/0 Enable-
Address: 0000000000000000 Data: 0000
Capabilities: [6c] Power Management version 2
Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
Status: D0 PME-Enable- DSel=0 DScale=0 PME-
Capabilities: [d8] PCI-X bridge device.
Secondary Status: 64bit+, 133MHz+, SCD-, USC-, SCO-, SRD- Freq=0
Status: Bus=5 Dev=0 Func=0 64bit- 133MHz- SCD- USC-, SCO-, SRD-
: Upstream: Capacity=65535, Commitment Limit=65535
: Downstream: Capacity=65535, Commitment Limit=65535
05:00.2 PCI bridge: Intel Corporation 6700PXH PCI Express-to-PCI
Bridge B (rev 09) (prog-if 00 [Normal decode])
Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+
Stepping- SERR- FastB2B-
Status: Cap+ 66Mhz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort-
<TAbort- <MAbort- >SERR- <PERR-
Latency: 0, Cache Line Size 10
Bus: primary=05, secondary=07, subordinate=07, sec-latency=32
Secondary status: 66Mhz+ FastB2B+ ParErr- DEVSEL=medium >TAbort-
<TAbort- <MAbort+ <SERR- <PERR-
BridgeCtl: Parity+ SERR+ NoISA+ VGA- MAbort- >Reset- FastB2B-
Capabilities: [44] Express PCI/PCI-X Bridge IRQ 0
Device: Supported: MaxPayload 256 bytes, PhantFunc 0, ExtTag-
Device: Latency L0s <64ns, L1 <1us
Device: AtnBtn- AtnInd- PwrInd-
Device: Errors: Correctable+ Non-Fatal+ Fatal+ Unsupported-
Device: RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
Device: MaxPayload 256 bytes, MaxReadReq 512 bytes
Link: Supported Speed 2.5Gb/s, Width x8, ASPM L0s, Port 0
Link: Latency L0s unlimited, L1 unlimited
Link: ASPM Disabled CommClk- ExtSynch-
Link: Speed 2.5Gb/s, Width x8
Capabilities: [5c] Message Signalled Interrupts: 64bit+ Queue=0/0 Enable-
Address: 0000000000000000 Data: 0000
Capabilities: [6c] Power Management version 2
Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
Status: D0 PME-Enable- DSel=0 DScale=0 PME-
Capabilities: [d8] PCI-X bridge device.
Secondary Status: 64bit+, 133MHz+, SCD-, USC-, SCO-, SRD- Freq=0
Status: Bus=5 Dev=0 Func=2 64bit- 133MHz- SCD- USC-, SCO-, SRD-
: Upstream: Capacity=65535, Commitment Limit=65535
: Downstream: Capacity=65535, Commitment Limit=65535
06:07.0 Ethernet controller: Intel Corporation 82541GI/PI Gigabit
Ethernet Controller (rev 05)
Subsystem: Dell: Unknown device 016d
Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV+ VGASnoop- ParErr-
Stepping- SERR+ FastB2B-
Status: Cap+ 66Mhz+ UDF- FastB2B- ParErr- DEVSEL=medium >TAbort-
<TAbort- <MAbort- >SERR- <PERR-
Latency: 32 (63750ns min), Cache Line Size 10
Interrupt: pin A routed to IRQ 217
Region 0: Memory at dfbe0000 (32-bit, non-prefetchable) [size=128K]
Region 2: I/O ports at ecc0 [size=64]
Capabilities: [dc] Power Management version 2
Flags: PMEClk- DSI+ D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
Status: D0 PME-Enable- DSel=0 DScale=1 PME-
Capabilities: [e4] PCI-X non-bridge device.
Command: DPERE- ERO+ RBC=0 OST=0
Status: Bus=0 Dev=0 Func=0 64bit- 133MHz- SCD- USC-, DC=simple,
DMMRBC=2, DMOST=0, DMCRS=0, RSCEM-
08:00.0 PCI bridge: Intel Corporation 6700PXH PCI Express-to-PCI
Bridge A (rev 09) (prog-if 00 [Normal decode])
Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+
Stepping- SERR- FastB2B-
Status: Cap+ 66Mhz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort-
<TAbort- <MAbort- >SERR- <PERR-
Latency: 0, Cache Line Size 10
Bus: primary=08, secondary=09, subordinate=09, sec-latency=64
Secondary status: 66Mhz+ FastB2B+ ParErr- DEVSEL=medium >TAbort-
<TAbort- <MAbort+ <SERR- <PERR-
BridgeCtl: Parity+ SERR+ NoISA+ VGA- MAbort- >Reset- FastB2B-
Capabilities: [44] Express PCI/PCI-X Bridge IRQ 0
Device: Supported: MaxPayload 256 bytes, PhantFunc 0, ExtTag-
Device: Latency L0s <64ns, L1 <1us
Device: AtnBtn- AtnInd- PwrInd-
Device: Errors: Correctable+ Non-Fatal+ Fatal+ Unsupported-
Device: RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
Device: MaxPayload 256 bytes, MaxReadReq 512 bytes
Link: Supported Speed 2.5Gb/s, Width x8, ASPM L0s, Port 0
Link: Latency L0s unlimited, L1 unlimited
Link: ASPM Disabled CommClk- ExtSynch-
Link: Speed 2.5Gb/s, Width x8
Capabilities: [5c] Message Signalled Interrupts: 64bit+ Queue=0/0 Enable-
Address: 0000000000000000 Data: 0000
Capabilities: [6c] Power Management version 2
Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
Status: D0 PME-Enable- DSel=0 DScale=0 PME-
Capabilities: [d8] PCI-X bridge device.
Secondary Status: 64bit+, 133MHz+, SCD-, USC-, SCO-, SRD- Freq=3
Status: Bus=8 Dev=0 Func=0 64bit- 133MHz- SCD- USC-, SCO-, SRD-
: Upstream: Capacity=65535, Commitment Limit=65535
: Downstream: Capacity=65535, Commitment Limit=65535
08:00.2 PCI bridge: Intel Corporation 6700PXH PCI Express-to-PCI
Bridge B (rev 09) (prog-if 00 [Normal decode])
Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+
Stepping- SERR- FastB2B-
Status: Cap+ 66Mhz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort-
<TAbort- <MAbort- >SERR- <PERR-
Latency: 0, Cache Line Size 10
Bus: primary=08, secondary=0a, subordinate=0a, sec-latency=32
Memory behind bridge: df800000-df9fffff
Secondary status: 66Mhz+ FastB2B+ ParErr- DEVSEL=medium >TAbort-
<TAbort- <MAbort+ <SERR- <PERR-
BridgeCtl: Parity+ SERR+ NoISA+ VGA- MAbort- >Reset- FastB2B-
Capabilities: [44] Express PCI/PCI-X Bridge IRQ 0
Device: Supported: MaxPayload 256 bytes, PhantFunc 0, ExtTag-
Device: Latency L0s <64ns, L1 <1us
Device: AtnBtn- AtnInd- PwrInd-
Device: Errors: Correctable+ Non-Fatal+ Fatal+ Unsupported-
Device: RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
Device: MaxPayload 256 bytes, MaxReadReq 512 bytes
Link: Supported Speed 2.5Gb/s, Width x8, ASPM L0s, Port 0
Link: Latency L0s unlimited, L1 unlimited
Link: ASPM Disabled CommClk- ExtSynch-
Link: Speed 2.5Gb/s, Width x8
Capabilities: [5c] Message Signalled Interrupts: 64bit+ Queue=0/0 Enable-
Address: 0000000000000000 Data: 0000
Capabilities: [6c] Power Management version 2
Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
Status: D0 PME-Enable- DSel=0 DScale=0 PME-
Capabilities: [d8] PCI-X bridge device.
Secondary Status: 64bit+, 133MHz+, SCD-, USC-, SCO-, SRD- Freq=0
Status: Bus=8 Dev=0 Func=2 64bit- 133MHz- SCD- USC-, SCO-, SRD-
: Upstream: Capacity=65535, Commitment Limit=65535
: Downstream: Capacity=65535, Commitment Limit=65535
0a:02.0 Network controller: Unknown device 1923:0100
Subsystem: Unknown device a113:2010
Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr-
Stepping- SERR+ FastB2B-
Status: Cap- 66Mhz- UDF- FastB2B- ParErr- DEVSEL=medium >TAbort-
<TAbort- <MAbort- >SERR- <PERR-
Latency: 255 (1250ns min, 3750ns max)
Interrupt: pin A routed to IRQ 233
Region 0: Memory at df8f0000 (32-bit, non-prefetchable) [size=64K]
0b:0d.0 VGA compatible controller: ATI Technologies Inc Radeon RV100
QY [Radeon 7000/VE] (prog-if 00 [VGA])
Subsystem: Dell: Unknown device 016d
Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop+ ParErr-
Stepping+ SERR+ FastB2B-
Status: Cap+ 66Mhz- UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort-
<TAbort- <MAbort- >SERR- <PERR-
Latency: 32 (2000ns min), Cache Line Size 10
Interrupt: pin A routed to IRQ 153
Region 0: Memory at d0000000 (32-bit, prefetchable) [size=128M]
Region 1: I/O ports at dc00 [size=256]
Region 2: Memory at df5f0000 (32-bit, non-prefetchable) [size=64K]
Capabilities: [50] Power Management version 2
Flags: PMEClk- DSI- D1+ D2+ AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot-,D3cold-)
Status: D0 PME-Enable- DSel=0 DScale=0 PME-
-----------------------------------------------------------------------------------------------------------
lspci -vv | grep IRQ
-----------------------------------------------------------------------------------------------------------
Capabilities: [64] Express Root Port (Slot-) IRQ 0
Capabilities: [64] Express Root Port (Slot-) IRQ 0
Capabilities: [64] Express Root Port (Slot-) IRQ 0
Capabilities: [64] Express Root Port (Slot-) IRQ 0
Interrupt: pin A routed to IRQ 0
Capabilities: [44] Express PCI/PCI-X Bridge IRQ 0
Capabilities: [44] Express PCI/PCI-X Bridge IRQ 0
Interrupt: pin A routed to IRQ 209
Capabilities: [44] Express PCI/PCI-X Bridge IRQ 0
Capabilities: [44] Express PCI/PCI-X Bridge IRQ 0
Interrupt: pin A routed to IRQ 217
Capabilities: [44] Express PCI/PCI-X Bridge IRQ 0
Capabilities: [44] Express PCI/PCI-X Bridge IRQ 0
Interrupt: pin A routed to IRQ 233
Interrupt: pin A routed to IRQ 153
-----------------------------------------------------------------------------------------------------------
lspci
-----------------------------------------------------------------------------------------------------------
00:00.0 Host bridge: Intel Corporation E7520 Memory Controller Hub (rev 09)
00:02.0 PCI bridge: Intel Corporation E7525/E7520/E7320 PCI Express
Port A (rev 09)
00:04.0 PCI bridge: Intel Corporation E7525/E7520 PCI Express Port B (rev 09)
00:05.0 PCI bridge: Intel Corporation E7520 PCI Express Port B1 (rev 09)
00:06.0 PCI bridge: Intel Corporation E7520 PCI Express Port C (rev 09)
00:1e.0 PCI bridge: Intel Corporation 82801 PCI Bridge (rev c2)
00:1f.0 ISA bridge: Intel Corporation 82801EB/ER (ICH5/ICH5R) LPC
Interface Bridge (rev 02)
00:1f.1 IDE interface: Intel Corporation 82801EB/ER (ICH5/ICH5R) IDE
Controller (rev 02)
01:00.0 PCI bridge: Intel Corporation 80332 [Dobson] I/O processor (rev 06)
01:00.2 PCI bridge: Intel Corporation 80332 [Dobson] I/O processor (rev 06)
02:0e.0 RAID bus controller: Dell PowerEdge Expandable RAID controller
4 (rev 06)
05:00.0 PCI bridge: Intel Corporation 6700PXH PCI Express-to-PCI
Bridge A (rev 09)
05:00.2 PCI bridge: Intel Corporation 6700PXH PCI Express-to-PCI
Bridge B (rev 09)
06:07.0 Ethernet controller: Intel Corporation 82541GI/PI Gigabit
Ethernet Controller (rev 05)
08:00.0 PCI bridge: Intel Corporation 6700PXH PCI Express-to-PCI
Bridge A (rev 09)
08:00.2 PCI bridge: Intel Corporation 6700PXH PCI Express-to-PCI
Bridge B (rev 09)
0a:02.0 Network controller: Unknown device 1923:0100
0b:0d.0 VGA compatible controller: ATI Technologies Inc Radeon RV100
QY [Radeon 7000/VE]
-----------------------------------------------------------------------------------------------------------
cat /proc/interrupts
-----------------------------------------------------------------------------------------------------------
CPU0 CPU1
0: 423 33707424 IO-APIC-edge timer
2: 0 0 XT-PIC cascade
8: 0 1 IO-APIC-edge rtc
14: 0 301773 IO-APIC-edge ide0
209: 0 2253498 IO-APIC-level megaraid
217: 0 19704153 IO-APIC-level eth0
233: 100759227 112501 IO-APIC-level wanpipe1, wanpipe2, wanpipe3
NMI: 0 0
LOC: 33709208 33709209
ERR: 0
MIS: 0
-----------------------------------------------------------------------------------------------------------
thanks!
Alexander Lopez
2006-Jul-06 10:29 UTC
[asterisk-users] Phones cutting out.....again - PLEASE HELP!!!
Your problem is intermittent. It is probably Network related as if you reboot that problems may or may not comeback. In addition to the lspci stuff requested. Have you checked your fiberlink. Is it possible that something or someone is saturating the link with Virus/Spy/PtP Ware??? SIP doesn't have a Jitter Buffer so it is sensitive to the traffic. You may want to try Olle's branch with the Jitter Buffer. See if that helps. I think you are fine on the Hardware side of things. It is also possible you got root-kitted. SNIP.
broadbandvoice@comcast.net
2006-Jul-06 15:00 UTC
[asterisk-users] Phones cutting out.....again - PLEASE HELP!!!
Do you have tetheral network analyser installed on server, that can be a good start, look at the analyses of the graphs. Also try pinging the CPE's and see if there is any latency. Do you also have the abilty to check the upstreams signals? -------------- Original message -------------- From: "whois wes" <whoiswes@gmail.com>> Hate to drag this one back up, but....it's happening again. > > Overview of architecture: > > Dell poweredge 2850, running fedora core 4, asterisk 1.2.7.1, zaptel > 1.2.5, and sangoma wanpipe 2.3.4 drivers. T1 interface card is the > sangoma a104d with onboard echo can. > > Server is located in our data center and connected directly to our > cisco 6513 core switch, so we have almost zero latency. The office > having the issues is located several miles away and is connected via a > 10Mbit fiber pipe, also low latency. Ping times between remote office > and here are well under 10ms. > > T1's are robbed-bit, E&M wink signalling <--- (this may be cause, but > want your input). > > Server load is averaging around 20%, plenty of memory, disk space, and > bandwidth available. No QOS running on network. ulaw is the primary > codec. Server is stable, and there are no extraneous services > running, save mysql and httpd. Even running a processor intensive > query doesn't trigger the droputs, they happen randomly. > > Phones are a mix of Eyebeam 1.5.5 and Eyebeam 1.10 3010n. Both types > of phones are experiencing cutting out of the signal, mainly in the Rx > stream, but occassional in the Tx stream as well. The cutting out was > NOT occurring last night, and the phone server is being rebooted > nightly. Nothing has changed AT ALL, and the problem has started > occurring again. If I don't do ANYTHING at all today, there is a 50% > chance that this will NOT occur tomorrow. In other words, SOMETHING > is causing our phones to drop out, but whatever changes I make seem to > have no effect. The problem will start and stop seeminly at it's own > whim. > > --- > Things I have tried: > > 1. changed from ulaw to gsm as primary codec - no change > 2. disabled hardware echo can on A104D - no change > 3. moved from asterisk 1.2.4 to 1.2.7.1, recompiled both several > times - no change > 4. have played with gain settings a bit, doesn't seem to make much difference > --- > > At this point, i am nearing the end of my rope - i have rebuilt this > machine three times now, and have recompiled the system at least a > dozen times. We have gone from Digium hardware to Sangoma harware and > back again. I have changed every conceivable setting on the phones to > no avail. The problem will randomly disappear, only to come back a few > days later. I can make a change, it seems to have an effect, then > we're back to the same old thing again. > > I am in dire need of ANY help anyone can offer, this has been going on > in some form for almost three months. > > Thanks for reading, > > Wes > _______________________________________________ > --Bandwidth and Colocation provided by Easynews.com -- > > asterisk-users mailing list > To UNSUBSCRIBE or update options visit: > http://lists.digium.com/mailman/listinfo/asterisk-users-------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.digium.com/pipermail/asterisk-users/attachments/20060706/7f4d3bc0/attachment.htm
Isaac Xiao
2006-Jul-06 15:16 UTC
[asterisk-users] Phones cutting out.....again - PLEASE HELP!!!
Did you try set autofallthrough=no. We have the same problem when using 1.2.9.1 (we are using A104d with IBM x306). So we downgraded to 1.2.6 and set autofallthrough=no. The call drop problem seems fixing. But we have IVR DTMF recognition and queue not assign call to static agents (Local channel) problem if I don't reboot the server more than 2 days. Now I am trying downgrade A104d F/W from v20 to v18 (don't know what is new in v20 and v19) and Asterisk 1.2.6 to 1.2.4. BTW, we are using a lot of group pickup, call transfer in queue, not sure if it is cause or not. Isaac Xiao