How to troubleshoot VoIP Module DSP Resets
Symptom:
Dialogic Gate Control Element Management System (GCEMS) EventView indicates that a Voip Module DSP reset has occurred in a Dialogic IMG Integrated Media Gateway.
This article describes how to troubleshoot the resets and what diagnostic information should be gathered.
Solution:
1. Identify a Voip Module DSP reset in EventView:
2. Dump the VPPL diags from the advanced debug menu for analysis.
Below are the diagnostic commands.
Note: be sure to "q" back to the home menu before executing each command.
VPPL:
v-r (RTCP stats)
v-b (Span and IP assignments)
v-x-s (general Picasso call stats)
v-z-a-9 (alert stats)
v-m0 (module 0 stats)
v-m1 (module 1 stats)
n-e-c (Ethernet MIB stats)
W-d Dump Call Tracing Log
W-10-d-x (dump all previously logged GEL in facPfc space)
3. If the resets occur frequently, it may be helpful to enable call tracing as a particular call flow may be causing the resets. Enable call tracing on the IMG either using Dialogic Gate Control Element Management System (GCEMS) Clientview or from the Advanced Debug Menu using the W->29->P commands.
4. On occasion a DSP may not recover after a reset resulting in the DSP's channels being marked OOS (out of service). This may require a manual reset of the DSP using the CLI.
The first step is to identify whether or not the DSP is marked OOS.
From the initial VPPL dump in step 2, locate the v-m0 (module 0 stats) or v-m1 (module 1 stats) information.
Below is an example with the relevant information - the current states of the DSP channels - highlighted.
In this case, DSP #2 channels are all OOS.
A manual reset of the DSP is suggested to recover the channels. The steps are outlined in the Workaround section below.
MODULE 1 (PICASSO ) STATE (5.5.MODstOPEN)
**Board Information**
Ethernet : 00-20-1c-11-05-02
Static IP: 010.129.052.136 SN: 255.255.255.224 GW: 010.129.052.129
Board ID :x6e Profile : 5 (VDAC Compatible + ClearChan)
VAPI version: VAPI Library Release 2.5.1-cand1, API Version 5.0
MSPD Module FPGA Version: 24
MSPD DSP Firmware Date: 02/17/10
MSPD DSP Firmware Version: v6_15_5_6
Picasso #0: State: PICASSOstRUNNING, Index: 0 , Reset Count: 0
Picasso #1: State: PICASSOstRUNNING, Index: 1 , Reset Count: 0
Picasso #2: State: PICASSOstRUNNING, Index: 2 , Reset Count: 0
Picasso #3: State: PICASSOstRUNNING, Index: 3 , Reset Count: 0
**Channel Information**
SRTP (Media Security) is DISABLED By BOOTP Host Flag
Chan En : TRUE maxChans : 512 Per DSP : 128
Default Host Channel Attributes:
Payload Type: 01-G711Mulaw Silence Suppression: Disabled
Payload Size: 4x Echo Cancellation: Enabled
Fax Type: Bypass Minimum JB Delay: 75ms
Modem Type: Bypass Maximum JB Delay: 150ms
Digit Relay (2833): Disabled Digit Transport to L3: OFF
JB Adaptation Rate: Auto
RTP Redundancy: Level 0 FAX Redundancy: Level 0
Bypass Coder: 01-G711Mulaw MODEM Redundancy: Level 0
RTCP SRC UDP: -1 T.38 SRC UDP: -1
RTCP DST UDP: -1 T.38 DST UDP: -1
Connection Mode: Tx/Rx UDP Source Validate: Enabled
Initial MID Timer: 0 MID Timer: 0
RFC2833 PType: 101 RFC2198 PType: 104
NAT Mode: Normal
IP Type Of Service(0x00): Normal Cost, Normal Reliabilty, Normal Delay,
Normal Throughput, Routine Precedence
Picasso #0: Closed: 128 Pend: 0 Active: 0 , OOS: 0
Picasso #1: Closed: 128 Pend: 0 Active: 0 , OOS: 0
Picasso #2: Closed: 0 Pend: 0 Active: 0 , OOS: 128
Picasso #3: Closed: 128 Pend: 0 Active: 0 , OOS: 0
-----------------------------------------
Closed: 512 Pend: 0 Active: 0 , OOS: 0
Picasso Info: Forwarded ARP Replies to CPU: 0
**Monitor Information**
Mon En : TRUE Poll En : TRUE
Picasso #0: Poll En: 1, Poll Num: 510079, Poll Last Rx: 1990
Picasso #1: Poll En: 1, Poll Num: 510079, Poll Last Rx: 1990
Picasso #2: Poll En: 1, Poll Num: 510079, Poll Last Rx: 1990
Picasso #3: Poll En: 1, Poll Num: 510079, Poll Last Rx: 1990
facPfc (h:help,q:quit)>
Workaround:
To reset a DSP from the Advanced Debug Menu enter v->x->r->d->module #->DSP #->0.
Below is an example:
username: admin
password:
Advanced Debug> v
facPfc (h:help,q:quit)> x
cnxm (h:help,q:quit)> r
Reset (m)odule or (d)sp or (l)oop or (s)top loop? d
Enter Module (0-1)> 1
Enter DSP ID (0-3, f for all)> 2
1 to KILL, 0 to RESET> 0
You can then dump the module information v-m0 (module 0 stats) or v-m1 (module 1 stats) again and confirm the channels on the reset DSP are now In Service.
In this case DSP #2 channels are now all In Service:
Advanced Debug> v
facPfc (h:help,q:quit)> m
1
MODULE 1 (PICASSO ) STATE (5.5.MODstOPEN)
**Board Information**
Ethernet : 00-20-1c-11-05-02
Static IP: 010.129.052.136 SN: 255.255.255.224 GW: 010.129.052.129
Board ID :x6e Profile : 5 (VDAC Compatible + ClearChan)
VAPI version: VAPI Library Release 2.5.1-cand1, API Version 5.0
MSPD Module FPGA Version: 24
MSPD DSP Firmware Date: 02/17/10
MSPD DSP Firmware Version: v6_15_5_6
Picasso #0: State: PICASSOstRUNNING, Index: 0 , Reset Count: 0
Picasso #1: State: PICASSOstRUNNING, Index: 1 , Reset Count: 0
Picasso #2: State: PICASSOstRUNNING, Index: 2 , Reset Count: 1
Picasso #3: State: PICASSOstRUNNING, Index: 3 , Reset Count: 0
**Channel Information**
SRTP (Media Security) is DISABLED By BOOTP Host Flag
Chan En : TRUE maxChans : 512 Per DSP : 128
Default Host Channel Attributes:
Payload Type: 01-G711Mulaw Silence Suppression: Disabled
Payload Size: 4x Echo Cancellation: Enabled
Fax Type: Bypass Minimum JB Delay: 75ms
Modem Type: Bypass Maximum JB Delay: 150ms
Digit Relay (2833): Disabled Digit Transport to L3: OFF
JB Adaptation Rate: Auto
RTP Redundancy: Level 0 FAX Redundancy: Level 0
Bypass Coder: 01-G711Mulaw MODEM Redundancy: Level 0
RTCP SRC UDP: -1 T.38 SRC UDP: -1
RTCP DST UDP: -1 T.38 DST UDP: -1
Connection Mode: Tx/Rx UDP Source Validate: Enabled
Initial MID Timer: 0 MID Timer: 0
RFC2833 PType: 101 RFC2198 PType: 104
NAT Mode: Normal
IP Type Of Service(0x00): Normal Cost, Normal Reliabilty, Normal Delay,
Normal Throughput, Routine Precedence
Picasso #0: Closed: 128 Pend: 0 Active: 0 , OOS: 0
Picasso #1: Closed: 128 Pend: 0 Active: 0 , OOS: 0
Picasso #2: Closed: 128 Pend: 0 Active: 0 , OOS: 0
Picasso #3: Closed: 128 Pend: 0 Active: 0 , OOS: 0
-----------------------------------------
Closed: 512 Pend: 0 Active: 0 , OOS: 0
Picasso Info: Forwarded ARP Replies to CPU: 0
**Monitor Information**
Mon En : TRUE Poll En : TRUE
Picasso #0: Poll En: 1, Poll Num: 41473, Poll Last Rx: 380
Picasso #1: Poll En: 1, Poll Num: 41473, Poll Last Rx: 380
Picasso #2: Poll En: 1, Poll Num: 47, Poll Last Rx: 680
Picasso #3: Poll En: 1, Poll Num: 41473, Poll Last Rx: 380
Product List
Dialogic IMG 1010 Integrated Media Gateway
Dialogic IMG 1004 Integrated Media Gateway