How to troubleshoot VoIP Module DSP Resets

 

Symptom:
Dialogic Gate Control Element Management System (GCEMS) EventView indicates that a Voip Module DSP reset has occurred in a Dialogic IMG Integrated Media Gateway.

This article describes how to troubleshoot the resets and what diagnostic information should be gathered.

Solution:
1. Identify a Voip Module DSP reset in EventView:

2. Dump the VPPL diags from the advanced debug menu for analysis. 
Below are the diagnostic commands.
Note: be sure to "q" back to the home menu before executing each command.

VPPL:

v-r (RTCP stats)

 

v-b (Span and IP assignments)

 

v-x-s (general Picasso call stats)

 

v-z-a-9 (alert stats)

 

v-m0 (module 0 stats)

 

v-m1 (module 1 stats)

 

n-e-c (Ethernet MIB stats)

 

W-d Dump Call Tracing Log

 

W-10-d-x (dump all previously logged GEL in facPfc space)


3. If the resets occur frequently, it may be helpful to enable call tracing as a particular call flow may be causing the resets. Enable call tracing on the IMG either using Dialogic Gate Control Element Management System (GCEMS) Clientview or from the Advanced Debug Menu using the W->29->P commands. 

4. On occasion a DSP may not recover after a reset resulting in the DSP's channels being marked OOS (out of service). This may require a manual reset of the DSP using the CLI. 

The first step is to identify whether or not the DSP is marked OOS. 

From the initial VPPL dump in step 2, locate the v-m0 (module 0 stats)  or v-m1 (module 1 stats) information. 

Below is an example with the relevant information - the current states of the DSP channels - highlighted. 

In this case, DSP #2 channels are all OOS. 

A manual reset of the DSP is suggested to recover the channels. The steps are outlined in the Workaround section below. 

MODULE 1 (PICASSO ) STATE (5.5.MODstOPEN)

 

**Board Information**

Ethernet : 00-20-1c-11-05-02

Static IP: 010.129.052.136 SN: 255.255.255.224 GW: 010.129.052.129

Board ID :x6e Profile : 5 (VDAC Compatible + ClearChan)

VAPI version: VAPI Library Release 2.5.1-cand1, API Version 5.0

 

MSPD Module FPGA Version: 24

MSPD DSP Firmware Date: 02/17/10

MSPD DSP Firmware Version: v6_15_5_6

 

Picasso #0: State: PICASSOstRUNNING, Index: 0 , Reset Count: 0

Picasso #1: State: PICASSOstRUNNING, Index: 1 , Reset Count: 0

Picasso #2: State: PICASSOstRUNNING, Index: 2 , Reset Count: 0

Picasso #3: State: PICASSOstRUNNING, Index: 3 , Reset Count: 0

**Channel Information**

SRTP (Media Security) is DISABLED By BOOTP Host Flag

Chan En : TRUE maxChans : 512 Per DSP : 128

Default Host Channel Attributes:

Payload Type: 01-G711Mulaw Silence Suppression: Disabled

Payload Size: 4x Echo Cancellation: Enabled

Fax Type: Bypass Minimum JB Delay: 75ms

Modem Type: Bypass Maximum JB Delay: 150ms

Digit Relay (2833): Disabled Digit Transport to L3: OFF

JB Adaptation Rate: Auto

RTP Redundancy: Level 0 FAX Redundancy: Level 0

Bypass Coder: 01-G711Mulaw MODEM Redundancy: Level 0

RTCP SRC UDP: -1 T.38 SRC UDP: -1

RTCP DST UDP: -1 T.38 DST UDP: -1

Connection Mode: Tx/Rx UDP Source Validate: Enabled

Initial MID Timer: 0 MID Timer: 0

RFC2833 PType: 101 RFC2198 PType: 104

NAT Mode: Normal

IP Type Of Service(0x00): Normal Cost, Normal Reliabilty, Normal Delay,

Normal Throughput, Routine Precedence

 

Picasso #0: Closed: 128 Pend: 0 Active: 0 , OOS: 0
Picasso #1: Closed: 128 Pend: 0 Active: 0 , OOS: 0
Picasso #2: Closed: 0 Pend: 0 Active: 0 , OOS: 128
Picasso #3: Closed: 128 Pend: 0 Active: 0 , OOS: 0
-----------------------------------------

Closed: 512 Pend: 0 Active: 0 , OOS: 0

 

Picasso Info: Forwarded ARP Replies to CPU: 0

 

**Monitor Information**

Mon En : TRUE Poll En : TRUE

Picasso #0: Poll En: 1, Poll Num: 510079, Poll Last Rx: 1990

Picasso #1: Poll En: 1, Poll Num: 510079, Poll Last Rx: 1990

Picasso #2: Poll En: 1, Poll Num: 510079, Poll Last Rx: 1990

Picasso #3: Poll En: 1, Poll Num: 510079, Poll Last Rx: 1990

facPfc (h:help,q:quit)>



Workaround:


To reset a DSP from the Advanced Debug Menu enter v->x->r->d->module #->DSP #->0. 

Below is an example:

username: admin

password:

Advanced Debug> v

facPfc (h:help,q:quit)> x

cnxm (h:help,q:quit)> r

 

Reset (m)odule or (d)sp or (l)oop or (s)top loop? d

Enter Module (0-1)> 1

Enter DSP ID (0-3, f for all)> 2

1 to KILL, 0 to RESET> 0


You can then dump the module information v-m0 (module 0 stats) or v-m1 (module 1 stats) again and confirm the channels on the reset DSP are now In Service. 

In this case DSP #2 channels are now all In Service:

Advanced Debug> v

facPfc (h:help,q:quit)> m

1

 

MODULE 1 (PICASSO ) STATE (5.5.MODstOPEN)

 

**Board Information**

Ethernet : 00-20-1c-11-05-02

Static IP: 010.129.052.136 SN: 255.255.255.224 GW: 010.129.052.129

Board ID :x6e Profile : 5 (VDAC Compatible + ClearChan)

VAPI version: VAPI Library Release 2.5.1-cand1, API Version 5.0

 

MSPD Module FPGA Version: 24

MSPD DSP Firmware Date: 02/17/10

MSPD DSP Firmware Version: v6_15_5_6

 

Picasso #0: State: PICASSOstRUNNING, Index: 0 , Reset Count: 0

Picasso #1: State: PICASSOstRUNNING, Index: 1 , Reset Count: 0

Picasso #2: State: PICASSOstRUNNING, Index: 2 , Reset Count: 1

Picasso #3: State: PICASSOstRUNNING, Index: 3 , Reset Count: 0

**Channel Information**

SRTP (Media Security) is DISABLED By BOOTP Host Flag

Chan En : TRUE maxChans : 512 Per DSP : 128

Default Host Channel Attributes:

Payload Type: 01-G711Mulaw Silence Suppression: Disabled

Payload Size: 4x Echo Cancellation: Enabled

Fax Type: Bypass Minimum JB Delay: 75ms

Modem Type: Bypass Maximum JB Delay: 150ms

Digit Relay (2833): Disabled Digit Transport to L3: OFF

JB Adaptation Rate: Auto

RTP Redundancy: Level 0 FAX Redundancy: Level 0

Bypass Coder: 01-G711Mulaw MODEM Redundancy: Level 0

RTCP SRC UDP: -1 T.38 SRC UDP: -1

RTCP DST UDP: -1 T.38 DST UDP: -1

Connection Mode: Tx/Rx UDP Source Validate: Enabled

Initial MID Timer: 0 MID Timer: 0

RFC2833 PType: 101 RFC2198 PType: 104

NAT Mode: Normal

IP Type Of Service(0x00): Normal Cost, Normal Reliabilty, Normal Delay,

Normal Throughput, Routine Precedence

 

Picasso #0: Closed: 128 Pend: 0 Active: 0 , OOS: 0
Picasso #1: Closed: 128 Pend: 0 Active: 0 , OOS: 0
Picasso #2: Closed: 128 Pend: 0 Active: 0 , OOS: 0
Picasso #3: Closed: 128 Pend: 0 Active: 0 , OOS: 0
-----------------------------------------

Closed: 512 Pend: 0 Active: 0 , OOS: 0

 

Picasso Info: Forwarded ARP Replies to CPU: 0

 

**Monitor Information**

Mon En : TRUE Poll En : TRUE

Picasso #0: Poll En: 1, Poll Num: 41473, Poll Last Rx: 380

Picasso #1: Poll En: 1, Poll Num: 41473, Poll Last Rx: 380

Picasso #2: Poll En: 1, Poll Num: 47, Poll Last Rx: 680

Picasso #3: Poll En: 1, Poll Num: 41473, Poll Last Rx: 380


Product List
Dialogic IMG 1010 Integrated Media Gateway
Dialogic IMG 1004 Integrated Media Gateway

Return to Documentation Home I Return to Sangoma Support