Conformance

Protocol Conformance Test Suites for 5G, 4G, 3G, IMS, VoIP, PSTN Interfaces
eNodeB
OCS
ETSI
3G
3GPP
4G
5G
AMF
AUSF
Device
DHCP
Diameter
EPC
gNodeB
H.248
HLR
GGSN
HSS
http2
IMS
LTE
ISUP
MCX
VoLTE
PCRF
S6a
S6c
S6m
S6n
Sxx
Tsp
Conformance

Protocol Conformance Test Suites for 5G, 4G, 3G, IMS, VoIP, PSTN Interfaces

Overview

The Valid8 Conformance Test Suites are suitable for testing many protocols and interfaces in the wireless and wireline network including S1AP, X2AP, F1AP, Diameter, HTTP2, PFCP, GTP, SIP, ISUP, H.323 and many others.

What It Can Do For You

The Conformance solution is capable of simulating and testing several devices individually or in parallel:

It can simulate

  • ‍Signaling gateway (SG)
  • IP signaling point (IPSP)
  • eNodeB
  • MME
  • UA
  • Proxy
  • Redirect Server
  • B2BUA
  • CSCF
  • AS
  • HSS
  • PCRF
  • AMF
  • UPF
  • SMF
  • AUSF
  • PCF
  • UDM
  • UDR

It can test

  • ‍Diameter: AF, AS, DRA, DEA, HSS, OCS, OFCS, PCEF, PCRF, SPDF
  • GTP: SGSN, GGSN SGW, PGW
  • SCTP: signaling gateway (SG), IP signaling point (IPSP), eNodeB, MME
  • SIP: UA, Proxy, Redirect Server, B2BUA
  • E1AP
  • F1AP
  • XnAP
  • PFCP
  • HTTP2

Why It’s Different

  • Scalable software-based architecture can run on a range of hardware from COTS and high-end customer provided hardware to Virtual Machines and the Cloud (e.g. Amazon AWS) for maximum versatility and performance
  • Web-based UI is easy to learn
  • HTTP API enable integration with automation test systems and other equipment
  • Stateful modeling provides accurate emulation of network elements

Features

  • Pre-made test scenarios and procedures
  • PASS / FAIL analysis, including plain English diagnostic reason
  • Valid / Invalid testing
  • Customizable source-code
  • User-configurable proprietary messages, IEs, headers
  • Animated test results action-replay
  • Easy to configure
  • Automatic execution of test batches
  • UDP, TCP, SCTP transport layer IPv4/IPv6 support
  • Suitable for Development and QA test lab environments, verifying protocol compliance, negative and robustness testing, Regression testing and Reproducing customer issues in the field
4G Conformance

Subsystems

KPIs
  • Verdict Pass/Fail/Inconclusive 
  • Reason information
Configurable Parameters
  • Mobile Country Code
  • Mobile Network Code
  • eNodeB Type
  • IP Addres S1 Interface
  • IP Address eNodeB
  • Primary DNS Address
  • Secondary DNS Adress
  • MAC Address Public Gateway
  • GTP Tunnel IP Address and Port
  • GTP Tunnel eNodeB IP Address
  • Integrity Algorithm
  • IP Address to assign UEs on LAN

Automation API

User commands can be fully automated using REST API. This includes performing all test control functions as well as collecting results and metrics. It can be integrated into virtually any CI system via the HTTP API, including Jenkins, CircleCI, Gitlab and others.

Scripting

The application’s subsystems can be edited directly in the browser using TDL or by using the graphical tools. The Message Workshop allows for creating of test scenarios directly from the hex stream of a remote capture, while the Graphical Editor (on the feature roadmap for 2019) will allow for creating customized call scenarios by dragging and dropping the call flow to meet your test needs.

This is some text inside of a div block.

Use Cases

eNodeB Under Test

In the scenario where the eNodeB is to be tested, it can be tested by the Valid8 4G Network Emulator emulating the core network. Additionally, load and conformance tests are available for interfaces S1-MME and S1-U. In the case where the eNodeB needs to be tested on the RF side, it can be tested by the Valid8 4G UE Emulator.

Supported Scenarios:
  • ‍Power on / Start up
  • Attach
  • TAU
  • Attach
  • eRAB Setup
  • Detach
  • X2 handover
  • Emulates MME (for S1-MME) and SGW (for S1-U) along with all other needed core network elements, exposing all internal interfaces
  • Conformance tests available for S1-MME, S1-U, and X2

PCRF Under Test

For testing the PCRF, the 4G Network Emulator can wrap around the PCRF with the core network and IMS.

Supported Scenarios:

PGW Under Test

For testing the PGW, the 4G Network Emulator can wrap around the node using the S5/8, S7, Sxx and SGi interfaces. Traffic can be originated from real or emulated UE and IoT devices.

Supported Scenarios:
  • ‍Create Session
  • Delete Session
  • Create Bearer
  • Modify Bearer
  • Delete Bearer
  • Echo
  • Emulates all required nodes for wrapping around, including MME and PCRF for testing over interfaces S5/8, S7, Sxx nd SGi

  • Exposes all internal interfaces
  • Conformance tests available for each interface (S5/8, S7, Sxx, SGi)

UE Under Test

For testing UE or IoT devices, the 5G, 4G or 3G Network Emulators can provide the entire core network as well as an emulated or real base station depending on your test needs.

Supported Scenarios:
  • ‍Power on
  • Attach
  • Detach
  • TAU
  • Data Connection
  • VoLTE Call
  • ‍End to end VoLTE test capability
  • Includes real femto, pico, or microcell eNodeB
  • Emulates all core network nodes and allows for data connection to external networks

SIP Client Under Test

For testing the SIP Client, the Valid8 Tester can generate SIP calls to test performance and stability.

Supported Scenarios:
  • REGISTER
  • INVITE Audio/Video calls
  • MESSAGE
  • UPDATE
  • PRACK

SIP Server Under Test

For testing the SIP Server, the Valid8 Tester can generate SIP calls to test performance and stability.

Supported Scenarios:

Message flows

  • REGISTER
  • INVITE Audio/Video calls
  • MESSAGE
  • UPDATE
  • PRACK
  • SUBSCRIBE/NOTIFY
  • INFO

Emulate Real Network Conditions

  • Peak times
  • PSTN to IP calls
  • Jitter
  • Limited bandwidth
  • Duplicate packets
  • Corrupted packets
  • Bursty network traffic
  • Redundant link switchover / outage

HSS Under Test

For testing the HSS Server, the Valid8 Tester can generate Diameter traffic on a variety of interfaces in parallel to test performance and stability.

Supported Scenarios:
  • Cx
  • D/D'
  • S6a/S6c/S6d/S6m/S6n/S6t
  • S13/S13'
  • Sh
  • SLh
  • Sp
  • SWx
  • Zh

AMF Under Test

For testing the AMF, the 5G Network Emulator can wrap around the node using the N1, N2, N8, N11, N12 & N22 interfaces. Traffic can be originated from real or emulated UE and IoT devices

Supported Scenarios:

• General Registration

• Registration with AMFre-allocation

• UE-initiated Deregistration

• Network-initiated Deregistration

• UE Triggered Service Request

• Network Triggered Service Request

• UE Configuration Update procedure for access and mobility management related parameters    

• UE Configuration Update procedure for transparent UE Policy delivery

• UE Reachability Notification Request procedure

• UE Activity Notification procedure    

• AN Release

SAS Server

For testing the SAS Server, the Valid8 Tester can generate CBRS CBSD messages to test performance, stability and security.

Supported Scenarios:
  • SAS Discovery
  • Registration
  • Spectrum Inquiry
  • Grant
  • Heartbeat
  • Deregistration

Firewall Under Test

GTP, SCTP, S1-AP Firewall

Supported Scenarios:
  • Invalid version
  • Invalid IEs/AVPs
  • Invalid TIDs
  • Invalid UE IDs

IoT Gateway Under Test

For testing the IoT Gateway, the Valid8 Tester can generate MQTT, COAP, HTTP, SIP calls to test performance and stability.

Supported Scenarios:
  • MQTT
  • COAP
  • SIP
  • HTTP
  • other on request

MCPTT Application Server Under Test

For testing the MCPTT AS, the Valid8 Tester can generate SIP PTT calls to test performance and stability.

Supported Scenarios:
  • REGISTER
  • INVITE Audio/Video calls
  • MESSAGE
  • UPDATE

Media Gateway Under Test

For testing the Media Gateway (MG), the Valid8 Tester can generate SIP, Megaco & ISUP calls with user plan media to test performance and stability.

Supported Scenarios:
  • SIP calls - INVITE/200/ACK/INFO/BYE/200
  • Megaco calls - Add/Modify/Subtract/Audit
  • ISUP calls - IAM/ACM/ANM/REL/RLC
  • RTP & TDM user plane with voice Quality check option (PESQ/PoLQA)

MME Under Test

For testing MME, the HSS emulator can provide a realistic, stateful emulation of the subscriber DB for testing purposes

Supported Scenarios:
  • Attach
  • Detach
  • Location Update

RCS Client Under Test

For testing the RCS Client, the Valid8 Tester can generate SIP MSRP calls to test performance and stability.

Supported Scenarios:
  • REGISTER
  • INVITE Audio/Video calls
  • MESSAGE
  • UPDATE
  • MSRP
Conformance
Conformance

Summary of Specifications

Specifications

Diameter Base Conformance

  • ‍Test Specification: V. Fajardo et al., Diameter Base Protocol Interoperability Test Suite, IETF Work in progress, 2009
  • Number of tests included: 46
  • IETF RFC 6733: Diameter Base Protocol

Diameter Cx/Dx Conformance

  • ‍Test Specification: ETSI TS 129 228
  • Number of tests included: 14
  • IETF RFC 6733: Diameter Base Protocol

Diameter Rf Conformance

  • ‍IETF RFC 4006, 3GPP TS 32.225, TS 32.299
  • Available 2Q 2016

Diameter Rx Conformance

  • ‍3GPP TS 23.203, TS 29.214
  • Available 2Q 2016

Diameter Rq Conformance

  • ‍ES 283-026
  • Available 2Q 2016

Diameter S6a Conformance

  • ‍Test Specification: 3GPP TS 29.272
  • Number of tests included: 115
  • Includes tests from the following areas:
  • Notification-Request / Answer (NOR / NOA)
  • Reset-Request / Answer (RSR / RSA)
  • Purge-UE-Request / Answer (PUR / PUA)
  • Delete-Subscriber-Data Request / Answer (DSR / DSA)
  • Insert-Subscriber-Data Request / Answer (IDR / IDA)
  • Cancel-Location-Request / Answer (CLR / CLA)
  • Capability-Exchange-Request / Answer (CER / CEA)
  • Session-Termination-Request / Answer (STR / STA)
  • Abort-Termination-Request / Answer (ASR / ASA)
  • Device-Watchdog-Request / Answer (DWR / DWA)
  • Disconnect-Peer-Request / Answer (DPR / DPA)
  • Authentication-Information-Request / Answer (AIR / AIA)
  • Update-Location-Request / Answer (ULR / ULA)

Diameter S7 Conformance

  • ‍Test Specification: 3GPP TS 23.402
  • Number of tests included: 30
  • Includes tests from the following areas:
  • Update-VCSG-Location Request / Answer (UVR / UVA)
  • Cancel-VCSG Location Request / Answer (CVR / CVA)
  • Insert-Subscription-Data Request / Answer (IDR / IDA)
  • Delete-Subscriber-Data Request / Answer (DSR / DSA)
  • Reset Request / Answer (RSR / RSA)

Diameter S13 Conformance

  • ‍Test Specification: 3GPP TS 29.274, TS 129 274
  • Number of tests included: 6
  • Includes tests from the following areas:
  • ME-Identity-Check Request / Answer (ECR / ECA)

Diameter Sd Conformance

  • ‍Test Specification: 3GPP TS 29.212 version 12 release 12, 3GPP TS 29.213 version 11.6.0 release 11
  • Number of tests included: 21
  • IETF RFC 5516 Diameter Command Code Registration for the 3GPP EPS

Diameter Sh Conformance

  • ‍Test Specification: 910-6856-001_rev_b
  • Number of tests included: 46
  • IETF RFC 6733: Diameter Base Protocol

Diameter Si Conformance

  • ‍Test Specification: 3GPP TS 23.228
  • Number of tests included: 20
  • IETF RFC 6733: Diameter Base Protocol

E1 Conformance,

  • Test Specification: 3GPP TS 38.463
  • Number of tests included: 20

F1 Conformance

  • Test Specification: 3GPP TS 38.473
  • Number of tests included: 20

NGAP Conformance

  • Test Specification: 3GPP TS 38.413
  • Number of tests included: 24

NRPPa Conformance

  • Test Specification: 3GPP 38.455
  • Number of tests included: 16

Xn Conformance

  • Test Specification: 3GPP TS 38.423
  • Number of tests included: 24

GTP S3 Conformance

  • Test Specification: 3GPP TS 36.413, 3GPP TS 29.328, 3GPP TS 29.329
  • Number of tests included: 42
  • Includes tests from the following areas:
  • CC-Request / Answer (CCR / CCA)
  • Re-Auth-Request / Answer (RAR / RAA)
  • Capability-Exchange-Request / Answer (CER / CEA)
  • Session-Termination-Request / Answer (STR / STA)
  • Abort-Termination-Request / Answer (ASR / ASA)
  • Device-Watchdog-Request / Answer (DWR / DWA)
  • Disconnect-Peer-Request / Answer (DPR / DPA)

S1 Conformance

  • ‍Test Specification: 3GPP TS 36.413 & 24.301
  • Number of tests included: 57
  • Includes tests from the following areas:
  • NAS
  • SAE Bearer Management
  • UE Location, Subscriber Data Handling
  • Authentication
  • Fault Recovery
  • Notification

S2b Conformance

  • ‍Test Specification: 3GPP TS 23.834
  • Number of tests included: 20
  • Includes tests from the following areas:
  • Create Session
  • Delete Session
  • Create Bearer
  • Modify Bearer
  • Delete Bearer
  • Echo

GTP S3 Conformance

  • Test Specification: 3GPP TS 29.274, TS 129 274
  • Number of tests included: 26
  • Includes tests from the following areas:
  • Create Session
  • Delete Session
  • Create Bearer
  • Modify Bearer
  • Delete Bearer
  • Echo

SIP Conformance

  • Test Specification: ETSI TS 102 027-2 V4.1.1 (2006-07), SIPPING working group Torture Tests RFC4475, RFC5118
  • Number of tests included: main suite F/1013/SIP: 646 from ETSI TS 102 027-2, PROTOS suite F/1013/SIP-PROTOS: 1,000+ from PROTOS_Test-Suite_c07
  • Includes tests from the following areas: F/1013/SIP-TORTURE: 49 from RFC4475

SIP Extensions Conformance

  • Tests included in F/1013/SIP-EXT from the specifications below:
  • IETF RFC 2396 - URI Generic Syntax
  • IETF RFC 2617 - HTTP
  • IETF RFC 2833 - RTP Telephony Payload
  • IETF RFC 2848 - PINT Service Protocol
  • IETF RFC 2976 - Info
  • IETF RFC 2976 - SIP INFO
  • IETF RFC 3087 - URIs for Services
  • IETF RFC 3262 - PRACK
  • IETF RFC 3264 - Offer/answer model with SDP
  • IETF RFC 3265 - SIP Events Subscribe/Notify
  • IETF RFC 3310 - HTTP Digest Authentication AKA
  • IETF RFC 3311 - SIP Update
  • IETF RFC 3313 - Private Media Extension
  • IETF RFC 3323 - Privacy
  • IETF RFC 3324 - Short term Network Aserted ID
  • IETF RFC 3325 - P-Asserted-Identity
  • IETF RFC 3326 - Reason
  • IETF RFC 3327 - Path
  • IETF RFC 3329 - Security Mechanism Agreement
  • IETF RFC 3362 - T38 Fax
  • IETF RFC 3420 - SIP message/sipfrag
  • IETF RFC 3428 - Instant Messaging
  • IETF RFC 3515 - REFER
  • IETF RFC 3551 - RTP Audio/Video Conference
  • IETF RFC 3578 - Overlap Signaling
  • IETF RFC 3581 - rport
  • IETF RFC 3608 - Registration Extnsn Hdr Route
  • IETF RFC 3665 - Call Flows
  • IETF RFC 3666 - PSTN Call Flows
  • IETF RFC 3725 - 3PCC
  • IETF RFC 3842 - Message Waiting Indicator (MWI)
  • IETF RFC 3856 - Presence Event Package
  • IETF RFC 3863 - Presence Info Data Format
  • IETF RFC 3891 - Replaces
  • IETF RFC 3892 - Referred-By
  • IETF RFC 3903 - PUBLISH
  • IETF RFC 3966 - URI for Telephone Numbers
  • IETF RFC 4028 - Session Timer
  • IETF RFC 4411 - Preemption
  • IETF RFC 4412 - Resource Priority
  • IETF RFC 4483 - Content Indirection
  • IETF RFC 4497 - QSIG Interworking
  • IETF RFC 4508 - Feature tags with REFER
  • IETF RFC 4566 - Session Description Protocol
  • IETF RFC 4904 - Trunk Groups in URIs
  • IETF draft-ietf-simple-message-sessions - MSRP
  • IETF draft-ietf-sipping-cc-transfer - SIP Call Transfer
  • IETF draft-hdesinen-mmusic-oa-send-bw-attr-02 - Bandwidth Modifier
  • IETF draft-levy-sip-diversion-08 - Diversion
  • IETF IANA sdp-parameters - IANA SDP parameters
  • IETF draft Remote-Party-ID
  • IETF draft SIP Session Timer
  • IETF draft 3xx responses

Product Details

Conformance tests available for each interface  

  • (S1, F1, X2, S5, S6a, S7, S11, Rx, Gx, Gy, Ro, SIP, 5G Nxx)

Operating System 

  • ‍Protocol Engine (Linux-based) 

User Interface 

  • ‍Browser-based, touch-optimized graphical user interface 

Automation 

  • HTTP API 

Note:

  • Actual throughput levels over radio may vary based on the 3rd party device manufacturer and software versions. Valid8 product specifications are subject to change at any time without notice.
All Solutions

Valid8 exports its products strictly in accordance with all US Export Control laws and regulations which shall apply to any purchase or order. Specifications are subject to change without notice.

500 West Cummings Park, Suite 6550 Woburn, MA 01801
p: +1-855-482-5438
f: +1-781-996-3708
welcome@valid8.com
VALID8.COM

Ordering Information

  • Product Name: SIP Conformance
  • Product Code: sip-conformance-base-suite, sip-conformance-protos-suite, sip-conformance-torture-suite, sip-conformance-extensions-suite
Datasheet Page

Related Video

Related Solutions

4G Core And RAN Network Emulator
  • Product Name: 4G Network Emulator
  • Product Code: 4g-network-emulator

Datasheet Page
4G UE Emulator
  • Product Name: 4G UE Emulator 
  • Product Code: 4g-ue-emulator

Datasheet Page
5G Core and RAN Network Emulator
  • Product Name: 5G Network Emulator 
  • Product Code: 5g-network-emulator
Datasheet Page
MCX Load Tester

Product Name: MCPTT Load Tester 

Product Code: mcptt-load-tester

Datasheet Page
LTE eNodeB EPC Emulator

LTE eNodeB EPC Emulator

Emulation options:
lte-core-network-emulator-enodeb-mimo-m3-1-pkg : 1 M3, 1 eNB (up to 2x2 MIMO or up to 2 CA), 1 EPC (MME, HSS, PGW, SGW, OCS, PCRF), supporting 1 UE, basic call
lte-core-network-emulator-enodeb-mimo-m5-1-pkg : 1 M3, 1 eNB (up to 2x2 MIMO and up to 4 CA), 1 EPC (MME, HSS, PGW, SGW, OCS, PCRF), supporting 1 UE, basic call
(others on request)(others on request)

Protocol interface options:
(on request)

Miscellaneous options:
network-emulator-internal-impairment-module
Security, fuzzing, penetration test

Licensing options:
wireless-UE-upgrade-licenses-10 : 10 UEs
wireless-UE-upgrade-licenses-20 : 20 UEs
(others on request)
3CA
4CA
2x2 MIMO
Multiple eNodeBs on request
Multiple EPC network elements on request

Datasheet Page
P25 ISSI CSSI Conformance Tester

P25 ISSI CSSI Conformance Tester

Conformance options:

sip-conformance-cap-suite : CAP conformance test suite

sip-conformance-tia-suite : TIA conformance test suite

Datasheet Page

Navigate through All Solutions