TR-398 Issue 2

WiFi Performance Test Plan

Wed Jul 20 07:40:25 PDT 2022

PDF Report

Test Setup Information
Device Under Test
Name adtran-root
SSIDs
adtran-tr398 adtran-tr398 
Passwords
lanforge lanforge 
BSSIDs
e8:2c:6d:85:73:64 e8:2c:6d:85:73:6a 
Notes [BLANK]
Estimated Run Time 2.133 h
Actual Run Time 4.318 h

Objective

The TR-398 Issue 2 WiFi Performance test plan by the Broadband forum provides a comprehensive set of tests to qualify the performance of WiFi access points (APs) designed for residential and small office environments. Radio performance, Throughput, Connection Stability, Airtime Fairness, AP Co-existence, Mu_MIMO Performance, Spatial Consistency and Long-term Stability are some of the test areas covered in this test plan. The test plan is designed for service providers deploying in home WiFi APs to qualify the APs in the lab before deployment and for equipment makers to test during the development of the APs. Candela Technologies offers a fully automated TR-398 Issue 2 test system. The user can select from the list of tests available. Most tests can run fully automated, though some require user interaction. Measurements are made and compared to the specified PASS/FAIL criteria in the TR-398 Issue 2 test plan and this report will show the summary PASS/FAIL results followed more detailed results for each test.


Summary Results

Test Result Candela
Score
Elapsed Info
6.5.1 Long Term Stability Test 2.4Ghz PASS
5Ghz PASS
100 4.311 h AC 2.4Ghz Packet Error Rate Passed: 0 / 0
AC 5Ghz Packet Error Rate Passed: 0 / 0
AX 2.4Ghz Packet Error Rate Passed: 16 / 16
AX 5Ghz Packet Error Rate Passed: 16 / 16


6.5.1 Long Term Stability Test


Summary

Long term stability test intends to measure the stability performance of Wi-Fi device under stress. Throughput and connection availability are continuously monitored in a long period of time (4 hours).

Test Procedure

These steps are done for 802.11ac and then for 802.11ax stations.
  1. Create 4 stations and set attenuation so that they are at a 2-meter distance.
  2. One station on each band runs a 50Mbps UDP download.
  3. A second station on each band associates for 5 minutes, then disconnects for 5 minutes, over and over.
  4. UDP Packet loss is measured every 15 minutes and recorded for pass/fail reporting.

Pass/Fail Criteria

  1. At end of each 15 minute interval, the packet loss must no more than 0.01%

Candela Score

The Candela Score is calculated as the percentage of passing sub-tests.

CSV Data for Port Reset Totals
Port Reset Totals

6.5.1 Long Term Stability Test Results

Type Result Value P/F Value Notes
Configuration NOTE INFO Configured to skip N/AC test.
AX 2.4Ghz UDP Pkt-Loss check 1 / 16 INFO 0 0.01%
AX 5Ghz UDP Pkt-Loss check 1 / 16 INFO 0 0.01%
AX 2.4Ghz UDP Pkt-Loss check 2 / 16 INFO 0 0.01%
AX 5Ghz UDP Pkt-Loss check 2 / 16 INFO 0 0.01%
AX 2.4Ghz UDP Pkt-Loss check 3 / 16 INFO 0 0.01%
AX 5Ghz UDP Pkt-Loss check 3 / 16 INFO 0 0.01%
AX 2.4Ghz UDP Pkt-Loss check 4 / 16 INFO 0 0.01%
AX 5Ghz UDP Pkt-Loss check 4 / 16 INFO 0 0.01%
AX 2.4Ghz UDP Pkt-Loss check 5 / 16 INFO 0 0.01%
AX 5Ghz UDP Pkt-Loss check 5 / 16 INFO 0 0.01%
AX 2.4Ghz UDP Pkt-Loss check 6 / 16 INFO 0.000 0.01%
AX 5Ghz UDP Pkt-Loss check 6 / 16 INFO 0 0.01%
AX 2.4Ghz UDP Pkt-Loss check 7 / 16 INFO 0.000 0.01%
AX 5Ghz UDP Pkt-Loss check 7 / 16 INFO 0 0.01%
AX 2.4Ghz UDP Pkt-Loss check 8 / 16 INFO 0.000 0.01%
AX 5Ghz UDP Pkt-Loss check 8 / 16 INFO 0 0.01%
AX 2.4Ghz UDP Pkt-Loss check 9 / 16 INFO 0 0.01%
AX 5Ghz UDP Pkt-Loss check 9 / 16 INFO 0.000 0.01%
AX 2.4Ghz UDP Pkt-Loss check 10 / 16 INFO 0 0.01%
AX 5Ghz UDP Pkt-Loss check 10 / 16 INFO 0 0.01%
AX 2.4Ghz UDP Pkt-Loss check 11 / 16 INFO 0 0.01%
AX 5Ghz UDP Pkt-Loss check 11 / 16 INFO 0 0.01%
AX 2.4Ghz UDP Pkt-Loss check 12 / 16 INFO 0 0.01%
AX 5Ghz UDP Pkt-Loss check 12 / 16 INFO 0 0.01%
AX 2.4Ghz UDP Pkt-Loss check 13 / 16 INFO 0 0.01%
AX 5Ghz UDP Pkt-Loss check 13 / 16 INFO 0 0.01%
AX 2.4Ghz UDP Pkt-Loss check 14 / 16 INFO 0 0.01%
AX 5Ghz UDP Pkt-Loss check 14 / 16 INFO 0 0.01%
AX 2.4Ghz UDP Pkt-Loss check 15 / 16 INFO 0.000 0.01%
AX 5Ghz UDP Pkt-Loss check 15 / 16 INFO 0 0.01%
AX 2.4Ghz UDP Pkt-Loss check 16 / 16 INFO 0 0.01%
AX 5Ghz UDP Pkt-Loss check 16 / 16 INFO 0 0.01%


Realtime Throughput for: 6.5.1 Long Term Stability Test



Key Performance Indicators CSV


Test configuration and LANforge software version
Auto-Helper true
Use Issue-3 Behaviour false
Allow-11w (MFP/PMF) false
Skip 2.4Ghz Tests false
Skip 5Ghz Tests false
Duration-120 30
Duration-60 30
Channel 2Ghz 1
Channel 5Ghz 36
Extra Download Path-loss 0
TX Power 20
DUT TX Power 2.4G 20
DUT TX Power 5G 23
Multi-Conn 10
ToS 0
Upstream Port 1.2.2 eth2 Firmware: 0x80000aef, 1.1876.0 Resource: ct523c-3b89
Alien Upstream Port 1.2.2 eth2 Firmware: 0x80000aef, 1.1876.0 Resource: ct523c-3b89
Turn-Table Chamber TR-398
Configured 2m 2.4Ghz RSSI -26
Configured 2m 5Ghz RSSI -30
Opposite-Speed: 20000
Allow Maximum NSS false
Max-CX Offered Load: 1000000
Max-CX 2Ghz N rate: 2000000
Max-CX 2Ghz AX rate: 3000000
Max-CX 5Ghz AC rate: 8000000
Max-CX 5Ghz AX rate: 10000000
Throughput N 2Ghz rate: 100000000
Throughput AC 5Ghz rate: 560000000
Throughput AX 2Ghz rate: 200000000
Throughput AX 5Ghz rate: 720000000
Skip 4x4 5Ghz test false
RvR issue 3 false
Throughput AX 2Ghz rate: 300000000
Throughput AX 2x2 5Ghz rate: 1100000000
Throughput AX 4x4 5Ghz rate: 1100000000
ATF Max NSS: 2
ATF Attenuation: 0
Max allowed packet loss%: 0.05
Assoc/Disassoc Traffic %: 99
Requested Rx-Sens Speed 65%
RxSens Rotation Degrees: 45
RxSens Start Step: 4
Attenuation Adjustment 0
Stop RX-Sens at pass false
Pause on zero throughput false
Spatial issue 3 true
Multiple STA issue 3 true
Use Virtual AX Stations false
Use AX Radios for AC tests false
Auto-Calibrate Interferer true
Use 40Mhz DUT to Avoid DFS false
Calibrate Alien with DUT Down false
LANforge-AP is Interferer true
Use AP-Coex Alien radios true
Use AP-Coex Alien Tx-Power true
User Interaction true
Interferer AC 5G-80Mhz: 195.00 Mbps
Interferer AC 5G-40Mhz: 90.00 Mbps
Interferer AC 2.4G-20Mhz: 32.00 Mbps
Interferer AX 5G-80Mhz: 195.00 Mbps
Interferer AX 5G-40Mhz: 90.00 Mbps
Interferer AX 2.4G-20Mhz: 32.00 Mbps
2Ghz Alien AP Radio: 1.4.3 wiphy0
5Ghz Alien AP Radio: 1.4.3 wiphy0
Alien AP TxPower: 0 dBm
2Ghz Alien STA Radio: 1.4.4 wiphy1
5Ghz Alien STA Radio: 1.4.4 wiphy1
Alien STA TxPower: 0 dBm
Spatial Rotation Degrees: 30
Test Retries: 0
Stability Duration-180 180
Stability Max-Iterations 16
Stability UDP Duration 15 m
Calibration Mode: 4
Calibration NSS: 1
2.4Ghz LANforge AP Calibration Radio: 1.4.3 wiphy0
5Ghz LANforge AP Calibration Radio: 1.4.4 wiphy1
2.4Ghz Mesh Node-1 LANforge AP Calibration Radio: 1.5.3 wiphy0
5Ghz Mesh Node-1 LANforge AP Calibration Radio: 1.5.3 wiphy0
2.4Ghz Mesh Node-2 LANforge AP Calibration Radio: 1.6.3 wiphy0
5Ghz Mesh Node-2 LANforge AP Calibration Radio: 1.6.4 wiphy1
Calibrate against LANforge AP true
Background Scan Module simple
Background Short Interval 30
Background Long Interval 300
Background RSSI Threshold -65
WiFi Radio 0 1.1.5 wiphy1 Resource: ct523c-3b29
WiFi Radio 1 1.1.4 wiphy0 Resource: ct523c-3b29
WiFi Radio 2 1.1.7 wiphy3 Resource: ct523c-3b29
WiFi Radio 3 1.1.6 wiphy2 Resource: ct523c-3b29
WiFi Radio 4 1.1.9 wiphy5 Resource: ct523c-3b29
WiFi Radio 5 1.1.8 wiphy4 Resource: ct523c-3b29
WiFi AX Radio 0 1.2.wiphy0 Firmware: release/core68::058653f6 Resource: ct523c-3b89
WiFi AX Radio 1 1.2.wiphy1 Firmware: release/core68::058653f6 Resource: ct523c-3b89
WiFi AX Radio 2 1.2.wiphy2 Firmware: release/core68::058653f6 Resource: ct523c-3b89
WiFi AX Radio 3 1.2.wiphy3 Firmware: release/core68::058653f6 Resource: ct523c-3b89
WiFi AX Radio 4 1.2.wiphy4 Firmware: release/core68::058653f6 Resource: ct523c-3b89
WiFi AX Radio 5 1.2.wiphy5 Firmware: release/core68::058653f6 Resource: ct523c-3b89
WiFi AX Radio 6 1.2.wiphy6 Firmware: release/core68::058653f6 Resource: ct523c-3b89
WiFi AX Radio 7 1.2.wiphy7 Firmware: release/core68::058653f6 Resource: ct523c-3b89
WiFi AX Radio 8 1.2.wiphy8 Firmware: release/core68::058653f6 Resource: ct523c-3b89
WiFi AX Radio 9 1.2.wiphy9 Firmware: release/core68::058653f6 Resource: ct523c-3b89
WiFi AX Radio 10 1.2.wiphy10 Firmware: release/core68::058653f6 Resource: ct523c-3b89
WiFi AX Radio 11 1.2.wiphy11 Firmware: release/core68::058653f6 Resource: ct523c-3b89
WiFi AX Radio 12 1.3.wiphy0 Firmware: release/core68::058653f6 Resource: ct523c-de7c
WiFi AX Radio 13 1.3.wiphy5 Firmware: release/core68::058653f6 Resource: ct523c-de7c
WiFi AX Radio 14 1.3.wiphy10 Firmware: release/core68::058653f6 Resource: ct523c-de7c
WiFi AX Radio 15 1.3.wiphy15 Firmware: release/core68::058653f6 Resource: ct523c-de7c
WiFi AX Radio 16 1.3.wiphy1 Firmware: release/core68::058653f6 Resource: ct523c-de7c
WiFi AX Radio 17 1.3.wiphy6 Firmware: release/core68::058653f6 Resource: ct523c-de7c
WiFi AX Radio 18 1.3.wiphy11 Firmware: release/core68::058653f6 Resource: ct523c-de7c
WiFi AX Radio 19 1.3.wiphy16 Firmware: release/core68::058653f6 Resource: ct523c-de7c
WiFi AX Radio 20 1.3.wiphy2 Firmware: release/core68::058653f6 Resource: ct523c-de7c
WiFi AX Radio 21 1.3.wiphy7 Firmware: release/core68::058653f6 Resource: ct523c-de7c
WiFi AX Radio 22 1.3.wiphy12 Firmware: release/core68::058653f6 Resource: ct523c-de7c
WiFi AX Radio 23 1.3.wiphy17 Firmware: release/core68::058653f6 Resource: ct523c-de7c
WiFi AX Radio 24 1.3.wiphy3 Firmware: release/core68::058653f6 Resource: ct523c-de7c
WiFi AX Radio 25 1.3.wiphy8 Firmware: release/core68::058653f6 Resource: ct523c-de7c
WiFi AX Radio 26 1.3.wiphy13 Firmware: release/core68::058653f6 Resource: ct523c-de7c
WiFi AX Radio 27 1.3.wiphy18 Firmware: release/core68::058653f6 Resource: ct523c-de7c
WiFi AX Radio 28 1.3.wiphy4 Firmware: release/core68::058653f6 Resource: ct523c-de7c
WiFi AX Radio 29 1.3.wiphy9 Firmware: release/core68::058653f6 Resource: ct523c-de7c
WiFi AX Radio 30 1.3.wiphy14 Firmware: release/core68::058653f6 Resource: ct523c-de7c
WiFi AX Radio 31 1.3.wiphy19 Firmware: release/core68::058653f6 Resource: ct523c-de7c
WiFi Mesh Radio 0 1.3.18 wiphy21 Firmware: release/core68::058653f6 Resource: ct523c-de7c
WiFi Mesh Radio 1 1.3.18 wiphy21 Firmware: release/core68::058653f6 Resource: ct523c-de7c
Attenuator 0 rssi-0-2.4Ghz: -22 rssi-0-5Ghz: -41 atten: 1.1.3094.0
Attenuator 1 rssi-0-2.4Ghz: -22 rssi-0-5Ghz: -41 atten: 1.1.3094.1
Attenuator 2 rssi-0-2.4Ghz: -22 rssi-0-5Ghz: -41 atten: 1.1.3094.2
Attenuator 3 rssi-0-2.4Ghz: -22 rssi-0-5Ghz: -41 atten: 1.1.3094.3
Attenuator 4 rssi-0-2.4Ghz: -27 rssi-0-5Ghz: -43 atten: 1.1.3102.0
Attenuator 5 rssi-0-2.4Ghz: -27 rssi-0-5Ghz: -43 atten: 1.1.3102.1
Attenuator 6 rssi-0-2.4Ghz: -27 rssi-0-5Ghz: -43 atten: 1.1.3099.0
Attenuator 7 rssi-0-2.4Ghz: -27 rssi-0-5Ghz: -43 atten: 1.1.3099.1
Attenuator 8 rssi-0-2.4Ghz: -25 rssi-0-5Ghz: -43 atten: 1.1.3102.2
Attenuator 9 rssi-0-2.4Ghz: -25 rssi-0-5Ghz: -43 atten: 1.1.3102.3
Attenuator 10 rssi-0-2.4Ghz: -25 rssi-0-5Ghz: -43 atten:
Attenuator 11 rssi-0-2.4Ghz: -25 rssi-0-5Ghz: -43 atten:
AX Attenuator 0 AX rssi-0-2.4Ghz: -30 rssi-0-5Ghz: -44 atten: 1.1.3100.3
AX Attenuator 1 AX rssi-0-2.4Ghz: -30 rssi-0-5Ghz: -44 atten: 1.1.3100.2
AX Attenuator 2 AX rssi-0-2.4Ghz: -30 rssi-0-5Ghz: -44 atten: NA
AX Attenuator 3 AX rssi-0-2.4Ghz: -30 rssi-0-5Ghz: -44 atten: NA
AX Attenuator 4 AX rssi-0-2.4Ghz: -30 rssi-0-5Ghz: -42 atten: 1.1.3100.1
AX Attenuator 5 AX rssi-0-2.4Ghz: -30 rssi-0-5Ghz: -42 atten: 1.1.3100.0
AX Attenuator 6 AX rssi-0-2.4Ghz: -30 rssi-0-5Ghz: -42 atten:
AX Attenuator 7 AX rssi-0-2.4Ghz: -30 rssi-0-5Ghz: -42 atten:
AX Attenuator 8 AX rssi-0-2.4Ghz: -33 rssi-0-5Ghz: -45 atten: 1.1.3099.3
AX Attenuator 9 AX rssi-0-2.4Ghz: -33 rssi-0-5Ghz: -45 atten: 1.1.3099.2
AX Attenuator 10 AX rssi-0-2.4Ghz: -33 rssi-0-5Ghz: -45 atten:
AX Attenuator 11 AX rssi-0-2.4Ghz: -33 rssi-0-5Ghz: -45 atten:
AX Attenuator 12 AX rssi-0-2.4Ghz: -25 rssi-0-5Ghz: -30 atten:
AX Attenuator 13 AX rssi-0-2.4Ghz: -25 rssi-0-5Ghz: -30 atten:
AX Attenuator 14 AX rssi-0-2.4Ghz: -25 rssi-0-5Ghz: -30 atten:
AX Attenuator 15 AX rssi-0-2.4Ghz: -25 rssi-0-5Ghz: -30 atten:
AX Attenuator 16 AX rssi-0-2.4Ghz: -25 rssi-0-5Ghz: -30 atten:
AX Attenuator 17 AX rssi-0-2.4Ghz: -25 rssi-0-5Ghz: -30 atten:
AX Attenuator 18 AX rssi-0-2.4Ghz: -25 rssi-0-5Ghz: -30 atten:
AX Attenuator 19 AX rssi-0-2.4Ghz: -25 rssi-0-5Ghz: -30 atten:
AX Attenuator 20 AX rssi-0-2.4Ghz: -25 rssi-0-5Ghz: -30 atten:
AX Attenuator 21 AX rssi-0-2.4Ghz: -25 rssi-0-5Ghz: -30 atten:
AX Attenuator 22 AX rssi-0-2.4Ghz: -25 rssi-0-5Ghz: -30 atten:
AX Attenuator 23 AX rssi-0-2.4Ghz: -25 rssi-0-5Ghz: -30 atten:
AX Attenuator 24 AX rssi-0-2.4Ghz: -25 rssi-0-5Ghz: -30 atten:
AX Attenuator 25 AX rssi-0-2.4Ghz: -25 rssi-0-5Ghz: -30 atten:
AX Attenuator 26 AX rssi-0-2.4Ghz: -25 rssi-0-5Ghz: -30 atten:
AX Attenuator 27 AX rssi-0-2.4Ghz: -25 rssi-0-5Ghz: -30 atten:
AX Attenuator 28 AX rssi-0-2.4Ghz: -25 rssi-0-5Ghz: -30 atten:
AX Attenuator 29 AX rssi-0-2.4Ghz: -25 rssi-0-5Ghz: -30 atten:
AX Attenuator 30 AX rssi-0-2.4Ghz: -25 rssi-0-5Ghz: -30 atten:
AX Attenuator 31 AX rssi-0-2.4Ghz: -25 rssi-0-5Ghz: -30 atten:
Mesh Attenuator 0 Mesh rssi-0-2.4Ghz: -43 rssi-0-5Ghz: -63 atten: 1.1.3249.0
Mesh Attenuator 1 Mesh rssi-0-2.4Ghz: -43 rssi-0-5Ghz: -63 atten: 1.1.3249.1
Mesh Attenuator 2 Mesh rssi-0-2.4Ghz: -43 rssi-0-5Ghz: -63 atten: 1.1.3249.2
Mesh Attenuator 3 Mesh rssi-0-2.4Ghz: -43 rssi-0-5Ghz: -63 atten: 1.1.3249.3
Mesh Attenuator 4 Mesh rssi-0-2.4Ghz: -34 rssi-0-5Ghz: -60 atten: 1.1.3232.0
Mesh Attenuator 5 Mesh rssi-0-2.4Ghz: -34 rssi-0-5Ghz: -60 atten: 1.1.3232.1
Mesh Attenuator 6 Mesh rssi-0-2.4Ghz: -34 rssi-0-5Ghz: -60 atten:
Mesh Attenuator 7 Mesh rssi-0-2.4Ghz: -34 rssi-0-5Ghz: -60 atten:
Mesh Attenuator 8 Mesh rssi-0-2.4Ghz: -33 rssi-0-5Ghz: -41 atten: 1.1.3232.2
Mesh Attenuator 9 Mesh rssi-0-2.4Ghz: -33 rssi-0-5Ghz: -41 atten: 1.1.3232.3
Mesh Attenuator 10 Mesh rssi-0-2.4Ghz: -33 rssi-0-5Ghz: -41 atten:
Mesh Attenuator 11 Mesh rssi-0-2.4Ghz: -33 rssi-0-5Ghz: -41 atten:
Mesh Attenuator 12 Mesh rssi-0-2.4Ghz: -34 rssi-0-5Ghz: -46 atten: 1.1.3263.0
Mesh Attenuator 13 Mesh rssi-0-2.4Ghz: -34 rssi-0-5Ghz: -46 atten: 1.1.3263.1
Mesh Attenuator 14 Mesh rssi-0-2.4Ghz: -34 rssi-0-5Ghz: -46 atten:
Mesh Attenuator 15 Mesh rssi-0-2.4Ghz: -34 rssi-0-5Ghz: -46 atten:
Mesh Attenuator 16 Mesh rssi-0-2.4Ghz: -52 rssi-0-5Ghz: -59 atten: 1.1.3256.0
Mesh Attenuator 17 Mesh rssi-0-2.4Ghz: -52 rssi-0-5Ghz: -59 atten: 1.1.3256.1
Mesh Attenuator 18 Mesh rssi-0-2.4Ghz: -52 rssi-0-5Ghz: -59 atten: 1.1.3256.2
Mesh Attenuator 19 Mesh rssi-0-2.4Ghz: -52 rssi-0-5Ghz: -59 atten: 1.1.3256.3
Mesh Attenuator 20 Mesh rssi-0-2.4Ghz: -38 rssi-0-5Ghz: -59 atten: 1.1.3263.2
Mesh Attenuator 21 Mesh rssi-0-2.4Ghz: -38 rssi-0-5Ghz: -59 atten: 1.1.3263.3
Mesh Attenuator 22 Mesh rssi-0-2.4Ghz: -38 rssi-0-5Ghz: -59 atten:
Mesh Attenuator 23 Mesh rssi-0-2.4Ghz: -38 rssi-0-5Ghz: -59 atten:
Show Events true
Build Date Tue 19 Jul 2022 07:33:09 PM PDT
Git Version 1e4f6e387d4ca74f665f4590b1c8d27ecf151e3b


CSV Data

META Information for TR-398 Issue 2
Generated by Candela Technologies LANforge network testing tool.
www.candelatech.com