Candela Technologies Logo
Network Testing and Emulation Solutions

Audio Quality Testing:
Mobile to mobile calls using POLQA (Basic Setup)

Goal: Evaluate the voice/speech audio quality made between mobile to mobile calls through POLQA scoring server where both the endpoints are located on the same LANforge system.


Consider an example:
LANforge system is connected with two mobile devices: Mobile-A and Mobile-B using bluetooth connection. LANforge system makes a single long call using Mobile-A towards Mobile-B. LANforge plays a reference audio file over Mobile-A phone call for multiple times using Bluetooth or audio cable. The call is being recorded by LANforge from Mobile-B for same multiple times using Bluetooth or audio cable. After the call completes, both the reference audio file and recorded audio file are evaluated by installed POLQA server. The POLQA server scores the recording based on audio quality loss during the call.
 
  1. Requirements:
    1. LANforge system. (version 5.4.8)
    2. LANforge licenses.
    3. POLQA server with required licenses.
    4. POLQA standard reference audio files.
    5. Bluetooth USB dongle.
    6. Analog sound card and audio cables. (If testing over analog audio cable)
    7. Mobile device (Android or IOS) having Bluetooth and active SIM/eSIM card. (Customer provided)
    8. Mobile network like VoLTE, VoNR, etc. (Customer provided)
    9. Internet access. (Customer provided)
  2. Configuration:
    1. LANforge and POLQA licenses are installed.
    2. AQ configuration: Follow /home/lanforge/audio-bluetooth/README.txt on all LANforge resources.
    3. Then reboot all the systems.
    4. On the LANforge manager (cloud), open the GUI.
      Under VoIP/RTP tab, select Create. screenshot
      1. Cross Connect details to be filled are:
        1. Cross Connect Information:
          1. CX name: Mobile-Mobile
          2. Select Continuous Call checkbox.
          3. Select Save Call Records checkbox to save recordings for further analysis.
          4. Select Directed checkbox as mobile devices here does not require Gateway.
          5. Select PingPong checkbox for alternate play and record event count on each endpoint.
          6. Number Of AQ Reports: 20
            (Means, 20 pingpong events on each endpoint)
          7. Rest can remain defaults
        2. TX Endpoint A: Fill the TX Endpoint A with Mobile-A details.
          1. Resource: LANforge system Hostname
          2. Port: Management Port with Internet access.
          3. Auth User Name: AUTO
          4. Display Name: Mobile-A Name
          5. Mobile BT MAC: Mobile-A bluetooth mac address
          6. Deselect Rcv Call checkbox.
          7. Select Mobile checkbox.
          8. Select Enable Scoring checkbox for POLQA.
          9. Audio Band: Narrow Band
            (Optional: Super Wide Band also supported)
          10. Select Play Audio checkbox.
          11. Select Bluetooth checkbox.
            (Deselect this option for analog sound card option.)
          12. Tx file: /home/lanforge/media/AmEnglish_NB_m1s1_f2s2_8s.wav
          13. Destination: AUTO
          14. Phone: Mobile-A number
          15. Record File: Recording folder path
          16. Scoring Server: POLQA Server Address
        3. RX Endpoint B: Fill the RX Endpoint B with Mobile-B details.
          1. Resource: LANforge system Hostname
          2. Port: Management Port with Internet access.
          3. Auth User Name: AUTO
          4. Display Name: Mobile-B Name
          5. Mobile BT MAC: Mobile-B bluetooth mac address
          6. Select Rcv Call checkbox.
          7. Select Mobile checkbox.
          8. Select Record checkbox.
          9. Select Enable Scoring checkbox for POLQA.
          10. Audio Band: Narrow Band
            (Optional: Super Wide Band also supported)
          11. Select Bluetooth checkbox.
            (Deselect this option for analog sound card option.)
          12. Tx file: /home/lanforge/media/AmEnglish_NB_m1s1_f2s2_8s.wav
          13. Destination: AUTO
          14. Phone: Mobile-B number
          15. Record File: Recording folder path
          16. Scoring Server: POLQA Server Address
      2. Select Apply, OK
  3. Options to start the test:
    1. Under VoIP/RTP tab, select the test name and click the Start button to begin. screenshot
    2. Using Command Terminal and get the test results in .csv format.
      1. Open a command terminal as a user
      2. cd /home/lanforge/Documents
      3. git clone https://github.com/greearb/lanforge-scripts
      4. cd lanforge-scripts/py-scripts/
      5. git pull
      6. ./run_voip_cx.py --host localhost --cx_list Mobile-Mobile --csv_file /home/lanforge/report-data/my_test_reports.csv
      7. This command can be integrated for further automation.
  4. AQ Test Results:
    1. Option 01: Under VoIP/RTP Endp tab, current results will be shown in column/row structure once started. screenshot
    2. Option 02: Using live graphical reporting.
      1. Under VoIP/RTP tab, right click on the selected AQ test name, and select Audio Quality Reporting. screenshot
      2. Select the required configuration and Start the monitoring. screenshot
      3. Once started, we see Live view of graphical test monitoring which shows detailed reporting. screenshot
      4. Use Save HTML or Save PDF to get detailed report including .csv data.
  5. Sample screenshots of Live AQ Reporting.
    1. Screenshot 01 screenshot
    2. Screenshot 02 screenshot
    3. Screenshot 03 screenshot
    4. Screenshot 04 screenshot
  6. Further analysis: If Save Call Records option is true, received audio file along with the reference audio file can be evaluated manually on POLQA server to get more advanced report. Sample Advanced Report
  7. If you need assistance, you can contact us at support@candelatech.com
Candela  Technologies, 2417 Main Street, Suite 201, Ferndale, WA 98248, USA
www.candelatech.com | sales@candelatech.com | +1.360.380.1618
Facebook | LinkedIn | Blog