Test Case

Show / Hide direct link   <MAIN> 5397PA: Enhanced Wireless Testing - PP-80497



Version 1
Created on 31/10/2014 14:10:30  by Muralidharan Seshadri
Summary
Preconditions
Status:   New
Priority:   Mandatory
BASIC INFORMATION
Section:S/W Test Require attachment:No
Team:Network Group:Reliability
Lessons Learned:No Phase:FVT, SIT, SVT
Locations:Inhouse: AWS and Cambridge, Inhouse: AWS, Inhouse: Cambridge, Compal, Flextronics, Quanta, Wistron Owned By:Eiji Ogata/LENOVO
Objective:To qualify wireless for reliable, stable and quality connectivity
CRITERIA
Refer the criteria section for each test item
EUT QUANTITY
Two systems
EQUIPMENT
- Enhanced Network Facilities setup at MMC


Critical Attribute:[0] : WLS - Wireless

CONFIGURATION
REFERENCE PROCEDURE
STATISTIC INFO
Operating System Win81-64bit Win81-32bit Win10-32bit Win10-64bit Win7- 64bit Win7- 32bit Total
Test Points
Duration
Workload
# Step actions Win81-64bitWin81-32bitWin10-32bitWin10-64bitWin7- 64bitWin7- 32bit
1 RSSI - Noise induction Wireless verification - Wireless Development Tea AAAAAA
2 Wireless Controller based Network quality AAAAAA
3 Wireless multiple AP Network quality AAAAAA
4 Wireless Integrated environment reliability AAAAAA
5 Real World user scenario AAAAAA
DETAILS
ATTENTION!! Please follow below information.
1. Please check Error and Warning message in Event Viewer before you start the test case and after you complete the test case, and report it to your team lead, then arrange to open defect, if needed.

2. Perform All Test in Battery Mode (Some of the test items need to perform in AC Mode, follow each Test Case).

3. All Test Activity should be performed with AMT Enabled as Default (applicable on vPro enabled systems).

4. Please check Usability / Cosmetic issues (correct sentence/appropriate display/etc.) and open defect, if needed.

OTHER DETAILS
EUT Quantity : Two systems 1. "Please check Error and Warning message in Event Viewer before you start the test case and after you complete the test case, and report it to your team lead."
2. "Perform All Test in Battery Mode (Some of the test items need to perform in AC Mode, follow each Test Case)"
(All Test Activity should be performed with AMT Enabled)
1. Performance Comparison Test


Attachment "WLAN Performance Report.xlsx"can be seen at the bottom of the page.

Note: Use report sheet to input data for performance, reliability, and share connection

==Requirements==

>> 2 to 3 Wireless Router.

>> 3 location points:

a. Test Location A: Maximum Performance ( 0 to 5m away from Wireless Router)

b. Test Location B: Performance at moderate distance (10 to 15m away from Wireless Router)

c. Test Location C: Worst-case Performance (more than 20m away from Wireless Router)

>> Perform test with Test Unit and compare results with a Non-Lenovo System.

==FTP File Upload / Download Throughput Calculation==

1. Upload or Download 100 MB / 500MB/ 1GB File in FTP.

2. Use stopwatch and note the time for file transfer to complete.

3. Calculate throughput in Mbps (throughput = file size / transfer time)

4. To check signal strength, run "netsh wlan show interface" command.

6. The higher value of throughput and signal strenght means better performance.

==Online Video 1080p Streaming==

1. Pick a 15 - 30 mins 1080p video in youtube, use the same video throughout the test.

2. Play the video, and note down actual time when it completes.

3. Calculate and note down time difference (time difference = actual video complete - video duration).

4. The Lower value of time difference means better performance.

2. Reliability Comparison Test


Attachment "NetworkReliability.zip"can be seen at the bottom of the page.

>> Perform realiability test using Network ATS Script "NetworkReliability.ps1" on both Lenovo Test Unit & Non-Lenovo Test System.

>> Collect data of average Mbps for FTP file copy / Network Server File Copy / HTTP Copy.

>> Note down the results in the attached file, and compare the results.

3. Share Connection Test

==Requirement==

>> Latest build of Lenovo Settings Mobile Hotspot, WLAN / Ethernet driver.

>> 5 - 10 devices (any brand of Smart Phone/Tablet/Laptop) as client.

==Procedure==

1. Launch Lenovo Settings Mobile Hotspot and Start Sharing Connection.

2. Connect 5 to 10 client device to Test System AP (Host).

3. In the client system, run the following at the same time for 60 mins:

a. continuous ping command ex. "ping google.com -t".

b. play online video from youtube.

c. download test file from web. >> http://www.thinkbroadband.com/download.html

4. Input the data in the attached file and compare results.

4. Switching Profile

Scenario 1 (Ethernet and Wi-Fi)

>> Plug in Ethernet cable and ensure that Ethernet Profile is shown in the Networks Charms Bar

>> Connect to one Wi-Fi profile and ensure that “Connect automatically” is checked

>> Unplug the Ethernet Profile, ensure that Wi-Fi profile is in connection

>> Plug in Ethernet cable and ensure both Profiles (Ethernet and Wi-Fi) are connected

>> Disconnect Wi-Fi Profile and ensure Ethernet Profile is in connection

>> Repeat the steps for 20 times

Scenario 2 (2 Wi-Fi profiles)

>> Connect to 2 Wi-Fi profiles and ensure that “Connect automatically” is checked

>> Switch off Profile 1 router and ensure that Profile 2 is connected and having connection

>> Switch on Profile 1 router and ensure that Profile 1 is found in the Networks Charms Bar

>> Switch off Profile 2 router and ensure that Profile 1 is connected and having connection

>> Switch on Profile 2 router and ensure that Profile 2 is found in the Networks Charms Bar

>> Disconnect the current profile, Profile 1 and ensure that Profile 2 is connected automatically

>> Disconnect the current profile, Profile 2 and ensure that Profile 1 is connected automatically

>> Repeat the steps for 20 times

5. Wireless Integration / Coexistence

Scenario 1 (BIOS)

>> Connect to Wi-Fi and switch on Bluetooth

>> Boot to the BIOS menu, go to the security tab and under I/O Port Access “Disable” the Bluetooth

>> Save the settings and boot to Desktop, ensure that Wi-Fi is still in connection

>> Boot to the BIOS menu, and “Enable” the Bluetooth

>> Save the settings and boot to Desktop, ensure that Wi-Fi is still in connection

>> Repeat the steps for 20 times

Scenario 2 (Device Manager)

>> Connect to Wi-Fi and switch on Bluetooth

>> Disable the Bluetooth Device from the Device Manager and ensure Wi-Fi is still in connection

>> Enable the Bluetooth Device from the Device Manger and ensure Wi-Fi is still in connection

>> Repeat the steps for 20 times

Scenario 3 (Bluetooth and Wi-Fi)

>> Connect to Wi-Fi and switch on Bluetooth from PC settings>Network>Airplane mode

>> Switch off Bluetooth and ensure that Wi-Fi is still in connection

>> Switch on the Bluetooth and ensure that Wi-Fi is still in connection

>> Repeat the steps for 20 times

TEMS Reviewer Log:
Review Logs
Keywords:   None
Requirements :   None
Attached files :
NetworkReliability.zip - NetworkReliability.zip (133339 bytes, ) 07/03/2015
WLAN Performance Report.xlsx - WLAN Performance Report.xlsx (34108 bytes, ) 07/03/2015

Update History:
This document is not yet modified.