Test Case

Show / Hide direct link   <MAIN> 5401PA: Wireless Quality - PP-80495



Version 1
Created on 31/10/2014 14:31:09  by Muralidharan Seshadri
Summary
Preconditions
Status:   New
Priority:   Mandatory
BASIC INFORMATION
Section:S/W Test Require attachment:No
Team:Network Group:Test Coverage
Lessons Learned:No Phase:FVT
Locations:Inhouse: AWS and Cambridge, Inhouse: AWS, Inhouse: Cambridge, Compal, Flextronics, Quanta, Wistron Owned By:Eiji Ogata/LENOVO
Objective:a
CRITERIA
a
EUT QUANTITY
a
EQUIPMENT
a
Critical Attribute:[0] : WLS - Wireless

CONFIGURATION
REFERENCE PROCEDURE
STATISTIC INFO
Operating System Win81-64bit Win81-32bit Win10-32bit Win10-64bit Win7- 64bit Win7- 32bit Total
Test Points
Duration
Workload
# Step actions Win81-64bitWin81-32bitWin10-32bitWin10-64bitWin7- 64bitWin7- 32bit
1 test AAAAAA
DETAILS
ATTENTION!! Please follow below information.
1. Please check Error and Warning message in Event Viewer before you start the test case and after you complete the test case, and report it to your team lead, then arrange to open defect, if needed.

2. Perform All Test in Battery Mode (Some of the test items need to perform in AC Mode, follow each Test Case).

3. All Test Activity should be performed with AMT Enabled as Default (applicable on vPro enabled systems).

4. Please check Usability / Cosmetic issues (correct sentence/appropriate display/etc.) and open defect, if needed.

All:Network Adapters Performance and Reliability Test

S.No
Test Items
Win7- 32bit
Win7- 64bit
Win81-32bit
Win81-64bit
1
Web Data Download Test
2
FTP Data Upload Test
3
FTP Data Download Test
4
Video Playback Test
5
Network Connectivity Verification after PM operations using ATS
6
Device Detection Verification after PM Operations using ATS
7
Network Connectivity Verification after Connected Standby in Tablets
8
Network Reliability Test using ATS
9
Overnight test


Known Limitations

Restrictions

Information




Test Result:
S.No
Test Items
Adapter Win7-32 bit Win7-64 bit Win8.1-32 bit Win8.1-64 bit
1
Web Data Download Test LAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
WLAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
WWAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
2
FTP Data Upload Test LAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
WLAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
WWAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
3
FTP Data Download Test LAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
WLAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
WWAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
4
Video Playback Test LAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
WLAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
WWAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
5
Network Connectivity Verification after PM operations using ATS LAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
WLAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
WWAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
6
Device Detection Verification after PM Operations using ATS LAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
WLAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
WWAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
7
Network Connectivity Verification after Connected Standby in Tablets LAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
WLAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
WWAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
8
Network Reliability Test using ATS LAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
WLAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
WWAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
9
Overnight test LAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
WLAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
WWAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL


ATS Scripts

Attachment "NWAdapterSpeedTest.zip"can be seen at the bottom of the page.

Attachment "IPConfigVerifyAfterPM.zip"can be seen at the bottom of the page.

Attachment "SetPrerequisites.zip"can be seen at the bottom of the page.

Attachment "NetworkReliability.zip"can be seen at the bottom of the page.

Attachment "VerifyAutoConnectivityForTablets.zip"can be seen at the bottom of the page.



Web Data Download Test
Procedure Expected Result Remarks
  1. Connect the test system to LAN/WLAN/WWAN network.
  2. Launch Internet browser an type in Address bar https://clients.wswd.net/testdownloadfiles.php
  3. Download files of different sizes (5 MB, 10 MB, 20 MB, 50 MB, 100 MB and 200 MB) from the website and measure the time required to download the file.
  4. Check the throughput of the network connection using www.speedtest.net
  5. Open Command prompt as Administrator, type netsh wlan show interface and note down the signal strength.
System should connect to network successfully


Files should be downloaded successfully


Complete this test for all supported OS for the product, tabulate the results in the below format and include in test report.

FTP Data Upload Test
Procedure Expected Result Remarks
  1. Connect the test system to LAN/WLAN/WWAN network.
  2. Download and Install FTP client [For e.g., FileZilla]
  3. Connect to a FTP server.
  4. Upload files of different sizes (5 MB, 10 MB, 20 MB, 50 MB, 100 MB and 200 MB) and Measure the time required to upload the files.
  5. Check the throughput of the network connection using www.speedtest.net
  6. Open Command prompt as Administrator, type netsh wlan show interface and note down the signal strength.
System should connect to network successfully


Files should be uploaded successfully


Complete this test for all supported OS for the product, tabulate the results in the below format and include in test report.

FTP Data Download Test
Procedure Expected Result Remarks
  1. Connect the test system to LAN/WLAN/WWAN network.
  2. Download and Install FTP client [For e.g., FileZilla]
  3. Connect to a FTP server.
  4. Upload files of different sizes (5 MB, 10 MB, 20 MB, 50 MB, 100 MB and 200 MB) and Measure the time required to upload the files.
  5. Check the throughput of the network connection using www.speedtest.net
  6. Open Command prompt as Administrator, type netsh wlan show interface and note down the signal strength.
System should connect to network successfully


Files should be downloaded successfully


Complete this test for all supported OS for the product, tabulate the results in the below format and include in test report.

Performance Test Results:
OS/ Adapter Windows 8.1 Windows 7-32 bit Windows 7-64 bit
LAN
WLAN
WWAN


Sample:

Attachment "Network Performance Test.xlsx"can be seen at the bottom of the page.


Video Playback Test
Procedure Expected Result Remarks
  1. Connect the test system to LAN/WLAN/WWAN network.
  2. Download NetworkAdapterSpeedTest script from ATS admin Console.
  3. Open Internet browser and load www.youtube.com
  4. Play video files for over 40 minutes.
  5. Extract the NetworkAdapterSpeedTest ATS Script.
  6. Right Click Set Execution Policy_Bypass.bat file and click on Run as Administrator in ATS Sys Files folder.
  7. Right Click the NWAdapterSpeedTest.ps1 file and select Run with powershell.
  8. In the next pop up, select WLAN and Click on the Proceed.
  9. Enter the lower speed of the network adapter based on the connection [ like for e.g, 54 Mbps for 802.11a]
  10. Enter the time for the script to run as 60 minutes.
  11. Wait the for the script to run through and complete.
  12. In the web browser launch another video to play.
System should connect to network successfully



The video should play without any failures.






Once completed open NWAdapterSpeedTest_DevLog.htm and validate for error and failures.
The video should play without any failures.
Complete this test for all supported OS for the product, and attach the log files in the below table.
OS/ Adapter Windows 8.1 Windows 7-32 bit Windows 7-64 bit
LAN
WLAN
WWAN


Network Connectivity Verification after PM operations using ATS
Procedure Expected Result Remarks
  1. Connect the test system to LAN/WLAN/WWAN network.
  2. Download IPConfigAfterPM ATS script from ATS admin Console.
  3. Extract the IPConfigAfterPM ATS script.
  4. Right Click Set Execution Policy_Bypass.bat file and click on Run as Administrator in ATS Sys Files folder.
  5. Right Click the IPConfigAfterPM.ps1 file and select Run with powershell.
  6. Enter the input as, Test mode: Silent, Loop count: 100, S3 resume time: 60, S3 Elapse time: 60, S4 resume time: 60, S4 Elapse time: 60 and Restart Elapse time: 120 seconds.
  7. Click S3, S4 and R to select S3, S4, restart for test and Click ok.
  8. The script starts execution.
  9. Once completed a pop-up appears "Test Completed". Click Ok to save logs.
System should connect to network successfully











Once completed open IPConfigAfterPM_DevLog.htm and validate for error and failures.
Complete this test for all supported OS for the product, and attach the log files in the below table.


OS/ Adapter Windows 8.1 Windows 7-32 bit Windows 7-64 bit
LAN
WLAN
WWAN


Device Detection Verification after PM Operations using ATS
Procedure Expected Result Remarks
  1. Connect the test system to LAN/WLAN/WWAN network.
  2. Download DeviceDetectPM ATS script from ATS admin Console.
  3. Extract the DeviceDetectPM ATS script.
  4. Right Click Set Execution Policy_Bypass.bat file and click on Run as Administrator in ATS Sys Files folder.
  5. Right Click the DeviceDetectPM.ps1 file and select Run with powershell.
  6. Enter the input as, Loop count: 50,
  7. The script starts execution.
  8. Once completed a pop-up appears "Test Completed". Click Ok to save logs.
System should connect to network successfully








Once completed open DeviceDetectPM_DevLog.htm and validate for error and failures.
Complete this test for all supported OS for the product, and attach the log files in the below table.

OS / Adapter Windows 8.1 Windows 7-32 bit Windows 7-64 bit
LAN
WLAN
WWAN


Network Connectivity Verification after PM operations in Tablets
Procedure Expected Result Remarks
System Preparation:
  1. Connect the test system to LAN/WLAN/WWAN network.
  2. Download VerifyAutoConnectivityForTablets ATS script from ATS admin Console.
  3. Extract the VerifyAutoConnectivityForTablets ATS script.
  4. Launch Computer management console --> Local Users and Groups --> Users, Right-Click on Administrator account and select Properties.
  5. Uncheck the Account is disabled option and click Apply and OK.
  6. Right-Click on Current user account and Select Properties.
  7. Check the Account is disabled option and click Apply and OK.
  8. Navigate to VerifyAutoConnectivityForTablets --> ATS Sys Files --> resources --> WDTF Runtime --> Runtimes, Right-Click on WDTF Runtime Install.bat and select Run as Administrator.
  9. Wait for the installation to Complete.
  10. Launch Computer management console --> Local Users and Groups --> Users, Right-Click on Administrator account and select Properties.
  11. Check the Account is disabled option and click Apply and OK.
  12. Right-Click on Current user account and Select Properties.
  13. Uncheck the Account is disabled option and click Apply and OK.
Test Procedure for Connected Standby:
  1. Open VerifyAutoConnectivityForTablets ATS script folder
  2. Right Click Set Execution Policy_Bypass.bat file and click on Run as Administrator in ATS Sys Files folder.
  3. Right Click the VerifyAutoConnectivityForTablets.ps1 file and select Run with powershell.
  4. Enter the input as, Test mode: Silent, Loop count: 100, Connected Standby resume time: 60, Connected Standby Elapse time: 60 and Click Ok
  5. The script starts execution.
  6. Once completed a pop-up appears "Test Completed". Click Ok to save logs.
Test Procedure for Restart
  1. Open IPConfigAfterPM ATS script folder
  2. Right Click Set Execution Policy_Bypass.bat file and click on Run as Administrator in ATS Sys Files folder.
  3. Right Click the IPConfigAfterPM.ps1 file and select Run with powershell.
  4. Enter the input as, Test mode: Silent, Select R for Restart only, Loop count: 100, Restart Elapse time: 120 and Click Ok
  5. The script starts execution.
  6. Once completed a pop-up appears "Test Completed". Click Ok to save logs.
System should connect to network successfully












Open Programs and Features and ensure "Windows Driver Testing Framework (WDTF) Runtime Libraries" is installed.

















Once completed open VerifyAutoConnectivityForTablets_DevLog.htm and validate for error and failures.










Once completed open IPConfigAfterPM_DevLog.htm and validate for error and failures.
Complete this test for all supported OS for the product, and attach the log files in the below table.























OS/Adapter Windows 8.1
LAN
WLAN
WWAN









OS/Adapter Windows 8.1
LAN
WLAN
WWAN


Network Reliability Test using ATS
Procedure Expected Result Remarks
  1. Connect the test system to LAN/WLAN/WWAN network.
  2. Download NetworkReliability ATS script from ATS admin Console.
  3. Extract the NetworkReliability ATS script.
  4. A sample of 4 input files is available in NetworkReliability --> ATS Sys Files --> resources folder.
  5. Open NetworkReliabilityInfo.txt and edit the FTP server details, network server details, time as 60 secs and PM repeat as 10 trails for suspend, hibernate and restart and save it.
  6. Open FTPFileList.txt to include a test file available in the FTP location.
  7. Open NetworkFileList.txt to include a test file available in the Network location.
  8. Open HTTPFileList.txt and include the web download location for e.g; http://www.wswd.net/testdownloadfiles/20MB.zip
  9. Right Click Set Execution Policy_Bypass.bat file and click on Run as Administrator in ATS Sys Files folder.
  10. Right Click the NetworkReliability.ps1 file and select Run with powershell.
  11. The script starts execution.
  12. Once completed a pop-up appears "Test Completed". Click Ok to save logs.
System should connect to network successfully



















Once completed open NetworkReliability_DevLog.htm and validate for error and failures.
Complete this test for all supported OS for the product, and attach the log files in the below table.

OS / Adapter Windows 8.1 Windows 7-32 bit Windows 7-64 bit
LAN
WLAN
WWAN


Overnight test
Procedure Expected Result Remarks
  1. Connect the test system to LAN/WLAN/WWAN network.
  2. Download NetworkAdapterSpeedTest script from ATS admin Console.
  3. Open Internet browser and load www.youtube.com
  4. Queue video files ina playlist for 6 to 8 hours and start the video .
  5. Extract the NetworkAdapterSpeedTest ATS Script.
  6. Right Click Set Execution Policy_Bypass.bat file and click on Run as Administrator in ATS Sys Files folder.
  7. Right Click the NWAdapterSpeedTest.ps1 file and select Run with powershell.
  8. In the next pop up, select WLAN and Click on the Proceed.
  9. Enter the lower speed of the network adapter based on the connection [ like for e.g, 54 Mbps for 802.11a]
  10. Enter the time for the script to run as 400 minutes.
  11. Wait the for the script to run through and complete.
  12. In the web browser launch another video to play.
System should connect to network successfully



The video should play without any failures.








Once completed open NWAdapterSpeedTest_DevLog.htm and validate for error and failures.
The video should play without any failures.
Complete this test for all supported OS for the product, and attach the log files in the below table.
OS/ Adapter Windows 8.1 Windows 7-32 bit Windows 7-64 bit
LAN
WLAN
WWAN





Reference: For looping youtube videos please use www.infinitelooper.com


OTHER DETAILS
EUT Quantity : a 1. "Please check Error and Warning message in Event Viewer before you start the test case and after you complete the test case, and report it to your team lead."
2. "Perform All Test in Battery Mode (Some of the test items need to perform in AC Mode, follow each Test Case)"
(All Test Activity should be performed with AMT Enabled)
TEMS Reviewer Log:
Review Logs
Keywords:   None
Requirements :   None
Attached files :
Network Performance Test.xlsx - Network Performance Test.xlsx (18691 bytes, ) 07/03/2015
VerifyAutoConnectivityForTablets.zip - VerifyAutoConnectivityForTablets.zip (19781057 bytes, ) 07/03/2015
NetworkReliability.zip - NetworkReliability.zip (133339 bytes, ) 07/03/2015
SetPrerequisites.zip - SetPrerequisites.zip (123466 bytes, ) 07/03/2015
IPConfigVerifyAfterPM.zip - IPConfigVerifyAfterPM.zip (124421 bytes, ) 07/03/2015
NWAdapterSpeedTest.zip - NWAdapterSpeedTest.zip (130019 bytes, ) 07/03/2015

Update History:
This document is not yet modified.