Test Case

Show / Hide direct link   <MAIN> 5402PA: Network : Ethernet / WLAN / WWAN Performance measurement test - PP-80494



Version 1.1
Created on 28/07/2017 07:00:35  by m_komatsu
Last modified on  28/07/2017 14:05:03  by m_komatsu
Summary
Preconditions
Status:   Review Complete
Priority:   Mandatory
BASIC INFORMATION
Section:S/W Test Require attachment:No
Team:Network Group:Test Coverage
Lessons Learned:No Phase:FVT, SVT, SIT
Locations:Inhouse: AWS and Cambridge, Inhouse: AWS, Inhouse: Cambridge, Compal, Flextronics, Quanta, Wistron Owned By:Eiji Ogata/LENOVO
Objective:To measure the various performance related data for Ethernet / WLAN / WWAN communication devices
CRITERIA

- Better performance than the predecessor systems

- Better performance than the competitor systems

Refer the criteria section in the

EUT QUANTITY

Test system with the correct configuration and competetor / predecessor system

EQUIPMENT

- Internet connection

- Necessary SIM cards

- Connectivity with various APs

Critical Attribute:[0] : WLS - Wireless

CONFIGURATION
REFERENCE PROCEDURE
STATISTIC INFO
Operating System Win81-64bit Win81-32bit Win10-32bit Win10-64bit Win7- 64bit Win7- 32bit Total
Test Points
Duration
Workload
# Step actions Win81-64bitWin81-32bitWin10-32bitWin10-64bitWin7- 64bitWin7- 32bit
1 Web Data Download Test AAAAAA
DETAILS
ATTENTION!! Please follow below information.
1. Please check Error and Warning message in Event Viewer before you start the test case and after you complete the test case, and report it to your team lead, then arrange to open defect, if needed.

2. Perform All Test in Battery Mode (Some of the test items need to perform in AC Mode, follow each Test Case).

3. All Test Activity should be performed with AMT Enabled as Default (applicable on vPro enabled systems).

4. Please check Usability / Cosmetic issues (correct sentence/appropriate display/etc.) and open defect, if needed.

S.No
Test Items
Win7- 32bit
Win7- 64bit
Win81-32bit
Win81-64bit
Win10-32bit
Win10-64bit
1
Web Data Download Test
2
FTP Data Upload Test
3
FTP Data Download Test
4
Video Playback Test
5
Network Connectivity Verification after Combined PM operations using ATS
6
Network Connectivity Verification after Suspend PM operations using ATS
7
Network Connectivity Verification after Hibernate PM operations using ATS
8
Network Connectivity Verification after Restart PM operations using ATS
9
Network Connectivity Verification after Long Suspend PM operations using ATS
10
Device Detection Verification after PM Operations using ATS
11
Network Connectivity Verification after Connected Standby in Tablets
12
Network Reliability Test using ATS
13
Overnight test

Known Limitations
Restrictions
Information

Test Result:

S.No
Test Items
Adapter Win7-32 bit Win7-64 bit Win8.1-32 bit Win8.1-64 bit Win10-32 bit Win10-64 bit
1
Web Data Download Test LAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
WLAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
WWAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
2
FTP Data Upload Test LAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
WLAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
WWAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
3
FTP Data Download Test LAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
WLAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
WWAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
4
Video Playback Test LAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
WLAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
WWAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
5
Network Connectivity Verification after Combined PM operations using ATS LAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
WLAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
WWAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
6
Network Connectivity Verification after Suspend PM operations using ATS LAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
WLAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
WWAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
7
Network Connectivity Verification after Hibernate PM operations using ATS LAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
WLAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
WWAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
8
Network Connectivity Verification after Restart PM operations using ATS LAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
WLAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
WWAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
9
Network Connectivity Verification after Long Suspend PM operations using ATS LAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
WLAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
WWAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
10
Device Detection Verification after PM Operations using ATS LAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
WLAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
WWAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
11
Network Connectivity Verification after Connected Standby in Tablets LAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
WLAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
WWAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
12
Network Reliability Test using ATS LAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
WLAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
WWAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
13
Overnight test LAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
WLAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
WWAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL

Perform the test with the following APs and attach the result. Cover all the APs listed here.

Cisco Access Point Non-Cisco AP [Netgear / Marvell / other chipset based AP] Apple Airport Extreme
Basic Functionality
Long run

ATS Scripts

Attachment "NWAdapterSpeedTest.zip"can be seen at the bottom of the page.

Attachment "IPConfigVerifyAfterPM.zip"can be seen at the bottom of the page.

Attachment "SetPrerequisites.zip"can be seen at the bottom of the page.

Attachment "NetworkReliability.zip"can be seen at the bottom of the page.

Attachment "VerifyAutoConnectivityForTablets.zip"can be seen at the bottom of the page.

ATS Pre-requsites

Procedure Expected Result Remarks
  1. Download SetPrerequisites ATS script from ATS admin Console.
  2. Extract the SetPrerequisites ATS script.
  3. Right Click Set Execution Policy_Bypass.bat file and click on Run as Administrator in ATS Sys Files folder.
  4. Right Click the SetPrerequisites.ps1 file and select Run with powershell.
  5. The script starts execution.
  6. Click Ok when prompted to restart the system.
This script will disable all PM timers, passowrd pop-up and User access control. Note:

Remove Windows Log-on password for all ATS script executions.

Web Data Download Test

Procedure Expected Result Remarks
  1. Connect the test system to LAN/WLAN/WWAN network.
  2. Launch Internet browser an type in Address bar https://www.thinkbroadband.com/download
  3. Download files of different sizes (5 MB, 10 MB, 20 MB, 50 MB, 100 MB and 200 MB) from the website and measure the time required to download the file.
  4. Check the throughput of the network connection using www.speedtest.net
  5. Open Command prompt as Administrator, type netsh wlan show interface and note down the signal strength.
System should connect to network successfully

Files should be downloaded successfully

Complete this test for all supported OS for the product, tabulate the results in the below format and include in test report.

FTP Data Upload Test

Procedure Expected Result Remarks
  1. Connect the test system to LAN/WLAN/WWAN network.
  2. Download and Install FTP client [For e.g., FileZilla]
  3. Connect to a FTP server.
  4. Upload files of different sizes (5 MB, 10 MB, 20 MB, 50 MB, 100 MB and 200 MB) and Measure the time required to upload the files.
  5. Check the throughput of the network connection using www.speedtest.net
  6. Open Command prompt as Administrator, type netsh wlan show interface and note down the signal strength.
System should connect to network successfully

Files should be uploaded successfully

Complete this test for all supported OS for the product, tabulate the results in the below format and include in test report.

FTP Data Download Test

Procedure Expected Result Remarks
  1. Connect the test system to LAN/WLAN/WWAN network.
  2. Download and Install FTP client [For e.g., FileZilla]
  3. Connect to a FTP server.
  4. Upload files of different sizes (5 MB, 10 MB, 20 MB, 50 MB, 100 MB and 200 MB) and Measure the time required to upload the files.
  5. Check the throughput of the network connection using www.speedtest.net
  6. Open Command prompt as Administrator, type netsh wlan show interface and note down the signal strength.
System should connect to network successfully

Files should be downloaded successfully

Complete this test for all supported OS for the product, tabulate the results in the below format and include in test report.

Performance Test Results:

OS/ Adapter Windows 8.1/10 Windows 7-32 bit Windows 7-64 bit
LAN
WLAN
WWAN

Sample:

Attachment "Network Performance Test.xlsx"can be seen at the bottom of the page.

Video Playback Test

Procedure Expected Result Remarks
  1. Connect the test system to LAN/WLAN/WWAN network.
  2. Download NetworkAdapterSpeedTest script from ATS admin Console.
  3. Open Internet browser and load www.youtube.com
  4. Play video files for over 40 minutes.
  5. Extract the NetworkAdapterSpeedTest ATS Script.
  6. Right Click Set Execution Policy_Bypass.bat file and click on Run as Administrator in ATS Sys Files folder.
  7. Right Click the NWAdapterSpeedTest.ps1 file and select Run with powershell.
  8. In the next pop up, select WLAN and Click on the Proceed.
  9. Enter the lower speed of the network adapter based on the connection [ like for e.g, 54 Mbps for 802.11a]
  10. Enter the time for the script to run as 60 minutes.
  11. Wait the for the script to run through and complete.
  12. In the web browser launch another video to play.
System should connect to network successfully

The video should play without any failures.

Once completed open NWAdapterSpeedTest_DevLog.htm and validate for error and failures.

The video should play without any failures.

Complete this test for all supported OS for the product, and attach the log files in the below table.

OS/ Adapter Windows 8.1/10 Windows 7-32 bit Windows 7-64 bit
LAN
WLAN
WWAN

Reference:

ECR231950 FT:WL2:W7:Verizon network loses connection when browsing internet for over 30 minutes

Network Connectivity Verification after Combined PM operations using ATS

Procedure Expected Result Remarks
  1. Connect the test system to LAN/WLAN/WWAN network.
  2. Download IPConfigAfterPM ATS script from ATS admin Console.
  3. Extract the IPConfigAfterPM ATS script.
  4. Right Click Set Execution Policy_Bypass.bat file and click on Run as Administrator in ATS Sys Files folder.
  5. Right Click the IPConfigAfterPM.ps1 file and select Run with powershell.
  6. Enter the input as, Test mode: Silent, Loop count: 50, S3 resume time: 60, S3 Elapse time: 60, S4 resume time: 60, S4 Elapse time: 60 and Restart Elapse time: 120 seconds.
  7. Click S3, S4 and R to select S3, S4, restart for test and Click ok.
  8. The script starts execution.
  9. Once completed a pop-up appears "Test Completed". Click Ok to save logs.
System should connect to network successfully

Once completed open IPConfigAfterPM_DevLog.htm and validate for error and failures.

Complete this test for all supported OS for the product, and attach the log files in the below table.

OS/ Adapter Windows 8.1/10 Windows 7-32 bit Windows 7-64 bit
LAN
WLAN
WWAN

Reference:

ECR235556 FT:WL2:W7:BSOD 7E[iusb3xhc.sys] encountered during IPConfigVerifyAfterPM(S3,S4 and R) ATS Long run with WWAN connected

Network Connectivity Verification after Suspend PM operations using ATS

Procedure Expected Result Remarks
  1. Connect the test system to LAN/WLAN/WWAN network.
  2. Download IPConfigAfterPM ATS script from ATS admin Console.
  3. Extract the IPConfigAfterPM ATS script.
  4. Right Click Set Execution Policy_Bypass.bat file and click on Run as Administrator in ATS Sys Files folder.
  5. Right Click the IPConfigAfterPM.ps1 file and select Run with powershell.
  6. Enter the input as, Test mode: Silent, Loop count: 100, S3 resume time: 60, S3 Elapse time: 60,
  7. Click S3 to select Suspend for test and Click ok.
  8. The script starts execution.
  9. Once completed a pop-up appears "Test Completed". Click Ok to save logs.
System should connect to network successfully

Once completed open IPConfigAfterPM_DevLog.htm and validate for error and failures.

Complete this test for all supported OS for the product, and attach the log files in the below table.

OS/ Adapter Windows 8.1/10 Windows 7-32 bit Windows 7-64 bit
LAN
WLAN
WWAN

Reference:

E545: Light of Christ Catholic School District: After S3 Unable to connect to network

X1 Carbon 2nd Gen: American Honda Motor: X1C Gen2 Intel 7260 AC wont reconnect after suspend/resume

ThinkPad Yoga: Isidore Newman School: TP Yoga Intel 7260 AC can't connect after suspend/resume

Network Connectivity Verification after Hibernate PM operations using ATS

Procedure Expected Result Remarks
  1. Connect the test system to LAN/WLAN/WWAN network.
  2. Download IPConfigAfterPM ATS script from ATS admin Console.
  3. Extract the IPConfigAfterPM ATS script.
  4. Right Click Set Execution Policy_Bypass.bat file and click on Run as Administrator in ATS Sys Files folder.
  5. Right Click the IPConfigAfterPM.ps1 file and select Run with powershell.
  6. Enter the input as, Test mode: Silent, Loop count: 100, S4 resume time: 60, S4 Elapse time: 60,
  7. Click S4 to select Hibernate for test and Click ok.
  8. The script starts execution.
  9. Once completed a pop-up appears "Test Completed". Click Ok to save logs.
System should connect to network successfully

Once completed open IPConfigAfterPM_DevLog.htm and validate for error and failures.

Complete this test for all supported OS for the product, and attach the log files in the below table.

OS/ Adapter Windows 8.1/10 Windows 7-32 bit Windows 7-64 bit
LAN
WLAN
WWAN

Reference:

ECR224153 FT:WL1:Win8.1: Gobi5000 yellow mark on Device Manager after S4/Resume

Network Connectivity Verification after Restart PM operations using ATS

Procedure Expected Result Remarks
  1. Connect the test system to LAN/WLAN/WWAN network.
  2. Download IPConfigAfterPM ATS script from ATS admin Console.
  3. Extract the IPConfigAfterPM ATS script.
  4. Right Click Set Execution Policy_Bypass.bat file and click on Run as Administrator in ATS Sys Files folder.
  5. Right Click the IPConfigAfterPM.ps1 file and select Run with powershell.
  6. Enter the input as, Test mode: Silent, Loop count: 100, R Elapse time: 120,
  7. Click R to select Restart for test and Click ok.
  8. The script starts execution.
  9. Once completed a pop-up appears "Test Completed". Click Ok to save logs.
System should connect to network successfully

Once completed open IPConfigAfterPM_DevLog.htm and validate for error and failures.

Complete this test for all supported OS for the product, and attach the log files in the below table.

OS/ Adapter Windows 8.1/10 Windows 7-32 bit Windows 7-64 bit
LAN
WLAN
WWAN

Reference:

ECR226969 FT:MQ2:W7: Verizon not detected in VANUI and AC (unknown) intermittently after restart with ATS

ECR220750 FT:Ella:EM7345 device yellow bang intermittently in DM with error code 10 after restart PM using ATS FR:<5%

Network Connectivity Verification after Long Suspend PM operations using ATS

Procedure Expected Result Remarks
  1. Connect the test system to LAN/WLAN/WWAN network.
  2. Download IPConfigAfterPM ATS script from ATS admin Console.
  3. Extract the IPConfigAfterPM ATS script.
  4. Right Click Set Execution Policy_Bypass.bat file and click on Run as Administrator in ATS Sys Files folder.
  5. Right Click the IPConfigAfterPM.ps1 file and select Run with powershell.
  6. Enter the input as, Test mode: Silent, Loop count: 10, S3 resume time: 1800, S4 Elapse time: 300,
  7. Click R to select Restart for test and Click ok.
  8. The script starts execution.
  9. Once completed a pop-up appears "Test Completed". Click Ok to save logs.
System should connect to network successfully

Once completed open IPConfigAfterPM_DevLog.htm and validate for error and failures.

Complete this test for all supported OS for the product, and attach the log files in the below table.

OS/ Adapter Windows 8.1/10 Windows 7-32 bit Windows 7-64 bit
LAN
WLAN
WWAN

Reference:

ECR300627 FT:Helix:W8.1: ATT Mobile broadband not detected intermittently after S3 resume FR:30%

Device Detection Verification after PM Operations using ATS

Procedure Expected Result Remarks
  1. Connect the test system to LAN/WLAN/WWAN network.
  2. Download DeviceDetectPM ATS script from ATS admin Console.
  3. Extract the DeviceDetectPM ATS script.
  4. Right Click Set Execution Policy_Bypass.bat file and click on Run as Administrator in ATS Sys Files folder.
  5. Right Click the DeviceDetectPM.ps1 file and select Run with powershell.
  6. Enter the input as, Loop count: 50,
  7. The script starts execution.
  8. Once completed a pop-up appears "Test Completed". Click Ok to save logs.
System should connect to network successfully

Once completed open DeviceDetectPM_DevLog.htm and validate for error and failures.

Complete this test for all supported OS for the product, and attach the log files in the below table.

OS / Adapter Windows 8.1/10 Windows 7-32 bit Windows 7-64 bit
LAN
WLAN
WWAN

Network Connectivity Verification after PM operations in Tablets

Procedure Expected Result Remarks
System Preparation:
  1. Connect the test system to LAN/WLAN/WWAN network.
  2. Download VerifyAutoConnectivityForTablets ATS script from ATS admin Console.
  3. Extract the VerifyAutoConnectivityForTablets ATS script.
  4. Launch Computer management console --> Local Users and Groups --> Users, Right-Click on Administrator account and select Properties.
  5. Uncheck the Account is disabled option and click Apply and OK.
  6. Right-Click on Current user account and Select Properties.
  7. Check the Account is disabled option and click Apply and OK.
  8. Navigate to VerifyAutoConnectivityForTablets --> ATS Sys Files --> resources --> WDTF Runtime --> Runtimes, Right-Click on WDTF Runtime Install.bat and select Run as Administrator.
  9. Wait for the installation to Complete.
  10. Launch Computer management console --> Local Users and Groups --> Users, Right-Click on Administrator account and select Properties.
  11. Check the Account is disabled option and click Apply and OK.
  12. Right-Click on Current user account and Select Properties.
  13. Uncheck the Account is disabled option and click Apply and OK.
Test Procedure for Connected Standby:
  1. Open VerifyAutoConnectivityForTablets ATS script folder
  2. Right Click Set Execution Policy_Bypass.bat file and click on Run as Administrator in ATS Sys Files folder.
  3. Right Click the VerifyAutoConnectivityForTablets.ps1 file and select Run with powershell.
  4. Enter the input as, Test mode: Silent, Loop count: 100, Connected Standby resume time: 60, Connected Standby Elapse time: 60 and Click Ok
  5. The script starts execution.
  6. Once completed a pop-up appears "Test Completed". Click Ok to save logs.
Test Procedure for Restart
  1. Open IPConfigAfterPM ATS script folder
  2. Right Click Set Execution Policy_Bypass.bat file and click on Run as Administrator in ATS Sys Files folder.
  3. Right Click the IPConfigAfterPM.ps1 file and select Run with powershell.
  4. Enter the input as, Test mode: Silent, Select R for Restart only, Loop count: 100, Restart Elapse time: 120 and Click Ok
  5. The script starts execution.
  6. Once completed a pop-up appears "Test Completed". Click Ok to save logs.
System should connect to network successfully

Open Programs and Features and ensure "Windows Driver Testing Framework (WDTF) Runtime Libraries" is installed.

Once completed open VerifyAutoConnectivityForTablets_DevLog.htm and validate for error and failures.

Once completed open IPConfigAfterPM_DevLog.htm and validate for error and failures.

Complete this test for all supported OS for the product, and attach the log files in the below table.

OS/Adapter latest version
LAN
WLAN
WWAN

OS/Adapter latest version
LAN
WLAN
WWAN

Network Reliability Test using ATS

Procedure Expected Result Remarks
  1. Connect the test system to LAN/WLAN/WWAN network.
  2. Download NetworkReliability ATS script from ATS admin Console.
  3. Extract the NetworkReliability ATS script.
  4. A sample of 4 input files is available in NetworkReliability --> ATS Sys Files --> resources folder.
  5. Open NetworkReliabilityInfo.txt and edit the FTP server details, network server details, time as 60 secs and PM repeat as 10 trails for suspend, hibernate and restart and save it.
  6. Open FTPFileList.txt to include a test file available in the FTP location.
  7. Open NetworkFileList.txt to include a test file available in the Network location.
  8. Open HTTPFileList.txt and include the web download location for e.g; http://www.wswd.net/testdownloadfiles/20MB.zip
  9. Right Click Set Execution Policy_Bypass.bat file and click on Run as Administrator in ATS Sys Files folder.
  10. Right Click the NetworkReliability.ps1 file and select Run with powershell.
  11. The script starts execution.
  12. Once completed a pop-up appears "Test Completed". Click Ok to save logs.
System should connect to network successfully

Once completed open NetworkReliability_DevLog.htm and validate for error and failures.

Complete this test for all supported OS for the product, and attach the log files in the below table.

OS / Adapter Windows 8.1/10 Windows 7-32 bit Windows 7-64 bit
LAN
WLAN
WWAN

Overnight test

Procedure Expected Result Remarks
  1. Connect the test system to LAN/WLAN/WWAN network.
  2. Download NetworkAdapterSpeedTest script from ATS admin Console.
  3. Open Internet browser and load www.youtube.com
  4. Queue video files ina playlist for 6 to 8 hours and start the video .
  5. Extract the NetworkAdapterSpeedTest ATS Script.
  6. Right Click Set Execution Policy_Bypass.bat file and click on Run as Administrator in ATS Sys Files folder.
  7. Right Click the NWAdapterSpeedTest.ps1 file and select Run with powershell.
  8. In the next pop up, select WLAN and Click on the Proceed.
  9. Enter the lower speed of the network adapter based on the connection [ like for e.g, 54 Mbps for 802.11a]
  10. Enter the time for the script to run as 400 minutes.
  11. Wait the for the script to run through and complete.
  12. In the web browser launch another video to play.
System should connect to network successfully

The video should play without any failures.

Once completed open NWAdapterSpeedTest_DevLog.htm and validate for error and failures.

The video should play without any failures.

Complete this test for all supported OS for the product, and attach the log files in the below table.

OS/ Adapter Windows 8.1/10 Windows 7-32 bit Windows 7-64 bit
LAN
WLAN
WWAN

Reference: For looping youtube videos please use www.infinitelooper.com

Reference:

ThinkPad Yoga: Deloitte- randomly lose connection and limited connection. recovers in 2 to 5 mins

X1 Carbon 2nd Gen: PWC: - randomly lose connection and limited connection

OTHER DETAILS

EUT Quantity : Test system with the correct configuration and competetor / predecessor system 1. "Please check Error and Warning message in Event Viewer before you start the test case and after you complete the test case, and report it to your team lead."

2. "Perform All Test in Battery Mode (Some of the test items need to perform in AC Mode, follow each Test Case)" (All Test Activity should be performed with AMT Enabled)

3. If you observed error log against ATS process, Please reconfirm it manually.

TEMS Reviewer Log:
Review Logs
Created last 2017-07-28 09:19:27 by Eiji Ogata. Review Comments(Review Complete): review completed.
Keywords:   None
Requirements :   None
Attached files :
Network Performance Test.xlsx - Network Performance Test.xlsx (18691 bytes, ) 07/03/2015
VerifyAutoConnectivityForTablets.zip - VerifyAutoConnectivityForTablets.zip (19781057 bytes, ) 07/03/2015
NetworkReliability.zip - NetworkReliability.zip (133339 bytes, ) 07/03/2015
SetPrerequisites.zip - SetPrerequisites.zip (123466 bytes, ) 07/03/2015
IPConfigVerifyAfterPM.zip - IPConfigVerifyAfterPM.zip (124421 bytes, ) 07/03/2015
NWAdapterSpeedTest.zip - NWAdapterSpeedTest.zip (130019 bytes, ) 07/03/2015
Update History:
Modified last: 2017-07-28 14:05:03.68077, by Miyuki Komatsu, Corrected current download site
Version Update History:
2017-07-28 07:00:35, Version 1.1, m_komatsu, Download site updated

Other versions
Version 1


Version 1
Created on 31/10/2014 14:33:07  by Muralidharan Seshadri
Last modified on  05/07/2016 16:08:51  by m_komatsu_nw
Summary
Preconditions
Status:   Review Complete
Priority:  
BASIC INFORMATION
Section:S/W Test Require attachment:No
Team:Network Group:Test Coverage
Lessons Learned:No Phase:FVT, SVT, SIT
Locations:Inhouse: AWS and Cambridge, Inhouse: AWS, Inhouse: Cambridge, Compal, Flextronics, Quanta, Wistron Owned By:Eiji Ogata/LENOVO
Objective:To measure the various performance related data for Ethernet / WLAN / WWAN communication devices
CRITERIA

- Better performance than the predecessor systems

- Better performance than the competitor systems

Refer the criteria section in the

EUT QUANTITY

Test system with the correct configuration and competetor / predecessor system

EQUIPMENT

- Internet connection

- Necessary SIM cards

- Connectivity with various APs

Critical Attribute:[0] : WLS - Wireless

CONFIGURATION
REFERENCE PROCEDURE
STATISTIC INFO
Operating System Win81-64bit Win81-32bit Win10-32bit Win10-64bit Win7- 64bit Win7- 32bit Total
Test Points
Duration
Workload
# Step actions Win81-64bitWin81-32bitWin10-32bitWin10-64bitWin7- 64bitWin7- 32bit
1 Web Data Download Test AAAAAA
DETAILS
ATTENTION!! Please follow below information.
1. Please check Error and Warning message in Event Viewer before you start the test case and after you complete the test case, and report it to your team lead, then arrange to open defect, if needed.

2. Perform All Test in Battery Mode (Some of the test items need to perform in AC Mode, follow each Test Case).

3. All Test Activity should be performed with AMT Enabled as Default (applicable on vPro enabled systems).

4. Please check Usability / Cosmetic issues (correct sentence/appropriate display/etc.) and open defect, if needed.

S.No
Test Items
Win7- 32bit
Win7- 64bit
Win81-32bit
Win81-64bit
Win10-32bit
Win10-64bit
1
Web Data Download Test
2
FTP Data Upload Test
3
FTP Data Download Test
4
Video Playback Test
5
Network Connectivity Verification after Combined PM operations using ATS
6
Network Connectivity Verification after Suspend PM operations using ATS
7
Network Connectivity Verification after Hibernate PM operations using ATS
8
Network Connectivity Verification after Restart PM operations using ATS
9
Network Connectivity Verification after Long Suspend PM operations using ATS
10
Device Detection Verification after PM Operations using ATS
11
Network Connectivity Verification after Connected Standby in Tablets
12
Network Reliability Test using ATS
13
Overnight test

Known Limitations
Restrictions
Information

Test Result:

S.No
Test Items
Adapter Win7-32 bit Win7-64 bit Win8.1-32 bit Win8.1-64 bit Win10-32 bit Win10-64 bit
1
Web Data Download Test LAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
WLAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
WWAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
2
FTP Data Upload Test LAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
WLAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
WWAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
3
FTP Data Download Test LAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
WLAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
WWAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
4
Video Playback Test LAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
WLAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
WWAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
5
Network Connectivity Verification after Combined PM operations using ATS LAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
WLAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
WWAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
6
Network Connectivity Verification after Suspend PM operations using ATS LAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
WLAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
WWAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
7
Network Connectivity Verification after Hibernate PM operations using ATS LAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
WLAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
WWAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
8
Network Connectivity Verification after Restart PM operations using ATS LAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
WLAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
WWAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
9
Network Connectivity Verification after Long Suspend PM operations using ATS LAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
WLAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
WWAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
10
Device Detection Verification after PM Operations using ATS LAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
WLAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
WWAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
11
Network Connectivity Verification after Connected Standby in Tablets LAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
WLAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
WWAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
12
Network Reliability Test using ATS LAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
WLAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
WWAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
13
Overnight test LAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
WLAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL
WWAN PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL PASS / FAIL

Perform the test with the following APs and attach the result. Cover all the APs listed here.

Cisco Access Point Non-Cisco AP [Netgear / Marvell / other chipset based AP] Apple Airport Extreme
Basic Functionality
Long run

ATS Scripts

Attachment "NWAdapterSpeedTest.zip"can be seen at the bottom of the page.

Attachment "IPConfigVerifyAfterPM.zip"can be seen at the bottom of the page.

Attachment "SetPrerequisites.zip"can be seen at the bottom of the page.

Attachment "NetworkReliability.zip"can be seen at the bottom of the page.

Attachment "VerifyAutoConnectivityForTablets.zip"can be seen at the bottom of the page.

ATS Pre-requsites

Procedure Expected Result Remarks
  1. Download SetPrerequisites ATS script from ATS admin Console.
  2. Extract the SetPrerequisites ATS script.
  3. Right Click Set Execution Policy_Bypass.bat file and click on Run as Administrator in ATS Sys Files folder.
  4. Right Click the SetPrerequisites.ps1 file and select Run with powershell.
  5. The script starts execution.
  6. Click Ok when prompted to restart the system.
This script will disable all PM timers, passowrd pop-up and User access control. Note:

Remove Windows Log-on password for all ATS script executions.

Web Data Download Test

Procedure Expected Result Remarks
  1. Connect the test system to LAN/WLAN/WWAN network.
  2. Launch Internet browser an type in Address bar https://clients.wswd.net/testdownloadfiles.php
  3. Download files of different sizes (5 MB, 10 MB, 20 MB, 50 MB, 100 MB and 200 MB) from the website and measure the time required to download the file.
  4. Check the throughput of the network connection using www.speedtest.net
  5. Open Command prompt as Administrator, type netsh wlan show interface and note down the signal strength.
System should connect to network successfully

Files should be downloaded successfully

Complete this test for all supported OS for the product, tabulate the results in the below format and include in test report.

FTP Data Upload Test

Procedure Expected Result Remarks
  1. Connect the test system to LAN/WLAN/WWAN network.
  2. Download and Install FTP client [For e.g., FileZilla]
  3. Connect to a FTP server.
  4. Upload files of different sizes (5 MB, 10 MB, 20 MB, 50 MB, 100 MB and 200 MB) and Measure the time required to upload the files.
  5. Check the throughput of the network connection using www.speedtest.net
  6. Open Command prompt as Administrator, type netsh wlan show interface and note down the signal strength.
System should connect to network successfully

Files should be uploaded successfully

Complete this test for all supported OS for the product, tabulate the results in the below format and include in test report.

FTP Data Download Test

Procedure Expected Result Remarks
  1. Connect the test system to LAN/WLAN/WWAN network.
  2. Download and Install FTP client [For e.g., FileZilla]
  3. Connect to a FTP server.
  4. Upload files of different sizes (5 MB, 10 MB, 20 MB, 50 MB, 100 MB and 200 MB) and Measure the time required to upload the files.
  5. Check the throughput of the network connection using www.speedtest.net
  6. Open Command prompt as Administrator, type netsh wlan show interface and note down the signal strength.
System should connect to network successfully

Files should be downloaded successfully

Complete this test for all supported OS for the product, tabulate the results in the below format and include in test report.

Performance Test Results:

OS/ Adapter Windows 8.1/10 Windows 7-32 bit Windows 7-64 bit
LAN
WLAN
WWAN

Sample:

Attachment "Network Performance Test.xlsx"can be seen at the bottom of the page.

Video Playback Test

Procedure Expected Result Remarks
  1. Connect the test system to LAN/WLAN/WWAN network.
  2. Download NetworkAdapterSpeedTest script from ATS admin Console.
  3. Open Internet browser and load www.youtube.com
  4. Play video files for over 40 minutes.
  5. Extract the NetworkAdapterSpeedTest ATS Script.
  6. Right Click Set Execution Policy_Bypass.bat file and click on Run as Administrator in ATS Sys Files folder.
  7. Right Click the NWAdapterSpeedTest.ps1 file and select Run with powershell.
  8. In the next pop up, select WLAN and Click on the Proceed.
  9. Enter the lower speed of the network adapter based on the connection [ like for e.g, 54 Mbps for 802.11a]
  10. Enter the time for the script to run as 60 minutes.
  11. Wait the for the script to run through and complete.
  12. In the web browser launch another video to play.
System should connect to network successfully

The video should play without any failures.

Once completed open NWAdapterSpeedTest_DevLog.htm and validate for error and failures.

The video should play without any failures.

Complete this test for all supported OS for the product, and attach the log files in the below table.

OS/ Adapter Windows 8.1/10 Windows 7-32 bit Windows 7-64 bit
LAN
WLAN
WWAN

Reference:

ECR231950 FT:WL2:W7:Verizon network loses connection when browsing internet for over 30 minutes

Network Connectivity Verification after Combined PM operations using ATS

Procedure Expected Result Remarks
  1. Connect the test system to LAN/WLAN/WWAN network.
  2. Download IPConfigAfterPM ATS script from ATS admin Console.
  3. Extract the IPConfigAfterPM ATS script.
  4. Right Click Set Execution Policy_Bypass.bat file and click on Run as Administrator in ATS Sys Files folder.
  5. Right Click the IPConfigAfterPM.ps1 file and select Run with powershell.
  6. Enter the input as, Test mode: Silent, Loop count: 50, S3 resume time: 60, S3 Elapse time: 60, S4 resume time: 60, S4 Elapse time: 60 and Restart Elapse time: 120 seconds.
  7. Click S3, S4 and R to select S3, S4, restart for test and Click ok.
  8. The script starts execution.
  9. Once completed a pop-up appears "Test Completed". Click Ok to save logs.
System should connect to network successfully

Once completed open IPConfigAfterPM_DevLog.htm and validate for error and failures.

Complete this test for all supported OS for the product, and attach the log files in the below table.

OS/ Adapter Windows 8.1/10 Windows 7-32 bit Windows 7-64 bit
LAN
WLAN
WWAN

Reference:

ECR235556 FT:WL2:W7:BSOD 7E[iusb3xhc.sys] encountered during IPConfigVerifyAfterPM(S3,S4 and R) ATS Long run with WWAN connected

Network Connectivity Verification after Suspend PM operations using ATS

Procedure Expected Result Remarks
  1. Connect the test system to LAN/WLAN/WWAN network.
  2. Download IPConfigAfterPM ATS script from ATS admin Console.
  3. Extract the IPConfigAfterPM ATS script.
  4. Right Click Set Execution Policy_Bypass.bat file and click on Run as Administrator in ATS Sys Files folder.
  5. Right Click the IPConfigAfterPM.ps1 file and select Run with powershell.
  6. Enter the input as, Test mode: Silent, Loop count: 100, S3 resume time: 60, S3 Elapse time: 60,
  7. Click S3 to select Suspend for test and Click ok.
  8. The script starts execution.
  9. Once completed a pop-up appears "Test Completed". Click Ok to save logs.
System should connect to network successfully

Once completed open IPConfigAfterPM_DevLog.htm and validate for error and failures.

Complete this test for all supported OS for the product, and attach the log files in the below table.

OS/ Adapter Windows 8.1/10 Windows 7-32 bit Windows 7-64 bit
LAN
WLAN
WWAN

Reference:

E545: Light of Christ Catholic School District: After S3 Unable to connect to network

X1 Carbon 2nd Gen: American Honda Motor: X1C Gen2 Intel 7260 AC wont reconnect after suspend/resume

ThinkPad Yoga: Isidore Newman School: TP Yoga Intel 7260 AC can't connect after suspend/resume

Network Connectivity Verification after Hibernate PM operations using ATS

Procedure Expected Result Remarks
  1. Connect the test system to LAN/WLAN/WWAN network.
  2. Download IPConfigAfterPM ATS script from ATS admin Console.
  3. Extract the IPConfigAfterPM ATS script.
  4. Right Click Set Execution Policy_Bypass.bat file and click on Run as Administrator in ATS Sys Files folder.
  5. Right Click the IPConfigAfterPM.ps1 file and select Run with powershell.
  6. Enter the input as, Test mode: Silent, Loop count: 100, S4 resume time: 60, S4 Elapse time: 60,
  7. Click S4 to select Hibernate for test and Click ok.
  8. The script starts execution.
  9. Once completed a pop-up appears "Test Completed". Click Ok to save logs.
System should connect to network successfully

Once completed open IPConfigAfterPM_DevLog.htm and validate for error and failures.

Complete this test for all supported OS for the product, and attach the log files in the below table.

OS/ Adapter Windows 8.1/10 Windows 7-32 bit Windows 7-64 bit
LAN
WLAN
WWAN

Reference:

ECR224153 FT:WL1:Win8.1: Gobi5000 yellow mark on Device Manager after S4/Resume

Network Connectivity Verification after Restart PM operations using ATS

Procedure Expected Result Remarks
  1. Connect the test system to LAN/WLAN/WWAN network.
  2. Download IPConfigAfterPM ATS script from ATS admin Console.
  3. Extract the IPConfigAfterPM ATS script.
  4. Right Click Set Execution Policy_Bypass.bat file and click on Run as Administrator in ATS Sys Files folder.
  5. Right Click the IPConfigAfterPM.ps1 file and select Run with powershell.
  6. Enter the input as, Test mode: Silent, Loop count: 100, R Elapse time: 120,
  7. Click R to select Restart for test and Click ok.
  8. The script starts execution.
  9. Once completed a pop-up appears "Test Completed". Click Ok to save logs.
System should connect to network successfully

Once completed open IPConfigAfterPM_DevLog.htm and validate for error and failures.

Complete this test for all supported OS for the product, and attach the log files in the below table.

OS/ Adapter Windows 8.1/10 Windows 7-32 bit Windows 7-64 bit
LAN
WLAN
WWAN

Reference:

ECR226969 FT:MQ2:W7: Verizon not detected in VANUI and AC (unknown) intermittently after restart with ATS

ECR220750 FT:Ella:EM7345 device yellow bang intermittently in DM with error code 10 after restart PM using ATS FR:<5%

Network Connectivity Verification after Long Suspend PM operations using ATS

Procedure Expected Result Remarks
  1. Connect the test system to LAN/WLAN/WWAN network.
  2. Download IPConfigAfterPM ATS script from ATS admin Console.
  3. Extract the IPConfigAfterPM ATS script.
  4. Right Click Set Execution Policy_Bypass.bat file and click on Run as Administrator in ATS Sys Files folder.
  5. Right Click the IPConfigAfterPM.ps1 file and select Run with powershell.
  6. Enter the input as, Test mode: Silent, Loop count: 10, S3 resume time: 1800, S4 Elapse time: 300,
  7. Click R to select Restart for test and Click ok.
  8. The script starts execution.
  9. Once completed a pop-up appears "Test Completed". Click Ok to save logs.
System should connect to network successfully

Once completed open IPConfigAfterPM_DevLog.htm and validate for error and failures.

Complete this test for all supported OS for the product, and attach the log files in the below table.

OS/ Adapter Windows 8.1/10 Windows 7-32 bit Windows 7-64 bit
LAN
WLAN
WWAN

Reference:

ECR300627 FT:Helix:W8.1: ATT Mobile broadband not detected intermittently after S3 resume FR:30%

Device Detection Verification after PM Operations using ATS

Procedure Expected Result Remarks
  1. Connect the test system to LAN/WLAN/WWAN network.
  2. Download DeviceDetectPM ATS script from ATS admin Console.
  3. Extract the DeviceDetectPM ATS script.
  4. Right Click Set Execution Policy_Bypass.bat file and click on Run as Administrator in ATS Sys Files folder.
  5. Right Click the DeviceDetectPM.ps1 file and select Run with powershell.
  6. Enter the input as, Loop count: 50,
  7. The script starts execution.
  8. Once completed a pop-up appears "Test Completed". Click Ok to save logs.
System should connect to network successfully

Once completed open DeviceDetectPM_DevLog.htm and validate for error and failures.

Complete this test for all supported OS for the product, and attach the log files in the below table.

OS / Adapter Windows 8.1/10 Windows 7-32 bit Windows 7-64 bit
LAN
WLAN
WWAN

Network Connectivity Verification after PM operations in Tablets

Procedure Expected Result Remarks
System Preparation:
  1. Connect the test system to LAN/WLAN/WWAN network.
  2. Download VerifyAutoConnectivityForTablets ATS script from ATS admin Console.
  3. Extract the VerifyAutoConnectivityForTablets ATS script.
  4. Launch Computer management console --> Local Users and Groups --> Users, Right-Click on Administrator account and select Properties.
  5. Uncheck the Account is disabled option and click Apply and OK.
  6. Right-Click on Current user account and Select Properties.
  7. Check the Account is disabled option and click Apply and OK.
  8. Navigate to VerifyAutoConnectivityForTablets --> ATS Sys Files --> resources --> WDTF Runtime --> Runtimes, Right-Click on WDTF Runtime Install.bat and select Run as Administrator.
  9. Wait for the installation to Complete.
  10. Launch Computer management console --> Local Users and Groups --> Users, Right-Click on Administrator account and select Properties.
  11. Check the Account is disabled option and click Apply and OK.
  12. Right-Click on Current user account and Select Properties.
  13. Uncheck the Account is disabled option and click Apply and OK.
Test Procedure for Connected Standby:
  1. Open VerifyAutoConnectivityForTablets ATS script folder
  2. Right Click Set Execution Policy_Bypass.bat file and click on Run as Administrator in ATS Sys Files folder.
  3. Right Click the VerifyAutoConnectivityForTablets.ps1 file and select Run with powershell.
  4. Enter the input as, Test mode: Silent, Loop count: 100, Connected Standby resume time: 60, Connected Standby Elapse time: 60 and Click Ok
  5. The script starts execution.
  6. Once completed a pop-up appears "Test Completed". Click Ok to save logs.
Test Procedure for Restart
  1. Open IPConfigAfterPM ATS script folder
  2. Right Click Set Execution Policy_Bypass.bat file and click on Run as Administrator in ATS Sys Files folder.
  3. Right Click the IPConfigAfterPM.ps1 file and select Run with powershell.
  4. Enter the input as, Test mode: Silent, Select R for Restart only, Loop count: 100, Restart Elapse time: 120 and Click Ok
  5. The script starts execution.
  6. Once completed a pop-up appears "Test Completed". Click Ok to save logs.
System should connect to network successfully

Open Programs and Features and ensure "Windows Driver Testing Framework (WDTF) Runtime Libraries" is installed.

Once completed open VerifyAutoConnectivityForTablets_DevLog.htm and validate for error and failures.

Once completed open IPConfigAfterPM_DevLog.htm and validate for error and failures.

Complete this test for all supported OS for the product, and attach the log files in the below table.

OS/Adapter latest version
LAN
WLAN
WWAN

OS/Adapter latest version
LAN
WLAN
WWAN

Network Reliability Test using ATS

Procedure Expected Result Remarks
  1. Connect the test system to LAN/WLAN/WWAN network.
  2. Download NetworkReliability ATS script from ATS admin Console.
  3. Extract the NetworkReliability ATS script.
  4. A sample of 4 input files is available in NetworkReliability --> ATS Sys Files --> resources folder.
  5. Open NetworkReliabilityInfo.txt and edit the FTP server details, network server details, time as 60 secs and PM repeat as 10 trails for suspend, hibernate and restart and save it.
  6. Open FTPFileList.txt to include a test file available in the FTP location.
  7. Open NetworkFileList.txt to include a test file available in the Network location.
  8. Open HTTPFileList.txt and include the web download location for e.g; http://www.wswd.net/testdownloadfiles/20MB.zip
  9. Right Click Set Execution Policy_Bypass.bat file and click on Run as Administrator in ATS Sys Files folder.
  10. Right Click the NetworkReliability.ps1 file and select Run with powershell.
  11. The script starts execution.
  12. Once completed a pop-up appears "Test Completed". Click Ok to save logs.
System should connect to network successfully

Once completed open NetworkReliability_DevLog.htm and validate for error and failures.

Complete this test for all supported OS for the product, and attach the log files in the below table.

OS / Adapter Windows 8.1/10 Windows 7-32 bit Windows 7-64 bit
LAN
WLAN
WWAN

Overnight test

Procedure Expected Result Remarks
  1. Connect the test system to LAN/WLAN/WWAN network.
  2. Download NetworkAdapterSpeedTest script from ATS admin Console.
  3. Open Internet browser and load www.youtube.com
  4. Queue video files ina playlist for 6 to 8 hours and start the video .
  5. Extract the NetworkAdapterSpeedTest ATS Script.
  6. Right Click Set Execution Policy_Bypass.bat file and click on Run as Administrator in ATS Sys Files folder.
  7. Right Click the NWAdapterSpeedTest.ps1 file and select Run with powershell.
  8. In the next pop up, select WLAN and Click on the Proceed.
  9. Enter the lower speed of the network adapter based on the connection [ like for e.g, 54 Mbps for 802.11a]
  10. Enter the time for the script to run as 400 minutes.
  11. Wait the for the script to run through and complete.
  12. In the web browser launch another video to play.
System should connect to network successfully

The video should play without any failures.

Once completed open NWAdapterSpeedTest_DevLog.htm and validate for error and failures.

The video should play without any failures.

Complete this test for all supported OS for the product, and attach the log files in the below table.

OS/ Adapter Windows 8.1/10 Windows 7-32 bit Windows 7-64 bit
LAN
WLAN
WWAN

Reference: For looping youtube videos please use www.infinitelooper.com

Reference:

ThinkPad Yoga: Deloitte- randomly lose connection and limited connection. recovers in 2 to 5 mins

X1 Carbon 2nd Gen: PWC: - randomly lose connection and limited connection

OTHER DETAILS

EUT Quantity : Test system with the correct configuration and competetor / predecessor system 1. "Please check Error and Warning message in Event Viewer before you start the test case and after you complete the test case, and report it to your team lead."

2. "Perform All Test in Battery Mode (Some of the test items need to perform in AC Mode, follow each Test Case)" (All Test Activity should be performed with AMT Enabled)

3. If you observed error log against ATS process, Please reconfirm it manually.

TEMS Reviewer Log:
Review Logs
Created last 2016-11-30 15:06:13 by Eiji Ogata. Review Comments(Review Complete): review completed.
Keywords:   None
Requirements :   None
Version Update History:
Modified last: 2015-12-16 10:23:04.752, by Yoshihiro Amenomiya
Modified last: 2015-08-14 17:44:14.589, by Yoshihiro Amenomiya
Modified last: 2016-07-05 16:08:51.655, by Miyuki Komatsu_nw, WebTEMS trouble. Status was changed to new.