Test Case

Show / Hide direct link   <MAIN> 5038PA: =Draft=Win 8 / 10 : E2E verification Test for WWAN Test - PP-80493



Version 1
Created on 26/11/2012 11:48:24  by Muralidharan Seshadri
Last modified on  10/06/2016 17:58:15  by m_komatsu_nw
Summary
Preconditions
Status:   New
Priority:   Medium
BASIC INFORMATION
Section:S/W Test Require attachment:No
Team:Network Group:Basic Function
Lessons Learned:No Phase:SVT, SIT
Locations:Inhouse: AWS and Cambridge, Inhouse: AWS, Inhouse: Cambridge, Compal, Flextronics, Quanta, Wistron Owned By:Eiji Ogata/LENOVO
Objective:To verify WWAN functions at the country of support by Geo's.
CRITERIA

All functions to work correctly

EUT QUANTITY

Supported systems.

EQUIPMENT

Necessary SIM, carrier support

Critical Attribute:[0] : WLS - Wireless

CONFIGURATION
REFERENCE PROCEDURE
STATISTIC INFO
Operating System Win10-32bit Win10-64bit Total
Test Points
Duration
Workload
# Step actions Win10-32bitWin10-64bit
1 Lenovo Mobile Access (LMA) ANA
2 Windows Native WWAN Profile AA
3 Profile Connectivity with Wireless Radio & Hardware/Software Switch AA
4 Location Awareness AA
5 Mobile Hotspot AA
6 Third-Party WWAN Application AA
7 Co-existence between Lenovo applications AA
8 Performance measurement AA
9 VPN Connectivity AA
10 Connected Standby Mode Email Verification AA
11 Connected Standby Mode Social Networking Verification AA
DETAILS
ATTENTION!! Please follow below information.
1. Please check Error and Warning message in Event Viewer before you start the test case and after you complete the test case, and report it to your team lead, then arrange to open defect, if needed.

2. Perform All Test in Battery Mode (Some of the test items need to perform in AC Mode, follow each Test Case).

3. All Test Activity should be performed with AMT Enabled as Default (applicable on vPro enabled systems).

4. Please check Usability / Cosmetic issues (correct sentence/appropriate display/etc.) and open defect, if needed.

Lenovo Mobile Access (LMA)

GUI Verification

Test Item Check Item / Criteria
Result
Launch Lenovo Mobile Access thru Metro GUI > click Lenovo Mobile Access icon. - LMA should be launched without any problems.
A
On Lenovo Mobile Access application, confirm that only the following sections are present:

Get Connected Anywhere, Anytime!

Register New Account

Already have an account?

- Confirm that no other sections are present.
A
On Get Connected Anywhere, Anytime! section - Confirm that words/sentences are grammatically / spelled correct.

- Confirm Home Country dropdown is visible and contents are available.

A
On Register New Account section - Confirm the Email, Password, Confirm Password text boxes are available.

- Confirm the Terms of Service's words/sentences are grammatically / spelled correct.

- Confirm the check box "I agree to the terms of service" and Send button are available.

- Confirm the check box "I agree to the terms of service" and Send button are enabled when Email, Password and Confirm Password text boxes were filled.

A
On Already have an account? section - Confirm the Email and Password text boxes are available.

- Confirm that Login button is available

- Confirm that Forgot Password link is available and working.

- Confirm that Login button is enabled when Email and Password text boxes were filled.

A

Windows Native WWAN Profile

WWAN Profile Creation/Connection

Reminder: [Applicable to all carriers]. If NO SIM model, then insert the SIM under test and confirm the connectivity with necessary information like correct Service provider name / service type, logo etc..]

Test Item Check Item / Criteria
Result
1. From Start GUI, go to All Apps > Windows System > Control Panel

2. It will direct to Desktop > with Control Panel window viewed.

3. From Control Panel, go to Network and Internet.

4. Under Network and Sharing Center, click Connect to a network link.

5. Networks window pane will show in the right side of the desktop.

or

1. From Start GUI, click Desktop

2. It will direct to Desktop.

3. From Desktop, taskbar > left click Connect to a network icon.

4. Networks window pane will show in the right side of the desktop.

- OS / Windows Native should show / launch properly. (please enter Check Item / Criteria results here)
1. Under Mobile Broadband section, default WWAN profile with connectivity state is shown. (depends on the SIM card inserted)

The following should also be shown:

- Estimated usage and Reset link

- Connect automatically checkbox

- Allow data roaming checkbox (if roaming SIM card was inserted)

2. Connect the default WWAN profile.

- Select the default profile and click Connect button.

3. Right click default WWAN profile. The following options should show:

· Hide/Show estimated data usage

· Set as non-metered connection

· Forget this network

· View connection properties

4. Select View Connection properties. Mobile Broadband properties window will show:

- In Subscription tab, provider details and subscriber information should correctly show

- In Profile tab, Access point, APN, and other details shows correctly

- In Roaming tab (if roaming SIM was inserted), scanning and correct roaming carrier partners should show after.

- In Security tab, SIM PIN enabling is shown.

5. With Qualcomm Adapter connect to both EVDO and HSPA mode in live network

Gobi 3000:

- Switch between Verizon/Sprint (EVDO) profile and AT&T (HSPA) profile for 10 trials

- Browse internet in both the modes.

Gobi 3000 and 4000 MC7750:

- Switch between Verizon/Sprint (EVDO) profile using Gobi 3000 and Verizon LTE (HSPA) profile using Gobi 4000 MC7750 for 10 trials.

- Browse internet in both the modes.

- Confirm that connectivity state is shown in the right portion of default WWAN profile. (i.e. Roaming, Home, Locked - if SIM has PIN enabled)

- Confirm the default WWAN profile was automatically created.

- Confirm profile was successfully connected.

- Confirm that connection type shows when mouse hover connected profile. (i.e. HSPA, UMTS, EVDO, GPRS)

- Confirm that the following information shows correctly in WWAN properties.

- Confirm that EVDO and HSPA switching profiles are working properly.

(please enter Check Item / Criteria results here)
PIN Enabled/ PUK Blocked Condition

1. Insert working / activated SIM in the system.

2. Right click WWAN profile in Connect to the internet window panel.

3. Select View connection properties

4. Mobile Broadband Properties will show.

5. Go to Security tab, click Enable PIN button.

6. Enter correct PIN to enable PIN.

7. Reboot machine.

8. Connect to WWAN profile in windows native.

9. Enter PIN should show.

10. Enter the correct PIN and click OK

11. WWAN profile should connect successfully.

12. Repeat steps 1-11 with PUK blocked SIM.

- No error should appear while enter PUK / PIN

- Windows Native should connect to WAN profile successfully

- Confirm that the WAN connection is successful with Windows Mobile Broadband

-Confirm that Properties window shows correct information and all functions are working fine.

(please enter Check Item / Criteria results here)

Power Management

Test Item Check Item / Criteria
Result
1. Suspend the system - System should enter suspend mode (please enter Check Item / Criteria results here)
2. Wakeup the system after 1 minute - System should resume/wake-up

- No BSOD, error messages, crash should happen after suspend/resume.

(please enter Check Item / Criteria results here)
3. Connect to the service provider - Connection should be established

- Connection should not be disconnected without pressing the disconnect button/or signal is available

(please enter Check Item / Criteria results here)
4. Repeat steps 1-3 for 20 times - No system crash

- No BSOD, error message should occur

(please enter Check Item / Criteria results here)
Steps 5-8 is for Thinkpad notebooks

5. Suspend system by LID close

- System should enter suspend mode (please enter Check Item / Criteria results here)
6. LID open the system after 1 minute - System should resume

- No BSOD, error messages, crash should happen after lid close/lid open.

(please enter Check Item / Criteria results here)
7. Connect to the service - Connection should be established

- Connection should not be disconnected without pressing the disconnect button/or signal is available

(please enter Check Item / Criteria results here)
8. Repeat steps 5-7 for 20 times - No system crash

- No BSOD, error message should occur

(please enter Check Item / Criteria results here)
9. Hibernate the system - System should enter hibernation mode (please enter Check Item / Criteria results here)
10. Wakeup the system after 1 minute - System should resume/wake-up

- No BSOD, error messages, crash should happen after hibernate/resume.

(please enter Check Item / Criteria results here)
11. Connect to the service provider - Connection should be established

- Connection should not be disconnected without pressing the disconnect button/or signal is available

(please enter Check Item / Criteria results here)
12. Repeat steps 9-11 for 20 times - No system crash

- No BSOD, error message should occur

(please enter Check Item / Criteria results here)
13. Restart the system - System should restart (please enter Check Item / Criteria results here)
14. Boot to OS and connect to service provider - Connection should be established

- Connection should not be disconnected without pressing the disconnect button/or signal is available

(please enter Check Item / Criteria results here)
15. Repeat steps 13-14 for 20 times - No system crash

- No BSOD, error message should occur

(please enter Check Item / Criteria results here)
16. Shutdown the system - System should shutdown properly without any error (please enter Check Item / Criteria results here)
17. Turn on the system after 1 minute - System should boot without any error

- No BSOD, error messages, crash should happen after shutdown/boot.

(please enter Check Item / Criteria results here)
18. Connect to the service provider - Connection should be established

- Connection should not be disconnected without pressing the disconnect button/or signal is available

(please enter Check Item / Criteria results here)
19. Repeat steps 16-18 for 20 times - No system crash

- No BSOD, error message should occur

(please enter Check Item / Criteria results here)

Profile Connectivity with Wireless Radio & Hardware/Software Switch

Test Item Check Item / Criteria
Result
Profile connection with Wireless Radio

(Hardware Switch ON for machines having HW switch)

Confirm the WWAN connection to service provider

Go to PC Settings > Wireless

Turn OFF Mobile Broadband radio

Confirm the WWAN profile is disconnected

Turn ON Mobile Broadband radio

Go to Charms bar > click Settings > click Network icon

Select Mobile Broadband and press Connect

Confirm that the profile is successfully connected.

- Radio ON/OFF should work correctly

- Profile to be connected successfully after Turn ON/OFF.

(please enter Check Item / Criteria results here)
Profile Connection with Hardware Wireless Global Switch

Confirm the WWAN connection to service provider

Turn Off Hardware switch present in your system.

Confirm the WWAN profile is disconnected and Airplane Mode sets to ON automatically.

Turn ON Hardware switch present in your system.

Go to Charms bar > click Settings > click Network icon

Select Mobile Broadband and press Connect

Confirm that the profile is successfully connected.

- Radio ON/OFF should work correctly

- Profile to be connected successfully after Turn ON/OFF.

(please enter Check Item / Criteria results here)

Location Awareness

Reminder:

- Pre-requisite driver: latest Lenovo Settings Dependency driver

- Check connectivity using Radios A, B, G, N with the combination of supported channels (eg: 50GHz)

Test Item Check Item / Criteria Results / Remarks
Using Location Awareness Metro App

>> Add two (2) Wireless LAN:

- Office network

- Test wireless network

To add the above WLAN profiles, make sure to have your machine configured with supported WLAN adapter and follow the following steps:

Connect to Office network

1. Launch Lenovo Settings from Start GUI

2. Click Lenovo Awareness

3. The connected wlan profile will automatically shown in "Share this network" text box.

without VPN:

4. Input the following to setup save point under Customize portion.

a) Profile name

b) Set homepage

c) Set default printer

5. Click Add.

6. The profile name created will be listed in the table.

7. Browse to the internet.

with VPN:

8. Input the following to setup save point under Customize portion.

a) Profile name

b) Set homepage

c) Set default printer

9. Choose the following to setup VPN, under VPN portion.

a) VPN

- First dropdown box: Use Windows VPN settings

(Configure in Desktop > Control Panel > Network and Internet > Network and Sharing Center > Setup a

new connection or network > Connect to a workplace)

Second dropdown box: Choose the configured VPN in desktop

- If any third party VPN apps available you may use it and inform MMC Team to update test case.10. Click Add.

11. The profile name created will be listed in the table.

Test wireless network

12. Go to other location with available wireless connectivity and Office network cannot be detected.

13. Follow again steps 1 - 11.

14. Perform the test items below.

- Confirm that Location Awareness application is working properly after installation

- Confirm that no garbage, unnecessary texts (cut, not fit in text boxes, too small, etc.), buttons and links (if any) are working.

- Confirm that location and profile name lists correctly in the table.

- Confirm that connectivity and VPN is successful before and after going back to the saved point.

(please enter Check Item / Criteria results here)
Power Management

Suspend / Resume

1. Perform Suspend in Location Awareness machine.

2. Go to the other location where save point was made.

3. Resume machine.

4. Machine should connect to the saved profile in Location Awareness.

Hibernate / Resume

1. Perform Hibernate in Location Awareness machine.

2. Go to the other location where save point was made.

3. Resume machine.

4. Machine should connect to the saved profile in Location Awareness.

Reboot

1. While the Location Awareness machine reboots.

2. Go to the other location where save point was made.

3. After machine boots.

4. Machine should connect to the saved profile in Location Awareness.

System Shutdown

1. Shutdown the Location Awareness machine.

2. Go to the other location where save point was made.

3. Boot machine and after boot.

4. Machine should connect to the saved profile in Location Awareness.

Perform each PM operations for 5-10 trials

- Confirm that connection is established successfully after PM operations.

- Confirm that all functions (buttons, links, etc.) can be performed successfully after PM operations.

- Confirm that no error messages should show after PM operations.

(please enter Check Item / Criteria results here)

Mobile Hotspot

Reminder:

- Should be tested in all supported WLAN and WWAN adapters

- Pre-requisite driver: latest Lenovo Settings Dependency driver

- Check all supported components as Mobile Hotspot host and client (Ethernet, WWAN, WLAN: Intel, Realtek, Broadcom)

Test Item Check Item / Criteria Results / Remarks
Set up Mobile Hotspot

1. Launch Lenovo Settings from Start GUI

2. Click Mobile Hotspot

3. The connected wlan profile will automatically show in "Share this network" text box.

4. Input the following to setup HotSpot.

a) [Name your HotSpot] field

b) [Create Password] field

- Confirm that Mobile Hotspot application is working properly after installation

- Confirm that no garbage, unnecessary texts (cut, not fit in text boxes, too small, etc.), buttons and links (if any) are working.

(please enter Check Item / Criteria results here)
Connecting and Client connectivity

1. Press the Start sharing

2. Try connecting maximum of 8 client devices and access the hotspot:

2.1 Using Smart Phones, Wireless Printer, Mobile Phones w/ Wi-Fi capability, Wi-Fi Photo Frame, iPad, iPhone) with different OS (such as Android, iOS, Google Chrome, etc.) or with same OS.

2.3 Using other machines with different OS (such as Android, iOS, Google Chrome, etc.) or with same OS.

3. Once the devices are connected, the MAC addresses and device name should be shown in Mobile Hotspot's Connected Devices.

- Confirm that no BSOD or any error messages when client was connected in hotspot.

- Confirm that client can connect successfully to hotspot

- Confirm that correct client information was shown in Connected Devices.

(please enter Check Item / Criteria results here)
Client connectivity verification

1. Client should successfully connected in hotspot.

2. Verify that the client can connect successfully to the internet.

- Confirm that client can connect successfully to hotspot

- Confirm that client can access internet successfully

(please enter Check Item / Criteria results here)
Disconnecting and Client Disconnectivity

1.Press the Stop sharing

2. Press the Start sharing to Restart the sharing & Try connecting other clients and access the hotspot.

- Confirm that no BSOD or any error messages when stopped internet sharing using hotspot.

- Confirm that client devices disconnected successfully from hotspot

- Confirm that no client information was shown in Connected Devices.

-Confirm that client can connect successfully to hotspot when start sharing

(please enter Check Item / Criteria results here)
Power Management

Suspend / Resume

1. Perform Suspend / Resume in Mobile Hotspot system.

2. Connect any supported client to the Mobile Hotspot system through hotspot connection.

Hibernate / Resume

1. Perform Hibernate / Resume in Mobile Hotspot system.

2. Connect any supported client to the Mobile Hotspot system through hotspot connection.

Reboot

1. Perform Reboot in Mobile Hotspot system.

2. After Mobile Hotspot system reboot.

3. Connect any supported client to the Mobile Hotspot system through hotspot connection.

System Shutdown

1. Perform Shutdown in Mobile Hotspot system.

2. Boot again Mobile Hotspot system.

3. Connect any supported client to the Mobile Hotspot system through hotspot connection. Perform each PM operations for 5-10 trials

- Confirm that connection is established successfully after PM operations.

- Confirm that all functions (buttons, links, etc.) can be performed successfully after PM operations.

- Confirm that no error messages should show after PM operations.

(please enter Check Item / Criteria results here)

Third-Party WWAN Application

WWAN Connectivity

Third-Party WWAN application can be obtained from the WWAN carrier (if available)

Test Item Check Item / Criteria Results / Remarks
Download the carrier’s application from the carrier’s web site. Install the carrier application on the system. - Confirm that no problems are encountered during installation.

- Confirm that carrier information is shown properly.

(please enter Check Item / Criteria results here)
Launch the carrier’s application and connect to the network using WWAN*.

*When using the carrier’s application, please refrain from using Windows Native for WWAN. You can use Windows Native for WLAN and other adapters.

- Confirm that no problems were encountered after the application launches.

- Confirm that User can successfully connect to the WWAN network using the carrier’s application.

(please enter Check Item / Criteria results here)

WLAN Connectivity

Test Item Check Item / Criteria Results / Remarks
Launch the carrier’s application and connect to the network using WWAN.

Using Windows Native, create WLAN profile and connect to AP. Confirm that the functionality of Windows Native is not affected by the use of Carrier application (like VMC, AT&T client).

- Confirm that no problems were encountered after the application launches.

- Confirm that User can successfully connect to the WLAN network using the carrier’s application.

(please enter Check Item / Criteria results here)

WWAN - WLAN Connectivity (if applicable)

Test Item Check Item / Criteria Results / Remarks
Launch the carrier’s application and connect to the network using WWAN*.

Using Windows Native, create WLAN profile and connect to AP. Confirm that the functionality of Windows Native is not affected by the use of Carrier application (like VMC, AT&T client).

- Confirm that no problems were encountered after the application launches.

- Confirm that User can successfully connect to the WWAN network using the carrier’s application.

(please enter Check Item / Criteria results here)
While connected to the WWAN network, switch to the WLAN network and vice versa. - Confirm that no problems occur after switching from WWAN to WLAN and vice versa. (please enter Check Item / Criteria results here)

Co-existence between Lenovo applications

Test Item Check Item / Criteria Results / Remarks
Lenovo Mobile Broadband Activation Co-existence Verification -
While connected via WWAN, launch LMA in Metro GUI. - Confirm that WWAN profile should not disconnect and application is still working properly. (please enter Check Item / Criteria results here)
- Lenovo Mobile Access - Lenovo Settings > Location Awareness -
Launch LMA in Metro GUI. While LMA is open, Launch Lenovo Settings > Location Awareness - Confirm that Location Awareness launches successfully.

- Confirm no hang / bluescreen / error / crash message occurs.

Launch Location Awareness from Metro GUI > Lenovo Settings.

A message should prompt that WLAN profile should be connected.

Launch LMA from Metro GUI.

- Confirm LMA successfully launches and all details are correct.

- Confirm the Location Awareness launches successfully.

- Confirm no hang / bluescreen / error / crash message occurs.

(please enter Check Item / Criteria results here)
Lenovo Mobile Access - Lenovo Settings > Location Awareness - Lenovo Settings > Mobile Hotspot Co-existence Verification -
Perform the following steps mentioned above launching LMA, Location Awareness and Mobile Hotspot and vice versa. - Confirm that no application hang / bluescreen / error / crash appears and no system performance degradation encountered. (please enter Check Item / Criteria results here)
- 3rd Party WWAN Application - Lenovo Mobile Access - Mobile Hotspot Co-existence Verification
In case 3rd Party WWAN connection manager application is provided into preload image, need to try to run with Mobile Hotspot and Lenovo Mobile Access. - Confirm that no application hang / bluescreen / error / crash appears and no system performance degradation encountered. (please enter Check Item / Criteria results here)

For any additional test item that needs to be performed, please perform the same and inform Lenovo, Yamato for necessary test case update.

Performance measurement

Test Item Check Item / Criteria Results / Remarks
Measure the WWAN connection speed using the following web sites:

For Thinkpad Classic:

http://www.speedtest.net/

For Thinkpad Tablet:

www.bandwidthplace.com/

See if the connection speed is too slow than normal usage (please enter Check Item / Criteria results here)

VPN Connectivity

Test Item Check Item / Criteria
Win8 32
Win8 64
1. Prepare a system configured with WWAN adapter and activated SIM.

2. Create WAN profile and connect.

3. Confirm that the profile connects successfully.

4. Using any VPN client (Cisco, etc.), connect VPN.

5. Confirm that the user is able to connect to VPN via WWAN profile.

- Make sure that WWAN works correctly.

- Make sure that no Bluescreen, Hang up and Error Messages occured.

Connected Standby Mode Email Verification

Note: Perform this activity in AC / DC Mode

Test Procedure Expected Result(s)
Win8 32
Win8 64
WWAN to WWAN connectivity:

1. With SIM card attached, connect to SIM supported carrier.

2. Click Mail in Metro-tile GUI and sign-in with a Microsoft account.

3. Press Power button to enter Connected Standby mode.

4. While the system is in Connected Standby mode, get another machine.

5. Using other machine connected, browse to the Internet and login to different Email - (eg. MS Outlook/Windows Live Mail)

6. Send Email with attachments: maximum file size.

7. Resume system and take down note the time in Quick Connect Verification table below (Press Fn).

8. Count by timer how many seconds/minutes will it take to connect to the internet and take down note the time in Quick Connect Verification table below (Connectivity Time).

9. Confirm connectivity successful.

Overnight Scenario:

10. After completing the above tests, repeat steps 1-6.

11. Leave the system in Connected Standby overnight.

12. Resume system

13. Confirm connectivity successful.

WWAN to WLAN connectivity:

1. Make sure WWAN adapter and active SIM card was inserted to the machine.

2. Connect to WWAN.

3. Click Mail in Metro-tile GUI and sign-in with a Microsoft account.

4. Press Power button to enter Connected Standby mode.

5. While the system is in Connected Standby mode, go to another place where the machine will detect the wireless access point.

6. Get another machine.

7. Using other machine connected, browse to the Internet and login to different Email - (eg. MS Outlook/Windows Live Mail)

8. Send Email with attachments:

with WLAN connectivity, attach the maximum file size supported

9. Resume system and take down note the time in Quick Connect Verification table below (Press Fn).

10. Count by timer how many seconds/minutes will it take to connect to the internet and take down note the time in Quick Connect Verification table below (Connectivity Time).

11. Confirm connectivity successful to WLAN.

Overnight Scenario:

12. After completing the above tests, repeat steps 1-8.

13. Leave the system in Connected Standby overnight.

14. Resume system

15. Confirm connectivity successful.

· Confirm that system is still stable, no system hang up, bluescreen, crash messages or unexpected reboot occurred.

· Confirm that Mail metro-tile shows one by one the number of unread message including the mail sent during Connected Standby mode.

· Confirm that Email was received successfully including the attachment with correct file sizes.

· Confirm that connectivity is successful after resuming from Connected Standby.

- WWAN to WWAN connectivity

- WWAN to WLAN connectivity

· Confirm connectivity successful after resume from overnight.

Connected Standby Mode Social Networking Verification

Note: Perform this activity in AC / DC Mode

Test Procedure Expected Result(s)
Win8 32
Win8 64
WWAN to WWAN connectivity:

1. With SIM card attached, connect to SIM supported carrier.

2. Browse to internet and login to any social networking sites (eg. Facebook, Twitter, Sobees, etc.)

3. Make sure not to close the websites.

4. Press Power button to enter Connected Standby mode.

5. While the system is in Connected Standby mode, get another machine.

6. Using other machine connected, browse to the Internet and login to different social networking sites - (eg. Facebook, Twitter, Sobees, etc.)

7. Send notifications to the test machine in Connected Standby mode.

8. Resume the test machine from Connected Standby mode.

9. Confirm connectivity successful.

Overnight Scenario:

10. After completing the above tests, repeat steps 1-5.

11. Leave the system in Connected Standby overnight.

12. Resume system

13. Confirm connectivity successful.

WWAN to WLAN connectivity:

1. Make sure WWAN adapter and active SIM card was inserted to the machine.

2. Connect to WWAN.

3. Browse to internet and login to any social networking sites (eg. Facebook, Twitter, Sobees, etc.)

4. Make sure not to close the websites.

5. Press Power button to enter Connected Standby mode.

6. While the system is in Connected Standby mode, go to another place where the machine will detect the wireless access point.

7. Get another machine.

8. Using other machine connected, browse to the Internet and login to different social networking sites - (eg. Facebook, Twitter, etc.)

9. Send notifications to the test machine in Connected Standby mode.

10. Resume the test machine from Connected Standby mode.

11. Confirm connectivity successful to WLAN.

Overnight Scenario:

10. After completing the above tests, repeat steps 1-7.

11. Leave the system in Connected Standby overnight.

12. Resume system

13. Confirm connectivity successful.

· Confirm that system is still stable, no system hang up, bluescreen, crash messages or unexpected reboot occurred.

· Confirm that social networking sites updates / notifications shows.

· Confirm that Facebook / any social networking sites metro-tile shows updates / notifications done during Connected Standby mode.

· Confirm that connectivity is successful after resuming from Connected Standby.

- WWAN to WWAN connectivity

- WWAN to WLAN connectivity

· Confirm connectivity successful after resume from overnight.

OTHER DETAILS

EUT Quantity : Supported systems. 1. "Please check Error and Warning message in Event Viewer before you start the test case and after you complete the test case, and report it to your team lead."

2. "Perform All Test in Battery Mode (Some of the test items need to perform in AC Mode, follow each Test Case)" (All Test Activity should be performed with AMT Enabled) System Preparation for testing:

Insert the SIM card into the SIM card slot [Refer to the information that comes with the system on how to insert the SIM card].

1. Update BIOS, ME, H8 and EEPROM (if needed).

2. Recover Preload

3. Complete the recovery process as prompted by the preloaded condition.

* Any updation required to the test case, please inform Lenovo PA team.

Log all your test reports in the following table:

System Details:

Details
Remarks
System BIOS Level / date
System Embedded Controller version
WWAN Service Provider
SIM card details

How to get BIOS and Embedded Controller version details:

Boot the system

Press F1 when you see the ThinkPad Lenovo Logo.

BIOS Setup Utility will show BIOS Version, BIOS date & Embedded Controller Version. Note down these values in the following table.

Driver Details:

How to check the version
Windows 8 [32 bit / 64 bit]
Lenovo Settings Mobile Hotspot Version and Build ID Launch Lenovo Settings from Metro App GUI > Go to Charms bar by mouse hover to the right side / swipe left to the right side of LMA > select Permissions

Enter the version like 1.0.0.7175

Build ID : "GEMH23WW"

Lenovo Settings Location Awareness Version and Build ID
Lenovo Mobile Access Metro App Version and Build ID Launch LMA from Metro App GUI > Go to Charms bar by mouse hover to the right side / swipe left to the right side of LMA > select PermissionsEnter the version like 1.0.20810.1555
WWAN Adapter Build ID Go to Charms bar by mouse hover to the right side / swipe left to the right side of Metro GUI App GUI > select Change PC Settings

Click on Wireless > under Mobile broadband hardware details, click the available WWAN and you will see the information

Manufacturer:

Model:

Firmware:

Cellular class:

IMEI:

Mobile number (optional):

SIM ICC ID (optional):

Driver Version:

WLAN Adapter Build ID Launch Desktop from Metro App GUI

Go to Control Panel > Network and Internet > Network and Sharing Center > Change adapter settings > right click WLAN adapter > Properties

Check General and Driver tabs and you will see the information

General Tab

Device type:

Manufacturer:

Location:

Driver Tab

Driver Provider:

Driver Date:

Driver Version:

Digital Signer:

Test Result:

Mention either PASS or FAIL results.

If FAIL, mention the failure details, recreation procedure etc…

Lenovo Mobile Access

Windows 8 [32 bit / 64 bit]
GUI Verification
Enter test result here

Windows Native WWAN Profile

Windows 8 [32 bit / 64 bit]
WWAN Profile Creation/Connection
Enter test result here
Power Management
Enter test result here

Profile Connectivity with Wireless Radio & Hardware/Software Switch

Windows 8 [32 bit / 64 bit]
Profile connection with Wireless Radio
Enter test result here
Profile Connection with Hardware Wireless Global Switch
Enter test result here

Location Awareness

Windows 8 [32 bit / 64 bit]
Location Awareness
Enter test result here
Power Management
Enter test result here

Mobile Hotspot

Windows 8 [32 bit / 64 bit]
Mobile Hotspot
Enter test result here
Mobile Hotspot Stress Test
Power Management
Enter test result here

Third-Party WWAN Application

Windows 8 [32 bit / 64 bit]
WWAN Connectivity
Enter test result here
WLAN Connectivity
Enter test result here
WWAN - WLAN Connectivity (if applicable)
Enter test result here

Co-existence between Lenovo applications

Windows 8 [32 bit / 64 bit]
Co-existence between Lenovo applications
Enter test result here

Performance measurement

Windows 8 [32 bit / 64 bit]
Performance measurement
Enter test result here

VPN Connectivity

Windows 8 [32 bit / 64 bit]
VPN Connectivity
Enter test result here

Connected Standby Mode Email Verification

Windows 8 [32 bit / 64 bit]
Connected Standby Mode Email Verification
Enter test result here

Connected Standby Mode Social Networking Verification

Windows 8 [32 bit / 64 bit]
Connected Standby Mode Social Networking Verification
Enter test result here

Note:

If you notice any abnormal behaviour in system performance, messages shown, application not responding, application crashes with some message or any functional difference, report the same with full details.

Final test report should have full system details, software version used, Carrier tested, Problems list if any. You can add your other observations/details in a separate sheet.

TEMS Reviewer Log:
Review Logs
Keywords:   None
Requirements :   None
Attached files :

Update History:
Modified last: 2016-06-10 17:58:15.267, by Miyuki Komatsu_nw