Test Case

Show / Hide direct link   <MAIN> 4997PA: W8/W10: FFRT: Location Awareness Function Test - PP-80470



Version 1.2
Created on 04/10/2012 11:49:37  by PSI_PA_NW_Japan
Last modified on  09/03/2016 18:25:20  by y_amenomiya
Summary
Preconditions
Status:   Review Complete
Priority:   Medium
BASIC INFORMATION
Section:S/W Test Require attachment:No
Team:Network Group:Basic Function
Lessons Learned:No Phase:FVT, SVT, SIT
Locations:Inhouse: AWS and Cambridge, Inhouse: AWS, Inhouse: Cambridge, Compal, Flextronics, Quanta, Wistron Owned By:Eiji Ogata/LENOVO
Objective:a
CRITERIA

a

EUT QUANTITY

a

EQUIPMENT

a

Critical Attribute:[0] : WLS - Wireless

CONFIGURATION
REFERENCE PROCEDURE
STATISTIC INFO
Operating System Win81-64bit Win81-32bit Win10-32bit Win10-64bit Total
Test Points
Duration
Workload
# Step actions Win81-64bitWin81-32bitWin10-32bitWin10-64bit
1 Installation / Uninstallation - Admin Mode AAAA
2 Installation / Uninstallation - User Mode AAAA
3 GUI Function Confirmation AAAA
4 Installation - General AAAA
5 Basic Power Management verification AAAA
6 Basic Location Profile Connectivity with Profile Verification AAAA
DETAILS
ATTENTION!! Please follow below information.
1. Please check Error and Warning message in Event Viewer before you start the test case and after you complete the test case, and report it to your team lead, then arrange to open defect, if needed.

2. Perform All Test in Battery Mode (Some of the test items need to perform in AC Mode, follow each Test Case).

3. All Test Activity should be performed with AMT Enabled as Default (applicable on vPro enabled systems).

4. Please check Usability / Cosmetic issues (correct sentence/appropriate display/etc.) and open defect, if needed.

Note :

  1. While doing JP coverage, verify the japanese characters, error messages and help menu contents.
  2. Verify all the supported adapters (Wireless and WWAN devices).
  3. Please verify the wireless (WLAN/WWAN) drivers/Lenovo Dependency Package/Lenovo Settings/Mobile Hotspot dependency. Read the build letters and follow the steps for proper working.

Mobile Hotspot application may have other functions/GUI not mentioned in this test case. Please verify all the available functions and GUI that comes with the particular version of Mobile Hotspot. Any updation required to the test case, Please inform Lenovo Engineer.

WL hotkey and PM keys are different for each products. Refer the supported keys based on the product support and perform the function accordingly.

WL Hotkey : FnF5 or /F8 /F9

PM : S3 : Fn+F4 or Fn+4

Installation / Uninstallation - Admin Mode

Test Item Check Item / Criteria Configuration
Result
Perform this test in Admin Mode only
Win 8 32
Win 8 64
Installation / Uninstallation
  1. Install Lenovo Dependency Package > Lenovo Settings in Admin mode as per the build letter
  2. Launch Location Awareness from Metro Tile GUI > Lenovo Settings > Location Awareness
  3. Confirm that the application launches properly .

    Note : After Installation, Desktop Icon for Location Awareness should not appear on the screen.

  4. Check the version is correct in Lenovo Settings > Settings, Add/Remove programs are the same as with build letter.
  5. Uninstall Location Awareness and confirm driver was uninstalled properly.
  • No error on installation / uninstallation
  • Application should be launched successfully after installation
  • Correct version of driver or application can be seen in utility after installing the driver
  • Drivers / Application to be tested shall be defined when test plan is created
Stand alone
Overwrite Install Software

1. After fresh installing Lenovo Dependency Package > Lenovo Settings, Overwrite install the Location Awareness using same Version and same Build.

2. Launch Location Awareness after overwrite install

3. Check all the GUI from the Location Awareness if there's abnormality

4. Go to Control Panel > Add/Remove Programs > Check Location Awareness if created 2 entries.

  • No Error or Repair Wizard appear after overwrite install Location Awareness
  • No multiple entries should be seen in Add/Remove Programs after overwrite install.
Set up Location Profiles- For WLAN and Ethernet config

1. Launch Lenovo Settings from Start GUI

2. Click Lenovo Awareness

3. The connected wlan profile will automatically shown under Locations in "Current connection" text box.

without VPN:

4. Input the following to setup save point under Customize portion.

a) SSID / Ethernet (Gateway MAC address) --> Automatically show without user input

b) Set homepage

c) Set default printer

5. Click Add button (this button will be disabled if already added to data table).

6. The profile name created will be listed in the Location Data table.

7. Browse to the internet.

with VPN:

8. Input the following to setup save point under Customize portion.

a) SSID / Ethernet (Gateway MAC address) --> Automatically show without user input

b) Set homepage

c) Set default printer

9. Choose the following to setup VPN, under VPN portion.

a) VPN

- First dropdown box: Use Windows VPN settings

(Configure in Desktop > Control Panel > Network and Internet > Network and Sharing Center > Setup a

new connection or network > Connect to a workplace)

Second dropdown box: Choose the configured VPN in desktop

- If any third party VPN apps available you may use it and inform MMC Team to update test case.10. Click Add button (this button will be disabled if already added to data table).

11. The profile name created will be listed in the Location Data table.

12. Browse to the internet and to the VPN connection (eg. Office network, etc.)

13. When another profile was already created, go back to the location save point (location added in table)

14. Machine should connect again to the saved profile in Location Awareness.

Note:

- Verify also the above items with both Wi-Fi and Ethernet scenario

- If both Wi-Fi and Ethernet is connected, Wi-Fi SSID will be shown in SSID / Ethernet (Gateway MAC address)

  • No error while creating Hotspot
  • Confirm client devices can connect successfully and showing correct details in Connected Devices portion.
  • Confirm that Location Awareness application is working properly after installation
  • Confirm that no garbage, unnecessary texts (cut, not fit in text boxes, too small, etc.), buttons and links (if any) are working.
  • Confirm that location and profile name lists correctly in the table.
  • Confirm that connectivity and VPN is successful before and after going back to the saved point.
Stand alone
Overwrite Installation with Locations existence
  1. Install Location Awareness after creating locations in the earlier step.
  2. Confirm to proceed installation
  3. Restart the system if the system prompts for it.
  4. Go to Control Panel > Add/Remove Programs > Check Location Awareness if created 2 entries.
  5. Launch Location Awareness from Metro Tile GUI > Lenovo Settings
  6. Confirm that the application launches properly and the locations created earlier are available.
  7. Confirm success connectivity to the current saved point location.
  8. Go to another location saved point and check system connectivity successful.
  • No error on overwrite installation
  • No system malfunction
  • Locations created earlier should be available on overwrite installation of Location Awareness.
  • No multiple entries should be seen in Add/Remove Programs after overwrite install.
  • Confirm system can connect successfully to the current and another location saved points.
Stand alone
Edit/Delete Locations With Existing Locations
  1. Launch Location Awareness from Metro Tile GUI > Lenovo Settings
  2. Double click any available location profile in the table
  3. Confirm pop-up messages will appear if:

    - No Profile name entered/Edit and erase location profile name: "Are you sure you want to set the profile name of selected profile to blank?"

  4. Click Yes/No upon seeing the pop-up message in Step 3.
  5. Confirm correct behavior will show with Step 4 procedure:

    - Yes: Location profile should be blank

    - No: Location profile should retain the previous name

  6. Click any location profile available in the table.
  7. Edit any in Location profile table
  8. Confirm that revision will reflect in Location profile table
  9. Confirm SSID/Ethernet(Gateway MAC address) shows the same as the current connection profile and not editable.
  10. Click any location profile available in the table.
  11. Click Delete button and confirm pop-up message: "Are you sure you want to delete this profile?"
  12. Click No and confirm location profile is still listed.
  13. Select again the location profile and click Deleted button.
  14. Click Yes and confirm location profile deleted successfully.
  • Location profile should be edited successfully
  • Pop-up messages should be correct and corresponds to the missteps made.
  • Location profile should be deleted / not deleted upon clicking correct button.

Installation / Uninstallation - User Mode

Test Item Check Item / Criteria Configuration
Result
This test should be performed in User Mode
Win 8 32
Win 8 64
Installation
  1. Install Location Awareness as per the build letter.
  2. It should prompt User Account Control with message "Do you want to allow the following program to make changes to this computer?"
  3. Type an administrator password, and then click OK.
  • Installation of application in user mode will continue after typing the correct password.
  • Installation of application in user mode will not continue after input of incorrect password.
  • Proper warning message should be displayed
Stand alone
UnInstallation
  • Uninstall Location Awareness as per the build letter.
    1. It should prompt User Account Control with message "Do you want to allow the following program to make changes to this computer?"
    2. Type an administrator password, and then click OK.
  • Uninstallation of application in user mode will continue after typing the correct password.
  • Uninstallation of application in user mode will not continue after input of incorrect password.
  • Proper warning message should be displayed
Stand alone

GUI Function Confirmation

Test Item
Configuration
Results
Check Item / Criteria
Win 8 32
Win 8 64
Confirming Location Awareness GUI

1. Back button should be available in upper left corner of Location Awareness GUI and should function properly.

2. Location Awareness section title and product icon should show in the upper right corner of the GUI.

3. Graphic Element should show correct grammar and correct message as this:

"Have your settings automatically update depending on your location. Connect to a Wi-Fi source that you visit often like home, work or a coffee shop. Then you can set up and save customized settings for each location."

4. Locations

4.1 The following options / widgets should be available:

a.) Current connection textbox

b.) Add button

c.) Location Data Table

d.) Delete button

5. Customize

5.1 The following options / widgets should be available:

a.) SSID / Ethernet (Gateway MAC address)

b.) Set home page textbox

c.) Set default printer textbox

6. VPN

6.1 The following options / widgets should be available:

a.) VPN dropdown with options:

(1) Off

(2) Use Windows VPN settings --> option displayed only if VPN is setup

b.) VPN application dropdown with browse button --> to choose 3rd party VPN apps

c.) Dropdown list of VPN setup.

7. Security Settings

7.1 The following options / widgets should be available:

a.) Override security settings On/Off switch

b.) Enable file and printer sharing check box --> if checked, file and printer sharing should work properly

c.) Enable internet connection sharing --> if checked, ICS should work properly

d.) Enable Windows firewall --> if checked, firewall should be enabled in Windows

e.) Disconnect Wi-Fi connection when Ethernet is connected --> if checked, WLAN profile should be disconnected if LAN cable was attached to the system.

Notes:

1. After performing the above items, go to one place where access point with internet connection is available and connect the machine.

2. Run the test items below (Location Awareness Configuration and Verification).

3. After performing all, go to another place and connect another available access point with internet connection.

4. Run the test items below again.

  • Confirm the GUI of Location Awareness
  • Confirm all buttons / widgets are working properly
  • Confirm all text boxes can be inputted
  • Confirm checkbox is working properly
  • Confirm Back button is working properly
A
A

Installation - General

Test Item Check Item / Criteria Configuration
Result
Win 8 32
Win 8 64
Installation

1. Install latest Wireless card driver & Restart the system.

2. Go to the directory where Location Awareness files are located

3. Go to Run and command prompt and input [setup.exe /s /v/qn] and enter

  • Setup should run properly or related help information should be shown.
  • No malfunction like automatically starting uninstallation of the Location Awareness or other files/programs.
Stand alone
  • Install Location Awareness in silent mode. [Refer build letter for silent installation procedure.
    1. Confirm that the Location Awareness is installed properly.
    2. Please note that Location Awareness and Wireless driver dependency may be there and we may have to install the specific version of Location Awareness and Wireless driver to work properly and also the sequence of installation is important.
  • Location Awareness should be installed in silent mode without any problem.
Stand alone
Installation with Other applications1. Install latest drivers

2. Install Location Awareness

3.Confirm that the Location Awareness works fine

4. Install other applications like Lenovo Settings Mobile Hotspot, Power and other applications like MS Office, Lotus Notes, MS Lync.

5. Confirm that the applications can be installed properly

  • Setup of other applications should run properly.
  • Both the Location Awareness and other installed applications should work properly.
Stand alone

Basic Power Management verification

(Both Admin mode and User mode)

Test Procedure Expected Result(s)
Win8 32 Bit
Win8 64 Bit
Suspend / Resume

1. Perform Suspend in Location Awareness machine.

2. Go to the other location where save point was made.

3. Resume machine.

4. Machine should connect to the saved profile in Location Awareness.

Hibernate / Resume

1. Perform Hibernate in Location Awareness machine.

2. Go to the other location where save point was made.

3. Resume machine.

4. Machine should connect to the saved profile in Location Awareness.

Lid Close / Resume

1. Perform Lid Close in Location Awareness machine.

2. Go to the other location where save point was made.

3. Resume machine.

4. Machine should connect to the saved profile in Location Awareness.

Reboot

1. While the Location Awareness machine reboots.

2. Go to the other location where save point was made.

3. After machine boots.

4. Machine should connect to the saved profile in Location Awareness.

System Shutdown

1. Shutdown the Location Awareness machine.

2. Go to the other location where save point was made.

3. Boot machine and after boot.

4. Machine should connect to the saved profile in Location Awareness.

Perform each PM operations for 5-10 trials

- Confirm that connection is established successfully after PM operations.

- Confirm that all functions (buttons, links, etc.) can be performed successfully after PM operations.

- Confirm that no error messages should show after PM operations.

A
A
Event Viewer / Location Awareness Service Verification

Suspend / Resume

1. Perform Suspend in Location Awareness machine.

2. Go to the other location where save point was made.

3. Resume machine.

4. Go to Event Viewer:

5.1 Right click My Computer > Manage > Event Viewer

5.2 Confirm that there are NO Critical / Error / Warning messages for Location Awareness Service.

6. Go to Problem Reports:

6.1 Go to Control Panel then type Problem Reports in "Search Control Panel" textbox

6.2 Open "View all problem reports"

6.3 Confirm that there are NO crash / stopped working messages for Location Awareness Service.

7. Machine should connect to the saved profile in Location Awareness.

Hibernate / Resume

1. Perform Hibernate in Location Awareness machine.

2. Go to the other location where save point was made.

3. Resume machine.

4. Go to Event Viewer:

5.1 Right click My Computer > Manage > Event Viewer

5.2 Confirm that there are NO Critical / Error / Warning messages for Location Awareness Service.

6. Go to Problem Reports:

6.1 Go to Control Panel then type Problem Reports in "Search Control Panel" textbox

6.2 Open "View all problem reports"

6.3 Confirm that there are NO crash / stopped working messages for Location Awareness Service.

7. Machine should connect to the saved profile in Location Awareness.

Lid Close / Resume

1. Perform Lid Close in Location Awareness machine.

2. Go to the other location where save point was made.

3. Resume machine.

4. Go to Event Viewer:

5.1 Right click My Computer > Manage > Event Viewer

5.2 Confirm that there are NO Critical / Error / Warning messages for Location Awareness Service.

6. Go to Problem Reports:

6.1 Go to Control Panel then type Problem Reports in "Search Control Panel" textbox

6.2 Open "View all problem reports"

6.3 Confirm that there are NO crash / stopped working messages for Location Awareness Service.

7. Machine should connect to the saved profile in Location Awareness.

Reboot

1. While the Location Awareness machine reboots.

2. Go to the other location where save point was made.

3. After machine boots.

4. Go to Event Viewer:

5.1 Right click My Computer > Manage > Event Viewer

5.2 Confirm that there are NO Critical / Error / Warning messages for Location Awareness Service.

6. Go to Problem Reports:

6.1 Go to Control Panel then type Problem Reports in "Search Control Panel" textbox

6.2 Open "View all problem reports"

6.3 Confirm that there are NO crash / stopped working messages for Location Awareness Service.

7. Machine should connect to the saved profile in Location Awareness.

System Shutdown

1. Shutdown the Location Awareness machine.

2. Go to the other location where save point was made.

3. Boot machine and after boot.

4. Go to Event Viewer:

5.1 Right click My Computer > Manage > Event Viewer

5.2 Confirm that there are NO Critical / Error / Warning messages for Location Awareness Service.

6. Go to Problem Reports:

6.1 Go to Control Panel then type Problem Reports in "Search Control Panel" textbox

6.2 Open "View all problem reports"

6.3 Confirm that there are NO crash / stopped working messages for Location Awareness Service.

7. Machine should connect to the saved profile in Location Awareness.

Perform each PM operations for 5-10 trials

- Confirm that connection is established successfully after PM operations.

- Confirm that all functions (buttons, links, etc.) can be performed successfully after PM operations.

- Confirm that no error messages should show after PM operations.

- Confirm there are no error / crash / critical / warning messages under Event Viewer and Problem Reports.

A
A

Basic Location Profile Connectivity with Profile Verification

Create Location Profile for the following profiles and confirm the system connects with basic profile connectivity.

Procedure Profile Criteria
Windows 8 32/64 bit
Admin Mode
User mode (Standard / Restricted)
1. Connect to Profile (stated in next column)

2. Create Location profile

without VPN:

4. Input the following to setup save point under Customize portion.

a) Profile name

b) Set homepage

c) Set default printer

5. Click Add.

6. The profile name created will be listed in the table.

7.Disconnect the Wlan profile & reconnect to the same profile.

8. Browse to the internet.

with VPN:

8. Input the following to setup save point under Customize portion.

a) Profile name

b) Set homepage

c) Set default printer

9. Choose the following to setup VPN, under VPN portion.

a) VPN

- First dropdown box: Use Windows VPN settings

(Configure in Desktop > Control Panel > Network and Internet > Network and Sharing Center > Setup a

new connection or network > Connect to a workplace)

Second dropdown box: Choose the configured VPN in desktop

- If any third party VPN apps available you may use it and inform MMC Team to update test case.

10. Click Add.

11. The profile name created will be listed in the table.

12.Disconnect theVPN profile & reconnect to the same profile.

13. Browse to the internet and to the VPN connection (eg. Office network, etc.)

14. When another profile was already created, go back to the location saved point (location added in table)

15. System should connect again to the saved profile in Location Awareness.

16. Verify that GUIs are shown properly and functions are working as expected

17. Verify Location profile connectivity

WPA-TLS
  • No error message or system malfunction on connecting to different profiles.
  • All GUI's must be shown correctly and clearly.
  • Confirm Location profile connectivity.
WPA-PSK (ASCI)
WPA-PSK (Hex)
802.1x EAP - Zero Configuration
LEAP
WEP (64bit, 128bit)
No WEP
Ethernet Profile
VPN Profile

OTHER DETAILS

EUT Quantity : a 1. "Please check Error and Warning message in Event Viewer before you start the test case and after you complete the test case, and report it to your team lead."

2. "Perform All Test in Battery Mode (Some of the test items need to perform in AC Mode, follow each Test Case)" (All Test Activity should be performed with AMT Enabled) 1. Perform the test for all the supported Wireless adapters.

2. Hotkey Function test is covered by Wireless Function Test

ADAPTER LIST

Adapter Name
Card Revision (Example 3B2....)
Firmware Version
Phase Entry :

Phase Exit :

Phase Entry :

Phase Exit :

TEMS Reviewer Log:
Review Logs
Created last 2016-06-13 13:53:49 by Eiji Ogata. Review Comments(Review Complete): review completed.
Keywords:   None
Requirements :   None
Attached files :

Update History:
Modified last: 2016-03-09 18:25:20.798, by Yoshihiro Amenomiya