Test Case

Show / Hide direct link   <ROOT> 4941PA: Win 8 / 10 : Wide Area Network [WWAN] Function test - PP-80463



Version 1.9
Created on 13/07/2012 13:51:59  by PSI_PA_NW_Japan
Summary
Preconditions
Status:   Review Complete
Priority:   Medium
BASIC INFORMATION
Section:S/W Test Require attachment:No
Team:Network Group:Test Coverage
Lessons Learned:No Phase:FVT, SIV (BBFV), SIT
Locations:Inhouse: AWS and Cambridge, Inhouse: AWS, Inhouse: Cambridge, Compal, Flextronics, Quanta, Wistron Owned By:Eiji Ogata/LENOVO
Objective:To verify WAN functions in Windows-8
CRITERIA
Refer criteria in proecedure section
EUT QUANTITY
Two systems
EQUIPMENT
PA Networking facilities
Critical Attribute:[0] : WLS - Wireless

CONFIGURATION
REFERENCE PROCEDURE
3. Sensor Diagnostic Tool can only be used when Bing Maps and Google Maps cannot get satellite fix.
STATISTIC INFO
Operating System Win81-64bit Win81-32bit Win10-32bit Win10-64bit Total
Test Points
Duration
Workload
# Step actions Win81-64bitWin81-32bitWin10-32bitWin10-64bit
1 Installation/Uninstallation Test AAAA
2 Basic Verification Test AAAA
3 VPN Connectivity AAAA
4 GPS Test AAAA
5 Long Runs AAAA
DETAILS
ATTENTION!! Please follow below information.
1. Please check Error and Warning message in Event Viewer before you start the test case and after you complete the test case, and report it to your team lead, then arrange to open defect, if needed.

2. Perform All Test in Battery Mode (Some of the test items need to perform in AC Mode, follow each Test Case).

3. All Test Activity should be performed with AMT Enabled as Default (applicable on vPro enabled systems).

4. Please check Usability / Cosmetic issues (correct sentence/appropriate display/etc.) and open defect, if needed.

Note: Perform WWAN basic functions with Sleeve / Smart cover scenario (for tablet systems only).
Known Limitations
1. EM7355:Verizon,AT&T not Available in Windows Mobile Broadband Native UI while Rogers/Telus/Bell are Displayed (Permanent Limitation)
References:
ECR184221, ECR184256, ECR184255, ECR184220, ECR184254

2.Mobile broadband get limited connectivity / disconnects while switching between 3G to 4G(LTE) for Intel-Sierra
Ref Defect:ECR195552,W8:Connection becomes limited/disconnects when WWAN switch to LTE band

3."Insert SIM card" will show when WWAN radio OFF & ON.for Intel-Sierra EM7345 WWAN
Ref.Defect: ECR193295 WL1:W8:EM7345:"Insert a SIM" shown after Turn On WAN Radio.

4.GPS radio not available under Airplane mode (PC settings) in Windows 8.1 for Intel-Sierra EM7345 WWAN.
Ref.Defect:ECR195298,WL1:W8.1:GNSS radio On/Off switch is missing in PC Settings - UR 3910


MobileBroadband settings in OOBE is missing using Swisscom/Orange SIM
Reference: ECR191866 FT:Win8.1:MobileBroadband settings in OOBE is missing using Swisscom/Orange SIM
Reason: Permanent Limitation approved
User Impact: Low. OOBE setting usually setup when sales sell to customer in the store which without SIM card.
Work Around: User need set their profile after complete OOBE

Default Profile name is displayed twice using Orange SIM
Reference: ECR191874 FT:Win8.1:Default Profile name is displayed twice using Orange SIM
Reason: Permanent Limitation approved
-This issue is caused by Orange ISP. Lenovo Deve cannot fix this issue because ISP is responsible for this
User Impact: Very Low. User just confuse why there have same APN profile on Access point
Root Cause: There is ISP define problem. And this issue only happen on Orange Card

Swisscom logo is not displayed after OOBE
Reference: ECR191722 FT:Win8.1:Swisscom logo is not displayed after OOBE(FR:75%)
Reason: Permanent Limitation
User Impact: Low user impact. User still can known what telecom provided.
Root Cause: There have some problem when OS try go find submit logo icon on this card.

Ericsson cannot remove SIM PIN
Reference: ECR198847 ELLA:Ericsson cannot remove SIM PIN
Reason: Permanent Limitation approved
[UR-3972]

[UR-4145]
SIM PIN can't be removed when not connected to Ericsson WAN Profile.
Reference: ECR211876 WL2 W8.1:Can't remove PIN when NOT connect to Ericsson WAN Profile w/ GRWO05WW
Reason: Permanent Limitation approved

"Wrong left number" message appears when removing SIM PIN after unlocking PUK
Reference: ECR213209 WL2 W81:Wrong tries left number when remove PIN after unlock by PUK,w/t Ericsson N5321 - GRWO05WW
Reason: Permanent Limitation approved

Re-enter PIN shows again in 4th time after entering 3 consecutive incorrect PIN.
Reference: ECR213210: WL2 W81:Can enter 4 wrong tries when removing PIN,w/Sierra-GTWO31WW
Reason: Permanent Limitation approved

Restriction

[UR-03459SG]
1. Gobi-4k MC 7750 not supported in Windows 8
Reference:
ECR131242 Win8:Gobi 4K MC7750 show no "IMEI" text in connection properties
ECR131241 Win8:Design confirm:GPS not shown under Wireless devices in G4K7750
Reason: Gobi-4k MC7750 is not supported in Windows 8, PCR approved

2. SIM PIN cannot be disabled with Ericsson H5321gw WWAN adapter
Reference:
ECR130729 W8: Can't disable the SIM PIN with Ericsson H5321
ECR130101 W8: Error message pop up when disable PIN
Reason: Limitation approved

[UR-03485SG]
3. Ericsson FW update windows is in English using Windows 8 JP os.
Reference: ECR136622 Win8:JP:Ericsson WWAN FW update window shows English chars
Reason: Limitation approved. Help center info


4. Operator displayed will be abbreviated if Preferred Presentation of Country Initials and Mobile Network Name (PPCI&N) is long
Reference: ECR123780 W8:Wrong operator name/available network with Ericsson H5321gw
Reason:
MBIM Spec says WWAN device should show Abbreviate name only if PPCI&N is more than 20 Characters. Same is the Requirement by Microsoft. Hence Ericsson show PPCI&N.
As Per MS :
http://msdn.microsoft.com/en-us/library/windows/hardware/ff571223(v=vs.85).aspx

5. Mobile Broadband will not show OFF with Blocked / Locked SIM
Reference:
ECR131237 Win8:Mobile broadband not shown as OFF with Blocked/Locked SIM.
Reason: Working as design.


6. Lenovo Mobile access is not supported for Gobi-4k and Gobi-3K
Reason: LMA not supported for gobi 4K. supported only for ERicsson and Gobi 3K. Also current release is only for Ericsson. Gobi 3K to be released later


7. No Logo for T-Mobile in Mobile Broadband
Reference:
ECR138393 FT:Win8:No logo for T-Mobile in Mobile Broadband
Reason:
Limitation approved. Helpcentre info


8. Gobi 5000 WWAN will show the following providers: Sprint, Verizon, AT&T and Mobile Broadband 3G.
Once the Generic UMTS FW is switched to the WWAN (Mobile Broadband 3G) and connect to local provider (eg. Singtel), it will appear in Networks panel.
References:
ECR158547, RG2:W864:SIM card shows the wrong service provider w/GHWP04WW
ECR158696, STG:W864:SIM card shows the wrong service provider w/GHWP04WW
Information

Incorrect logo appears for Swisscom
Reference:
ECR138882 FT:W8: Swisscom shows incorrect logo at the Networks pane
Reason:
Vodafone and Swisscom being partners, Vodafone logo appearing in place of Swisscom is considered acceptable.

WWAN device driver provider listed as Microsoft in DM
Reference:
ECR130931 Gobi 4K n/w adapter driver provider listed as Microsoft in DM
ECR130930 Win8:Gobi 3K n/w adapter driver provider listed as Microsoft in DM
Reason:
Network adapter driver uses the Microsoft inbox drivers in Windows 8 OS design.

Ericsson service type will show as different when connected / disconnected.
Reference:
ECR184460, W8.1:Ericsson Service type show differ with connect/disconnect SIM
Reason:
The Data Class depends on QOS negotiation between Device and Network and this can also change.


OOBE Scenario
Test Item Check Item / Criteria Results / Remarks

Windows 8.1 - UR3972

1. Make sure that the SIM card is inserted in the machine before OOBE
2. Upon OOBE, click "I accept" button in License Terms.
3. Click Next
4. Click the carrier information in Mobile broadband section
5. Select the necessary options in "Choose how you want to connect"
6. Click the "Show details"
7. Confirm that all information displayed are correct
8. Click Next
9. Connection is successful if Settings window will show with Use express settings and Customize buttons.
10. Follow the instructions after clicking any of Use express settings and Customize buttons and confirm no problem happens.
11. Input Username and password
12. Boot to OS
13. Make sure that WWAN can connect to the network

Should be no error messages during OOBE
Should be no system hang up, bluescreen and other unnecessary error messages after connecting to available networks.

Confirm the successful sign up and connectivity.

Confirm successful connectivity in WWAN after performing OOBE.
(please enter Check Item / Criteria results here)



Installation/Uninstallation Test
Test Item Check Item / Criteria Limitation / Known restrictions
Win8 32
Win8 64
Installation (Admin Mode)

Note :
1. Before driver installation, update the firmware of the card by following the procedure mention in the firmware release notice.

1. Install WWAN Driver as per the build letter instrutions.
2. Do this for all supported WWAN adapters.
- Check that the installation is successful and no error message during the installation
- Check for the correct driver version and firmware version as mentioned on the build letter
- Check the device manager for the WWAN adapter entries under any of the following:
- Network Adapters
- Ports (COM)
- USB Controllers
- Smart card readers
- Modems


Device Confirmation
1. Check the Device Manager and open the Properties window for each WWAN entry.
2. Open WWAN Properties in Device Manager under 'Modems'.
3. Check Driver Version is same as mentioned in build letter.
4. Go to 'Diagnostics' tab and click Query Modem button.
5. Check that firmware version is same as mentioned in build letter.
6. Check Add/Remove Program if Product Version is same as mentioned in build letter.
7. Do this for all supported WWAN adapters.

Note:
Error is prompted when "Query Modem" in Diagnostics tab is clicked a number of times. It appears that the device manager is having trouble detecting the AT port after the 1st query or if there's a sudden device removable.
Further investigation shows that when the ATI commands performed when clicking Query Modem is issued through the Hyperterminal, the modem responds successfully. Thus, only the Microsoft Device Manager exhibits the problem.
And based on Sierra's investigation, they had no issue connecting to the AT port using any terminal programs. The issue only happens with Microsoft Device Manager.
Hence Sierra concluded this is not a Sierra issue, but rather a Microsoft issue. (As Designed)
References: ECR98392, ECR101228, ECR101962, ECR111609, ECR108560 Error Message pop up when click Query Modem more than once in DM
- Make sure that no Yellow Marks appear for the WWAN device.
- Make sure that all information shown for the WWAN device is correct.
- Make sure each property tab appears correctly.
Overwrite/Update Installation
1. Perform overwrite installation for the same driver version.
2. Refer to the build letter for any limitations/restrictions for overwrite installation.
3. Perform update installation from previous version to latest version.
4. Refer to the build letter for any limitations/restrictions for update installation.
5. Do this for all supported WWAN adapters.

Install WWAN Driver as per the build letter instructions
- Check that the installation is successful
- Check for the correct driver version and firmware version

Uninstallation (Admin Mode)
1. Uninstall WWAN Driver as per the build letter instrutions.
2. Do this for all supported WWAN adapters.
- Check that the uninstallation is successful and no error message appears during uninstallation
Installation and Uninstallation (User Mode)
1. Install the driver in User Mode as per the build letter instructions.
2. Uninstall the driver in User Mode as per the build letter instructions.
3. Do this for all supported WWAN adapters.
- User should not be able to install the driver. Necessary message to be shown.
- User should not be able to uninstall the driver. Necessary message to be shown.

Note:
Admin pop-up is not displayed when Gobi3000 driver package is uninstalled. This is already approved as Help Center Info (ECR86988)
Reference ECR113554, No dialog box pop up to stop GOBI3000 driver uninstall in standard use

Basic Verification Test

Test Item Check Item / Criteria Limitation / Known restrictions
Win8 32
Win8 64
WWAN Device enable/disable function in BIOS
  1. Enter to BIOS setup by pressing F1 button
  2. Security -> I/O Port Access -> Wireless WAN
  3. This will have two options [Enabled, Disabled].
  4. Select Enabled option
  5. Confirm the functionality of the WWAN device
  1. Enter to BIOS setup by pressing F1 button
  2. Security -> I/O Port Access -> Wireless WAN
  3. This will have two options [Enabled, Disabled].
  4. Select Disabled option
  5. Confirm that WWAN device cannot be used
Enabled:
- WWAN device should be available on Device Manager, OS
- WWAN device can be configured and connected to Network
- WWAN LED should be ON when WWAN radio is in use

Disabled:
- WWAN device should not be shown on Device Manager, OS
- WWAN LED should always be OFF
WWAN Device enable/disable function in Device Manager1. Install WWAN adapter as per the build letter.
2. Disable WWAN adapter in the Device Manager.
3. Make sure that WWAN device is shown as disabled does not disappear in Device Manager.
WWAN device cannot connect to Network.
4. Enable WWAN adapter in Device Manager.
5. Make sure that WWAN device is shown as enabled in Device Manager and can be connected to Network.
Enabled:
- WWAN device should be available and shown as enabled in Device Manager
- WWAN device can be connected to Network

Disabled:
- WWAN device is shown as disabled and should not disapear in Device Manager
- WWAN device cannot be connected to Network
-Ericsson WWAN device will be hidden in Windows XP and Vista when disabled in Device Manager. This is working as designed and the behavior is expected. (Reference:ECR83338 and ECR82503)
WWAN Profile Creation / Connection

Note: Before testing, insert working / activated SIM.

1. From Start GUI, go to All Apps > Windows System > Control Panel
2. It will direct to Desktop > with Control Panel window viewed.
3. From Control Panel, go to Network and Internet.
4. Under Network and Sharing Center, click Connect to a network link.
5. Networks window pane will show in the right side of the desktop.

or

1. From Start GUI, click Desktop
2. It will direct to Desktop.
3. From Desktop, taskbar > left click Connect to a network icon.
4. Networks window pane will show in the right side of the desktop.

For Gobi 5000 adapter's case (to be tested locally):
1. Once the activated SIM was inserted, the following profiles will show: Sprint, Verizon, AT&T and Mobile Broadband.
2. Choose Mobile Broadband to switch the WWAN adapter to Generic UMTS FW.
3. Connect to local provider.
4. Profile should connect and show in Networks panel.
- OS / Windows Native should show / launch properly.
- Local profile should connect successfully by using Generic UMTS FW of Gobi 5000.
1. Under Mobile Broadband section, default WWAN profile with connectivity state is shown. (depends on the SIM card inserted)
The following should also be shown:
- Estimated usage and Reset link
- Connect automatically checkbox
- Allow data roaming checkbox (if roaming SIM card was inserted)

2. Connect the default WWAN profile.
- Select the default profile and click Connect button.

3. Right click default WWAN profile. The following options should show:
  • Hide/Show estimated data usage
  • Set as non-metered connection
  • Forget this network
  • View connection properties

4. Select View Connection properties. Mobile Broadband properties window will show:
- In Subscription tab, provider details and subscriber information should correctly show
- In Profile tab, Access point, APN, and other details shows correctly
- In Roaming tab (if roaming SIM was inserted), scanning and correct roaming carrier partners should show after.
- In Security tab, SIM PIN enabling is shown.

5. With Qualcomm Adapter connect to both EVDO and HSPA mode in live network
Gobi 3000:
- Switch between Verizon/Sprint (EVDO) profile and AT&T (HSPA) profile for 10 trials
- Browse internet in both the modes.
Gobi 3000 and 4000 MC7750:
- Switch between Verizon/Sprint (EVDO) profile using Gobi 3000 and Verizon LTE (HSPA) profile using Gobi 4000 MC7750 for 10 trials.
- Browse internet in both the modes.
Gobi 5000:
- Switch between Verizon/Sprint (EVDO) profile and AT&T (HSPA) profile for 10 trials
- Browse internet in both the modes.
- Switch between Verizon/Sprint (EVDO) profile and Sprint (LTE) profile for 10 trials
- Browse internet in both the modes.
- Switch between Sprint (LTE) profile and AT&T (HSPA) profile for 10 trials
- Browse internet in both the modes.
- Confirm that connectivity state is shown in the right portion of default WWAN profile. (i.e. Roaming, Home, Locked - if SIM has PIN enabled)
- Confirm the default WWAN profile was automatically created.
- Confirm profile was successfully connected.
- Confirm that connection type shows when mouse hover connected profile. (i.e. HSPA, UMTS, EVDO, GPRS)
- Confirm that the following information shows correctly in WWAN properties.
- Confirm that EVDO and HSPA switching profiles are working properly.
- Confirm Sprint LTE and AT&T HSPA switching profiles are working properly.

PIN Enabled/ PUK Blocked Condition
1. Insert working / activated SIM in the system.
2. Right click WWAN profile in Connect to the internet window panel.
3. Select View connection properties
4. Mobile Broadband Properties will show.
5. Go to Security tab, click Enable PIN button.
6. Enter correct PIN to enable PIN.
7. Reboot machine.
8. Connect to WWAN profile in windows native.
9. Enter PIN should show.
10. Enter the correct PIN and click OK
11. WWAN profile should connect successfully.
12. Repeat steps 1-11 with PUK blocked SIM.

PM Management with PIN Enabled
1. Insert working / activated SIM in the system.
2. Right click WWAN profile in Connect to the internet window panel.
3. Select View connection properties
4. Mobile Broadband Properties will show.
5. Go to Security tab, click Enable PIN button.
6. Enter correct PIN to enable PIN
7. Suspend (S3) the system for 5 mins.
8. Resume from S3, SIM will be locked with PIN.
9. Repeat step 1 to 6.
10. Hibernate (S4) the system for 5 mins.
11. Resume from S4, SIM will be locked with PIN.
12. Enter correct PIN code.
13. Restart the system.
14. WAN profile should connect withouth entering PIN.

Reference:
ECR213951 W8.1:After restart need input PIN code with EM7345 WWAN

SIM PIN Behavior:

Notebooks and Ultrabooks (Windows 7 and Windows 8.1):
I. After resuming from Suspend (S3), SIM will be locked with SIM PIN.
II. After resuming from Hibernate (S4), SIM will be locked with SIM PIN.
III. After restart SIM will not be locked and can connect without entering SIM PIN. Since the module is not reset during restart.

Tablets (Windows 8,1):
I. After restarting the tablet SIM will be locked with SIM PIN.
II. After resuming from S0i3 (Connected standby) SIM will not be locked and can connect without entering SIM PIN. Since the module is not reset during connected standby state.

Intel Atom processors (Bay trail) support Connected standby state and does not support Hibernate (S4). To check if the system supports connects Connected standby run the following in command prompt with Administrator privileges.
- No error should appear while enter PUK / PIN

- Windows Native should connect to WAN profile successfully

- Confirm that the WAN connection is successful with Windows Mobile Broadband

-Confirm that Properties window shows correct information and all functions are working fine.

International Roaming Scenario
1. Connect to WAN profile with Windows Native in USA / Europe with AT&T / Verizon roaming SIM.
2. Hibernate/suspend the system.
3. Travel to some other country i.e USA ---> Europe , USA ---> Japan / Singapore, Europe ---> Japan / Singapore, etc.
4. Resume the system and leave the system idle for 5 minutes to detect the roaming signal.
5. The system should detect the roaming carrier WAN signals.
6. Connect to WAN profile. Connection should be successful.
- WAN connection should be successful after International roaming after Hibernate / suspend - resume.
WWAN Radio ON/OFF
install PM driver

From PC Settings
1. From Start GUI, move the mouse cursor to the right side of the GUI.
2. Charms bar will appear and choose Settings.
3. In the lower right portion of Charms bar, click Change PC settings link.
4. From PC Settings GUI,
- select Wireless option (for Windows 8)
- select Network option > Radio devices (for Windows 8.1)
5. Continue to step 16 onwards.

From Control Panel
6. From Start GUI > All Apps > Find Control Panel
7. From Control Panel, select Network and Internet
8. Under Network and Sharing Center, click Connect to a network link.
9. Charms bar with Network section will show.
10. Continue to step 16 onwards.

From Desktop
11. From Start GUI, click Desktop tile.
12. Desktop will show.
13. Click Network icon in taskbar.
14. Charms bar with Network section will show.
15. Continue to step 16 onwards.

16. Power off Mobile Broadband radio
17. Confirm that the WWAN utility shows radio off and the LED on the panel shows OFF
18. Power ON WWAN radio
19. Confirm that the WWAN radio is turned ON and the LED on the panel shows ON
20. Enable WLAN and Bluetooth
21. Confirm that all WWAN, bluetooth and Wireless LAN are powered ON
22. Leave the system for 15 / 30 / 60 / 120 minutes in idle condition.
23. Verify that the system functions well without any malfunction/performance degradation.

- Suspend the system and resume after one minute.
- Repeat steps 1 to 10 for 5 times

- LID close the system and LID open after one minute.
- Repeat steps 1 to 10 for 5 times

- Hibernate the system and resume after one minute
- Repeat steps 1 to 10 for 5 times

-- Hibernate the system, then dettach/attach the battery and resume after one minute
- Repeat steps 1 to 10 for 5 times

Ericsson WWAN radio on/off button can't function when system left idle for 15 - 120 mins.
ECR186917 Basie8.1: WWAN radio not functioning if system left idle state for 2hr
- Confirm that the GUI matches with the actual data
- All the information must contain correct value.
- WWAN radio must be turned ON / OFF
.
(Supported on Windows 8.1)
Wireless WWAN Properties
1. Once WWAN profile is connected, from PC Settings, go to Network > Connections
2. Tap currently connected WWAN from Mobile Broadband section
3. The currently connected WWAN profile page should show with correct SSID name on top with following:

Share this connection
4. Confirm Share this connection Turn ON/OFF radio is present
5. Confirm correct sentence is shown: "Share your mobile broadband internet connection with other people. They'll need the network name and password to connect.
6. To test this item please refer to Mobile Broadband Connection Sharing / Tethering Test Case (5163PA).

Properties
7. The following description should show while WWAN profile is currently connected.
- Manufacturer
- Model
- Firmware
- Network type
- Data class
- IMEI
- Mobile Number
- IMSI
- SIM ICCID
8. Make sure the above descriptions shows correct information.

Security
9. Use a PIN to help protect your SIM shows with "Use a PIN" button

10. To Enable PIN, click "Use a PIN" button
11. Use a PIN prompt will show with the following:
11.1 First, enter the current PIN. A default PIN is provided by your mobile operator.
11.2 Enter the Current PIN and click OK.

12. Once SIM PIN was enabled, the following should show:
12.1 You're using a PIN to help protect your SIM with "Change PIN" button
12.2 Removing the PIN will make your device less secure with "Remove PIN" button

Note:
- On this part, the WWAN SSID will prompt SIM PIN when trying to connect. Once the SIM PIN prompted, enter correct PIN and confirm connectivity success.
- If entered wrong PIN up to 3 times, SIM will be blocked. Once SIM was blocked/if SIM is blocked, go to step 25 onwards to Unblock SIM.

13. To Change PIN, click "Change PIN" button
14. Change your PIN prompt will show with the following:
14.1 You'll be asked for the new PIN the next time you connect after your mobile broadband device is turned on.
14.2 Enter the Current PIN
14.3 Enter new PIN
14.4 Enter to Confirm New PIN
14.5 Click OK

15. To Remove / Disable PIN, click "Remove PIN" button
16. Remove your PIN prompt will show with the following:
16.1 Confirm your current PIN. You'll need this PIN if you devide to use a PIN again.
16.2 Enter Current PIN and click OK.
17. Confirm SIM PIN was disabled.

18. With PUK/Blocked SIM card.
19. Click "Use a PIN" button
20. Use a PIN prompt will show with the following:
20.1 First, enter the current PIN. A default PIN is provided by your mobile operator.
21.2 Enter a wrong PIN and click OK.
21.3 "The PIN isn't correct. Please try again" message should show for first trial.
21.4 Enter again a wrong PIN and click OK.
21.5 "The PIN isn't correct. Your SIM will be blocked if one more incorrect PIN is entered" message should show for second trial.
22. Click again "Use a PIN" button
23. Enter the correct PIN and click OK
24. The following will show under Security section:
24.1 Your SIM is blocked because an incorrect PIN was entered too many times with "Unblock PIN" button.

Note: On this part, the WWAN SSID is disabled in Desktop > Network Charms bar.

25. Unblocking SIM
26. Click "Unblock PIN" button
27. Unblock your PIN prompt will show with the following:
27.1 You'll be asked for the new PIN the next time you connect after your mobile broadband device is turned on.
27.2 Enter PUK
27.3 Enter New PIN
27.4 Enter to Confirm new PIN
27.5 Click OK
28. Confirm SIM was unblocked and SIM is enabled.

29. Unlock Code
30. Unlock this device for use with a different network provider with textbox and Unlock button.
31. Enter unlocking code in the textbox and press Unlock button.

Notes:
- Try to connect to non-ASCII (with Japanese / Chinese / etc. characters or symbols) SSID profile and confirm again the above procedures.
- If WWAN profile is not connected, only Properties section will show.
- Confirm correct and no garbage for SSID name shown under Mobile Broadband section and SSID page.





- Confirm Share this connection radio should be able to Turn ON/OFF



- Confirm WWAN Properties shows correct information and no blank.











- Confirm SIM PIN works properly
- Confirm changing SIM PIN works properly
- Confirm removing/disabling SIM PIN works properly
- Confirm unblocking SIM works properly
Power Management Operations:-



Perform PM Operation Test with below condition: [UR-3952]
1. "Allow the computer to turn off this device to save power" Checked/Enabled in WWAN Power Management Tab.
2. "Allow the computer to turn off this device to save power" Unchecked/Disabled in WWAN Power Management Tab.

ECR199834/ECR199835: WL2 W81:BSOD after resume from S3 when Ericsson N5321/Sierra EM7345 WAN - PM Option Disabled


  • Should Suspend, hibernate and resume succussfully with out any error
  • Make sure no errors
  • Yellow Mark should not appear in Device Manager
Always ON (Instant Connect) / Always Connected (Instant Internet) - AOAC (Applicable to Chief River Products only.. BIOS support is needed).
REFER TEST CASE #4527PA

VPN Connectivity

VPN client utilities:

Name Setup
Cisco AnyConnect 3.1
Attachment "Cisco Anyconnect 3.1.zip"can be seen at the bottom of the page.

Test Item Check Item / Criteria Limitation / Known restrictions
Win8 32
Win8 64
1. Prepare a system configured with WWAN adapter and activated SIM.
2. Create WAN profile and connect.
3. Confirm that the profile connects successfully.

4. Using any VPN client (Cisco, etc.), connect VPN.
5. Confirm that the user is able to connect to VPN via WWAN profile.
- Make sure that WWAN works correctly.
- Make sure that no Bluescreen, Hang up and Error Messages occured.
Using Cisco AnyConnect VPN client

1. Install the Cisco AnyConnect.
2. Follow the instructions and reboot if required.
3. On initial launch, press the Advanced Window icon found in lower left side of the Cisco AnyConnect GUI.
4. Cisco AnyConnect Secure Mobility Client window will show.
5. On the above screen, choose Preferences tab.
6. By default, the following options are checked:
- Minimize AnyConnect on VPN connect.
- Block connections to untrusted servers.
7. Uncheck "Block connections to untrusted servers." and close the window.
8. On Cisco AnyConnect GUI, type the VPN address to access and press Connect.
9. Once connection is successful, try to access databases, ping server, etc.
- Make sure that WWAN works correctly.

- Make sure VPN connectivity is successful.

- Make sure that no Bluescreen, Hang up and Error Messages occurred during VPN session.



GPS Test

Satellite Fix [TTF]

Note:
- Perform this under open-sky signal condition.
- This testing is for Sensors only.
- No GPS application used yet. If you find any reliable GPS application to test kindly inform MMC NW Team.

Trial on Day : 1

FOR BROADCOM DRIVERS:

- Run batchfiles as per the build letter. (Batch files are included in the driver package)
- Batch files will take long time to process as indicated below.
- Observe GLMap Tool and confirm no hang up and bluescreen.
- GLMap will show the last fix after batch file processing completed.
- Screencapture Stats tab and Statistics tab and post in the table below.
- Post also logfile from C:\BcmGnssLog\SyslogArchive.

Collect Almanac (15mins) Cold Starts (25mins)
-98-99 counts (refer to Statistics tab > Fixes > TTF portion)
Warm Starts (10-15mins)
-98-99 counts (refer to Statistics tab > Fixes > TTF portion)
Hot Starts (10-15mins)
-98-99 counts (refer to Statistics tab > Fixes > TTF portion)
Satellites
Satellites
Satellites
Satellites
Post TTF average here (refer to Statistics tab > Fixes > TTF portion)

<sample result: 17 seconds>
Post TTF average here (refer to Statistics tab > Fixes > TTF portion)

<sample result: 15.51 seconds>
Post TTF average here (refer to Statistics tab > Fixes > TTF portion)


<sample result: 4.8 seconds>
Post TTF average here (refer to Statistics tab > Fixes > TTF portion)


<sample result: 4.32 seconds>
Post Screenshot here (refer to sample screenshots below)

Attachment "collectalmanacsats.jpg"can be seen at the bottom of the page.

Attachment "collectalmanacstatistics.jpg"can be seen at the bottom of the page.

Post Screenshot here (refer to sample screenshots below)

Attachment "coldstartssats.jpg"can be seen at the bottom of the page.

Attachment "coldstartsstatistics.jpg"can be seen at the bottom of the page.
Post Screenshot here (refer to sample screenshots below)

Attachment "warmstartssats.jpg"can be seen at the bottom of the page.

Attachment "warmstartsstatistics.jpg"can be seen at the bottom of the page.
Post Screenshot here (refer to sample screenshots below)

Attachment "hotstartssats.jpg"can be seen at the bottom of the page.

Attachment "hotstartsstatistics.jpg"can be seen at the bottom of the page.
Post Logfile here Post Logfile here Post Logfile here Post Logfile here


FOR ERICSSON and GOBI 3000/4000 DRIVERS:
D3Cold Fix : (Supported on Windows 8.1)
Cold Fix :
Warm Fix
- Already got fix once and now trying for the second
Hot Fix
- Already got fix once
- Trying to fix second time quickly.
Mention the time here Mention the time here within 4 hours -> Mention the time here
more than 4 hours -> Mention the time here
Mention the time here
Mention the time here Mention the time here


Trial on Day : 2

FOR BROADCOM DRIVERS:

- Same tests as Trial on Day 1
Collect Almanac (15 mins) Cold Starts (25 mins) Warm Starts (10-15 mins) Hot Starts (10-15 mins)
Satellites
Satellites
Satellites
Satellites
Post TTF average here (refer to Statistics tab > Fixes > TTF portion)

<sample result: 17 seconds>
Post TTF average here (refer to Statistics tab > Fixes > TTF portion)

<sample result: 15.51 seconds>
Post TTF average here (refer to Statistics tab > Fixes > TTF portion)


<sample result: 4.8 seconds>
Post TTF average here (refer to Statistics tab > Fixes > TTF portion)


<sample result: 4.32 seconds>
Post Screenshot here (refer to sample screenshots above)
Post Screenshot here (refer to sample screenshots above) Post Screenshot here (refer to sample screenshots above)
Post Screenshot here (refer to sample screenshots above)
Post Logfile here Post Logfile here Post Logfile here Post Logfile here


FOR ERICSSON and GOBI 3000/4000 DRIVERS:
D3Cold Fix : (Supported on Windows 8.1)
Cold Fix :
Warm Fix
- Already got fix once and now trying for the second
Hot Fix
- Already got fix once
- Trying to fix second time quickly.
Mention the time here Mention the time here within 4 hours -> Mention the time here
more than 4 hours -> Mention the time here
Mention the time here
Mention the time here Mention the time here


GPS Navigation Test
- Need to travel by Car or Train with the speed of 50Km or above for Navigation function test.

- No application crash to be noted throughout the testing.

- Need to perform this test if any major rework is done / image or driver is changed.

- Both Fix and Navigation test to be performed on 2 different days.-Test to be performed for 2 days in the same location to get the data for comparison.

Test Item
Check Item / Criteria
Result
Win8 32
Win8 64
GPS - Navigation with WWAN Adapters
Step 1 > Flash Image to system with Ericsson / Gobi - wwan adapters + SIM

>> Ensure that Internet connection is established using the SIM.
Step 2 > Launch application and click to start the tracking.

Step 3> Ensure that the satellite fix is obtained as per the criteria mentioned above.
Step 4> Once we get the smooth satellite fix, confirm the current location is in Google Map, and then start moving in a car / train with the speed of 50Km or above.
Step 5 > Real time tracking started, make sure no jump is seen.


Navigation needs to be monitored for 20minutes.

Need to test this function using :
1. Bing Maps
2. Google Maps (GMaps, can be downloaded to Store Metro App)

If you find any Navigation application from web, it may also be used. Also inform YMT NW team if you will use any such reliable application to be able to add in this test case.

This navigation test needs to be tested by using car / high speed train.


IMPORTANT :
If your test results are not meeting the criteria, inform full details to Yamato team before opening the defect. Yamato NW team will confirm with the development and defect should be opened based on Yamato NW team's advise.
  • Tracking on the map should be smooth, and no jump on the map.
  • The navigation pointer should move smoothly without any stuck or no noticable jump.
A
A

GPS Geofencing Test (Supported on Windows 8.1)

- Need to test outside within a designated area for Geofencing test.
- No application crash to be noted throughout the testing
- Need to perform this test if any major rework is done / image or driver is changed.
- Both Fix, Navigation and Geofencing test to be performed on 2 different days.
-Test to be performed for 2 days in the same location to get the data for comparison.

Test Item Check Item / Criteria
Win8.1 32
Win8.1 64
GPS - Geofencing with WWAN Adapters
Step 1 > Flash Image to system with Ericsson / Gobi - wwan adapters + SIM
>> Ensure that Internet connection is established using the SIM.
Step 2 > Launch application and click to start the Geofencing.

Step 3 > Generate Geofence (particular area (perimeter) / boundary). (eg. within a shopping area, within a street/block, within train station, within a city)
Step 4 > Ensure that the satellite fix is obtained as per the criteria mentioned above.
Step 5 > Once we get the smooth satellite fix, confirm the current location is in Google Map, and then start moving away from Geofence.
>> This step can be done by:
- Walking
- Moving in a car / train with the speed of 50km or above.
Step 6 > Real time tracking started, make sure no jump is seen while .
Step 7 > Confirm user will be notified that the device was already out of the particular area (perimeter) / boundary generated above.

Step 8 > By performing again Step 5, this time going back to the generated particular area (perimeter) / boundary.
Step 9 > Confirm user will be notified that the device was already inside the particular area (perimeter) / boundary generated above.

Navigation still needs to be monitored for 20 minutes. To check Geoference co-existence.

Need to test this function using:
1. Bing Maps
2. Google Maps (GMaps, can be downloaded to Store Metro App)

If you find any Geofence application from web, it may also be used. Also inform YMT NW team if you will use any such reliable application to be able to add in this test case.

Note: The navigation test still needs to be tested by using car / high speed train.


IMPORTANT :
If your test results are not meeting the criteria, inform full details to Yamato team before opening the defect. Yamato NW team will confirm with the development and defect should be opened based on Yamato NW team's advise.
  • Generating particular area (perimeter) / boundary for Geofencing should work properly.
  • Should notify correctly when the device presumably leaves / enters Geofence.
  • Tracking on the map should be smooth, and no jump on the map.
  • The navigation pointer should move smoothly without any stuck or no noticeable jump.

Long Runs

Test Item Check Item / Criteria Results / Remarks
Windows Native
1. With connection established, leave the system idle for few hours (5 -10 hours) overnight.
2. After long runs perform Suspend/Hibernate/Restart.
3. Resume the system and connect again to WAN profile.
4. Download data from web (around 50 - 100 MB)
5. Check the speed and throughput of the WAN connection at www.speedtest.net
6. To check the speed and throughput click on the location arrow at www.speedtest.net
- OS or WAN softwares should not crash or give error while long runs
- Connection should not drop during long hours connection
- Windows Native should connect successfully to WAN profile successfully after PM operations after long runs
-Confirm that data can be downloaded successfully
-The connection speed and throughput should be under acceptable limits depending on the Service Type
(please enter Check Item / Criteria results here)
Sensor Diagnostic Tool (mentioned above in Tools for GPS Test)
1. Launch Sensor Diagnostic Tool and start satellite tracking
2. With satellite fix, leave the system idle for few hours (5 -10 hours) overnight.
3. After long runs perform Suspend/Hibernate/Restart.
4. Resume the system.
- Sensor Diagnostic Tool should not crash or give error while long runs
- Satellite fix should not drop during long hours connection
- Sensor Diagnostic Tool should get satellite fix successfully after PM operations after long runs
(please enter Check Item / Criteria results here)
Youtube Playback test [UR-03783AP]
1.Connect to Mobile Broadband profile via Network icon on Windows Taskbar.
2.Verify that test machine can connect to mobile broadband successfully
3.Open Internet Explorer and go to www.youtube.com
4.Play HD video(search for 1080P video) on Youtube
5.Confirm video plays smooth & no loss in Connectivity.
6.Repeat steps 1-5 and play on different types of video quality.
- Confirm that HD video plays smooth.
-Confirm no loss or drop in connectivity.
-Confirm that the test machine can play all types of video quality.
(please enter Check Item / Criteria results here)

OTHER DETAILS
EUT Quantity : Two systems 1. "Please check Error and Warning message in Event Viewer before you start the test case and after you complete the test case, and report it to your team lead."
2. "Perform All Test in Battery Mode (Some of the test items need to perform in AC Mode, follow each Test Case)"

3. Sensor Diagnostic Tool can be used when Bing Maps and Google Maps cannot get satellite fix. (All Test Activity should be performed with AMT Enabled)
TEMS Reviewer Log:
Review Logs
Created last 2016-06-13 14:13:56 by Eiji Ogata. Review Comments(Review Complete): review copleted.
Keywords:   None
Requirements :   None
Attached files :
hotstartsstatistics.jpg - hotstartsstatistics.jpg (186019 bytes, ) 07/03/2015
hotstartssats.jpg - hotstartssats.jpg (262179 bytes, ) 07/03/2015
warmstartsstatistics.jpg - warmstartsstatistics.jpg (206217 bytes, ) 07/03/2015
warmstartssats.jpg - warmstartssats.jpg (208237 bytes, ) 07/03/2015
coldstartsstatistics.jpg - coldstartsstatistics.jpg (282652 bytes, ) 07/03/2015
coldstartssats.jpg - coldstartssats.jpg (264541 bytes, ) 07/03/2015
collectalmanacstatistics.jpg - collectalmanacstatistics.jpg (276829 bytes, ) 07/03/2015
collectalmanacsats.jpg - collectalmanacsats.jpg (272441 bytes, ) 07/03/2015
Cisco Anyconnect 3.1.zip - Cisco Anyconnect 3.1.zip (3884326 bytes, ) 07/03/2015

Update History:
This document is not yet modified.